• russjr08@outpost.zeuslink.netEnglish
      5·
      1 year ago

      Yes, and I’d rather not have my time wasted by waiting on thousands of small files transfer, rather than just compressing it and the time spent of one file transferring being much smaller.

    • Eager Eagle@lemmy.worldEnglish
      4·
      1 year ago

      as in time wasted transferring a highly compressible file that you didn’t bother compressing first?

      it’s only a waste of time when the file format is already compressed.

        • Eager Eagle@lemmy.worldEnglish
          4·
          1 year ago

          unless you’re picking a slow compressor that’s not true at all

          Original size | 100 GB
Compressed size | 47.8 GB (2.091 ratio)
Transfer speed | 1 Gbps (125 MB/s)
Original transfer time | 100 GB / 125 MB/s = 800 seconds
Compressed transfer time | 47.8 GB / 125 MB/s = 382.4 seconds

Compressor | Snappy
Compression ratio | 2.091 ratio
Compression speed | 565 MB/s
Decompression speed | 1950 MB/s
Compression time | 100 GB / 565 MB/s = 177 seconds
Decompression time | 47.8 GB / 1950 MB/s = 24.5 seconds

Transfer time w/o compression | 800 seconds
Transfer time with compression | 177 + 382.4 + 24.5 = 584.9 seconds