• russjr08@outpost.zeuslink.net
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      Yes, and I’d rather not have my time wasted by waiting on thousands of small files transfer, rather than just compressing it and the time spent of one file transferring being much smaller.

    • Eager Eagle@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      as in time wasted transferring a highly compressible file that you didn’t bother compressing first?

      it’s only a waste of time when the file format is already compressed.

        • Eager Eagle@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          unless you’re picking a slow compressor that’s not true at all

          Original size | 100 GB
          Compressed size | 47.8 GB (2.091 ratio)
          Transfer speed | 1 Gbps (125 MB/s)
          Original transfer time | 100 GB / 125 MB/s = 800 seconds
          Compressed transfer time | 47.8 GB / 125 MB/s = 382.4 seconds
          
          Compressor | Snappy
          Compression ratio | 2.091 ratio
          Compression speed | 565 MB/s
          Decompression speed | 1950 MB/s
          Compression time | 100 GB / 565 MB/s = 177 seconds
          Decompression time | 47.8 GB / 1950 MB/s = 24.5 seconds
          
          Transfer time w/o compression | 800 seconds
          Transfer time with compression | 177 + 382.4 + 24.5 = 584.9 seconds