• igorlogius@lemmy.world
          link
          fedilink
          English
          arrow-up
          9
          ·
          edit-2
          1 year ago

          And they sell it to the highest bidder to train their next LLM, which seems to be all the rage at the moment.

      • thisbenzingring@wirebase.org
        link
        fedilink
        English
        arrow-up
        14
        ·
        edit-2
        1 year ago

        Text data on a compressed drive is so small. You have a modern server and accessing text files in a compressed drive is not noticeable performance hit. The compression ratio is massive for text and markup language files