• igorlogius@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        edit-2
        1 year ago

        And they sell it to the highest bidder to train their next LLM, which seems to be all the rage at the moment.

    • thisbenzingring@wirebase.org
      link
      fedilink
      English
      arrow-up
      14
      ·
      edit-2
      1 year ago

      Text data on a compressed drive is so small. You have a modern server and accessing text files in a compressed drive is not noticeable performance hit. The compression ratio is massive for text and markup language files