Are there any alternatives to the Internet Archive that are built around P2P, so that everyone can contribute to hosting/sharing web archives? Seems like having all these important archives hosted by a single organization isn’t the best idea for longevity/redundancy

@opensource

  • thingsiplay@beehaw.org
    link
    fedilink
    arrow-up
    9
    ·
    4 hours ago

    We have already the technology for sharing with P2P, lot of Torrent websites. The problem is, sharing with P2P is illegal, if you don’t have the rights to. Internet Archive is different, because they have special rights we users don’t have, such as being a library in the US with rights of a library.

    In example Internet Archive is allowed to share books, but only lend one at a time for each real local copy they have.

    Downloading from Internet Archive is harmless and only Internet Archive and your ISP knows your IP when doing so. But with P2P (if we are talking about Torrents) everyone who connects to it knows the IP from everyone else. There is a higher risk for uploading stuff, or sharing with others. Basically the government can join the P2P network and suddenly see everyone.

  • ipkpjersi
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    3 hours ago

    That’s what private trackers (and torrents in general) are for, but private trackers commonly share copyrighted materials, which is of course not so legal.

  • Mubelotix@jlai.lu
    link
    fedilink
    arrow-up
    11
    ·
    8 hours ago

    I think there was an officially-lead attempt to distribute internet archive over IPFS but I’m not sure what it became

  • CameronDev@programming.dev
    link
    fedilink
    arrow-up
    21
    arrow-down
    1
    ·
    edit-2
    10 hours ago

    There was a ActivityPub wiki clone, no idea where it got to.

    The major upside of IA being built and owned by one central company is trust. We can (so far at least, if I’m wrong please correct me) trust IA to not censor/rewrite history. As soon as every man and his dog can contribute, that gets a lot harder to guarantee.

    Edit: https://github.com/Nutomic/ibis

    Don’t take me linking it as endorsement, I think federated wiki’s for anything other than fandom stuff to be madness.

    • Sem
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      3
      ·
      10 hours ago

      Sounds like a potential application for a blockchain techs, that allows to do verifications, voting and consensus.

      • webghost0101@sopuli.xyz
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        9 hours ago

        Ive had similar ideas on verified unaltered media to combat fake news. Such an archive but for journalism would be a great start.

      • CameronDev@programming.dev
        link
        fedilink
        arrow-up
        5
        arrow-down
        1
        ·
        edit-2
        10 hours ago

        Yeah, quite possibly. Could still be very hard to get right. Region blocking might make consensus difficult.

        Edit: just occurred to me, any method of consensus could be used to ddos sites as well. Might be best left for people smarter than me

        • Sem
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          2
          ·
          10 hours ago

          I think that proof-of-work approach to blockchain can make ddos attacks much harder, but I’m not an expert too :)

          • CameronDev@programming.dev
            link
            fedilink
            arrow-up
            2
            arrow-down
            1
            ·
            9 hours ago

            I figured that every node would need to scrap the site, in order to validate the content. If there are thousands of nodes, that would ddos the site.

            I don’t really understand how PoW would solve that, can you explain?

            • ReversalHatchery@beehaw.org
              link
              fedilink
              English
              arrow-up
              1
              ·
              edit-2
              1 hour ago

              I figured that every node would need to scrap the site, in order to validate the content. If there are thousands of nodes, that would ddos the site.

              with cryptocurrencies the blockchain is distributed, its not stored centrally. your idea could work similarly

            • Sem
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              3
              ·
              9 hours ago

              I think it can be done like a NFTs on top of Bitcoin. In this case evey archived page is NFT and all the blockchain is available, so there is no centralized cite. If each action will require some computations (PoW) then ddos attack or spam attack will be very hard to implement.

              • CameronDev@programming.dev
                link
                fedilink
                arrow-up
                2
                ·
                edit-2
                7 hours ago

                Thats for proving its untampered with right? I’m more thinking of validating the archive copy is a “true” copy when adding it initially, which requires each node to check against the live site?

                Its definitely an intriguing idea though, but I don’t know enough to know how feasable it can be

  • frank87@feddit.nl
    link
    fedilink
    Nederlands
    arrow-up
    2
    ·
    9 hours ago

    You can store stuff in the IPFS. But probably, someone has to build some archiving tool around it. But you would be vulnerable to copyright claims.

    • unexposedhazard@discuss.tchncs.de
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      9 hours ago

      This is what i never understand about attempts at P2P hosting of copyright content. It only works BECAUSE its obscure and irrelevant. As soon as it gets popular, all of these people and their VPN providers would get crushed by lawsuits.

      Dont get me wrong i love P2P tech, but it will never solve these issues unless the laws are fixed.