• underisk
    link
    fedilink
    arrow-up
    13
    ·
    9 months ago

    Also helpful for pages that try to hide parts they let the search engine index behind a paywall when it’s a human visitor. Like the notorious expertsexchange before it got usurped by stackoverflow.

      • underisk
        link
        fedilink
        arrow-up
        3
        ·
        9 months ago

        it would have been a much better website if that were the case.

    • qevlarr@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      9 months ago

      Or getting around geoblocking. Very annoying. It’s also unnecessary to shut down everything because some countries have reasonable privacy protection. Don’t snoop on your visitors and you have nothing to worry about. I’m sorry the US policy is written by and for marketing tech companies