Why don’t Lemmy posts (from any instance) show up on search engines? Like if I try my hardest to get a thread to show up, virtually nothing from the actual instances in the fediverse comes up. I’m sure if I searched the exact url or something I could get it but it’s very noticable that the search engines by and large just kind of gloss over posts on here and I’m not sure why.

This stinks cause that was one of the biggest draws for reddit. So many times when you search some super obscure or specific question you’d get a few reddit threads with all sorts of information.

  • rckclmbr@lemmy.world
    link
    fedilink
    arrow-up
    1
    arrow-down
    10
    ·
    1 year ago

    I say don’t let them crawl. I’d rather the server and bandwidth costs go to real people rather than bots

    • Luca@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      1 year ago

      Ignoring everything else about this, how do you propose we get new people without being searchable?