Like Reddit is? e.g. for Google, or Bing (shudders), you know. Search engines. One of the ways many people around the world interacted with Reddit was looking up solutions, discussions, or similar from a search engine and NOT on Reddit itself. Is that possible in this thread of the fediverse?

  • key@lemmy.keychat.org
    link
    fedilink
    English
    arrow-up
    25
    ·
    1 year ago

    I saw Googlebot showing up in the access logs of my personal instance the very first day I stood it up.

  • damipereira@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    1 year ago

    I can already find some stuff on lemmy if I search for it. It will take time for everything to be indexed but I think it will work ok eventually.

  • sethboy66@kbin.social
    link
    fedilink
    arrow-up
    20
    ·
    1 year ago

    It’s certainly archivable; all one must do is look at the ‘robots.txt’ (a file that websites use to let nice search engines know which pages they shouldn’t index) associated with the domain to find out what it permits to be indexed. Lemmy.world’s robots.txt only disallows pages associated with instance/account creation, user settings, and administrator/authorized interaction.

    So everything relevant to how reddit appears on Google is possible for Lemmy, the only difference is that Lemmy’s associated PageRank (and other ranking scores) are considerable lower than reddit’s. This should change with time, especially when more niche and specialized communities take hold.

    • MattMist@kbin.social
      link
      fedilink
      arrow-up
      11
      ·
      edit-2
      1 year ago

      That’s true, but aren’t federated pages at a disadvantage since you can look at them from any instance thus decreasing the number of links to one specific post (which is how PageRank works)? Since then instead of one post on page 1 you’d have 10 from different instances on page 3. I’m thinking this could be fixed if all posts had a link to the post on the original instance, which is where the ranking scores would then be more likely to aggregate.

      • sethboy66@kbin.social
        link
        fedilink
        arrow-up
        7
        ·
        edit-2
        1 year ago

        That’s a good point, and I’m sure that would certainly be a problem with PageRank and similar ranking algorithms, but I wouldn’t be entirely surprised if Google and other SEs have intelligently crafted a pre-processor that translates links like “kbin.social/m/lemmyworld@lemmy.world/t/34817/Is-Lemmy-Indexable” to the Original-Instance-Link (OIL, lurking Google devs feel free to steal this acronym) “https://lemmy.world/post/189226” so that relevant algorithms properly reflect the ‘true’ ranking of the information itself rather than the particular instance’s… instance of it.

        OStatus and Pump.io have been around for a while so SEs may (should) have already identified this problem and addressed it unless they’ve decided it’s not important, not in-line with how their rankings are intended to work, or simply not easily solvable in some cases like I previously assumed. As Bjarne Stroustrup would say, “If you think it’s simple, then you have misunderstood the problem.”

        • silas@programming.dev
          link
          fedilink
          arrow-up
          4
          ·
          1 year ago

          There are <meta> HTML tags and <link rel=“canonical” href=“https://example.com/sample-page/”> tags as well that point to the original copy of a page, if it is not implemented it would be super easy to, but I’m on my phone at the moment so I can’t see the source code

      • jcg@halubilo.social
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        All posts and comments do have a link to the instance they were originated from. That’s what that weird looking multicolour star is (the fediverse logo).

  • Abreus96@vlemmy.net
    link
    fedilink
    English
    arrow-up
    9
    ·
    1 year ago

    In good time I’m sure it will be easier to find by using the standard Google search. For those who used to use (site:reddit.com) as a reliable search query. Here is a Feddiverse alternative you can copy and paste, at least for now until Google searching the feddiverse gets easier.

    Copy paste and then type your search

    (site:kbin.social OR site:lemmy.world OR site:sh.itjust.works OR site:beehaw.org OR site:lemmy.ml OR site:lemmy.ca OR site:midwest.social OR site:lemmy.blahaj.zone)

  • Soltros@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    Hopefully as Google is now indexing lemmy.world, more people will see it while searching and come hang out.

  • nivenkos@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    I wish it were easier to maintain anonymity with indexing. Like it’s weird that you can easily find people’s archive of TikTok comments on Google, but in the app you can’t see them.

    Likewise if there were a way for posting stuff without making it easy for malicious actors to look at your whole post history to piece together who you are.

    • EV_EV@kbin.social
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      Yeah, this is actually a big worry to me, on Reddit especially because I think it would be easy (if not easier) to find out info about me by the subreddits I was active in

      • nivenkos@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        But it’s also nice to have stuff indexed in Google when looking up product reviews and technical issues, etc. - it’s a double-edged sword.

        Ideally it’d be possible to make some comments pseudonymous at least (so only instance admins, or possibly community moderators could see the real author).

      • Fizz@lemmy.nz
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        There was extenstions that allowed you to click a button on someones name and see what subs they were active in at a glance. There was also websites you could put a username into that showed detailed history of how that user interacted with reddit. What they subed to, what times they were active, sentiment analysis on their comments etc.

  • O Galdo
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    At least in other Fediverse services you can’t search post content in searches, only hashtags. It would be desirable that this would be the case for all federated services.

    At least that it could be configured on each server and that the other federated servers would respect the privacy settings of the servers on which each post was published.

    It may be a little difficult to implement, but it is desirable to maintain that philosophy with respect to privacy.

    In any case, there have already been cases of bots (crawlers) collecting data in instances of the Fediverse. Although measures can be taken and at a legal level, at least in Europe, it is reportable, technically these can be done, outside the Law.