I subscribed to communities, but my Lemmy instance receives only a few posts, comments and votes. I can see linked instances, but whether or not they sync data feels hit or miss. I’m not quite sure if this is expected. Does Lemmy have a utility similar to the Matrix federation tester?
- Federation only sets up a channel to exchange data, very little comes across during initial federation.
- Subscription only requests that FUTURE posts/comments/votes/updates get sent to your server. It doesn’t do historical backfill.
If you sub to active communities, new posts will populate in a normal way. You’ll have an incomplete view of existing megaposts that predate your subscription. Click the fedi-link to scope those out on the server that hosts the community. You won’t be able to vote/reply, but you can see what’s there.
Within a few days, the vast majority of posts will be fully fleshed out. Try browsing by new in the meantime, you’ll see more posts that we created after your subscription landed, and spend less time in ghost-town posts where you’re missing all the comments.
Oh ok. Thanks for the info!
There is something else going on with replication of comments and postings to other instances. When I look at your home instance, I only see 2 of the 5 comments on the posting you are reading. https://lemmy.world/post/103943
This comment is now comment number 6. EDITED to fix link to lemmy .world
Are you on a private instance? It can take a long while for your instance to catch up to current stuff.
As far as testing federation… you posted to lemmy.ml from your instance… federation is working :)
Something is seriously wrong. It’s been hours and I looked at 7 or 8 instances, nobody has a complete copy. Your instance only shows your own comment: https://lemmy.saik0.com/post/4283
The comment you are reading is comment #14 on lemmy.ml
Well it’s possible that an instance blocks other instances. This also includes things like firewalls and proxy services. I for instance block all Russian and Chinese ip addresses outright. I want nothing to do with either of those countries from a web perspective. It’s possible that on their instance they’re blocking my instance, or IP so it’s not quite populating properly. There’s a lot that can go wrong… Doesn’t help that lemmy.ml is getting HAMMERED recently.
Actually looking at their instance… They’re using Cloudflare (I see the email protection injected code). Cloudflare in particular likes to mark ActivityPub traffic as “bot” traffic and block it. It’s more likely that lemmy.ml is blocked for that particular instance by cloudflare. Smaller instances like mine probably don’t get flagged. So it shows up in their instance just fine… https://lemmy.haigner.me/post/8?scrollToComments=true
But other instances might have problems talking to them. They need to setup a page rule to allow lemmy traffic through cloudflares bot detection.
I’m on a private instance, yes. My subscription to !lemmy@lemmy.ml is still pending, so idk about the federation part.
That’s a bug… You’re likely subscribed. Toggling the subscription has worked for me in the past. I don’t really run into it at this point anymore.
https://github.com/LemmyNet/lemmy/issues/2685
and
https://lemmy.ml/post/1216911Might be helpful
Indeed, when i go to lemmy.ml directly, i see many more posts. And that advertisement seems to be stickied…
The instance might be very busy and it won’t sync older content from before you subscribed.
Your comment made it into lemmy.ml fine, but it seems outbound isn’t getting to you very well. Your comment was the 9th comment on this posting, the one you are reading is number 10. Your home sever posting: https://lemmy.wtf/post/1021
Edit: the lemmy.ml posting with 10 total comments currently is here: https://lemmy.ml/post/1239920
I’m also curious, with my new instance, sometimes it seems like we’re receiving the content we should be, other times not so much.
I looked at your instance and it isn’t showing the other comments. https://lemmy.pro/post/1354
This is comment #15.
This is now comment #11 on this posting. Another server to look at: https://programming.dev/post/29631
I observed my Cloudflare firewall events under Security > Events. Cloudflare takes actions against instances that use the Lemmy API through Tor since the launch of my instance. I will allow this traffic to see if that improves federation for my instance, somehow. I doubt it as the vast majority of traffic gets through without a Cloudflare challenge.
Update: WAF rule didn’t work. I suspect page rules block the requests before they reach the WAF.
I whitelist everything under the sun as I only have 3 page rules. Lemmy requires the following paths as far as I saw:
- /.well-known/nodeinfo
- /nodeinfo/2.0.json
- /api/v3 and v1
- /pictrs
Update 2: Cloudflare neither blocks nor challenges API requests anymore. But federation is still whack.
It’s been over 8 minutes since i created comment #7, this is now comment #8. Another Lemmy server is also showing that it is missing most of the comments: https://lemmy.ca/post/648889
I’m seeing lemmy.ml communities that aren’t replicating posts and comments properly to other major instances.
Everyone keeps upgrading the hardware, but the PostgreSQL database seems to have a lot of locking issues / concurrency contention with federation and user activity at the same time.
Example: this posting over on Beehaw is currently lacking the comments: https://beehaw.org/post/536574
Another site, it is there, but only 2 of the 4 current comments: https://sh.itjust.works/post/74015
I don’t see all the comments yet on your home Instance either. https://lemmy.haigner.me/post/8
At lemmy.ml - the “owner” of this community, I am now creating the 5th comment (you are reading it).
Testing 1,2,3. It has been 10 minutes since I created comment #6 in this posting, this is now comment #7.
Ok, so this at least gives me confidence that the issues I’m seeing around federation may not just be me. One issue I’m seeing is that I’m not confident my comments are appearing on other instances/ or that I’m seeing comments from other instances.
@fedora, do you see this comment?
I can see your comment.
testing, 1,2,3. This is comment #22 you are reading, based on lemmy.ml posting.
