If anyone is working on such a tool, please speak up. I’ve got some clumsy Javascript code in the form of a SvelteKit app I named “lemmy_helper” that I am thinking of adding this as a command line where you can put in the URL of two servers for a specific community and crawl postings and comments and try to discover missing ones.
As I understand it, the Federation protocols have no ‘bulk copy’ ability, no way to send a list of comments and postings and get them all at once. So each individual missing comment and posting would need to be triggered by a search on the server that is missing them?
I propose “lemmy-remote-data-repair” as the working name for this concept code/app.
My instance is often not syncing with anything bigger at all (.world, .ml) so I too have been thinking about this.
Though my idea is a python (or anything quick) script that would run as a sidecar to the lemmy database, it would accept a link (thru cli or secured http request) to community, post or comment and insert it directly into database.
I propose “lemmy-remote-data-repair” as the working name for this concept code/app.
I’m pondering if the app should make a bot comment into a posting indicating which major peer servers have missing comments of older than 60 minutes. To raise awareness of the issue among the community… and hopefully inspire programmers/developers/database managers to get involved with turning and improving the code.
