If anyone is working on such a tool, please speak up. I’ve got some clumsy Javascript code in the form of a SvelteKit app I named “lemmy_helper” that I am thinking of adding this as a command line where you can put in the URL of two servers for a specific community and crawl postings and comments and try to discover missing ones.

As I understand it, the Federation protocols have no ‘bulk copy’ ability, no way to send a list of comments and postings and get them all at once. So each individual missing comment and posting would need to be triggered by a search on the server that is missing them?

I propose “lemmy-remote-data-repair” as the working name for this concept code/app.

  • taaz@biglemmowski.win
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    1 year ago

    My instance is often not syncing with anything bigger at all (.world, .ml) so I too have been thinking about this.

    Though my idea is a python (or anything quick) script that would run as a sidecar to the lemmy database, it would accept a link (thru cli or secured http request) to community, post or comment and insert it directly into database.

  • RoundSparrowOPM
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    1 year ago

    I propose “lemmy-remote-data-repair” as the working name for this concept code/app.

    I’m pondering if the app should make a bot comment into a posting indicating which major peer servers have missing comments of older than 60 minutes. To raise awareness of the issue among the community… and hopefully inspire programmers/developers/database managers to get involved with turning and improving the code.