So lets say lemmy.world and then lets take beehaw.org (I know they are defederated lets assume they are not) for example. All the posts and comments which are hosted by lemmy.world on hard drives or servers, are also hosted by beehaw.org and vice versa? So the amount of data is actually doubled in size?
Yep. Add in a 3rd instance and now you have 3 copies of the database, essentially. It’s just that each instance is responsible about telling the fediverse when updates occur to communities on their instance.
The post is a few years old and is quoting data that is a few years older still… but assuming that they’ve doubled in size since, there’s only 10TB of data for text, comments, etc… (i.e. no images).
Now I’m assuming this is compressed btw. (The link in the post is dead so I can’t actually check out the file and see what’s in there).
So lets say lemmy.world and then lets take beehaw.org (I know they are defederated lets assume they are not) for example. All the posts and comments which are hosted by lemmy.world on hard drives or servers, are also hosted by beehaw.org and vice versa? So the amount of data is actually doubled in size?
Yep. Add in a 3rd instance and now you have 3 copies of the database, essentially. It’s just that each instance is responsible about telling the fediverse when updates occur to communities on their instance.
If the fediverse gets really big, lets say the size of reddit, it may be hard for all the different instances to store all that data on their servers
Ya, ActivityPub isn’t without it’s issues… but luckily it’s all just text. Much of that can be compressed significantly.
I wonder what the total data storage size is for all the publicly viewable content on reddit. I find it hard to even guess lol. 100TB? 10,000TB?
Btw I did just find this: https://www.reddit.com/r/DataHoarder/comments/pqxs8m/size_of_reddit/
The post is a few years old and is quoting data that is a few years older still… but assuming that they’ve doubled in size since, there’s only 10TB of data for text, comments, etc… (i.e. no images).
Now I’m assuming this is compressed btw. (The link in the post is dead so I can’t actually check out the file and see what’s in there).