Lemmy Performance / Scalability

In the sign up process, it discourages using the primary srever. In the docs it talks about performance limitations. In contast Mastadon does not do this. Worse yet, most people think of a single centralized server. And this server only has some 500+ active users a month. Maybe 10 times that many lurkers?

While I love the Lemmy design, and the community looks great, I fear that it does not scale. Worse yet I suspect that the Activity Pub protocol is grossly inefficient for Reddit style applications. Maybe a publish subscribe message broker, like MQTT would be much more efficient.

So what is gong on here. Is this an issue? Am I correct to be scared about Lemmy scalability.

And just for context, I think you are totally on the right track, way ahead of all ofther reddit clones, but maybe just a little off course. Can you crank up performance?

@nutomic
mod
admin
link
143M

So far there are no performance problems at all. Lemmy.ml runs on a dual core vps and only uses like 5-10% of each core (load average around 0.5). The reason we want to discourage use of lemmy.ml is that it makes for an unhealthy ecosystem if the majority of users are all on a single instance. I also dont think that federation would be a performance problem unless you have a really huge instance. If we run into any performance issues, then Rust will give us a lot of ways to optimize that.

@dreeg_ocedam
link
2
edit-2
2M

deleted by creator

@nutomic
mod
admin
link
43M

Rust is just a really nice language (no null pointers or anything similar). We arent using it for performance reasons, thats just a nice bonus.

Once this is implemented, large threads can be handled much more efficiently.

@dreeg_ocedam
link
4
edit-2
2M

deleted by creator

@Jojonintendo
link
10
edit-2
2M

deleted by creator

@UncensoredNews
creator
link
43M

WOW. 100MB is tiny. but Lemmy requires postgress, and a quick google search says Postgres requires minimum of 2 GB or RAM.

@mesamunefire
link
33M

You can use RDS and not host it within the same server.

@Jojonintendo
link
3
edit-2
2M

deleted by creator

@dreeg_ocedam
link
8
edit-2
2M

deleted by creator

@mesamunefire
link
33M

I used to host a mastodon instance for just one user, me. It really struggled unfortunately in both speed and space requirements.

I wish they had an option to block all bots from the platform. I can block individuals and instances, but bots would still pop up like crazy.

Kinetix
link
13M

From lemmy.ca:

USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND

lemmy 17645 0.3 0.3 672368 98876 ? Ssl Aug03 154:51 node dist/js/server.js

lemmy 20959 0.4 0.6 4127676 210048 ? Ssl Aug03 169:59 /home/lemmy/lemmy/target/release/lemmy_server

pictrs 32164 0.0 11.4 10599856 3769764 ? Ssl Jul28 18:50 /home/lemmy/pictrs/pict-rs/pict-rs

iframely 20977 0.0 0.1 901704 55368 ? Ssl Jul08 3:25 iframely

Make of it what you will. :-)

@Jojonintendo
link
5
edit-2
2M

deleted by creator

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.

  • 0 users online
  • 3 users / day
  • 30 users / week
  • 69 users / month
  • 254 users / 6 months
  • 1.06K subscribers
  • 363 Posts
  • 2.57K Comments
  • Modlog