I’ve never heard of such an issue. My mind first goes to is you server hardware beefy enough to serve what you’re watching, but more info would be needed.

I’d suggest posting this to the Troubleshooting forum. There are tons of great peeps over there who can help diagnose all kinds of issues and get them sorted out.

https://forum.jellyfin.org/f-troubleshooting