Server is slow for me in the past few days. Anyone else feeling the same?
Performance issues?
Submitted 2 days ago by BB84@mander.xyz to mander@mander.xyz
Submitted 2 days ago by BB84@mander.xyz to mander@mander.xyz
Server is slow for me in the past few days. Anyone else feeling the same?
Sal@mander.xyz 2 days ago
I can see that since October 13 the CPU use spiked to 100%…
Image
I just reset the server to check if that would fix it quickly. It don’t think it did.
I can see the processes that are taking up a lot of CPU (parallell database queries it seems), but I still don’t understand what is causing these and why they have spiked since Oct 13. I will need to investigate.
Sal@mander.xyz 2 days ago
So far, I have been able to ‘control’ the CPU use by setting limits to the process that pulls stuff from the database (pool size, CPU, memory).
This does release some of the CPU for other tasks, but I think that that what creates the lag might actually be the clogged database queries. So, constraining those resources might not solve the lag problem.
Image
admiralpatrick@lemmy.world 2 days ago
Check your web access logs for these 3 IPs:
And see if they’re making repeated un-scoped (no
page
paramater) requests to/api/v3/comment/list
. If they are, block them in your firewall.Those used to hit my instance constantly with requests like
/api/v3/comment/list?sort=Old&page=16514
(yes, page 16,414). When I blocked those IPs making those requests, problem solved.acockworkorange@mander.xyz 2 days ago
Did you upgrade Lemmy on the 13th or something? Could be a new bug.
Also, did site traffic increase at all? Maybe there’s an AI scraper messing up.
Bonus@mander.xyz 2 days ago
It’s loading way faster than it was this morning.
Sal@mander.xyz 2 days ago
Hmm, thanks!
I just made another change. I am not sure why the database suddenly started taking up so many resources, so I have reduced the amount of resources available to it. It did reduce CPU use to 80% as opposed to 100%, but it is still somewhat laggy for me.