its running on AWS, US. you can see on 4/24 i finally solved for a long running bottleneck (disk writes), and it was smooth sailing until recently.
im not sure if anyone else has subscribed to any new communities, but ive been subbed to most of the big ones for awhile.
i don’t see any saturation in the server network activity, connections, etc. my queues are not overloaded, and as i mentioned other instances are very performative.
maybe i just need to be patient and let it catch up. those graphs are awesome
CanadaPlus@lemmy.sdf.org 1 month ago
Hey, sorry for the late reply, but I’m trying to figure out who runs this graph, because if it needs something like a bit of funding to store data for longer periods I’d like to help. Do you know, or know where you heard about it?
Nothing4You@programming.dev 1 month ago
Hi, I run this.
What benefit do you expect from longer retention periods and how much time did you have in mind?
The way data is currently collected and stored keeps the same granularity for the entire time period, which currently uses around 60 GiB for a month of retention across all monitored instances.
CanadaPlus@lemmy.sdf.org 1 month ago
Mainly, I’m interested in how Lemmy is growing and changing as a whole. If there was a way to store activity just weekly or even monthly that would help for what I’m interested in.
Nothing4You@programming.dev 1 month ago
so all you’re looking for is the amount of activities generated per instance?
that is only a small subset of the data currently collected, most of the storage use currently comes from collecting information in relation to other instances.