Comment

Sal@mander.xyz ⁨5⁩ ⁨months⁩ ago

Hi!

Yes, I have been told about the slow federation. I have tested a few things - for example, I am able to fetch up-to-date data from Lemmy.World immediately. But I am not entirely sure why the federation is so slow in the background. Has anyone noticed if this affects only lemmy.world?

I have two things planned:

Move images to object storage, which will be a more efficient way of using space. I can also use what I gain from decreasing disk resources by increasing the RAM and CPU count.
Upgrade the instance to 0.19.4

My plan is to do these first and hopefully the federation issues are fixed during the process, and if not the next step will be to troubleshoot. But I have been so busy recently, and I do want to have a long block of uninterrupted time in case that things go wrong and I have to spend some time troubleshooting. I will try to do these tomorrow.

source

Sort:hotnew top

throws_lemy@lemmy.nz ⁨5⁩ ⁨months⁩ ago
There’s another overlooked issues regarding the slow federation. And I just found out a few days ago, there’s de-peering drama since mid February that caused a huge of delays from APAC to Europe.

thinkbroadband.com/…/9896-ntt-cogent-peering-disp…

www.reddit.com/r/…/cogent_depeering_tata/

Around that time until now, I had trouble accessing some sites, like I couldn’t access some github projects, f-droid repos also failed, and also some websites. I’ve tried cloudflare warp, it didn’t help either.

And if I’m not mistaken our admin has a solution to this issue a while ago, you may ask Dave.

lemmy.nz/post/10046390

source
- Sal@mander.xyz ⁨5⁩ ⁨months⁩ ago
  Huh, interesting! I was not aware of this. Thanks!
  
  source
Blaze@reddthat.com ⁨5⁩ ⁨months⁩ ago
Here is a post with some technical details on the reasons of the federation delay: lemmy.world/post/13967373

source
Aviandelight@mander.xyz ⁨5⁩ ⁨months⁩ ago
Hi Sal, thanks for the update and everything you do here! Glad to hear that everything is okay and I completely understand being busy.😊 Fingers crossed on the new version fixing most of the issued.

source
Blaze@reddthat.com ⁨5⁩ ⁨months⁩ ago

EDIT: I have looked through the search for others experiencing similar issues, and it seems to be something experienced in the past by other instances, and so I will try to get some inspiration from those previous experiences: mander.xyz/post/10489815

Good luck!

source
Blaze@reddthat.com ⁨5⁩ ⁨months⁩ ago
Hello!

Are you on the admins Matrix channel? The APAC instances (Reddthat, lemdro.id, Aussie.zone, Lemmy.nz, Blahaj) had the same issues a few weeks back, they managed to solve them somehow, they’ll probably be able to help you out

source
- Sal@mander.xyz ⁨5⁩ ⁨months⁩ ago
  Thanks!
  
  I have collected a few of the posts… I have lagged behind on a few things (object storage, migrating pictrs database to postgres, upgrade to 0.19.4), so I am trying to catch up and during this process I will see if I can implement their solutions.
  
  I have also noticed a generally slower experience when using the instance… After I move the files to the much cheaper object storage I will be able to allocate more resources to RAM, CPU, and bandwidth. I was under the impression that the slow federation could be related to this decrease in performance, but from what I have read now it seems that it happens independent from this.
  
  source