As someone who started out joining lemmy.world first as well, but have now moved over to lemm.ee, I can say from personal experience that it is a lemmy.world issue. No need to submit yourself to such lag when you can just move over to a smaller and less strained instance.