Which client/app are you using? I’ve found just in my own trial and error that it can differ based on a few things: your internet connection, which client/app you’re using, and the relays you’re connected to.