Clients should all be fetching only from my outbox to get my notes, my inbox/private/chat is only used by me, so shouldn't be any issues on resources