Yes this one bothers me the most also, so far the only solution I have would also remove the unread counter and new posts coming in the from the top while keeping scroll position, I prefer to keep those.