Yeah, it's really annoying, and unfortunately there are no Github-enhancement extensions (for Firefox) that can have that feature.