I got rid of it by toggling the WoT setting on Coracle to 1, and to "Normal" on Nostur. At the cost of missing people I don't follow or with randomly low WoT scores, but the option to look at the hidden note is there.