I've found Grokking Bitcoin indispensible to understanding these things. Also, there is a great math videos out there (computerphile on youtube e.g.) that use metaphors to explain Diffie-Hellman and eliptical curve crytopgraphy to help understand how secret keys can nevertheless be proved in a signature without being exposed.