Reading the "Extended Keys" from BIP32 and it sounds like you can add the chaincode to that keypair to use it as the seed.
Discussion
Doable by getting down to point primitives maybe? Like take an nsec and boil down to a point on secp, then HD keys from there?