The device and PIN is needed to authorize a spend or send. This validates the holder is the owner. I'm guessing Without that check, anyone's funds could be sent or spent without their knowledge. So best to keep the wallet, PIN and seed/keys seperate.

They keys would only used to recover your authority IF you needed a new wallet.