lightning channels are an on-chain transaction shared between two peers. by default both usually have to be online because usually there is a policy to auto-close the channel if the other peer is offline for a substantial amount of time.
however, if two nodes decided to allow it, i'm pretty sure it can be done, just that you can't do any transactions without them both being online to share an update to the transaction that changes the balance.