It's difficult when both parents have different native languages...

Short answer: I try, and he still understands quite a lot, but replies exclusively in English😅