It depends on the rules of the two countries.

Some countries won't allow it, with diplomats being a usual exception.