They are kind of forever. You can't delete them, like once you broadcast a Bitcoin transaction you can't take it back. But given enough time it's possible that the relays will forget some or all of your messages