Paper titles in AI have gotten so stupid. “Self-rewarding language models” is just a more training-online version of iterative DPO which they say in the second paragraph.
What “self” are we talking about? It’s still being trained WITH HUMAN PREFERENCE DATA. Ugh.
Otherwise the paper seems decent if you ignore the clickbait title.