If self-play/synthetic data doesn’t work, the models look fucked

Reply to this note

Please Login to reply.

Discussion

Very intersting article

Didn't realize the scaling "laws" all these guys were talking about still would require more quality training data than exists to get anywhere

Making what we write, ever so more valuable.