Right. Going big just means youre brute forcing without really understanding which/how key parameters should be tuned.
Exciting to imagine what a phone's tiny neural processor can do in a few years after we figure a lot of this out.
I love this research!!