Now that "scale is all we need" has predictably faltered...

1. Small AI models often perform better in context.

2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.

Me +

nostr:nprofile1qy2hwumn8ghj7un9d3shjtnddaehgu3wwp6kyqpq4m5nu28anh99cmxqymavktvahtzexknxstgtgedfqk9dv0r3sh3sx5c5h6

@sashaluccioni

arxiv.org/abs/2409.14160