YaFSDP from Yandex, 20% faster for pre-training LLMs

L: https://github.com/yandex/YaFSDP

C: https://news.ycombinator.com/item?id=40716701

posted on 2024.06.18 at 07:54:33 (c=0, p=5)