Avatar
0xtr 1y ago

Does anyone know how big (in GB) that new #Meta #llama 3.1 70B instruct model is? Been downloading for ages...

Reply to this note

Please Login to reply.

Discussion

Avatar
Alan Siefert 1y ago

Apparently the next one is 400B.

Avatar
0xtr 1y ago

Can't imagine how big that file will be

Avatar
Alan Siefert 1y ago

Yuge

Avatar
Danz# 1y ago

Is it already available to download ? Few have hardware to run a 70b without quant.

Avatar
0xtr 1y ago

It is!

https://llama.meta.com/

https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/README.md

Avatar
Danz# 1y ago

128k context 😱

Avatar
Danz# 1y ago

405b is 231G of download with Q4