XGen-7B, a new 7B foundational model trained on up to 8K length for 1.5T tokens

Link: https://blog.salesforceairesearch.com/xgen/

Discussion: https://news.ycombinator.com/item?id=36514936