Check this out itβs called StarCoder and its a 15B LLM for code with 8k context and trained only on permissive data in 80+ programming languages. It can be prompted to reach 40% pass@1 on HumanEval and act as a Tech Assistant. Open sourced ((:
- Intro blog: https://huggingface.co/blog/starcoder
- Model link: https://huggingface.co/bigcode/starcoderbase
- Paper (May the source be with you!!)
https://drive.google.com/file/d/1cN-b9GnWtHzQRoE7M7gAEyivY0kl4BYs/view