Giraffe: 'Adventures in Expanding Context Lengths in LLMs' by Arka Pal, Deep Karkhanis, Manley Roberts, Samuel Dooley, Arvind Sundararajan & Siddartha Naidu..

https://arxiv.org/pdf/2308.10882.pdf