Context window is a bit of a hurdle to be overcome, especially for chatbots and storywriter models.

Commercial LLMs have the upper hand in the early stages, but open-source models have so much potential... And you won't have to deal with restricted access.