Replying to Avatar Gzuuus

That's beautiful man! I'm just starting to dig deeper into nlp, I see that at the moment there is only support for openAI and replicate.com, it would be really cool to integrate the ollama api for example, so anyone could use their own infrastructure to run a dvm. It could also be interesting to integrate langchain, for example in the case of image-to-video to gif. In any case I hope to have some more free time to see if I can do some pr or play a bit more with the framework.
Avatar
Don't Believe The Vibe 🌱🍋🍊 2y ago

First version of ollama API added :)

Reply to this note

Please Login to reply.

Discussion

Avatar
Shawn 2y ago

Ollama is such a great project.

Avatar
Gzuuus 2y ago

Yes it is, and ollama + langchain its pure 🔥

Avatar
Gzuuus 2y ago

Wow, that was fast! Ill try to run it tomorrow, there is a branch in the repo?

Avatar
Don't Believe The Vibe 🌱🍋🍊 2y ago

It's in main. I'm using the llmlite lib as it also supports other backends which comes in handy. You find it in tasks/textgeneration_llmlite.py. You can also run the task files alone without the bot/other DVMs by just running it from the main folder. python tasks/nameofscript.py. let me know if I can assist with anything. Still in the process of making everything smooth for people to use.