That's beautiful man! I'm just starting to dig deeper into nlp, I see that at the moment there is only support for openAI and replicate.com, it would be really cool to integrate the ollama api for example, so anyone could use their own infrastructure to run a dvm. It could also be interesting to integrate langchain, for example in the case of image-to-video to gif. In any case I hope to have some more free time to see if I can do some pr or play a bit more with the framework.

Reply to this note

Please Login to reply.

Discussion

There's also a branch with local models like whisper, SDXL, image upscaling, image analysis, but need to finish that up and write some documentation for it to make it useable for other people.

But yes, adding more stuff is on the list, besides extending the current capabilities of DVMs in general. And of course happy if people want to contribute or even simply run DVMs 🤙

First version of ollama API added :)

Ollama is such a great project.

Yes it is, and ollama + langchain its pure 🔥

Wow, that was fast! Ill try to run it tomorrow, there is a branch in the repo?

It's in main. I'm using the llmlite lib as it also supports other backends which comes in handy. You find it in tasks/textgeneration_llmlite.py. You can also run the task files alone without the bot/other DVMs by just running it from the main folder. python tasks/nameofscript.py. let me know if I can assist with anything. Still in the process of making everything smooth for people to use.