Replying to Avatar Vitor Pamplona

In-device models can take care of private events. But otherwise, I am not sure they are that interesting for public events. Constantly updating the local model to match the newest events coming in online is challenging.
Avatar
iefan 🕊️ 1y ago

I was attempting that, and it's quite challenging. So, I will be working on it with Gemini.

This will focus on private tasks like TTS, PDF summarizer, Basic Q/A etc., using small, task-specific language models with WebGPU.

Reply to this note

Please Login to reply.

Discussion

Avatar
Hazey 1y ago

Would be nice if we can set the address of an OpenAI API compatible LLM to give users choice