What's the best LLM (and context) for health-related questions?
#peatstr
Discussion
Deep research over medical literature?
I wanted something simpler but that would be great too. Do you have a recommendation?
Maybe there is some fine tuned LLM for this stuff?
Not too sure whether it's the best one but you can run or on your Pixel 9 Pro
https://ollama.com/library/medllama2
How to is there:
https://www.androidauthority.com/install-deepseek-android-3521203/
And there is also meditron 7b (runs on earlier mentioned Pixel. More demanding model is 70b. Look it up on ollama library.
I think Enoch by Brighteon AI might be a good idea. Enoch is an Apache-2.0 licensed dataset for LLMs, and it induces chronic forgetting for any LLM being trained with Enoch.
I used Neo, which wasn't so great.