I see this is for smaller models. Can I use this as well for ~100B parameter LLM's?
Would prefer to do locally if I can; I do have access to hardware to do this
Discussion
Yes, you can. These notebooks use smaller models only to take advantage of the Tesla T4 (free tier). You can mod the notebook and use it locally. You can use their bigger models or any other that you want when you feel more comfortable with the different model templates. https://docs.unsloth.ai/get-started/all-our-models
Thank you for your follow up answers; much appreciated🦾