Replying to Avatar SUPERMAX

What is your method & tool for fine-tuning this model(s)?

I've been desiring to train some LLM's on specific datasets and seeking a method(s)/tool(s) to do so best fit for me

Second question; what is your dataset structure? I understand kind 1 & other events, but how is it structured when feeding the LLM? Just JSON? Anything else I'm missing to train & fine-tune my own LLM?
Avatar
komori 1y ago

If you don’t mind me giving you a suggestion. An easy way to get started is by using Unsloth’s Google Colab notebooks. Just by inspecting the code of some of their many notebooks you can get a solid starting point about the fine-tunneling steps, including the dataset formats. https://unsloth.ai

Reply to this note

Please Login to reply.

Discussion

Avatar
SUPERMAX 1y ago

Thank you I'll give this a test

Avatar
SUPERMAX 1y ago

I see this is for smaller models. Can I use this as well for ~100B parameter LLM's?

Would prefer to do locally if I can; I do have access to hardware to do this

Avatar
komori 1y ago

Yes, you can. These notebooks use smaller models only to take advantage of the Tesla T4 (free tier). You can mod the notebook and use it locally. You can use their bigger models or any other that you want when you feel more comfortable with the different model templates. https://docs.unsloth.ai/get-started/all-our-models

Avatar
SUPERMAX 1y ago

Thank you for your follow up answers; much appreciated🦾