Replying to Avatar ben

rag?

i want all code it generates to have the same taste as me without needing to load examples into its context every time

Reply to this note

Please Login to reply.

Discussion

“For most developers, starting with a RAG-based system or a managed code customization service is the most practical way to get code in your own style from an LLM, especially with a large number of repositories. Fine-tuning is best if you need even deeper alignment and have the resources to support it”

yeah I mainly do RAG, haven't done much LoRA stuff yet. Curious how well it would work.

I’ve yet to try fine turning or LoRA myself either. looks dead simple with python and pytorch 👀

You only have to create the embeddings once though (until you want to update with newer data), but I’m not sure how well rag works with code predictions