LLM Evals are a very important topic to understand for any production LLM system. It was a pleasure working with Aparna on a piece that tries to explain the area in detail, please take a look:
https://towardsdatascience.com/llm-evals-setup-and-the-metrics-that-matter-2cc27e8e35f3 #llm #machinelearning #ai
Hey, I’m Ilya. Ex Meta technical lead in ML (prior to that Twitter, Adobe, federal gov… currently working on some projects on my own. Will share more soon.
Other than ML I like chess (especially bughouse), arduino electronics, 3d printing, playing guitar and travel. Dad and husband.
5 ways to use AI and machine learning in dataops - Data wrangling, dataops, data prep, data integration—whatever your organization calls ... - https://www.infoworld.com/article/3706090/5-ways-to-use-ai-and-machine-learning-in-dataops.html#tk.rss_all #artificialintelligence #softwaredevelopment #machinelearning #datamanagement
Synthetic data generation/augmentation is another one. Super important.