Here are some of the specific technical things they did to achieve lower costs. More efficient training procedure, memory compression, reliance on RL, low level code optimisation.
https://www.analyticsvidhya.com/blog/2025/01/how-deepseek-trained-ai-30-times-cheaper/