DeepSeek's R1 model release and OpenAI's new Deep Research product will push companies to use techniques like distillation, supervised fine-tuning (SFT), reinforcement learning (RL), and ...

The Microsoft piece also goes over various flavors of distillation, including response-based distillation, feature-based ...

DeepSeek’s success learning from bigger AI models raises questions about the billions being spent on the most advanced ...

AI-driven knowledge distillation is gaining attention. LLMs are teaching SLMs. Expect this trend to increase. Here's the ...

A small team of AI researchers from Stanford University and the University of Washington has found a way to train an AI ...

A flurry of developments in late January 2025 has caused quite a buzz in the AI world. On January 20, DeepSeek released a new open-source AI ...

Since Chinese artificial intelligence (AI) start-up DeepSeek rattled Silicon Valley and Wall Street with its cost-effective ...

Researchers from Stanford and Washington developed an AI model for $50, rivaling top models like OpenAI's o1 and DeepSeek.

OpenAI believes DeepSeek used a process called “distillation,” which helps make smaller AI models perform better by learning ...

One of the key takeaways from this research is the role that DeepSeek’s cost-efficient training approach may have played in ...

The Chinese company’s leap into the top ranks of AI makers has sparked heated discussions in Silicon Valley around a process DeepSeek used known as distillation, in which a new system learns ...