Phi-2: The Surprising Power of Small Language Models

Phi 2

Over the past few months, our Machine Learning Foundations team at Microsoft Research has been working diligently to develop a suite of small language models (SLMs) known as “Phi”. These SLMs have proven to possess a remarkable level of performance across various benchmarks, surprising even our own expectations. Our initial model, Phi-1, with its impressive … Read more