On this day: Mar 10

Represents the shift of embedding models from small dedicated encoders to derivatives of frontier LLMs

Dependency-free inference in pure C/C++ opened the way to running LLMs on a laptop without a GPU

Demonstrated that simply averaging the weights of several fine-tuned models raises performance; the starting point of model merging

"Hitting a wall" became the stock phrase of scaling skepticism