static evaluation
How this channel uses it
In this channel's material, static evaluation is the counterpart to evaluating a model inside a live environment. The channel's argument is that games — like a game of Diplomacy that seeded a $3.6 million AI startup — may be the richest environment for evaluating and training language models, precisely because they force a model to act and adapt rather than merely score well on a frozen test set.