Skip to content

static evaluation

How this channel uses it In this channel's material, static evaluation is the counterpart to evaluating a model inside a live environment. The channel's argument is that games — like a game of Diplomacy that seeded a $3.6 million AI startup — may be the richest environment for evaluating and training language models, precisely because they force a model to act and adapt rather than merely score well on a frozen test set.

glossary term

Ready

Loading…

1 min read