reward hacking
Reward hacking in this channel's material
## Why the term shows up here In the conversation with Surge AI founder Edwin Chen, reward hacking appears as one of the risks that surfaces when models are trained against benchmarks and incentives rather than against the underlying goal they were meant to serve. Chen points to novel mathematics and writing benchmarks as a revealing test case: they show both real progress in model capability and the misaligned incentives that arise when a training signal can be gamed instead of genuinely satisfied. The lesson explored in the video is that what gets rewarded is not always what was intended — and that careful training environments are part of the answer.