Next-step prediction is beautiful because it encourages, as a model gets extremely good, learning the underlying process that produced that data. That is, if a model can predict what comes next super well, it must be close to having discovered the 'underlying truth' of its data.
Quote by Greg Brockman, American entrepreneur (1987), about prediction. One of 28 Greg Brockman quotes on Quotlr.