AutoregressionIn language models, autoregression means that each future token prediction depends on tokens the model has already generated, not only on the initial input.