Hello and welcome to this series of tutorials on autoregressive models! I decided to put this together to help me (and hopefully you) learn about these types of model which have cutting edge applications in image generation. I want to go into depth on this because there are some core ideas I think it’s worth exploring and understanding; particularly as I find the papers are very thin on detail. I have split this up into chunks Part 1 : General introduction to generative autoregressive models and particularly the pixelCNN family of models. Part 2 : Theory (Probability); an exploration/explanation of the key ideas that make these models work. Part 3 : Theory (Causality); an exploration/explanation of the key ideas that[…]