Diffusion Models: An overview

Diffusion modelling framework have been applied for image synthesis and form the basis of current SOTA models such as DALL-E from openAI and Imagen from google. With these successful demonstrations there as huge interest in the diffusion models to generate synthesis data for potential applications of these models in text to image generation, video generation, AR, VR, medical imaging, and digital twins and beyond.

In a previous post we covered the optimization objective (loss function) for diffusion models, and it relationships to variational inference. In this post we cover the implementation of…