OpenAI’s Sora, a generative AI model capable of creating videos and interactive 3D environments, is powered by an AI model architecture known as the diffusion transformer. This architecture, which also powers Stability AI’s image generator, is set to revolutionize the field of generative AI by enabling models to scale up beyond what was previously possible. The diffusion transformer was developed by Saining Xie, a computer science professor at NYU, and William Peebles, who co-leads the Sora project at OpenAI. The diffusion transformer combines two concepts in machine learning to create a more efficient and effective generative model.
Read more at: https://techcrunch.com