The folks at Runway are pitching a new idea called General World Models which essentially boils down to training an AI on text, video, audio and other multimodal inputs. Pretty sure this was already happening anyway with GPT4 and others but they have packaged it up rather nicely. The video is really well made and makes a great case for them. Worth a watch to say the least.