If youre impressed by therecent spateoftext-to-image generators,get ready for the next step inAIartistry: text-to-video.
A computer artist called Glenn Marshall has given a glimpse at the potential.
The Belfast-based composer recently won the Jury Award at the Cannes Short Film Festival for his AI filmThe Crow.
Marshall had previously earned plaudits for anAI-generated Daft Punk video, but he applied a different approach toThe Crow.
It’s free, every week, in your inbox.
While his earlier technique turned text intorandom visual mutations,The Crowuses an underlying film as an image reference.
Marshall fed the video frames ofPaintedtoCLIP, a neural internet created by OpenAI.
He then prompted the system to generate a video of a painting of a crow in a desolate landscape.
In the future, Marshall wants to add 3D animation to his AI creations.
Hes also exploringCLIP-guided video generation, which can add detailed text-based directions, such as specific camera movements.
That could lead to entire feature films produced by text-to-video systems.
Yet Marshall believes even his current techniques could attract mainstream recognition.
He saysThe Crowis now eligible for submission to the prestigious BAFTA Awards.
Story byThomas Macaulay
Thomas is the managing editor of TNW.
He leads our coverage of European tech and oversees our talented team of writers.
Away from work, he e(show all)Thomas is the managing editor of TNW.
He leads our coverage of European tech and oversees our talented team of writers.
Away from work, he enjoys playing chess (badly) and the guitar (even worse).
