Meta simply introduced a brand new generative AI mannequin to assist customers flip easy textual content into photos, movies, and audio clips.

Meta Film Gen permits customers to enter textual content and mechanically generate new movies, personalize movies, do video modifying, and generate audio, all of which is educated on a “mixture of licensed and publicly obtainable datasets.”

If that appears lots like OpenAI’s Sora, that is as a result of it’s fairly related. However Film Gen builds upon Meta’s earlier work with AI — you may bear in mind, and even use, Llama Picture, as an example. However Film Gen is the third wave of its generative AI work, which Meta says combines all of its earlier modalities. “Just like earlier generations,” Meta wrote in a weblog publish, “we anticipate these fashions enabling varied new merchandise that would speed up creativity.”

Meta notes that “generative AI is not a substitute for the work of artists and animators,” however says the corporate “imagine[s] within the energy of this know-how to assist folks categorical themselves in new methods and to offer alternatives to individuals who may not in any other case have them.”

“Our hope is that maybe sooner or later sooner or later, everybody may have the chance to deliver their inventive visions to life and create high-definition movies and audio utilizing Film Gen,” the weblog publish reads.

Tweet may have been deleted

All the publish about this new know-how is targeted on the long run, noting that you may’t truly use Film Gen but.

Chris Cox, Meta’s chief product officer, wrote on Threads that the corporate is not “able to launch this as a product anytime quickly — it is nonetheless costly and technology time is just too lengthy — however we wished to share the place we’re because the outcomes are getting fairly spectacular.”

The corporate mentioned it was seeking to tweak the mannequin within the lead-up to it hitting the general public.

“As we proceed to enhance our fashions and transfer towards a possible future launch, we’ll work carefully with filmmakers and creators to combine their suggestions,” Meta wrote within the weblog publish. “By taking a collaborative method, we wish to guarantee we’re creating instruments that assist folks improve their inherent creativity in new methods they might have by no means dreamed can be potential. Think about animating a ‘day within the life’ video to share on Reels and modifying it utilizing textual content prompts, or making a custom-made animated birthday greeting for a buddy and sending it to them on WhatsApp. With creativity and self-expression taking cost, the chances are infinite.”