One of the most recent innovations in the sphere of technology are artificial intelligences (AI) that generate images from words and/or phrases, however, Meta intends to go further with this concept. Zuckerberg ‘s new AI called Make-A-Video can generate not only images, but videos, through words. Although it is not available to the public (for now), it is possible to activate notifications for when the tool is freely accessible. Come meet her!
from image to video
Mark Zuckerberg says that you only need to “ describe how you want your artwork to be created for a video ”, and that’s exactly what Make-A-Video does. They are short videos, something that approaches a gif , for example, but that has already left many people impressed with the technological capacity. The video quality is also not the best, which may not be a negative point, since this can be considered the pioneering tool in the video category.
Like any other AI art program, Make-A-Video was trained on “text image data,” or existing images that were labeled with a description explaining the object, person, or setting depicted. But beyond that, the technology has also been programmed to study video footage to understand “how the world moves,” according to Meta .
The Make-A-Video research builds on recent progress made in text-to-image generation technology, thus enabling text-to-video generation . The system uses images with descriptions to learn what the world is like and how it is often described. He also uses unlabeled videos to learn how the world moves — like people, certain objects, animals, etc. With this data, Make-A-Video allows you to bring your imagination to life by generating creative and unique videos with just a few words or a short text.
It is much more difficult to generate video than photos because in addition to correctly generating each pixel, the system also needs to predict how they will change over time. Make-A-Video solves this by adding an unsupervised learning layer that allows the system to understand motion in the physical world and apply it to traditional text-to-image generation.
Explains Mark Zuckerberg in a Facebook post about the new tool
Examples of Make-A-Video
Again, as this is a newer tool, obviously everything won’t be as perfect as expected. In some videos, artificial intelligence is not always able to replicate movements or logic that actually exists in real life — or the realistic intent of what the video would like to represent. Check out some examples of possible imperfections generated by Make-A-Video :
Still, the AI program is impressive and potentially opens the door to improvements in assertiveness, as well as giving anyone the chance to create whatever videos they want. Unfortunately, technologies can also be an evil that we must always be aware of . It’s not hard to imagine someone abusing Make-A-Video to create deepfakes and spread disinformation. The system also comes from Meta , a company accused of prioritizing profits over preventing misinformation.
Goal about the novelty
On the other hand, Meta says it is committed to responsibly developing AI-based technologies.
As a way to reduce the risk of harmful content being generated, we examine, apply and iterate on filters to reduce the potential for harmful content to be displayed in videos.
Meta’s positioning, in relation to possible bad faith uses with Make-A-Video
All videos generated in Make-A-Video will also include a watermark to indicate that it was created by artificial intelligence. Those who wish to test the technology at a later time can apply via this application form . Then, just wait until Meta gets in touch to invite you to test the new tool.
Check out some more examples of those who had the opportunity to use the tool:
Our goal is to eventually make this technology available to the public, but for now we will continue to review, test and test Make-A-Video to ensure that every step of the release is safe and intentional.
Adds Zuckerberg’s company, talking about the future availability of the program freely to the public
There is also a specific page with a catalog full of Make-A-Video creations , there you can find videos created with the most different types of categories. Check it out and let us know what you think in the comments!
See too
This new AI-powered image creation — and now videos too — is making the rounds on and off the internet! Recently a man won an art competition using a piece he didn’t “create by hand” but generated through a program. Just take a look.
Fonte: PCMag, Mashable, TechCrunch e Meta.
More:
