Make-A-Scene takes generative art one step further. Using the typical text-to-image generator and adding another layer of ‘awesomeness’ Meta AI, the artificial intelligence branch of Facebook part company allows users to draw a freeform digital sketch of a scene for the generator to use as a base to generate the final image.
Meta AI had recently published a report compiling its findings with the software and how its customers reacted to the facilities. “Our model generates an image given a text input and an optional scene layout,” the report reads. “As demonstrated in our experiments, by conditioning over the scene layout, our method provides a new form of implicit controllability, improves structural consistency and quality, and adheres to human preference.”
Generative art has come a long way, and as a medium has been enjoying its heyday in the mainstream.
To realize AI’s potential to push creative expression forward, people should be able to shape and control the content a system generates. It should be intuitive and easy to use so people can leverage whatever modes of expression work best for them. Imagine creating beautiful impressionist paintings in compositions you envision without ever picking up a paintbrush, or instantly generating imaginative storybook illustrations to accompany the words.” says Meta AI in their blog.
Make-A-Scene is also able to generate its scene layout with text-only prompts if that is the requirement of the user
The software is yet to go live to the public. Though it has been rolled out to a few developers, the idea is to understand the limitations of the software and fine-tune them for the general public. The beauty of this generator is the fact that any artist is quite literally dipping their brushes into the mind of a machine (the color pot) and painting with the machine’s consciousness.
The importance of this software cannot be overstated. Having such mediums of expression enable the everyday art enthusiast to find the time to explore their creative sides, and that is what Make-A-Scene provides. This stands to revolutionize the ways in which creativity is expressed and an opportunity for art to become more inclusive to the general public.
The blog also mentioned watching out for more details during their talk at the European Conference on Computer Vision (ECCV) in Tel Aviv this October.