Diary Forms of AI: Brain Transformation

The “Brain Transformation” video is derived from my interest in what AI interprets as mental health metaphorically. It begins with a man turning into a brain, representing humans being consumed by their minds. The video transitions between dark images and more colorful visuals, which can be interpreted as the brain going back and forth in life. Towards the end, tree imagery represents the growth and relationship between nature and humans. The ending, seen above, is how the video started to serve as a metaphor for the constant cycle in people’s lives.

The process started with a mind map. As you can see, the first step was to try different AI tools. I began with Diffusion Bee’s interpolator, which is where I put in a starting prompt, “depression in the mind metaphorically,” and an end prompt with “manic episode in the mind metaphorically.” After putting in this prompt, I got a video that is a sequence of about forty images, but it only lasts three seconds. Given that the video has to be about a minute long, I decided to use Diffusion Bee’s text-to-image using the same prompts shown below and integrate it into Vidu AI, which is a video AI website, rather than have Diffusion Bee create the video themselves. 

The third form of AI I used was Leonardo, and I gave prompts to create images, which I then put into Runway. This process yielded much different results than the Vidu AI. After showing the class the three videos, they preferred the second version, the Diffusion Bee with Vidu. 

After looking at the mind map, I found myself going in a different direction, looking more into the brain rather than showcasing manic episodes. I added images to the video, worked on smoothing the transitions, and removed the Vidu watermark. Following these steps, I made my own music that matched up with the video using Sound Raw. 

When I showed my class the work I had created, they told me to make the transitions more consistent and faster to keep the audience engaged. After making those tweaks, I added them to the open studio class reel. 

This was my first time being in an art class, which was scary, but I am glad I took it because I learned a lot about editing. Also, using AI to my advantage will be helpful in the future, and could help me land a career in it. 

Author: Beesley