Civitai A.I Video & Animation // Tyler // 3.21.24

Civitai
25 Mar 202476:07

TLDRIn this lively Twitch stream, Tyler, the social media and content manager at Civii, engages with his audience by showcasing the creation of AI videos using animate diff and comfy UI. He demonstrates the process of generating videos with various prompts and IP adapter images, resulting in entertaining scenarios such as a girl being chased by a Titan and a mermaid pursued by a shark. Tyler also discusses the technical aspects of his setup, including managing video batches for lower VRAM systems, and proposes a community contest involving AI video creation.

Takeaways

  • 🎥 The stream focuses on creating AI videos and animations while providing tips and tricks for using tools like animate diff and comfy UI.
  • 👤 Tyler, the social media and content manager at civii, hosts the stream and showcases various AI video workflows.
  • 🌟 The stream demonstrates the double masking IP adapter workflow, emphasizing the importance of preparation and creativity for successful results.
  • 🎨 The use of specific examples, such as a Japanese dance troupe member and the 'Attack on Titan' theme, illustrates the versatility of the AI video creation process.
  • 📸 Tyler discusses the technical aspects of the stream setup, including the use of a high-end PC with a 4090 graphics card and a Mac Studio for streaming.
  • 🤖 The AI's ability to interpret prompts and images is tested with various characters and scenarios, highlighting its strengths and limitations.
  • 🎬 The stream highlights the importance of alpha masks in achieving clean and effective AI video renders, especially when dealing with complex backgrounds.
  • 🚀 The concept of a community-driven video contest is introduced, where participants submit their AI video creations based on a common template and prompt.
  • 💡 Tyler expresses appreciation for the community's engagement and the collaborative spirit within the AI video creation space.
  • 🎓 Upcoming guest streams are announced, focusing on different areas of image and video creation to provide a variety of insights and knowledge to the viewers.
  • 📈 The stream concludes with a call to action for viewers to download the workflow, experiment with it, and engage with the community for further learning and improvement.

Q & A

  • What is the main theme of Tyler's AI video and animation stream?

    -The main theme of Tyler's stream is creating AI videos while answering questions and providing tips and tricks about running tools like animate diff in comfy UI and workflows.

  • What specific workflow did Tyler discuss during the stream?

    -Tyler discussed the double masking IP adapter workflow, specifically the LCM (Low-Complexity Mode) one.

  • How did Tyler incorporate the Attack on Titan theme into his video?

    -Tyler used images of Masasa from the Japanese dance troop Avent-gard and combined them with generated images of Titans to create a video where Masasa is being chased by the Colossal Titan in a vibrant forest setting.

  • What was Tyler's approach to the video with the translucent water element?

    -Tyler suggested describing the character as a 'translucent female sculpture made of water' to see how the AI would interpret and render a partially transparent character.

  • How did Tyler address the issue of the subject bleeding onto the background in the initial IP adapter image?

    -Tyler realized that the alpha mask for the subject was taken at a different frame where she was bigger, causing the bleed. He suggested fixing the mask frames to prevent this issue.

  • What was Tyler's reaction to the final output of the shark video with the mermaid?

    -Tyler was impressed and excited about the final output, stating that it might be the best one of the day and that it had everything he was looking for.

  • What is Tyler's setup for streaming and AI video generation?

    -Tyler uses a beefy PC with a 4090 GPU, an i9 13900K processor, and 128 GB of DDR5 RAM. He streams from a Mac Studio, remote desktop into the PC where the anime diff is running.

  • What was the idea proposed by Tyler for a community contest?

    -Tyler proposed a contest where he creates a base video, supplies an alpha mask, and participants submit their finished videos based on a specific workflow. The best videos would then be edited together to create a final showcase.

  • What was the issue Tyler faced with the Pikachu chasing Ash video?

    -Tyler was concerned about the coloring of the Pikachu image, fearing it might be too saturated and intense, potentially leading to undesirable results in the final video.

  • What was the significance of the Snoop Dogg video at the end of the stream?

    -The Snoop Dogg video was a fun and entertaining way to end the stream, with Tyler joking about the potential of using it as an Instagram post with a Snoop Dogg song overlay.

Outlines

00:00

🎥 Introduction to AI Video Stream and Workflow

The video begins with Tyler, the social media and content manager at Civii, welcoming viewers to the AI video and animation stream. He explains that on Thursdays, they engage in fun activities like creating AI videos while answering questions and providing tips on using tools like animate diff in comfy UI and workflows. Tyler checks his audio quality on Twitch and invites viewers to join in. He sets the stage for the day's activity, which involves showcasing a double masking IP adapter workflow, using a video of a girl from a Japanese dance troop as a base. Tyler shares his inspiration from the popular series 'Attack on Titan' and demonstrates the results of his work, emphasizing the ease of creating impressive VFX with minimal effort.

05:01

🌲 Exploring IP Adapter with Forest and Titan Background

Tyler delves into the specifics of the IP adapter, using a prompt featuring Masasa from 'Attack on Titan' being chased by the Colossal Titan against a vibrant forest backdrop with Titans and zombies. He discusses the process of upscaling the image and the use of OpenPose for depth and movement. Despite some initial concerns, the result is a successful blend of background and character, with the Titan fitting seamlessly into the scene. Tyler also mentions a Discord chat suggestion to use a different character, leading to a discussion on the flexibility of the IP adapter in creating various scenarios.

10:01

🎨 Customizing Prompts and Image Selection

The video continues with Tyler discussing the importance of the prompt in the IP adapter process. He takes suggestions from the Discord chat, including an image of a big boy character, and demonstrates how to adapt the workflow for different characters and scenes. Tyler emphasizes the creative potential of the IP adapter, showing how it can transform a simple image into a dynamic and engaging video sequence. He also shares a workflow for attention masking and discusses the technical aspects of using After Effects for rotoscoping. The segment concludes with Tyler expressing excitement over the creative possibilities and the community's involvement in the process.

15:08

🌊 Underwater Chase and AI's Interpretation

Tyler showcases an underwater chase scene, featuring a female cyborg being chased by a great white shark against a deep ocean floor background. He discusses the AI's interpretation of the prompt, noting how it created a surreal and captivating scene. Despite some minor issues with the shark's representation, Tyler is impressed with the outcome, particularly the addition of water elements and the shark's interaction with the environment. He also reflects on the potential for improvement, such as adding shadows for more realism. The segment highlights the AI's ability to create unique and engaging content from simple prompts.

20:08

👾 Mario and Bowser's AI Adventure

In this part, Tyler experiments with Mario and Bowser from the Super Mario franchise, placing them in various追逐场景. He discusses the challenges of working with transparent backgrounds and the importance of alpha masks in achieving the desired effect. Tyler's attempts to create a chase scene between Mario and Bowser result in a humorous and unexpected interpretation, with Bowser's appearance changing in a comical way. The segment showcases the unpredictable nature of AI and the creative opportunities it presents, even when working with well-known characters.

25:10

🧜‍♀️ Mermaid and Shark: A New Twist

Tyler revisits the shark scene, this time incorporating a mermaid into the mix. He discusses the creative process of adapting the prompt to include a mermaid and predicts how the AI might interpret the combination of elements. The result is a striking and imaginative scene, with the mermaid's features and the shark's presence creating a captivating narrative. Tyler expresses his satisfaction with the outcome, noting that it stands out among the other creations. The segment highlights the power of combining different elements to produce unique and memorable AI-generated content.

30:12

🚔 Snoop Dogg Chase: A Hyperrealistic Horror

The video concludes with a creative take on a chase scene featuring Snoop Dogg being pursued by a giant policeman against the backdrop of Sunset Boulevard in Los Angeles. Tyler sets a hyperrealistic horror tone for the scene, playing with the concept and the AI's interpretation of the prompt. The result is an amusing and unexpected visual, with Snoop Dogg's appearance and the policeman's transformation adding a comedic twist to the narrative. Tyler reflects on the potential of using AI to create entertaining and engaging content, even with unconventional prompts.

35:14

🎉 Reflections on the AI Community and Future Plans

In the final thoughts, Tyler expresses gratitude for the community's support and participation in the AI video stream. He reflects on the growth of the Twitch audience and the team's efforts to improve the Civii website. Tyler emphasizes the inclusivity and collaborative spirit of the AI community, contrasting it with other artistic fields. He shares his excitement for the upcoming guest streams, highlighting the diversity of topics and the aim to provide value to the community. Tyler also discusses the potential for a video contest involving AI-generated content and encourages viewers to participate and contribute their creations.

Mindmap

Keywords

💡AI video and animation stream

The main theme of the video revolves around the creation and展示 of AI-generated videos and animations. This involves using specific software and techniques to produce content that is engaging and visually appealing. The stream is a platform where the host, Tyler, demonstrates and discusses these processes in real-time, providing insights and tips to the audience.

💡Social media and content manager

Tyler's role as a social media and content manager is crucial in managing the online presence and content creation for Civii. This involves strategizing, creating, and curating content that resonates with the target audience, and ensuring consistent branding across various social media platforms. His expertise in this area is evident in the video as he navigates the intricacies of AI video creation and animation.

💡Double masking IP adapter workflow

The double masking IP (image prompt) adapter workflow is a technique used in the video to enhance the quality and control over the generated AI videos. It involves using two different images to guide the AI in creating a more detailed and accurate output. This workflow is showcased as Tyler walks the audience through the process of generating an AI video, emphasizing the importance of preparation and the use of imagery to achieve desired results.

💡Japanese dance troop

The Japanese dance troop mentioned in the video, Avent-gard, is used as an example of inspiration for creating AI videos. The troop is known for their synchronized dances and distinct uniforms, which Tyler uses to illustrate the potential for creating visually striking AI animations that mimic the troop's uniformity and style.

💡After Effects

After Effects is a powerful video editing and compositing software used by professionals in the film and video industry. In the context of the video, Tyler uses After Effects to mask and composite elements of the AI video, such as adding a Titan behind the running character, to create a seamless and realistic integration of different visual elements.

💡Stable diffusion

Stable diffusion is a term related to AI-generated imagery, referring to the process of refining and improving the quality of images or videos generated by AI. In the video, Tyler discusses the use of stable diffusion in the context of upscaling and enhancing the AI videos, aiming for a more polished and high-quality output.

💡Discord chat

Discord chat is a communication platform used by the Civii community to interact with each other and with Tyler during the stream. It serves as a real-time feedback channel and a way for the community to contribute ideas and suggestions for the AI video projects being discussed in the stream.

💡VFX work

VFX, or visual effects work, involves the creation and manipulation of digital images and videos to produce realistic or fantastical visuals. In the video, Tyler discusses the VFX work involved in integrating elements like the Titan and the environment into the AI videos, emphasizing the low-effort yet impactful results that can be achieved with AI.

💡IP adapter images

IP adapter images refer to the input images used to guide the AI in generating specific visuals. These images serve as prompts for the AI, helping it understand the desired look and elements to include in the final video. In the context of the video, Tyler uses IP adapter images to direct the AI in creating scenes like the 'Attack on Titan' chase and the mermaid encounter with a shark.

💡Upscaled

Upscaling refers to the process of increasing the resolution of an image or video, typically to enhance its quality and detail. In the video, Tyler discusses upscaling the AI-generated videos to improve their visual appeal and clarity, which is an important step in the post-production process.

💡Friday special guest Creator streams

The Friday special guest Creator streams are additional live sessions planned by Tyler and the Civii team, featuring different creators who specialize in various aspects of AI image and video generation. These streams aim to provide the community with a broader range of knowledge and expertise, covering diverse topics related to AI content creation.

Highlights

Tyler, the social media and content manager at Civii, hosts an AI video and animation stream on Thursdays where he showcases AI video creation and provides tips on using tools like animate diff and comfy UI.

The stream begins with an introduction and a check on audio quality with the Twitch chat, emphasizing audience engagement and technical readiness.

Tyler discusses a double masking IP adapter workflow, highlighting the importance of preparation and creativity in video production.

An example is given of a Japanese dance troupe member's video being transformed with the Attack on Titan theme using the IP adapter, demonstrating the power of imagination in video editing.

Technical details are provided on using the IP adapter images and the process of tracking the Titan to the camera for a realistic effect.

Tyler shares the results of his video work, emphasizing the effectiveness of the IP adapter and the control it offers over the final output.

The stream includes a live interaction with the Discord chat, showcasing community involvement and collaboration.

A variety of prompts are discussed, including a fire sorceress being chased by a fat warrior, showing the versatility of the AI video creation process.

Tyler explains a workflow for attention masking in Civii, which can be used to create alpha mask videos, further expanding the creative possibilities.

The stream features a real-time demonstration of the AI video creation process, including the use of images and prompts to generate unique scenes.

Tyler discusses the potential for a community-driven video project, where participants could submit their AI video creations for a collective showcase.

The importance of good prompting is emphasized, even with the use of IP adapters, as it can significantly impact the quality of the AI-generated videos.

The stream concludes with a discussion about upcoming guest streams and the potential for a video contest, highlighting the growing and dynamic AI community.