最好用的Midjourney新功能+GPT,AI半小时制作动态儿童绘本(最强教程) Best Midjourney feature ever make Children's book Tutorial

靜電的AI設計教室
8 Nov 202325:09

TLDRThe video script introduces two new AI functions, the style tuner by Midjourney and the updated Runway gen-2, which significantly simplify the process of creating children's picture book videos. The style tuner function enhances picture consistency, ideal for maintaining character uniformity in children's books. Runway gen-2 allows for video generation with improved fidelity and the ability to adjust camera movement within the generated videos. The tutorial demonstrates how to use these tools in combination with ChatGPT to craft a story, generate images, and produce an engaging video, exemplified by the creation of 'Mia's Wishing Tree'. The process is detailed, showing how AI can be leveraged to produce content for children's entertainment and education.

Takeaways

  • 🎨 New AI functions have simplified the creation of children's picture book videos, notably improving picture consistency.
  • 🌟 Midjourney's style tuner function allows for greater control over artistic style, enhancing character consistency in children's books.
  • 🚀 Runway gen-2 has introduced significant updates, improving the fidelity and consistency of generated video results.
  • 🎥 Users can now adjust the movement and amplitude of the lens in generated videos by Runway gen-2.
  • 📖 Static electricity demonstrated the creation of a children's picture book video named 'Mia's Wishing Tree' using AI tools.
  • 🤖 ChatGPT4 was utilized to write a short bedtime story suitable for children aged 3-6, with a focus on warmth and storytelling.
  • 🖼️ Midjourney's style tuner can generate a series of images with a consistent style by using a specific suffix in the command.
  • 📹 The combination of ChatGPT, Midjourney, and Runway Gen-2 tools streamlines the process of producing a children's picture book video.
  • 🎞️ Video editing tools like Final Cut can be used to compile and polish the final video, adding transitions, music, and subtitles.
  • 💡 AI can be leveraged to create additional income by producing short videos with a consistent and appealing style.
  • 🌐 The tutorial provided is a comprehensive guide for using AI to create engaging and stylistically consistent children's picture book content.

Q & A

  • What are the two new functions mentioned in the script that have made it easier to create children's picture book videos?

    -The two new functions mentioned are the 'style tuner' function from Midjourney, which improves picture consistency, and the updated version of Runway gen-2, which allows for better video generation and manipulation of the generated video's movement amplitude.

  • How does the style tuner function solve a common problem for designers?

    -The style tuner function solves the problem of maintaining a consistent style throughout the generated images. It allows designers to fix the style by adding a suffix to their commands, resulting in images with a consistent painting or comic style.

  • What is the significance of the Runway gen-2 update for video generation?

    -The Runway gen-2 update introduces significant improvements in the fidelity and consistency of the generated video results. It also allows users to move within the Runway lens and adjust the amplitude of the movement of a lens in the generated video, enhancing the dynamic nature of the content.

  • How long did it take the speaker to create a children's picture book video called 'Mia's Wishing Tree' using ChatGPT?

    -It took the speaker approximately one hour to create the children's picture book video 'Mia's Wishing Tree' using ChatGPT.

  • What is the process of using the style tuner function in Midjourney?

    -To use the style tuner function, one must first go to Midjourney and create a channel. Then, enter a command with a slash followed by 'tune' and add the desired style suffix. After entering the picture keywords, the system prompts to create a coordinator for the style. The user can choose to generate a certain number of picture groups and select the preferred style from each group.

  • How does the speaker use ChatGPT to assist in the creation of the children's picture book video?

    -The speaker uses ChatGPT to write a short bedtime story suitable for children aged 3-6 years old, to storyboard the article, and to generate a name for the story. ChatGPT also assists in creating the content for the storyboard by generating short paragraphs for each scene.

  • What are the steps involved in generating a video using Runway Gen-2?

    -The steps include opening Runway Gen-2, using the text2video tool, selecting the third option to use pictures and descriptions in parallel, uploading the generated pictures from Midjourney, adding related commands, adjusting the intensity of the movement and camera motion, and finally generating the video.

  • How does the speaker enhance the final video with additional elements?

    -The speaker enhances the final video by adding background music, using subtitles to generate dubbing, and including other content such as the call of birds or the cry of crickets at night to create a more immersive experience.

  • What is the moral of the story 'Mia's Wishing Tree'?

    -The moral of the story is that with kindness and bravery, all dreams can come true. Mia learns that her dreams can be realized if she approaches them with a good heart and courage.

  • What advice does the speaker give for those interested in creating similar videos?

    -The speaker advises readers to carefully follow the tutorial provided, ensuring that the production is beautiful and engaging. They also encourage users to utilize the AI tools to their full potential for creating picture books and videos that are suitable for children of all ages.

Outlines

00:00

🎨 Introducing AI Functions for Children's Picture Books

The paragraph introduces two new AI functions that simplify the creation of children's picture book videos. The first is the style tuner function from Midjourney, which improves picture consistency, crucial for character consistency in children's books. The second is the updated Runway gen-2, which now offers significant improvements in video and picture generation, including adjustable camera movement and amplitude in generated videos. The speaker shares their experience using ChatGPT to create a children's picture book video called 'Mia's Wishing Tree', highlighting the potential for monetization through short video creation.

05:01

🖌️ Utilizing the Style Tuner Function

This section provides a detailed explanation of the style tuner function, demonstrating how it addresses the issue of style inconsistency in AI-generated images. The speaker shows examples of images generated with the style tuner, explaining the process of selecting preferred styles from a set of options provided by Midjourney. The explanation includes how to use the function, the importance of choosing the right style, and the impact of adding suffixes to the commands. The speaker emphasizes the practical application of the style tuner in creating a cohesive children's picture book.

10:02

📖 Combining AI Tools for Story and Image Generation

The speaker discusses the process of using ChatGPT to write a children's story and generate a storyboard, which is then used in conjunction with Midjourney to create images based on the story's content. The paragraph outlines the steps of generating a story, selecting images, and using Midjourney's spells to create the desired pictures. The speaker also explains how to adjust the screen ratio for the images and provides a preview of the generated pictures, emphasizing the ease and simplicity of the process.

15:03

🎥 Enhancing Still Images with Runway Gen-2

This part of the script focuses on using Runway Gen-2 to add motion to the generated still images, transforming them into animated videos. The speaker guides through the process of uploading images, adding descriptions, and adjusting the intensity of movement and camera motion to create a dynamic video. The importance of keeping the movement range between 1-2 for a natural effect is highlighted. The speaker also mentions the option to reroll images if the generated result is not satisfactory and provides tips on managing points for video generation.

20:04

🎞️ Video Editing and Final Touches

The final paragraph discusses the video editing process using the generated images and videos. The speaker explains how to import the videos into a video editing tool, create transitions, and add background music to enhance the storytelling. The importance of selecting soft, soothing music appropriate for a bedtime story is emphasized. The paragraph concludes with the speaker demonstrating how to use subtitles for dubbing the story, adding final touches like sound effects, and exporting the finished video for sharing on various platforms.

Mindmap

Keywords

💡AI

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. In the context of the video, AI is used to create children's picture book videos, demonstrating its capability in generating content, designing images, and even dubbing voices for the stories.

💡Midjourney

Midjourney is an AI model used for image generation, which is highlighted in the video for its role in creating consistent and stylized images suitable for children's picture books. The video specifically mentions the 'style tuner' function, which allows for greater control over the artistic style of the generated images.

💡Runway Gen-2

Runway Gen-2 is an AI tool that has been updated to generate videos and pictures, with significant improvements in fidelity and consistency. It allows users to move within the 'Runway lens' and adjust the amplitude of movement in the generated videos, which is crucial for creating dynamic children's picture book videos.

💡Style Tuner

The style tuner is a function that enables users to control and maintain a consistent artistic style across a series of images. It is particularly useful for projects like children's picture books where character and scene consistency is important for coherence in storytelling.

💡ChatGPT

ChatGPT is an AI language model that is capable of generating human-like text based on the prompts given to it. In the video, ChatGPT is utilized to write a short bedtime story for children, complete with a storyboard, which serves as the narrative for the picture book video.

💡Children's Picture Book Video

A children's picture book video is a digital multimedia format that combines images and text from a traditional picture book with additional elements like movement and sound to create an interactive and engaging experience for children. These videos are designed to be entertaining and educational, often with the goal of helping children develop literacy skills.

💡Video Editing

Video editing is the process of manipulating and combining video clips, images, and audio to create a final product. In the context of the video, video editing involves assembling the AI-generated images and videos, adding transitions, music, and dubbing to complete the picture book video.

💡Storyboard

A storyboard is a sequence of illustrations or images displayed in the order of a narrative, often used to visualize a story before it is fully produced. In the video, the storyboard is generated by ChatGPT to outline the scenes and actions in the children's story, which then informs the creation of the AI-generated images and video sequences.

💡Consistency

In the context of the video, consistency refers to the uniformity and coherence in the visual and narrative elements of the children's picture book video. Maintaining consistency in style, character design, and storytelling is crucial for creating a cohesive and engaging experience for the viewer.

💡Dubbing

Dubbing is the process of replacing the original voice of a video with a different language or a different voiceover artist's performance. In the video, dubbing is used to add a narrated voice to the children's picture book video, enhancing the storytelling and making it more engaging for the audience.

Highlights

Midjourney has released a new model training function called the style tuner, which greatly improves picture consistency.

The style tuner function is particularly suitable for children's picture books due to its character consistency.

Runway gen-2 has also released a new version with significant updates to its video generation capabilities.

The new version of Runway gen-2 allows for adjustments in the amplitude of movement in generated videos.

AI can now simplify the process of creating children's picture book videos with improved effects.

ChatGPT was used to create a children's picture book video called 'Mia's Wishing Tree' in about an hour.

The style tuner function solves issues with style consistency in AI-generated images.

By using the style tuner, images can be generated with a specific style suffix, ensuring consistency.

The process of using the style tuner involves creating a channel on Midjourney and entering specific commands.

The style tuner allows for the generation of multiple groups of pictures, with each group having a different style.

ChatGPT4 can be used to write short bedtime stories for children, with a focus on warmth and storytelling.

The storyboard for the story can be generated and then used to create spells for image generation.

The combination of ChatGPT, Midjourney, and Runway Gen-2 can be used to produce a complete children's picture book video.

Runway Gen-2's text2video tool can transform images and descriptions into video content.

The final step in the process is editing the generated videos and adding music and dubbing to complete the picture book video.

The full version of 'Mia's Wishing Tree' demonstrates the potential of AI in creating engaging children's content.

AI tools can be used to generate e-books or videos for children's picture books, offering a popular choice for content creation.