Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

MDMZ
15 Apr 202306:52

TLDRThis tutorial video demonstrates how to use your smartphone to create immersive, cinematic camera movements with Luma AI. It guides you through the process of capturing 4K video loops from three different heights, keeping the subject centered and in frame. The video then explains how to upload the footage to Luma, where you can edit and manipulate camera movements using a browser-based editor. It also covers how to add keyframes for animation, adjust camera settings, and export the final video. Tips are provided for enhancing quality, such as using Topaz Video AI for upscaling and adding motion blur with a plugin. The video also briefly touches on using a DJI drone for scanning and combining Luma scans with other AI video tools for unique creations.

Takeaways

  • 📱 Use your phone to scan surroundings and create cinematic camera movements with Luma AI.
  • 📷 For iPhone users, use the dedicated Luma app for real-time guidelines; Android users can upload videos directly from a browser.
  • 🎥 Shoot in 4K, disable HDR and video stabilization, and use either a wide or normal focal length.
  • 🔄 Capture video in loops from three different heights: chest level, above your head, and knee level.
  • 📍 Keep your subject in frame and centered throughout the recording.
  • 🌐 After recording, upload the video to lumalabs.ai, name the project, and wait for processing.
  • 🎨 Use the browser-based editor to manipulate camera movements and access camera tools.
  • 👁️ Switch to first-person view and use preset trajectories or create custom animations with keyframes.
  • 🔄 Adjust camera settings like position, focal length, and roll to animate the camera over time.
  • 🌈 Fill in uncapture areas with a solid background color and adjust video resolution before exporting.
  • 📹 For social media, render in landscape mode and then crop and rotate the video in editing software.
  • 🚁 Use a DJI drone to scan and create FPV-like videos, and upscale the video to 4K for better quality.
  • 🤖 Combine Luma scans with other AI video tools like gen 1 from runwayml for unique effects.

Q & A

  • What is the main topic of the video?

    -The video is about how to use your phone to create FPV-like videos with cinematic camera movements in post-production using Luma AI.

  • Is there a specific app recommended for iPhone users to use with Luma AI?

    -Yes, the dedicated Luma app is recommended for iPhone users as it provides real-time guidelines.

  • Can Android users use Luma AI directly from their phones?

    -Android users can capture their videos and upload them directly to Luma from their browser.

  • What are some camera settings recommended for shooting with Luma AI?

    -It is recommended to shoot in 4K, disable HDR, and disable video stabilization. You can use either a wide or normal focal length.

  • How many different heights are suggested for capturing loops in the video?

    -Three different heights are suggested: chest level, above the head, and knee level.

  • What should you do after recording the video with your phone?

    -After recording, you should head over to lumalabs.ai, create an account, upload the video, give the project a descriptive name, and wait for it to process.

  • How can the 3D scene created by Luma AI be used after processing?

    -The 3D scene can be downloaded as an object or mesh scene for use in other 3D software, or you can edit it using a browser-based editor provided by Luma AI.

  • What are the two preset camera movement trajectories available in the Luma AI editor?

    -The two preset camera movement trajectories are 'orbit' and 'oscillate'.

  • How can you adjust the camera roll and focal length between keyframes in the Luma AI editor?

    -You can adjust the camera roll and focal length by inserting new keyframes and making the desired adjustments to the camera settings within those keyframes.

  • What is a trick mentioned in the video to maximize the output quality when exporting a vertical video?

    -You can edit each keyframe and add 90 degrees to the camera roll setting, which can be time-consuming but allows for maximizing the output quality.

  • How can you upscale a video to 4K before processing it through Luma AI?

    -You can use a tool like Topaz Video AI to upscale your video to 4K before processing it through Luma AI.

  • What AI video tool is mentioned in the video for creating unique and amazing videos in combination with Luma AI?

    -The video mentions 'gen 1' from RunwayML as an AI video tool that can be combined with Luma AI to create unique and amazing videos.

Outlines

00:00

📱 Using Phones for Cinematic Camera Movements with Luma AI

This paragraph introduces the video's main topic, which is utilizing a smartphone to scan surroundings and create cinematic camera movements in post-production using Luma AI. The video will also explore the use of a DJI drone for scanning and creating first-person view (FPV) style videos. The presenter shares tips for achieving the best quality, such as shooting in 4K, disabling HDR and video stabilization, and maintaining the subject's central position in the frame. The process involves capturing video loops from different heights and editing these in Luma's browser-based editor to manipulate camera movements. The video also credits Umar and Tarving from Product Nation for their assistance and encourages viewers to watch their behind-the-scenes footage.

05:02

🎥 Post-Production Techniques and Drone Scanning with Luma AI

The second paragraph delves into post-production techniques using Luma AI, including how to access and manipulate camera tools, work with preset trajectories, and create custom camera animations using keyframes. It discusses the process of adjusting camera settings, such as position and roll, and emphasizes the importance of applying changes to keyframes for smooth camera movement. The paragraph also addresses potential issues with environmental capture and how Luma allows users to fill in missing areas with a solid background color. Additionally, it provides a workaround for rendering vertical videos for social media platforms by editing keyframes to rotate the camera roll, thus maximizing output quality. The video concludes with a mention of using a drone for scanning and combining Luma scans with AI video tools for unique effects, and it encourages viewers to stay creative.

Mindmap

Keywords

💡FPV-Like Videos

FPV stands for 'First Person View,' which is a term used to describe videos that give the viewer the perspective as if they were the one controlling the action. In the context of this video, it refers to creating videos that mimic the immersive and dynamic perspective typically associated with FPV drone footage, but using a smartphone and Luma AI technology.

💡3D Scan

A 3D scan is the process of analyzing a real-world object or environment to collect data on its shape and appearance, which can then be used to create a three-dimensional digital model. In the video, the host demonstrates how to use a smartphone to capture the surroundings and generate a 3D scan, which is essential for creating cinematic camera movements in post-production.

💡Luma AI

Luma AI is a technology or software mentioned in the video that enables users to scan their surroundings with a phone and create cinematic camera movements in post-production. It is a key tool in the process described, allowing for the creation of professional-looking videos with consumer-grade equipment.

💡DJI Drone

A DJI Drone is a type of unmanned aerial vehicle (UAV) manufactured by the company DJI, known for its high-quality drones used in various applications, including photography and videography. In the script, the host discusses using a DJI drone to capture footage for creating FPV-looking videos, leveraging the drone's ability to maneuver and capture different perspectives.

💡4K Video

4K video refers to a resolution of 3840 x 2160 pixels, which is one of the highest resolutions available for consumer video recording. The video script recommends shooting in 4K to ensure high-quality footage that can be manipulated in post-production without significant loss of detail.

💡HDR (High Dynamic Range)

HDR is a technology that enhances the contrast between the light and dark parts of an image, allowing for a greater range of color and detail. However, the video suggests disabling HDR when shooting because it may not be compatible with the post-production process required for creating the desired 3D scan and cinematic effects.

💡Video Stabilization

Video stabilization is a feature that reduces the effects of camera shake in video footage. The script advises disabling video stabilization when recording, as the Luma AI technology will handle the stabilization in post-production to create smooth and professional-looking camera movements.

💡Loops

In the context of the video, loops refer to continuous video recordings taken from different heights while keeping the subject in frame and centered. These loops are used to capture a comprehensive 3D scan of the surroundings, which is crucial for the post-production process.

💡Browser-Based Editor

A browser-based editor is a type of software that runs within a web browser, allowing users to perform tasks like video editing without the need for desktop software. Luma AI provides a browser-based editor for users to manipulate camera movements and edit their 3D scenes after the scanning process.

💡Keyframes

Keyframes are points in an animation or video editing timeline that define the start or end of a transition or action. In the video, keyframes are used to animate the camera movement over time, creating dynamic and controlled motion in the final video output.

💡Render

To render a video means to process it into a final format that is ready for viewing or sharing. In the context of the script, rendering involves exporting the edited 3D scene with camera movements as a video file, which can then be downloaded and shared.

Highlights

Use your phone to scan surroundings and create cinematic camera movements in post-production with Luma AI.

For iPhone users, a dedicated Luma app provides real-time guidelines for easier scanning.

Android users can upload videos directly to Luma from their browser.

Shoot videos in 4K, disable HDR and video stabilization for best results with Luma AI.

Capture videos in loops from three different heights: chest level, above head, and knee level.

Keep the subject in frame and centered for consistent scanning.

Luma Labs provides detailed guidelines and best practices for video recording.

After recording, upload the video to lumalabs.ai to process and create a 3D scene.

Edit camera movements in a browser-based editor provided by Luma AI.

Use camera tools to manipulate movements and access preset trajectories like orbit and oscillate.

Create custom camera animations by setting keyframes and adjusting camera positions.

Adjust camera roll and focal length between keyframes for dynamic and interesting effects.

Luma AI allows filling uncapture environments with a solid background color.

Change video resolution before exporting for different social media platforms.

A trick to maximize output quality is editing keyframes and adding 90 degrees to the camera roll setting.

Exported videos can be edited in software like Premiere Pro for further enhancements.

Add motion blur for more realistic effects using plugins like RSMB.

Use a DJI drone with Luma AI to scan and create FPV-like videos.

Upscale videos to 4K using Topaz Video AI before processing with Luma for improved quality.

Combine Luma scans with AI video tools like Gen 1 from RunwayML for unique creations.

Casual Browsing

How To Stylize 3D Scan Videos with AI | Luma + Warpfusion

2024-04-27 08:10:01

Use Your Phone To Make Anything 3D With Luma AI!

2024-05-03 05:00:01

3D Scan your Environment with AI (Free Tool)

2024-05-03 04:05:01

Luma AI How to Achieve Cinematic Camera Moves with Your Phone

2024-05-03 05:05:01

Create 3D Video without any 3D knowledge | Luma Ai tutorial

2024-05-03 05:00:01

AI Animation Generator : Create YOUR OWN 3D Movie With AI

2024-04-16 05:55:01