Auto-Cinematography Using Directorial Hints for 3D Animation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing auto-cinematography systems lack diversity and fail to fully meet user expectations as they do not effectively incorporate directorial inputs, leading to a lack of stylization and user-oriented interaction in video generation.

Innovation Solution

A method and system that translate directorial hints into camera configurations and editing optimizations using a graph model, allowing users to input subjective preferences and adjust camera sequences, enabling personalized video production in 3D animation environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If existing auto-cinematography systems generate camera sequences automatically following cinematic rules, then the video generation process is autonomous, but the videos lack diversity and cannot express user individualized visions

Engineering Contradiction:

Improveautonomous camera sequence generationVSAvoiduser vision expression

Core Design Contradiction:

Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent introduces directorial hints as an intermediary between user intent and automatic camera sequence generation. These hints serve as a mediator that translates subjective user visions into constraints and objectives for the autonomous cinematography system, allowing both automation and user expression to coexist

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically adjusts the balance between autonomous generation and user control by incorporating directorial hints at multiple stages of the cinematography process. The camera sequence generation becomes adaptive, responding to user preferences while maintaining automated operation

Inventive Principle:

Principle #15Dynamics

2Adaptability or versatility

If users modify delicate details to achieve stylization according to directorial input, then the video reflects user ideas, but the process requires extensive user experience and time

Engineering Contradiction:

Improvedirectorial stylizationVSAvoiduser experience requirement

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent performs preliminary action by automatically generating multiple candidate camera sequences that incorporate directorial hints before presenting options to the user. This preliminary processing reduces the user's workload by preparing refined alternatives rather than requiring users to manually adjust every detail

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system changes parameters by translating directorial hints into quantitative constraints and optimization objectives. This transforms subjective artistic intentions into measurable parameters that guide the automatic camera sequence generation, making stylization accessible without requiring deep technical expertise

Inventive Principle:

Principle #35Parameter changes

3Manufacturing precision

If manual camera configuration is used in movie making, then precise control over camera sequences is achieved, but the process is time-consuming and requires tremendous expertise

Engineering Contradiction:

Improvecamera configuration controlVSAvoidcamera configuration time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements self-service by enabling the cinematography system to automatically configure camera sequences based on directorial hints and cinematic rules. The system serves itself by making autonomous decisions about camera positioning, movement, and timing, eliminating the need for manual expert intervention while maintaining precision

Inventive Principle:

Principle #25Self-service

4Reliability

If existing systems focus on making correct camera sequences following cinematic rules, then technical correctness is achieved, but user communication and diversity are neglected

Engineering Contradiction:

Improvecinematic rule complianceVSAvoiduser communication

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces feedback mechanisms where directorial hints from users are incorporated into the camera sequence generation process. The system responds to user preferences and adjusts the generated sequences accordingly, creating a feedback loop that maintains cinematic correctness while adapting to user communication

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11120638B2Director hint based auto-cinematography

Publication Date: 2021.09.14 TCL TECHNOLOGY GROUP CORPORATION

AI summary

A method of generating video in three-dimensional animation environment is provided. The method includes: obtaining and translating directorial hints for making a 3D animated movie based on user input; determining camera configurations in a 3D environment according to the directorial hints; establishing a camera search space that includes multiple candidate cameras to be used at different timestamps to shoot one or more scenes of the movie based on the camera configurations; performing editing optimization based on the camera search space and the directorial hints, to obtain an edited video. The editing optimization is formalized into a process of finding a path with minimum cost in a graph model, each path describing a candidate camera sequence for producing the movie, and at least some of the directorial hints are translated into cost functions of the graph model. The edited video is output as the produced 3D animated movie.