3D Model Display Control via Subject Gaze Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D video generation methods cannot cause 3D objects to perform interactive motions or reactions in response to observer movements, lacking immersion and engagement.
Innovation Solution
An information processing device with a control unit and detection unit that changes the display mode of a 3D model based on detected features of a subject, such as line-of-sight direction, allowing the 3D model to interactively respond to the observer's motions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional 3D video generation methods are used, then a 3D video can be generated using actual video of a subject, but the generated 3D object cannot perform interactive motion or reaction in response to observer movement
Solution Approach 1:
The system detects the observer's head motion and eye gaze direction, then feeds this information back to control the 3D object's motion and reaction. The detection unit captures observer state, and the control unit adjusts the 3D model's display mode accordingly, creating a closed-loop interactive system that enables natural interaction between the observer and the virtual subject.
2Illumination intensity
If the 3D model displays fixed motion patterns, then the system is simple to implement, but the observer cannot experience immersion or presence as if the subject is close by
Solution Approach 1:
The system transitions from static, pre-programmed 3D model animations to dynamic, real-time adaptive motion control. The 3D model's display mode changes dynamically based on the observer's actual head position and gaze direction, allowing the virtual subject to naturally follow and respond to the observer's movements, thereby creating an immersive experience.
Solution Approach 2:
The 3D model autonomously adjusts its own motion and reaction based on detected observer state without requiring manual intervention. The control unit automatically modifies the 3D model's behavior in response to the detection unit's input, enabling the system to self-regulate and maintain natural interaction.
3Ease of operation
If the 3D model responds to observer motion in real-time, then user engagement is enhanced, but the detection and control precision requirements increase
Solution Approach 1:
The system performs preliminary detection of the observer's head motion and eye gaze direction before the actual interaction occurs. By anticipating the observer's intended gaze direction based on head movement trends, the system can pre-adjust the 3D model's motion preparation, ensuring smooth and timely responses without requiring ultra-high precision detection at the moment of interaction.
Data Source
AI summary
A subject feature detection unit (53) (detection unit) of a mobile terminal (80) (information processing device) detects a line-of-sight direction (E) (feature) of a subject (92) displayed simultaneously with a 3D model (90M) in a captured image (I). Then, the display control unit (54) (control unit) changes a line-of-sight direction (F) (display mode) of the 3D model (90M) so that the 3D model (90M) faces the camera (84) in accordance with the line-of-sight direction (E) of the subject (92) detected by the subject feature detection unit (53).