Stereoscopic Display Control via Real Camera Pose Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods struggle to intuitively capture and reproduce the appearance and texture of virtual objects displayed stereoscopically due to difficulties in setting imaging trajectories, making it cumbersome to set a virtual camera in a virtual space.
Innovation Solution
A display control device that acquires position and posture information from an input apparatus in a real space, extracts part of the virtual content displayed stereoscopically, and generates video content based on this information, allowing intuitive control over virtual object display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual camera is set in a virtual space to capture virtual objects, then imaging can be performed, but it is troublesome to set an imaging trajectory and difficult to intuitively perform setting since imaging cannot be performed while actually viewing an object
Solution Approach 1:
The patent uses the real camera's position and posture information to copy the imaging trajectory in the virtual space. Instead of manually setting a virtual camera, the system automatically replicates the real camera's movement path and viewing angles in the virtual environment, enabling intuitive imaging without complex virtual camera configuration
Solution Approach 2:
The patent introduces position and posture information as an intermediary between the real camera and virtual camera. This information acts as a mediator that transfers the real camera's spatial parameters to control the virtual camera, allowing the user to capture virtual objects intuitively through real camera operations without directly configuring virtual camera settings
2Reliability
If a camera in the real space captures a stereoscopically displayed virtual object, then recording is possible, but it is difficult to reproduce the appearance and texture of the virtual object due to the principle of display
Solution Approach 1:
The patent copies the virtual object's rendering information from the stereoscopic display and combines it with real camera capture data. By replicating the virtual object's appearance characteristics and texture information into the captured image, the system overcomes the limitations of direct photographic capture and achieves accurate reproduction of virtual object properties
Solution Approach 2:
The patent merges real camera capture data with virtual object rendering information. By combining the actual captured image with synthesized virtual object appearance data, the system produces a composite result that faithfully reproduces the virtual object's appearance and texture while maintaining the benefits of real-space capture
3Adaptability or versatility
If virtual content is stereoscopically displayed to function like real objects, then 3D content creation is enhanced, but it becomes troublesome to control display of virtual content for capture and recording
Solution Approach 1:
The patent implements feedback by using the real camera's position and posture information to automatically adjust and control the virtual camera's display parameters. This closed-loop approach allows the system to respond to the user's actual capture actions, automatically configuring the virtual content display to match the desired viewing angle and trajectory without manual intervention
Solution Approach 2:
The system performs self-service by automatically controlling the virtual camera based on real camera data. The virtual content display is autonomously adjusted according to the captured imaging parameters, eliminating the need for manual configuration and enabling the system to serve itself in coordinating between real-space capture and virtual-space display
Data Source
AI summary
A display control device (100) according to an aspect of the present disclosure includes an acquisition unit (131) that acquires position and posture information about an input apparatus located in a real space, an extraction unit (133) that extracts, from virtual content stereoscopically displayed in the real space by a stereoscopic display, part of the virtual content in a virtual space based on the position and posture information about the input apparatus, and a generation unit (134) that generates video content based on information extracted by the extraction unit.