3D Video Reproduction Apparatus Viewer-Adaptive Frame Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D video reproduction methods fail to provide an interactive experience, as the 3D object's motion does not react to the viewer's actions, leading to a decline in immersion.
Innovation Solution
A video reproduction apparatus and method that acquires multiple 3D shape videos from different viewpoints and switches frames based on the viewer's state, allowing the 3D object's motion to change interactively in response to the viewer's actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If a 3D shape video is generated using actual video of a subject from multiple viewpoints, then the viewer experiences an immersive feeling as if the subject existed closer to the viewer, but the 3D object merely indicates a predefined motion irrespective of the viewer's actions, causing a decline in the degree of immersion
Solution Approach 1:
The patent applies dynamics by switching from a static predefined motion to a dynamic motion that adapts to the viewer's actions. The 3D object's motion is no longer fixed but changes based on real-time detection of viewer position and actions, making the system responsive and adaptive to viewer interactions.
Solution Approach 2:
The patent implements feedback by detecting the viewer's actions and position, then using this information to adjust the 3D object's motion accordingly. The system continuously monitors viewer behavior and provides responsive feedback through modified object motion, creating an interactive loop that enhances immersion.
2Productivity
If the 3D object follows a predefined motion pattern, then the video generation process is simple and efficient, but the object cannot react to viewer operations, impairing the degree of immersion
Solution Approach 1:
The patent applies preliminary action by pre-generating multiple 3D shape videos with different motion patterns before playback. During reproduction, the system selects and switches between these pre-prepared videos based on viewer actions, avoiding the need to generate motions in real-time while still providing interactive responsiveness.
Solution Approach 2:
The system transitions from a static single-motion approach to a dynamic multi-motion approach. Multiple 3D shape videos with different motion patterns are prepared in advance, and the system dynamically selects which video to display based on real-time viewer detection, maintaining both efficiency and interactivity.
3Adaptability or versatility
If multiple 3D shape videos are prepared for switching, then the interactive reaction to viewer actions is improved, but the device complexity increases due to the need to manage and switch between multiple video frames
Solution Approach 1:
The patent applies segmentation by dividing the 3D shape video into multiple segments or frames, each representing different motion patterns. This segmentation allows the system to manage complexity by treating each segment as an independent unit that can be selectively activated based on viewer actions, rather than managing a single complex continuous video.
Solution Approach 2:
The patent uses preliminary action by pre-organizing multiple 3D shape videos with different motion patterns before playback. The switching logic and video selection are prepared in advance, allowing the reproduction device to simply select from pre-organized options rather than making complex decisions in real-time, thereby reducing operational complexity.
Data Source
AI summary
There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like.