Display Image Generation With Motion Prediction for High Frame Rates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating display images that reflect the motion of a real object in virtual spaces face challenges in maintaining both high-quality image quality and accurate tracking, particularly when high frame rates are required, leading to potential blurring or unnatural object motion.
Innovation Solution
A display image generation device and method that utilize state information acquisition, control, and generation sections to adjust the manipulation of state information based on elapsed time and motion speed, allowing for high-quality display images by predicting or refraining from predicting state information to match the frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If the display frame rate is set to be high, then high-quality images are expected, but the time allowed to perform the tracking process becomes short, causing deterioration in the accuracy of motion or making the object look unnatural
Solution Approach 1:
The system performs preliminary action by predicting the state information for the current frame based on the previous frame's state information before the actual tracking is complete. This prediction is done in advance to ensure that the display image can be generated with accurate motion reflection even when the tracking process does not have sufficient time due to high frame rates. The state information control section determines whether to use predicted state information or actual tracked state information, allowing the system to maintain both high image quality and accurate motion tracking.
2Productivity
If the display frame rate is increased, then the image quality is improved, but the tracking process time is reduced, leading to potential blurring or unnatural motion
Solution Approach 1:
The system performs preliminary action by predicting the state information for the current frame based on the previous frame's state information before the actual tracking is complete. This prediction is done in advance to ensure that the display image can be generated with accurate motion reflection even when the tracking process does not have sufficient time due to high frame rates. The state information control section determines whether to use predicted state information or actual tracked state information, allowing the system to maintain both high image quality and accurate motion tracking.
Solution Approach 2:
The system uses feedback by continuously monitoring the actual tracked state information and comparing it with the predicted state information. The state information control section adjusts the manipulation of state information based on the elapsed time and the situation, using feedback from the tracking process to determine whether prediction is necessary. This feedback mechanism ensures that the system can adapt to changing conditions and maintain accurate motion reflection while operating at high frame rates.
Data Source
AI summary
Provided is a display image generation device including a state information acquisition section that acquires state information regarding a target in accordance with a figure of the target in an image obtained by video capturing by an imaging device, a state information control section that determines state information to be adopted, by switching whether or not to manipulate the state information in accordance with an elapsed time according to a situation, and a display image generation section that uses the determined state information to generate a display image that includes a virtual object reflecting motion of the target.