Bullet Time Video Centering on Moving Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing technologies fail to effectively create a bullet time video centered on a moving object, as they struggle to maintain the object's focus and smooth motion across multiple camera viewpoints.
Innovation Solution
A video processing device and method that acquire viewpoint position information and time ranges for notable objects, processing input image frames to keep the object at a specific position on output frames by interpolating camera positions and correcting postures, ensuring the object remains centered despite movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the viewpoint position moves to track a moving object, then the object remains centered in the output frame, but the video smoothness and motion coherence deteriorate
Solution Approach 1:
The patent applies preliminary action by predicting the object's future position based on its motion trajectory before the viewpoint actually reaches that position. The prediction unit calculates where the object will be at a future time point, and the viewpoint position is adjusted in advance to match this predicted position, ensuring smooth transitions and maintaining video coherence while keeping the object centered.
Solution Approach 2:
The patent implements feedback through a prediction unit that continuously monitors the object's motion trajectory and adjusts the viewpoint position based on predicted future positions. This closed-loop approach uses the object's past and current motion information to feedback-adjust the viewpoint, ensuring both accurate centering and smooth video output by compensating for motion in real-time.
2Adaptability or versatility
If multiple camera viewpoints are used to image the object, then the bullet time video coverage is improved, but the complexity of processing and synchronizing the views increases
Solution Approach 1:
The patent merges multiple camera viewpoints by synthesizing them into a single coherent output frame. The synthesis unit combines image data from multiple cameras, adjusting each viewpoint's position and orientation based on the predicted object location, and integrates them into one unified output that maintains smooth motion coherence while providing comprehensive bullet time video coverage.
Solution Approach 2:
The patent introduces an intermediary prediction unit that acts as a mediator between multiple camera viewpoints and the final output. This prediction unit calculates the synthesized viewpoint position that combines information from multiple cameras, serving as an intermediary reference that simplifies the processing by providing a single target position for all camera views to align with.
3Measurement precision
If the viewpoint position is adjusted frequently to track the object, then the object remains centered, but the computational load and processing time increase
Solution Approach 1:
The patent reduces processing time by performing preliminary calculations of the object's motion trajectory and future positions. The prediction unit computes anticipated object locations in advance based on current motion patterns, allowing the system to pre-determine viewpoint adjustments rather than calculating them in real-time, thus reducing computational load while maintaining high tracking accuracy.
Solution Approach 2:
The patent uses feedback efficiently by implementing a prediction mechanism that leverages past motion data to anticipate future positions. This reduces the need for frequent real-time calculations, as the system feedback-adjusts viewpoints based on predicted trajectories rather than continuously recomputing positions, thereby reducing processing time while maintaining precise tracking.
Data Source
AI summary
The present technology relates to a video processing device, a video processing method, and a program for providing a bullet time video centering on a moving object. The video processing device acquires view point position information indicating the range of movement of a view point position for an object in an input image frame where the object is imaged in chronological order at multiple different view point positions. Time information indicates a time range in the chronological order of imaging the input image frame. The device processes the input image frame such that the object is at a specific position on an output image frame when the view point position moves within the time range indicated by the time information and the view point position movement range indicated by the view point position information.