Camera Motion Compensation via Bitstream Embedding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera motion compensation methods, such as Optical Image Stabilization (OIS) and Electronic Image Stabilization (EIS), face limitations in real-time processing and differentiation between unintended and intended camera motion, leading to suboptimal image stabilization, especially during playback or re-encoding.
Innovation Solution
A system that includes motion sensors, a first circuit to record and process camera motion samples, and a second circuit to embed this information within a bitstream carrying image data, allowing for more sophisticated processing and improved image quality during playback or re-encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If real-time processing is used for camera motion compensation, then processing speed is improved, but processing sophistication and image quality deteriorate
Solution Approach 1:
The patent applies preliminary action by recording motion samples during image capture and embedding this motion information in the bitstream for later use. This allows sophisticated motion compensation to be performed during playback or re-encoding rather than in real-time, enabling higher quality processing without speed constraints. The motion data is prepared in advance and made available for enhanced post-processing algorithms.
2Reliability
If conventional EIS cropping is used to stabilize images, then unintended motion is corrected, but image content and resolution are lost
Solution Approach 1:
The patent uses motion sample information as an intermediary between the captured image data and the stabilization process. Instead of directly cropping the image (conventional EIS), the embedded motion data serves as a mediator that enables sophisticated motion compensation algorithms to reconstruct stabilized images while preserving more of the original image content and allowing for better differentiation between intentional and unintentional motion.
3Adaptability or versatility
If motion information is embedded in bitstream, then processing sophistication is improved, but data transmission volume increases
Solution Approach 1:
The patent extracts and embeds only the essential motion information from the motion sensors into the bitstream, rather than transmitting complete raw sensor data or unprocessed motion compensation results. This selective extraction of critical motion parameters enables sophisticated processing capabilities while minimizing the additional data volume introduced into the bitstream.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables better decision-making and more advanced image stabilization by carrying original and corrected motion information in the bitstream, improving image quality and allowing for extended range correction beyond real-time limitations.
Implementation Method 1
The unintended motion can be measured, for instance, using gyroscopic or inertial sensors 12
Data Source
AI summary
An apparatus including one or more motion sensors, a first circuit, and a second circuit. The one or more motion sensors may be configured to generate motion samples representing motion of a camera. The first circuit may be configured to record a plurality of the motion samples from the one or more motion sensors while capturing image data with the camera. The second circuit may be configured to transfer information about the motion of the camera based on the plurality of motion samples. The information about the motion of the camera may be transferred within a bitstream carrying the image data captured by the camera.