Video Encoder Motion Vector Search Using Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Real-time video encoding is resource-intensive due to the time-consuming process of searching for matching blocks between video frames, as the direction and distance of matching blocks are unknown, leading to inefficient motion estimation and compression.
Innovation Solution
Incorporating motion sensory components like accelerometers and gyroscopes to classify camera motion, which assists in limiting the search area for motion vectors and optimizing the encoding process by providing motion information to constrain the search for matching blocks, thereby reducing computational overhead and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a comprehensive search process is performed to compare current frame blocks with neighboring frame blocks for motion estimation, then encoding accuracy is improved, but processing time and computational resources increase significantly
Solution Approach 1:
The patent applies preliminary action by using motion information from the imaging device (accelerometer and gyroscope data) to predict the likely direction and magnitude of block movement before the actual search process begins. This pre-computation of motion constraints narrows the search space, allowing the encoder to achieve accurate motion estimation without performing an exhaustive search across all neighboring blocks, thereby reducing processing time while maintaining encoding accuracy
2Measurement precision
If a comprehensive search process is performed to compare current frame blocks with neighboring frame blocks, then encoding accuracy is improved, but computational resources and power consumption increase
Solution Approach 1:
The patent uses motion sensors to pre-determine the direction and distance constraints for block matching before the computational search begins. By establishing these constraints in advance based on physical motion data, the system avoids performing unnecessary comparisons in directions or distances where motion is unlikely to occur, significantly reducing the number of computational operations required and thereby lowering power consumption while maintaining accurate motion estimation
3Productivity
If motion information from imaging device is used to constrain the search area for motion vectors, then encoding efficiency is improved, but device complexity increases
Solution Approach 1:
The patent introduces motion information from the imaging device as an intermediary that bridges the physical motion of the camera and the digital encoding process. This motion data acts as a mediator that provides constraints for the search process without requiring complex algorithms or additional hardware beyond the existing motion sensors, thereby improving encoding efficiency while adding minimal device complexity
Solution Approach 2:
The imaging device's existing motion sensors (accelerometer and gyroscope), which are already present for other functions, are utilized to provide motion information for encoding purposes. This self-service approach allows the system to leverage existing components to improve encoding efficiency without adding significant new hardware or complexity to the device
Data Source
AI summary
Embodiments of the present application use motion information of an imaging device in encoding video or image frames captured by the imaging device. In one embodiment, a video encoding system that processes image data captured by an image sensor comprises at least one encoder that receives motion information describing motion of the imaging sensor during capturing of the image data and that encodes the image data with assistance of the motion information.