Real-Time Motion Estimation Using Compressed Video Encoder Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for motion estimation in video processing are computationally expensive and impractical for real-time applications, especially on lower power devices like mobile computers, particularly when dealing with resolutions greater than 320×240 pixels, and are inefficient in detecting objects in videos with multiple moving objects and background transformations.
Innovation Solution
A method that compresses raw video using a compression algorithm, parses the compressed video to identify moving objects by evaluating motion information across blocks, and uses a video encoder with a motion estimation component to determine motion vectors, allowing for efficient detection of objects and features in real-time video streams, even on robotic devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional motion estimation methods are used on raw video, then motion detection accuracy is improved, but computational complexity and energy consumption increase significantly
Solution Approach 1:
The video encoder performs motion estimation and compression on video frames before the motion detection algorithm processes them. By pre-processing the video data and extracting motion information during encoding, the system avoids performing computationally expensive motion estimation on high-resolution raw video, thereby reducing energy consumption while maintaining detection accuracy.
Solution Approach 2:
The patent introduces compressed video data as an intermediary between the video source and the motion detection algorithm. Instead of directly processing raw video frames, the system uses the compressed representation which contains encoded motion information, reducing the computational burden on the detection algorithm while preserving essential motion characteristics.
2Measurement precision
If motion estimation is performed on high resolution video, then detection precision is improved, but processing time increases making real-time operation impractical
Solution Approach 1:
The video encoder performs motion estimation and compression on video frames before the motion detection algorithm processes them. By pre-processing the video data and extracting motion information during encoding, the system avoids performing computationally expensive motion estimation on high-resolution raw video, thereby reducing processing time while maintaining detection accuracy.
3Measurement precision
If extensive processing of raw video is performed, then object identification accuracy is improved, but processing efficiency deteriorates
Solution Approach 1:
The patent introduces compressed video data as an intermediary between the video source and the motion detection algorithm. Instead of directly processing raw video frames, the system uses the compressed representation which contains encoded motion information, reducing the computational burden on the detection algorithm while preserving essential motion characteristics for accurate object identification.
Data Source
AI summary
A data processing apparatus may use a video encoder in order to extract motion information from streaming video in real time. Output of the video encoder may be parsed in order to extract motion information associated with one or more objects within the video stream. Motion information may be utilized by e.g., an adaptive controller in order to detect one or more objects salient to a given task. The controller may be configured to determine a control signal associated with the given task. The control signal determination may be configured based on a characteristic of an object detected using motion information extracted from the encoded output. The control signal may be provided to a robotic device causing the device to execute the task. The use of dedicated hardware video encoder output may reduce energy consumption associated with execution of the task and/or extend autonomy of the robotic device.