Video Encoding Quantization Parameter Adjustment via Motion Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding techniques face challenges in selecting an optimal quantization parameter (QP) due to hardware limitations, which affects video compression bit rate and quality, especially when estimating frame motion requires looking ahead to multiple future or prior frames.

Innovation Solution

The use of motion-sensing circuitry, such as accelerometers and location-sensing circuitry, to determine the quantization parameter for video encoding based on detected physical motion of the electronic device, allowing for real-time adjustment of QP without needing to examine large numbers of future or prior frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the encoder examines multiple future or prior frames to predict motion and select QP, then the video encoding quality is improved, but the device complexity and processing time increase due to hardware limitations

Engineering Contradiction:
Improvevideo encoding qualityVSAvoidhardware complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent introduces motion-sensing circuitry as an intermediary device that physically senses motion of the electronic device and converts it into motion information. This intermediary provides motion data directly to the encoder without requiring the encoder to examine multiple video frames, thereby improving encoding quality while reducing device complexity and processing burden

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/frame-based motion analysis system with a sensing-based system. Instead of using the encoder to mechanically examine multiple frames to detect motion, the system uses dedicated motion-sensing circuitry to detect physical motion and provide this information directly to the encoder, simplifying the overall system architecture

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the encoder looks ahead to multiple frames to select proper QP, then the quantization accuracy is improved, but the latency increases due to buffering requirements

Engineering Contradiction:
Improvequantization parameter selection accuracyVSAvoidencoding latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The motion-sensing circuitry continuously monitors and detects physical motion of the electronic device in advance, providing motion information to the encoder before encoding is needed. This preliminary detection eliminates the need to buffer and examine multiple frames to determine motion, reducing encoding latency while maintaining accurate QP selection

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The motion-sensing circuitry autonomously detects and provides motion information without requiring the encoder to perform frame analysis. The sensing system serves itself by directly outputting motion data that the encoder can use immediately, eliminating the time-consuming frame examination process

Inventive Principle:
Principle #25Self-service

3Quantity of substance

If a larger QP is used for compression, then the bit rate is reduced, but the image quality deteriorates when the source frame is complex

Engineering Contradiction:
Improvebit rateVSAvoidimage quality
Core Design Contradiction:
Quantity of substanceVSManufacturing precision

Solution Approach 1:

The patent dynamically adjusts the QP parameter based on real-time motion information from the motion-sensing circuitry. When motion is detected indicating complex scenes, the system automatically selects smaller QP values to maintain image quality. When no motion is detected indicating simple scenes, the system uses larger QP values to reduce bit rate, achieving adaptive optimization of both quality and compression

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9300969B2Video storage
Publication Date: 2016.03.29 APPLE INC
  • US9300969B2 patent drawing
  • US9300969B2 patent drawing
  • US9300969B2 patent drawing

AI summary

Systems, methods, and devices for encoding video data are provided. For example, an electronic device for obtaining and encoding video may include image capture circuitry, motion-sensing circuitry, and data processing circuitry. The image capture circuitry may capture an uncompressed video frame, and the motion-sensing circuitry may detect physical motion of the electronic device. The data processing circuitry may encode the uncompressed video frame based at least in part on a quantization parameter, which the data processing circuitry may determine based at least in part on whether the motion-sensing circuitry has detected physical motion of the electronic device.