Camera Angular Position Detection Using Brightness and Acceleration Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for automatically selecting video highlights on cameras face limitations due to restricted processing power and the inability to reliably detect camera pans using noisy angular acceleration data from low-end gyro sensors.

Innovation Solution

A method that utilizes brightness and acceleration metadata to detect changes in camera angular position by selecting contiguous sets of candidate panning motion frames, determining an angular movement score, and adjusting the display of video frames based on this score, effectively classifying pans as smooth or snap pans without requiring extensive image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image analysis of individual frames is used to detect camera pans, then measurement precision improves, but use of energy and processing power requirements increase

Engineering Contradiction:
Improvecamera pan detection accuracyVSAvoidbattery consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts and uses only the necessary metadata (acceleration and brightness data) from the video stream rather than processing complete image frames. This extraction approach maintains sufficient detection accuracy while dramatically reducing computational requirements and energy consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical/computational system of full image frame analysis with a lighter metadata-based detection system. By substituting complex image processing with simpler metadata analysis, the system achieves comparable detection results with minimal energy expenditure.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If full image processing is performed to detect camera pans, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvecamera pan detection accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts essential detection information from metadata rather than processing complete images. This extraction principle simplifies the processing system by focusing only on acceleration and brightness changes that are sufficient for pan detection.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent substitutes complex image processing mechanisms with simpler metadata analysis. This replacement reduces device complexity while maintaining the core functionality of detecting camera pans through acceleration and brightness pattern recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of manufacture

If noisy acceleration data from low-end gyro sensors is used, then device cost decreases, but measurement precision deteriorates

Engineering Contradiction:
Improvecamera hardware costVSAvoidangular acceleration measurement accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent merges acceleration metadata with brightness metadata to compensate for noisy acceleration data. By combining these two data sources and analyzing their patterns together, the system achieves reliable pan detection despite using low-quality gyro sensors.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses feedback from brightness changes to validate and refine pan detection based on acceleration data. The brightness metadata provides feedback that helps filter out noise from low-quality acceleration sensors, improving overall measurement reliability.

Inventive Principle:
Principle #23Feedback

4Use of energy by moving object

If metadata-based detection is used, then use of energy decreases, but measurement precision may deteriorate

Engineering Contradiction:
Improvebattery consumptionVSAvoidcamera pan detection accuracy
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent merges acceleration metadata and brightness metadata to achieve accurate pan detection. By combining these two metadata sources and analyzing their correlated patterns, the system maintains high detection accuracy while using minimal energy compared to full image processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent substitutes full image processing with a optimized metadata analysis system that processes only essential data points. This substitution maintains sufficient measurement precision for pan detection while dramatically reducing energy consumption.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10657657B2Method, system and apparatus for detecting a change in angular position of a camera
Publication Date: 2020.05.19 CANON KK
  • US10657657B2 patent drawing
  • US10657657B2 patent drawing
  • US10657657B2 patent drawing

AI summary

A method of detecting a change in angular position of a camera. A plurality of frames captured by the camera is received, each frame being associated with brightness and acceleration metadata. The brightness metadata is associated with a frame being representative of brightness of a scene captured by the frame. A contiguous set of candidate panning motion frames is selected from the plurality of frames, based on similarity of acceleration characteristics, to determine a change of brightness metadata in the selected contiguous set of frames. An angular movement score is determined for the selected contiguous set of frames using the change of brightness metadata. A change in the angular position of the camera is detected based on the angular movement score to adjust a manner in which the plurality of frames is displayed by a display device coupled with the camera.