Sweep Motion Direction Estimation in Image-Capturing Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capturing devices require user input to determine the direction of a sweep motion for panorama creation, which can frustrate the user experience and clutter the user interface.

Innovation Solution

Incorporating motion-estimating devices like gyroscopes and accelerometers to automatically estimate the direction of a sweep motion based on motion data and visual data, with a processing system that selects the most confident direction without user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If user input is required to determine sweep motion direction, then the system can accurately determine the direction, but the user interface is cluttered and user experience is frustrated

Engineering Contradiction:
Improvesweep motion direction determination accuracyVSAvoiduser interface simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically determines sweep motion direction using motion sensors and image analysis without requiring user input. The processing system estimates direction from motion data and image sequences, selecting the most confident direction automatically, thereby eliminating the need for user interface interactions while maintaining accurate direction determination

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical/user-based direction input method with automated sensor-based detection. Motion sensors (gyroscope, accelerometer) and image processing algorithms substitute for manual user input, enabling automatic direction estimation without user interface clutter

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If automated direction estimation is implemented, then user interface is simplified and user experience is enhanced, but the system complexity increases

Engineering Contradiction:
Improveuser interface simplicityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The processing system performs multiple functions: it processes motion sensor data, analyzes image sequences, estimates sweep motion direction, and selects the most confident direction. By consolidating these functions in a single processing system, the patent avoids the need for separate dedicated components for each function, thereby managing system complexity while achieving automated operation

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary processing system that mediates between raw sensor data/images and the final direction determination. This intermediary layer integrates motion data and image analysis results, comparing confidence levels to select the most reliable direction, thereby simplifying the user interface while managing computational complexity through structured processing

Inventive Principle:
Principle #24Intermediary (Mediator)

3Extent of automation

If motion sensors and image analysis are used for automatic direction estimation, then the system can operate without user input, but the computational processing requirements increase

Engineering Contradiction:
Improveautomatic direction estimation capabilityVSAvoidcomputational processing energy
Core Design Contradiction:
Extent of automationVSUse of energy by moving object

Solution Approach 1:

The system performs partial image analysis and motion data processing to estimate direction, rather than processing all available data exhaustively. By using motion sensors to provide preliminary direction cues and then performing targeted image analysis to confirm or adjust the estimate, the system achieves automated operation while reducing overall computational energy consumption compared to complete brute-force analysis

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user experience by eliminating the need for user input, reducing interface clutter, and enabling seamless and geometrically consistent panorama creation in real-time.

Implementation Method 1

an angular evidence function being associated with values from a gyroscope

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Implementation Method 2

a linear acceleration evidence function being associated with values from an accelerometer

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentUS9749524B1Methods and systems for determining a direction of a sweep motion
Publication Date: 2017.08.29 APPLE INC
  • US9749524B1 patent drawing
  • US9749524B1 patent drawing
  • US9749524B1 patent drawing

AI summary

In one embodiment, an image-capturing device includes a camera, one or more motion-estimating devices to detect motion data for the device, and a processing system which is configured to automatically estimate a first direction of a sweep motion of the image-capturing device based on the motion data. The processing system is further configured to automatically estimate a second direction of the sweep motion of the image-capturing device based on images captured by the image-capturing device and to automatically select the first direction or the second direction of the sweep motion.