Body-Worn Observation Direction Detection for Action Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup systems for action cameras face challenges in maintaining a consistent image pickup direction without distracting the user, and existing solutions either require cumbersome head-mounted equipment or suffer from inaccuracies in detecting the user's observation direction.

Innovation Solution

An image pickup apparatus with a body-worn observation direction detection unit, image pickup unit, recording direction determination unit, and deviation detection unit that allows for easy recording of experiences by determining and adjusting the image pickup direction based on the user's observation direction and body position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a camera is fixed to the head of a user using a fixing-to-head accessory, then the user can perform an image pickup operation without being occupied with the image pickup operation, but the user finds it troublesome to equip the head with the action camera and finds it difficult to focus attention on the experience

Engineering Contradiction:
Improveimage pickup operationVSAvoidhead mounting procedure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system separates the observation direction detection function from the image pickup function. The observation direction detection unit is worn on the body (separated from head mounting), while the image pickup unit captures images based on detected observation directions, eliminating the need for head-mounted cameras

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The observation direction detection unit acts as an intermediary between the user's observation direction and the image pickup unit. It detects the user's observation direction and transmits this information to control the image pickup apparatus, enabling hands-free operation without head mounting

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If an entire-celestial-sphere camera is used to pick up an image in a wide area, then the user can focus attention on their experience during the image pickup operation, but the user needs to extract a necessary part from the entire celestial sphere image and edit it, which puts heavy burden on the user

Engineering Contradiction:
Improveimage pickup operationVSAvoidimage extraction and editing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary action by automatically extracting and recording only the necessary image portions during the image pickup process. The control unit identifies and extracts images in the observed direction based on observation direction detection, so the user receives pre-processed images without needing post-editing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image pickup apparatus performs self-service by automatically selecting and recording relevant images based on the user's observation direction. The system autonomously determines which images to record without requiring user intervention for extraction or editing

Inventive Principle:
Principle #25Self-service

3Measurement precision

If a second camera that picks up a user is used to calculate moving direction and visual-line direction, then the image pickup direction can be determined based on user's viewpoint and state, but the second camera needs high optical performance and high arithmetic processing capability, making the apparatus scale large

Engineering Contradiction:
Improveobservation direction detection accuracyVSAvoidapparatus scale
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system replaces the mechanical/optical second camera approach with an inertial measurement unit (IMU) that uses accelerometers and gyroscopes to detect observation direction. This substitution reduces optical performance requirements and decreases apparatus scale while maintaining measurement precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the detection parameters by using motion parameters (acceleration, angular velocity) from the IMU instead of visual parameters from a second camera. This parameter change enables observation direction detection with simpler, smaller components

Inventive Principle:
Principle #35Parameter changes

4Measurement precision

If a sensor device consisting of a gyro sensor or acceleration sensor is attached to the user's head to detect observation direction, then the user's observation direction can be detected, but the user needs to equip the head with the sensor device which cannot solve troublesomeness in attaching any device to the head, and accuracy of detection of absolute observation direction especially in horizontal rotation direction cannot be obtained

Engineering Contradiction:
Improveobservation direction detection accuracyVSAvoiddevice attachment
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system segments the detection functions across multiple body locations. The IMU detects relative motion, while the camera captures images. By combining data from both locations, the system achieves accurate absolute observation direction detection without requiring head-mounted sensors

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The body-worn observation direction detection unit serves as an intermediary that combines IMU data with camera positioning information. This intermediary system compensates for the lack of absolute direction detection by using the camera's known position and orientation relative to the body

Inventive Principle:
Principle #24Intermediary (Mediator)

5Ease of operation

If the image pickup apparatus is worn on the body, then the weight is distributed and user fatigue is reduced, but the image pickup direction may deviate from the user's observation direction

Engineering Contradiction:
Improveuser fatigue reductionVSAvoidimage pickup direction accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system implements feedback by continuously detecting the user's observation direction and using this information to adjust the image pickup direction. The control unit modifies the image pickup apparatus orientation based on real-time observation direction detection, ensuring accurate image capture despite body-worn positioning

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies dynamics by making the image pickup direction adjustable and responsive to user movement. The image pickup apparatus dynamically changes its observation direction based on detected user observation direction, allowing accurate image capture while maintaining comfortable body-worn positioning

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11849217B2Image pickup apparatus used as action camera, calibration system, control method for image pickup apparatus, and storage medium storing control program for image pickup apparatus
Publication Date: 2023.12.19 CANON KK
  • US11849217B2 patent drawing
  • US11849217B2 patent drawing
  • US11849217B2 patent drawing

AI summary

An image pickup apparatus that is capable of eliminating change of an image pickup direction by a user during an image pickup operation and of easily obtaining an image that records experience while focusing attention on the experience. An observation direction detection unit is worn on a body part other than a head of a user and detects an observation direction of the user. An image pickup unit is worn on a body and picks up an image. A recording direction determination unit determines a recording direction using a detection result of the observation direction detection unit. A deviation detection unit detects a deviation of the image pickup apparatus with respect to the body. An image recording unit records a part of the image picked up by the image pickup unit in a recording area that is determined in accordance with the recording direction and the deviation.