Action Camera Virtual Tracking via Infrared Face Detection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image pickup apparatuses require manual direction changes and are cumbersome, making it difficult for users to focus on experiences while capturing images, especially when using action cameras or wide-angle celestial sphere cameras, which often result in distorted images and increased workload for users.

Innovation Solution

An image pickup apparatus with an observation direction detection unit worn on the body, an image pickup unit on the body, and a recording direction determination unit that automatically adjusts the image pickup direction based on the user's detected observation direction, allowing for hands-free operation and reduced distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a camera is fixed to the head using a fixing-to-head accessory, then the user can perform image pickup without being occupied with the operation, but the user feels uneasy about the accessory and camera due to their weights and appearance is bad

Engineering Contradiction:

Improvehands-free image pickup operationVSAvoidweight of fixing-to-head accessory and action camera

Core Design Contradiction:

Ease of operationVSWeight of moving object

Solution Approach 1:

The patent uses an infrared camera to capture the user's face image and creates a virtual copy of the camera mounted on the face. This virtual camera then tracks and follows the user's head movements to automatically adjust the pickup direction, eliminating the need for physical fixing-to-head accessories while maintaining hands-free operation capability

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical fixing-to-head accessory system with a computational approach using infrared face recognition and image processing algorithms. The system substitutes physical mechanical mounting with digital virtual camera technology that runs on a smartphone or computing device

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If an entire-celestial-sphere camera is used to pick up images in a wide area, then the user can focus attention on their experience, but the picked-up images are distorted and require series of operations such as image conversion and extraction position designation

Engineering Contradiction:

Improvefocus attention on experience during image pickupVSAvoidimage conversion and extraction position designation operations

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system creates a virtual camera that replicates the function of a physical camera but operates through software algorithms. This virtual camera captures images through the smartphone's camera and applies distortion correction, perspective transformation, and object extraction algorithms to automatically generate undistorted images without requiring manual post-processing operations

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent applies image processing parameter transformations including perspective transformation, distortion correction coefficients, and coordinate system conversions to convert wide-angle distorted images into undistorted natural-view images. The system automatically adjusts these parameters based on detected object positions and camera angles

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If the user manually directs the camera toward the object, then the image pickup direction can be controlled, but the user cannot focus on experiences because they are busy with image pickup operation

Engineering Contradiction:

Improveimage pickup direction controlVSAvoidtime spent on image pickup operation

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system continuously captures the user's face image via infrared camera, detects head orientation and gaze direction, and uses this feedback to automatically adjust the virtual camera's pickup direction. This closed-loop feedback system maintains precise directional control without requiring manual intervention, freeing the user to focus on their experience

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The virtual camera system serves itself by automatically tracking the user's head movements and independently adjusting its own pickup direction based on detected face orientation. The system performs self-correction and self-adjustment without external manual control, eliminating the need for user operation during image pickup

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS11849205B2Image pickup apparatus used as action camera

Publication Date: 2023.12.19 CANON KK

AI summary

An image pickup apparatus capable of eliminating a manual change of an image pickup direction and of easily obtaining an image while focusing attention on experience. A detection unit is worn on a body part other than a head of a user and detects an observation direction of the user. An image pickup unit is worn on the body part and picks up an image. A determination unit determines a recording direction in accordance with the observation direction. An image recording unit records an image corresponding to the recording direction from among a picked-up image. The detection unit and the image pickup unit are located on a user's median plane and under a user's jaw in a worn state where the user wears the image pickup apparatus. The detection unit is located at a nearer position to the jaw than the image pickup unit in the worn state.