Wearable Camera Module Stabilization via Gaze and Motion Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable augmented reality devices face challenges in capturing images without shaking due to the movement of the device when worn on the user's head, leading to degraded image quality.

Innovation Solution

An electronic device equipped with a camera module, eye-tracking sensor, and motion sensor, where a processor determines the photographing direction based on gaze information and motion information to adjust the camera module's orientation, ensuring images are captured without shaking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the camera module is fixed in the augmented reality device worn on the user's head, then the device structure is simple, but the captured image shakes due to device movement

Engineering Contradiction:
Improvedevice structureVSAvoidimage stability
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The camera module is designed to be rotatable relative to the housing, allowing dynamic adjustment of the photographing direction. The processor controls the camera module to rotate in response to detected motion, transforming the static camera into a dynamic system that can compensate for device movement and maintain stable image capture.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the camera module rotates to compensate for device movement, then image stability is improved, but the device complexity increases

Engineering Contradiction:
Improveimage stabilityVSAvoiddevice structure
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

A motion sensor is introduced as an intermediary component between the device movement and the camera module control. The motion sensor detects device movement and provides feedback to the processor, which then controls the camera module rotation. This intermediary sensing mechanism enables precise compensation without requiring complex direct control systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the photographing direction is adjusted based on both motion information and gaze information, then image capture accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvephotographing direction accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements feedback control by continuously monitoring both motion sensor data and eye-tracking sensor data, then adjusting the camera module's photographing direction based on this combined feedback. The processor integrates information from multiple sensors and dynamically adjusts the camera orientation to maintain accurate alignment with the user's line of sight while compensating for device movement.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12160654B2Electronic device and operation method thereof
Publication Date: 2024.12.03 SAMSUNG ELECTRONICS CO LTD
  • US12160654B2 patent drawing
  • US12160654B2 patent drawing
  • US12160654B2 patent drawing

AI summary

An electronic device worn by a user includes a camera module capable of changing a photographing direction, a motion sensor configured to obtain motion information about the electronic device, an eye-tracking sensor configured to obtain gaze information about eyes of the user, a memory storing one or more instructions, and a processor configured to execute the one or more instructions, wherein the processor is configured to, by executing the one or more instructions, determine the photographing direction based on the gaze information, determine photographing control information for changing the photographing direction of the camera module to obtain an image captured without shaking, based on the motion information, control the camera module to change the photographing, based on the determined photographing control information, and obtain the image captured by the camera module based on the changed photographing direction.