Mobile Projector Stabilization via Depth Mapping and Inertial Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mobile devices face challenges in providing a seamless interaction with environments due to limited display size and the need to project images onto non-uniform surfaces, which can result in distorted and unstable projections caused by surface variations and user movement.

Innovation Solution

Equipping mobile devices with time-of-flight cameras, structured-light techniques, and optical/electronic image stabilization modules, along with image-tracking systems, to map and adjust projections based on surface depth, orientation, and contours, and compensate for vibrations and movements, ensuring stable and proportional image display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If mobile devices project images onto non-uniform surfaces, then the display area is expanded and user interaction is enhanced, but the projection becomes distorted and unstable due to surface variations

Engineering Contradiction:
Improvedisplay areaVSAvoidprojection distortion
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system performs preliminary surface mapping using time-of-flight cameras and structured-light techniques to capture depth, orientation, and contour information before projection. This preliminary characterization of the non-uniform surface enables subsequent distortion compensation and proportional projection adjustment

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors the projected image position and uses image-tracking systems to detect deviations caused by surface variations and device movement. Feedback from these tracking systems enables real-time adjustment of projection parameters to maintain image stability and proportionality

Inventive Principle:
Principle #23Feedback

2Ease of operation

If mobile devices are handheld during projection, then portability and ease of operation are improved, but image stability deteriorates due to user movement and vibrations

Engineering Contradiction:
ImproveportabilityVSAvoidimage stability
Core Design Contradiction:
Ease of operationVSStability of the object's composition

Solution Approach 1:

The system uses the mobile device's own inertial sensors (accelerometers and gyroscopes) to detect its own movement and vibrations during handheld operation. This self-monitoring capability enables automatic compensation without requiring external stabilization equipment, maintaining image stability while preserving portability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system dynamically adjusts projection parameters including position, size, and orientation based on real-time data from inertial sensors. By changing these parameters in response to detected device movement, the system compensates for handheld vibrations and maintains stable image projection

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If optical image stabilization modules are added to compensate for vibrations, then image stability is improved, but device complexity increases

Engineering Contradiction:
Improveimage stabilityVSAvoidsystem complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The system leverages existing multi-functional components already present in mobile devices: inertial sensors serve both device orientation and vibration compensation functions, time-of-flight cameras perform both depth mapping and surface characterization, and image-tracking systems provide both position monitoring and stabilization feedback. This multi-functionality reduces the need for separate dedicated stabilization components

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables stable and undistorted projection of images onto various surfaces, enhancing user interaction by maintaining image stability and proportionality, even on non-uniform surfaces and during device movement.

Implementation Method 1

the mobile device may be configured with a time-of-flight camera to resolve distances between the mobile device and the surface

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

structured-light techniques may be utilized to map the depth, orientation and contours of the surface. In this example, a pattern (often a grid or a series of horizontal bars) is projected onto the surface and the mobile device determines the depth, orientation and contours of the surface based on the way that the pattern is deformed by the contour of the surface

Methodology Applied
Scientific EffectStructured light:

Data Source

PatentUS10326894B1Self stabilizing projector
Publication Date: 2019.06.18 AMAZON TECH INC
  • US10326894B1 patent drawing
  • US10326894B1 patent drawing
  • US10326894B1 patent drawing

AI summary

A mobile device for projecting images on a surface and for maintaining a position of the image on the surface. The device including an image rendering module to scan the surface and to modify the image based on data obtained about a three dimensional nature of the surface. The device further including an optical image stabilization to adjust an alignment of the projector based on orientation data of the device, an electronic image stabilization module to shift the image within a projection area based on the orientation data and an image-tracking module to shift the image within the projection area based on changes in a relative positions of the image and a target.