Mixed Reality Projector with Adjustable Mount for Face Pose Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality head-mounted displays (HMDs) are often bulky and expensive, limiting their accessibility and usability in various applications.

Innovation Solution

A system and method that includes an electronic device with an image sensor, a projector, and an adjustable mount, which determines the face pose of a viewer and characteristics of a projection surface to project 3D images, adjustable for optimal viewing through 3D glasses, allowing for a mixed reality experience without the need for bulky HMDs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If head mounted displays (HMD) are used for augmented or mixed reality, then immersive experience is achieved, but device size and cost increase

Engineering Contradiction:
ImproveaccessibilityVSAvoidbulkiness
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a projector as an intermediary device that projects images onto a real-world surface, which users can then view through 3D glasses. This mediator allows the mixed reality experience to be achieved without requiring users to wear bulky HMDs, thus resolving the contradiction between accessibility and device complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a virtual copy of the real-world environment by projecting computer-generated images onto physical surfaces. This copying approach allows users to experience mixed reality through the projected images rather than through head-mounted displays, reducing device bulkiness while maintaining the immersive experience

Inventive Principle:
Principle #26Copying

2Ease of operation

If head mounted displays (HMD) are used for augmented or mixed reality, then immersive experience is achieved, but device cost increases

Engineering Contradiction:
ImproveaccessibilityVSAvoidcost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The patent replaces expensive HMDs with cheaper components: a standard projector, 3D glasses, and a mobile device. These are significantly less expensive than HMDs while still providing the mixed reality experience, thus resolving the contradiction between accessibility and cost

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The system uses a mobile device that can perform multiple functions (capturing images, processing data, controlling projection) rather than requiring a specialized expensive HMD. This multi-functionality approach reduces overall system cost while maintaining accessibility

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If projector position is fixed, then system complexity is reduced, but viewing quality for different face poses deteriorates

Engineering Contradiction:
Improveviewing qualityVSAvoidadjustability
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a movable mounting structure that allows the projector to dynamically adjust its position and orientation based on the detected face pose of the user. This dynamic adjustment ensures optimal viewing quality for different user positions while maintaining reasonable system complexity through automated control

Inventive Principle:
Principle #15Dynamics

4Measurement precision

If images are projected without adjusting for face pose, then system complexity is reduced, but image perception accuracy deteriorates

Engineering Contradiction:
Improveimage perception accuracyVSAvoidface pose detection
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the mobile device's camera to detect the user's face pose and provides feedback to the processor, which then adjusts the projection parameters accordingly. This feedback loop ensures accurate image perception for different face poses while managing system complexity through software-based control

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11533468B2System and method for generating a mixed reality experience
Publication Date: 2022.12.20 SAMSUNG ELECTRONICS CO LTD
  • US11533468B2 patent drawing
  • US11533468B2 patent drawing
  • US11533468B2 patent drawing

AI summary

An electronic device includes an image sensor, a projector, an adjustable mount, a processor, and a memory. The memory stores instructions executable by the processor to: receive at least one image of an environment around the electronic device from the image sensor; determine a face pose of a viewer based on the at least one image; determine characteristics of a projection surface based on the at least one image; control the projector to project a plurality of images onto the projection surface, the images determined based in part on the face pose of the viewer and the characteristics of the projection surface, wherein the images are configured to be perceived as a three-dimensional (3D) object image when viewed through 3D glasses; and control the adjustable mount to adjust a position or an orientation of the projector based in part on a change in the face pose of the viewer.