Augmented Mirror With Depth Scanning For 3D Object Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing smart mirrors do not effectively enhance user experience during daily activities, particularly with FMCGs, and lack interaction capabilities with users and objects in both household and commercial settings.

Innovation Solution

An augmented mirror with a partially silvered mirrored surface, a display screen, a camera module with depth scanning, and a computer module that locates user eyes and objects in 3D coordinates, projects images on the screen at desired locations, and communicates via user objects, enabling interactive and personalized experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a smart mirror displays information while users perform daily routines, then users can perform other tasks simultaneously (improving productivity), but the mirror lacks effective interaction capabilities with users and objects (worsening adaptability)

Engineering Contradiction:
Improvetask performance efficiencyVSAvoiduser interaction capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The mirror system continuously captures images and depth information, processes this data to locate user eyes and objects of interest, and dynamically adjusts displayed information based on real-time user position and gaze. This closed-loop feedback enables the mirror to adapt its content delivery to user needs while maintaining high productivity during routine tasks.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system transitions from static information display to dynamic, real-time adaptation. The mirror dynamically adjusts what information is displayed based on current user position, gaze direction, and detected objects, enabling both efficient task performance and interactive responsiveness simultaneously.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If the mirror displays information at fixed locations, then the display is simple (improving ease of operation), but the information is not targeted to user needs or positions (worsening adaptability)

Engineering Contradiction:
Improvedisplay operation simplicityVSAvoidinformation targeting capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The mirror system automatically determines user eye position and object of interest without requiring manual input or configuration. The system self-adjusts information placement based on captured images and depth data, maintaining operational simplicity while achieving targeted information delivery to where the user is looking.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes display parameters dynamically based on detected user gaze position and object location. Instead of fixed display locations, the system adjusts the spatial parameters of information presentation in real-time, automatically adapting to user needs while keeping the user experience simple.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If the mirror uses basic image capture, then the device is simpler (improving device complexity), but it cannot accurately locate user eyes and objects in 3D coordinates (worsening measurement precision)

Engineering Contradiction:
Improvecamera system complexityVSAvoid3D coordinate accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system introduces depth information as an intermediary dimension to traditional 2D image capture. By combining regular camera images with depth scanning data, the system achieves accurate 3D localization of user eyes and objects without requiring entirely complex hardware, bridging the gap between simplicity and precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The camera system combines multiple data types (visual images and depth information) to create a composite representation of the user environment. This composite approach enables precise 3D coordinate measurement while maintaining reasonable device complexity by leveraging complementary data sources rather than requiring entirely complex single-system architecture.

Inventive Principle:
Principle #40Composite materials

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The augmented mirror provides targeted information and enhanced user interaction, improving the experience of FMCGs by projecting relevant images and data at specific locations on the mirror, thus improving user engagement and product usage in both home and commercial settings.

Implementation Method 1

a partially silvered mirrored surface

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

a camera module including a depth scanner for capturing an image and associated depth information of a user of the mirror

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS10963047B2Augmented mirror
Publication Date: 2021.03.30 CONOPCO INC
  • US10963047B2 patent drawing
  • US10963047B2 patent drawing
  • US10963047B2 patent drawing

AI summary

An augmented mirror for use with one or more user objects, the augmented mirror comprising: a partially silvered mirrored surface; a screen underneath the mirrored surface; a camera including a depth scanner; and a computer module for receiving data from the camera and for providing graphical images to the screen; wherein the sole means of communication with the computer module is via the one or more user objects.