VR Headset Mirror Reflection Photogrammetry for 3D Avatar Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods are cumbersome and inefficient for creating a realistic three-dimensional (3D) avatar that represents an entire user's body, often requiring complex processes or assistance.

Innovation Solution

A virtual reality (VR) headset captures images of a user's reflection in a mirror from multiple angles using its cameras, employing photogrammetry to generate a 3D avatar by stitching together depth-estimated images, allowing for real-time simulation of user movements in a virtual world.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If existing methods are used to create a realistic 3D avatar representing the entire user's body, then the avatar quality is improved, but the process becomes cumbersome and inefficient

Engineering Contradiction:
Improveavatar realismVSAvoidavatar creation efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent uses photogrammetry to create a digital copy (3D avatar) of the user's physical form. Multiple 2D images captured by VR headset cameras are processed to generate an accurate 3D representation, eliminating the need for complex physical scanning equipment or professional modeling services while maintaining high avatar realism

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The VR headset serves multiple functions: it captures images for avatar generation, provides the virtual reality experience, and acts as the primary computing device. This multi-functionality eliminates the need for separate specialized equipment, making the avatar creation process more efficient and accessible

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If existing methods are used to create a realistic 3D avatar, then the avatar quality is improved, but additional modifications or assistance are required

Engineering Contradiction:
Improveavatar realismVSAvoidavatar creation convenience
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system enables users to create their own 3D avatars independently. The VR headset captures images of the user and automatically processes them through photogrammetry algorithms to generate the avatar, eliminating the need for external assistance or complex setup procedures while maintaining high avatar quality

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Instead of using complex active scanning equipment that shines lights or projects patterns onto the user, the patent uses passive imaging by capturing reflections in a mirror. This inverted approach simplifies the system while achieving accurate 3D reconstruction

Inventive Principle:
Principle #13The other way round (Inversion)

3Manufacturing precision

If multiple images from multiple angles are captured to generate a full-body 3D avatar, then the avatar completeness is improved, but the capture process complexity increases

Engineering Contradiction:
Improveavatar completenessVSAvoidimage capture process
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system captures images dynamically as the user moves their body through various positions. The VR headset records images at different angles and body configurations, and the photogrammetry software processes these dynamic captures to reconstruct the complete 3D avatar, eliminating the need for complex multi-camera rig setups

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

A mirror serves as an intermediary element that enables the VR headset cameras to capture images of the user from multiple angles. The mirror reflects light from different parts of the user's body to the cameras, simplifying the capture process while achieving complete avatar coverage

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to easily generate realistic full-body 3D avatars without additional modifications or assistance, enhancing user experience and convenience by providing a more lifelike digital representation.

Implementation Method 1

capturing, by at least one camera of a virtual reality (VR) headset, a plurality of images of a reflection of a user in a mirror

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

employing photogrammetry to generate a 3D avatar by stitching together depth-estimated images

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS11995753B2Generating an avatar using a virtual reality headset
Publication Date: 2024.05.28 CHARTER COMM OPERATING LLC
  • US11995753B2 patent drawing
  • US11995753B2 patent drawing
  • US11995753B2 patent drawing

AI summary

A camera of a virtual reality (VR) headset captures a plurality of images of a reflection of a user in a mirror. The plurality of images include at least a first image of a reflection of the user in a first position with respect to the mirror and a second image of a reflection of the user in a second position with respect to the mirror. A three-dimensional avatar is generated based on the plurality of images captured by the camera.