AR Glasses Physical Feature Mesh Modification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) technologies in gaming fail to maintain user engagement due to discouragement from specific challenges or objects, leading to decreased self-esteem and confidence, particularly in interactive environments where users perceive themselves unfavorably.

Innovation Solution

The system generates AR scenes by detecting and modifying users' physical features in real-time using depth and texture data, allowing virtual meshes to change size and shape, enhancing the user's self-perception and confidence by rendering them as more robust or intimidating characters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users interact with challenging game tasks in AR environment, then gameplay engagement is improved, but user self-esteem and confidence deteriorate due to perceived physical limitations

Engineering Contradiction:
Improvegameplay engagementVSAvoiduser self-esteem
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent inverts the traditional approach by not hiding the user's real appearance but instead actively enhancing it through AR modifications. The system detects the user's physical features and presents an augmented version that exaggerates desirable attributes (muscular definition, height, strength) while maintaining the same physical actions, thereby transforming self-perception from negative to positive.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The system changes the visual parameters of the user's appearance in the AR environment by modifying physical feature representations. Depth data and texture data are processed to alter the perceived size, shape, and definition of body parts, creating a transformed self-image that boosts confidence without affecting actual gameplay performance.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If AR technology displays user's real physical features, then authenticity is improved, but user confidence deteriorates due to unfavorable physical perception

Engineering Contradiction:
ImproveauthenticityVSAvoiduser confidence
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality enhancement by selectively modifying specific physical features (arms, legs, torso, facial structure) while maintaining the overall authenticity of the user's appearance. The system enhances localized attributes such as muscle definition, body proportions, and facial symmetry without completely transforming the user's identity, thereby balancing authenticity with confidence-boosting effects.

Inventive Principle:
Principle #3Local quality

3Object-affected harmful factors

If AR scene modifies user's physical appearance to appear more robust, then user self-perception is improved, but technical complexity of the system increases

Engineering Contradiction:
Improveuser self-perceptionVSAvoidsystem complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system creates a virtual copy or mesh representation of the user's physical features based on depth and texture data. This digital twin is then modified to enhance appearance attributes. By working with a copied representation rather than the original video feed, the system achieves complex visual transformations while maintaining a manageable technical architecture.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary processing layer that sits between the camera input and the final AR display. This intermediary system includes components for depth mapping, mesh generation, and feature enhancement that transform raw visual data into the enhanced appearance. The intermediary architecture modularizes the complexity, making the system more manageable and maintainable.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12039673B2Augmented reality artificial intelligence enhance ways user perceive themselves
Publication Date: 2024.07.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12039673B2 patent drawing
  • US12039673B2 patent drawing
  • US12039673B2 patent drawing

AI summary

Methods and systems are provided for generating augmented reality (AR) scenes where the AR scenes can be adjusted to modify at least part of an image of the physical features of a user to produce a virtual mesh of the physical features. The method includes generating an augmented reality (AR) scene for rendering on a display for a user wearing AR glasses, the AR scene includes a real-world space and virtual objects overlaid in the real-world space. The method includes analyzing a field of view into the AR scene from the AR glasses; the analyzing is configured to detect images of physical features of the user when the field of view is directed toward at least part of said physical features of the user. The method includes adjusting the AR scene, in substantial real-time, to modify at least part of the images of the physical features of the user when the physical features of the user are detected to be in the AR scene as viewed from the field of view of the AR glasses, wherein said modifying includes detecting depth data and original texture data from said physical features to produce a virtual mesh of said physical features; the virtual mesh is changed in size and shape and rendered using modified texture data that blends with said original texture data. In one embodiment, the modified physical features of the user appear to the user when viewed via the AR glasses as existing in the real-world space. In this way, when the physical features of a user are detected to be in the AR scene, the physical features are augment in the AR scene which can result in the self-perception of the user improving which in turn can provide the user with confidence to overcome challenging tasks or obstacles during the gameplay of the user.