AR Communication Interface Mirroring User Expressions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current communication technologies do not enable interactive augmented reality experiences in real scenarios during voice or video communication, lacking the ability to seamlessly integrate virtual objects into real environments.

Innovation Solution

An augmented reality communication method that allows electronic devices to establish an AR link, displaying AR models that mirror the expressions and actions of users in real-time within a shared real scenario, enhancing the communication experience by integrating virtual elements into the real environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional voice or video communication is used, then communication functionality is achieved, but interactive service in real scenario cannot be implemented

Engineering Contradiction:
Improveinteractive service capabilityVSAvoidcommunication system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges traditional communication functionality with augmented reality elements by integrating AR models into the real scenario captured by the camera. The communication interface combines video feed, AR model rendering, and interaction controls into a unified system, allowing users to interact with virtual objects while maintaining real-time communication capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary layer between the user and the communication interface through AR models. These virtual models act as mediators that represent users in the real scenario, enabling indirect interaction while preserving the underlying communication functionality. The AR models serve as intermediaries that bridge the physical and digital communication spaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If AR models are integrated into real scenario, then user engagement is improved, but system resource consumption increases

Engineering Contradiction:
Improveuser engagementVSAvoiddevice energy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent implements partial action by selectively rendering AR models only in relevant portions of the real scenario rather than throughout the entire field of view. The system activates AR features based on user interaction states and communication context, reducing unnecessary rendering computations and energy consumption while maintaining user engagement when needed.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent dynamically adjusts rendering parameters such as model complexity, resolution, and frame rate based on device performance metrics and user interaction intensity. During high-engagement moments, higher quality rendering is applied, while during passive communication phases, resource consumption is reduced through simplified rendering, optimizing the balance between user engagement and energy usage.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11743954B2Augmented reality communication method and electronic device
Publication Date: 2023.08.29 HUAWEI TECH CO LTD
  • US11743954B2 patent drawing
  • US11743954B2 patent drawing
  • US11743954B2 patent drawing

AI summary

Embodiments of this application disclose an augmented reality communication method. A specific solution is: sending, by a first electronic device, AR communication request information to a second electronic device, to request to perform AR communication with the second electronic device; establishing, by the first electronic device, an AR communication link with the second electronic device; and displaying, by the first electronic device on a touchscreen, a first AR communication interface including an image of a first real scenario and a first AR model and a second AR model, where in an AR communication process, the first AR model makes a corresponding expression and action based on an expression and action of a first user that are obtained by the first device, and the second AR model makes a corresponding expression and action based on an expression and action of a second user that are obtained by the first device.