AR Virtual Companion for Real-Time Performance Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users engaging in activities like jogging, biking, or driving lack real-time feedback on their performance progress, as existing technologies only provide after-the-fact comparisons based on distance or time metrics without visual cues during the activity.

Innovation Solution

An augmented reality (AR) feature that tracks the user's location and displays a virtual reference object, such as an avatar, integrated with real-world scenes, adjusting its position and appearance based on the user's current and past movement data, providing real-time visual comparison against past or concurrent activities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual reference object is displayed to provide real-time visual feedback on user performance, then user engagement and motivation are enhanced, but the device complexity increases due to additional AR processing and tracking requirements

Engineering Contradiction:
Improveuser engagementVSAvoidAR processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system creates a virtual copy (avatar) of the user's past performance that can be displayed in the AR field of view. This copy replicates the user's previous position, movement, and appearance, allowing real-time comparison without requiring complex analysis of past performance data. The avatar serves as a simplified representation that provides intuitive visual feedback.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual avatar acts as an intermediary between the user's current performance and their past performance data. Instead of directly comparing raw data points, the system uses the avatar as a mediator that visually represents performance differences, making the feedback more intuitive and easier to interpret while reducing the complexity of direct data comparison.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the virtual companion adjusts its position and appearance based on real-time tracking data, then measurement precision of performance feedback is improved, but the use of energy increases due to continuous location tracking and rendering

Engineering Contradiction:
Improveperformance feedback accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system updates the virtual avatar's position and appearance at selected intervals or when significant performance changes occur, rather than continuously updating at maximum frequency. This partial action approach maintains sufficient measurement precision for effective feedback while reducing the energy consumption associated with constant high-frequency tracking and rendering operations.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system dynamically adjusts the update frequency and detail level of the virtual avatar based on current performance parameters and device state. When performance metrics change significantly, the avatar updates with higher precision; during stable performance periods, updates are reduced. This adaptive parameter changing optimizes the balance between feedback accuracy and energy consumption.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10878638B2Augmented-reality image processing
Publication Date: 2020.12.29 META PLATFORMS INC
  • US10878638B2 patent drawing
  • US10878638B2 patent drawing
  • US10878638B2 patent drawing

AI summary

In one embodiment, a computing system accesses a tracking record of a real-world object during a first movement session. The first tracking record comprises a plurality of locations of the real-world object relative to a first user. The system determines a display position of a virtual object representing the real-world object on a display screen of the second user based on the tracking record of the real-world object and the current location of the second user. Based on the determined position of the virtual object on the display screen, the system displays the virtual object on the display screen.