Multi-player AR VR System for Real-time Motion Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Single user interactive systems limit user improvisation and social interaction, as they are restricted to preset movements and responses, failing to allow users to communicate with friends during play.

Innovation Solution

A multi-player interactive system utilizing augmented reality (AR) and virtual reality (VR) with head-mounted displays (HMDs) that tracks users' movements, enabling flexible interaction with virtual objects and remote friends, allowing users to perceive and interact with each other and virtual objects in real-time through sensors and processors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single user system uses pre-recorded movements for computer generated images, then the system complexity is reduced and ease of operation is improved, but user improvisation and social interaction are limited

Engineering Contradiction:
Improveease of operationVSAvoiduser improvisation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system transitions from static pre-recorded movements to dynamic real-time motion tracking. Sensors continuously capture user movements and translate them into real-time animations of the computer generated image, allowing users to improvise freely while maintaining ease of operation through automatic tracking and rendering.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system creates a virtual copy of the user's movements through computer generated images. Motion capture sensors record the user's physical actions and replicate them in the virtual environment, enabling both improvisation and social interaction by allowing multiple users to see and respond to each other's movements in real-time.

Inventive Principle:
Principle #26Copying

2Device complexity

If a single user system uses pre-recorded movements, then device complexity is reduced, but social interaction and communication with friends are limited

Engineering Contradiction:
Improvedevice complexityVSAvoidsocial interaction
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system serves multiple functions simultaneously: it tracks individual user movements, renders computer generated images, enables social interaction between multiple users, and supports real-time communication. The motion tracking infrastructure supports both single-player and multi-player modes, making the system universally applicable to various interaction scenarios without requiring separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The computer generated image acts as an intermediary between users. It represents the user's movements and serves as a vehicle for social interaction, allowing users to communicate and play together remotely through their animated avatars while the system handles the complexity of motion tracking and synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the system allows flexible interaction with virtual objects and remote friends, then user experience and enjoyment are enhanced, but device complexity and processing requirements increase

Engineering Contradiction:
Improveflexible interactionVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the complex processing task into separate components: motion capture sensors handle data collection, processors handle motion translation and animation rendering, and display systems handle visual output. This segmentation allows flexible interaction capabilities while distributing device complexity across multiple specialized components rather than requiring one complex system to handle everything.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11938402B2Multi-player interactive system and method of using
Publication Date: 2024.03.26 RAKUTEN GROUP INC
  • US11938402B2 patent drawing
  • US11938402B2 patent drawing
  • US11938402B2 patent drawing

AI summary

A method includes receiving information related to a first user. The method further includes instructing a first display to display an image related to the first user to a second user based on the received information. The method further includes generating an image of a virtual object. The method further includes instructing a second display to display an image of the virtual object. The method further includes detecting movement of the second user. The method further includes determining a velocity of the virtual object in response to a determination that the second user contacts the virtual object based on the detected movement of the second user. The method further includes generating a moving image of the virtual object based on the determined velocity of the virtual object. The method further includes instructing the second display to display the moving image of the virtual object.