XR Pose Control for Real-Time Gesture Streaming Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

There is a lack of an effective gesture interaction solution adapted to extended reality streaming scenarios, limiting user interaction capabilities in lightweight XR devices.

Innovation Solution

A pose control method that involves receiving pose data and events from an extended reality device, updating virtual objects, and causing target applications to respond accordingly, enabling somatosensory interaction through pose-based control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture interaction is implemented in extended reality streaming, then user interaction capabilities are improved, but device complexity increases

Engineering Contradiction:

Improveuser interaction capabilitiesVSAvoidgesture recognition system complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary gesture recognition system that includes pose data acquisition modules, processing modules, and mapping modules. This intermediary layer translates physical gestures into digital commands, enabling natural interaction without requiring complex direct control interfaces on the XR device itself.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical control interfaces (buttons, joysticks) with gesture-based control. The gesture recognition system captures and processes body pose data, substituting physical mechanical interactions with motion-based digital signaling, thereby improving ease of operation while distributing complexity across software rather than hardware.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Speed

If pose data processing is performed in real-time, then interaction responsiveness is improved, but computational load increases

Engineering Contradiction:

Improveinteraction responsivenessVSAvoidcomputational load

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent segments the pose data processing into distinct functional modules: pose data acquisition, processing, and mapping. Each module handles specific tasks independently, allowing for optimized computational resource allocation and enabling real-time processing without overwhelming the system with monolithic computational demands.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary processing of pose data by establishing mapping relationships between gesture poses and control commands in advance. This pre-computation of gesture-meaning correlations reduces the real-time computational burden during actual interaction, as the system only needs to match current poses against pre-defined mappings rather than interpreting gestures from scratch.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20250349088A1Pose control method for extended reality, electronic device, and storage medium

Publication Date: 2025.11.13 BEIJING ZITIAO NETWORK TECH CO LTD

AI summary

Embodiments of the present disclosure provide a pose control method for extended reality, an electronic device, and a storage medium. The method is performed by a computer device in communication with an extended reality device, and the method includes: receiving pose data of a user and a pose event corresponding to the pose data sent by the extended reality device; updating a virtual object in an extended reality scene based on the pose data; and causing a target application running on the computer device to perform a response corresponding to the pose event, where real-time images of the target application are transmitted by the computer device to the extended reality device.