XR Touch Input Arbitration Based on Companion Screen State

Solution Overview

Problem

Current input methodologies for extended reality (XR) devices are inefficient and imprecise, lacking the ability to effectively utilize companion devices like smartphones and tablets for precise and efficient interactions.

Innovation Solution

An application on the touch device and/or XR device determines the screen state and touch status to arbitrate touch input, directing it to either the touch device or the XR device based on criteria such as screen activity and touch relevance to content, using wireless communication protocols.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If touch input is always assigned to the touch device, then the user can directly control the touch device, but the XR device cannot receive precise input from the companion device

Engineering Contradiction:

Improvedirect control of touch deviceVSAvoidinput precision to XR device

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system dynamically assigns touch input to either the touch device or XR device based on real-time screen state criteria. When the screen is inactive, touch input is assigned to the XR device for precise control. When the screen is active, touch input is assigned to the touch device for direct control. This dynamic assignment resolves the contradiction by adapting the input routing to current operational conditions.

Inventive Principle:

Principle #15Dynamics

2Measurement precision

If touch input is always assigned to the XR device, then the XR device can receive input from the touch device, but the touch device cannot be directly controlled

Engineering Contradiction:

Improveinput precision to XR deviceVSAvoiddirect control of touch device

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The system dynamically assigns touch input to either the touch device or XR device based on real-time screen state criteria. When the screen is inactive, touch input is assigned to the XR device for precise control. When the screen is active, touch input is assigned to the touch device for direct control. This dynamic assignment resolves the contradiction by adapting the input routing to current operational conditions.

Inventive Principle:

Principle #15Dynamics

3Measurement precision

If the system continuously monitors screen state to arbitrate touch input, then input can be precisely directed to the appropriate device, but system complexity increases

Engineering Contradiction:

Improveinput direction precisionVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses screen state as a key parameter to determine touch input routing. By monitoring whether the screen is in an active or inactive state, the system can straightforwardly direct touch input to the appropriate device without complex arbitration logic. This parameter-based approach achieves precise input direction while minimizing system complexity.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250370558A1Arbitration of touch input based on device screen state

Publication Date: 2025.12.04 GOOGLE LLC

AI summary

According to at least one implementation, a method includes identifying a screen state associated with a first device and determining whether the screen state associated with the first device satisfies at least one criterion. In response to determining that the screen state associated with the first device satisfies the at least one criterion, the method further includes identifying touch input for a second device at the first device. In response to determining that the screen state associated with the first device fails to satisfy the at least one criterion, the method further includes identifying touch input for the first device at the first device.