Controller Gesture Command Recovery for Abnormal AR Inputs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented and mixed reality systems face challenges in effectively handling controller abnormalities, leading to user interface disruptions and operational inefficiencies when controllers malfunction or become unresponsive.

Innovation Solution

An electronic device equipped with a camera and processor that detects user gestures to determine operation commands for controllers with abnormalities by displaying graphic affordances, allowing the device to interpret user inputs and adjust operations accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the controller executes all received commands including stop commands during movement, then the motor control responsiveness is improved, but the power consumption increases and motor wear accelerates

Engineering Contradiction:
Improvemotor control responsivenessVSAvoidpower consumption
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The controller pre-acquires the movement command before executing it, and determines whether to execute the stop command based on the relationship between the movement command acquisition timing and stop command reception timing. This preliminary determination avoids unnecessary motor operations and reduces power consumption while maintaining responsive control.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the controller executes all received commands including stop commands during movement, then the command execution completeness is improved, but the motor life decreases due to increased wear

Engineering Contradiction:
Improvecommand execution completenessVSAvoidmotor life
Core Design Contradiction:
ReliabilityVSDuration of action of stationary object

Solution Approach 1:

The controller pre-acquires the movement command and determines in advance whether to execute the stop command by comparing timing relationships. This selective execution approach completes necessary commands while avoiding unnecessary motor operations that cause wear, thereby extending motor life.

Inventive Principle:
Principle #10Preliminary action

3Loss of energy

If the controller determines command execution by comparing timing of movement command acquisition and stop command reception, then the power consumption is reduced, but the control logic complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidcontrol logic complexity
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The controller pre-acquires the movement command and stores its timing information, then uses this pre-acquired information to determine whether to execute subsequent stop commands. This timing comparison logic, while adding some complexity, efficiently reduces power consumption by avoiding unnecessary motor operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4730085A1Method and device for determining operation command of controller
Publication Date: 2026.04.22 SAMSUNG ELECTRONICS CO LTD
  • EP4730085A1 patent drawingFigure 1
  • EP4730085A1 patent drawingFigure 2
  • EP4730085A1 patent drawingFigure 3

AI summary

An electronic device according to one embodiment, when it is determined that an abnormality has occurred in a target controller among a plurality of controllers registered in the electronic device, displays a graphic affordance corresponding to the target controller on the basis of the abnormal state of the target controller, detects a user gesture for the displayed graphic affordance using a camera, and determines an operation command for the target controller indicated by the detected user gesture.