Somatosensory Game Control via Remote Key Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Smart-fitness-guided home exercise programs are often monotonous, making it difficult for users to maintain their exercise routine and achieve both fitness and fun.

Innovation Solution

A method that transforms conventional games controlled by a remote control into somatosensory games by associating specific somatosensory actions with remote control keys, allowing users to interact with games using body movements, without the need for additional devices or customization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If smart-fitness-guided home exercise programs are used, then exercise and fitness effect is improved, but exercise fun deteriorates

Engineering Contradiction:
Improveexercise and fitness effectVSAvoidexercise fun
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent merges exercise programs with game elements by integrating somatosensory action recognition into existing games. The electronic device recognizes user actions through camera-based pose estimation and maps them to game controls, combining the fitness benefits of structured exercise with the engagement of gameplay, thereby resolving the contradiction between fitness effectiveness and exercise fun

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an action recognition system as an intermediary between the user and the game/exercise system. This intermediary captures user movements via camera, processes them through pose estimation algorithms, and translates them into meaningful game inputs or exercise feedback, enabling natural interaction that enhances both fun and fitness effectiveness

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If conventional games controlled by remote control are transformed into somatosensory games, then exercise fun is improved, but device complexity increases

Engineering Contradiction:
Improveexercise funVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the electronic device universal by enabling it to perform multiple functions: traditional remote control operation, camera-based action recognition, and game control. The system can operate in different modes (remote control mode and somatosensory game mode) using existing hardware components, avoiding the need for specialized equipment while maintaining enhanced functionality

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses image copying and processing techniques where the camera captures user poses, creates skeletal representations through pose estimation, and copies these visual data into action templates for recognition. This copying approach enables complex somatosensory interaction without requiring additional sensors or hardware, managing device complexity through software-based solutions

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12558613B2Control method and electronic device
Publication Date: 2026.02.24 HUAWEI TECH CO LTD
  • US12558613B2 patent drawing
  • US12558613B2 patent drawing
  • US12558613B2 patent drawing

AI summary

An electronic device may learn a specific somatosensory action completed by a user, and also record a specific remote control key selected by the user, and then the electronic device may associate the action with the key. When recognizing that the user completes the action, the electronic device may simulate a control signal generated by the key, to control a game operation. Accordingly, the user can simply and quickly transform a conventional game into a somatosensory game. In this process, a game manufacturer does not need to perform additional customization work, and the user does not need to use an additional somatosensory device.