AI Facial Expression Recognition for Game Input Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional AI technologies for games have rarely applied AI to the player interface, relying primarily on traditional controllers for input, with limited exploration of using AI for input methods.

Innovation Solution

A program executed on a computer that utilizes AI to recognize and classify the facial expressions of a user, using a convolutional neural network to interpret the emotions and integrate them as input for game programs, such as a flight simulator, allowing for dynamic weather changes based on the user's expressions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional controllers are used for game input, then input reliability is maintained, but user interaction innovation is limited

Engineering Contradiction:

Improveinput method versatilityVSAvoidoperation intuitiveness

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical controllers with AI-based facial expression recognition. The imaging device captures facial images, and the AI algorithm interprets emotional expressions to control game characters, eliminating the need for physical buttons and joysticks while maintaining intuitive interaction

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the input parameter from physical controller signals to facial expression data. By detecting emotional parameters (happiness, sadness, anger, fear) from facial images, the system transforms biological signals into game control commands, enabling new interaction paradigms

Inventive Principle:

Principle #35Parameter changes

2Measurement precision

If specialized depth imaging devices are used for gesture recognition, then input precision is improved, but device complexity increases

Engineering Contradiction:

Improvegesture recognition precisionVSAvoiddevice complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of using complex specialized depth imaging devices, the patent uses a standard imaging device to capture facial images. The AI algorithm then processes these 2D images to recognize expressions, effectively copying the function of complex gesture recognition systems with simpler hardware

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent introduces an AI algorithm as an intermediary between the simple imaging device and the game control system. This intermediary layer processes facial images and translates them into control commands, eliminating the need for complex specialized hardware while maintaining recognition precision

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250166413A1Program which behaves differently depending on facial expression of user

Publication Date: 2025.05.22 INTERMAN CORP

AI summary

A new input method for computer-executed programs using AI technology. The program is executed on a computer equipped with an imaging device, which captures the user's facial expressions. In the computer, a facial expression recognition system is implemented that recognizes the expressions captured by the imaging device. The computer-executed program then behaves differently depending on facial expression of the user.