Eye-Tracking Gamepad Control for Accessible Mobile Gameplay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile gamepads are monotonous and limited to manual control with keys and joystick, and somatosensory games require large amplitudes, making them unsuitable for narrow spaces and inaccessible to disabled users.
Innovation Solution
A visual guidance-based mobile game system using an eye tracker to convert eye movements into responsive instructions, enabling game control through gaze direction, combined with traditional keys and joystick for enhanced interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional keys and joystick are used for mobile game control, then the device structure remains simple, but the gameplay becomes monotonous and boring
Solution Approach 1:
The gamepad integrates multiple control modalities (keys, joystick, and eye tracking) into a single device, allowing it to perform both traditional manual control and visual guidance control functions. This multi-functionality enriches gameplay variety without requiring separate devices for different control types.
Solution Approach 2:
The eye tracking system acts as an intermediary between the user and the game control system. Instead of directly manipulating physical controls, users can control the game through their gaze, with the eye tracker translating eye movements into control signals. This adds a new dimension to gameplay without fundamentally complicating the core control architecture.
2Ease of operation
If somatosensory games with large amplitude body actions are used, then the gameplay becomes more engaging, but the game cannot be played in narrow spaces or while sitting/lying
Solution Approach 1:
The patent replaces the mechanical system of large-amplitude body movements with an optical system (eye tracking). Instead of requiring physical limb movements, the system captures eye movement images and converts them into control signals. This substitution allows players to engage with the game using minimal physical movement, making it playable in confined spaces and while sitting or lying down, while maintaining the engagement level of somatosensory games.
3Adaptability or versatility
If eye tracking technology is integrated into the gamepad, then new control methods and accessible entertainment are enabled, but the device complexity increases
Solution Approach 1:
The patent merges the eye tracking module with the existing gamepad structure, integrating the image acquisition device, eye tracker, and visual intelligent guidance module into a unified system. By combining these components into a single integrated device rather than separate systems, the patent reduces overall system complexity while maintaining control method diversity.
Data Source
AI summary
A visual guidance-based mobile game system (001) comprises a terminal (100) and a gamepad (200) connected with the terminal (100). The terminal (100) comprises a user interface module configured to receive an eye movement image and output a mobile game response. The mobile game system (001) further comprises a visual intelligent guidance module (210) and a data processing module (220) that are connected with the user interface module (120). The eye tracker converts the eye movement image into the eye tracking information. The visual intelligent guidance module (210) is configured to transmit the eye tracking information to the data processing module (220). The data processing module (220) is configured to determine a responsive instruction corresponding to the eye tracking information according to the eye tracking information, so as to guide a control point on a screen of the terminal according to the responsive instruction and complete the mobile game response.