Virtual Scene Recognition for Dynamic Game Key Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile games designed for touchscreen operation lack support for complex operations and good visual experience when played on personal computers, requiring manual and unintelligent key setting for mouse and keyboard interactions.
Innovation Solution
A virtual scene recognition and interaction key position matching method that automatically recognizes game scenes based on map pictures and dynamically distributes game operation keys, enabling seamless mouse and keyboard operation without manual key setting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If mobile games are played on PC with mouse and keyboard, then operation complexity increases and visual experience improves, but manual key setting becomes required and operation convenience deteriorates
Solution Approach 1:
The system automatically recognizes game scenes through map picture identification and autonomously configures key positions without requiring manual user input. The simulator performs self-service by detecting game state changes and dynamically adjusting key bindings based on the recognized scene, eliminating the need for users to manually set up controls for different game scenarios.
Solution Approach 2:
The system pre-configures multiple key position configuration files corresponding to different game scenes before runtime. When a game scene is recognized, the appropriate pre-prepared configuration is automatically loaded and applied, allowing the system to have key settings ready in advance rather than requiring real-time manual configuration.
2Adaptability or versatility
If manual key setting is used in PC simulator, then key configuration flexibility is achieved, but time consumption increases and productivity decreases
Solution Approach 1:
The system continuously monitors game rendering data to detect map pictures and identifies the current game scene based on this feedback. This real-time detection mechanism allows the system to automatically determine which key configuration should be applied, creating a closed-loop system that adapts to game state changes without user intervention.
Solution Approach 2:
Multiple key position configuration files are prepared in advance for different game scenes. The system has these configurations ready beforehand, so when a scene is detected, the appropriate pre-configured key positions can be immediately applied without requiring time-consuming manual setup.
3Extent of automation
If automated scene recognition is implemented, then key setting intelligence improves and operation efficiency increases, but system complexity increases
Solution Approach 1:
The system introduces a scene recognition module that acts as an intermediary between the game rendering data and the key configuration system. This module detects map pictures in the rendering data and translates them into scene identification, which then triggers the appropriate key configuration. This intermediary layer simplifies the overall architecture by providing a clear separation of concerns.
Solution Approach 2:
The system uses map pictures from game rendering data as recognizable patterns to identify game scenes. By copying and comparing these visual elements against known map pictures, the system can determine the current scene without requiring complex analysis of the entire game state, simplifying the recognition process.
Data Source
Figure 1~2
Figure 3A~3B
Figure 4A~4B
AI summary
Embodiments of this application provide a virtual scene recognition and interaction key position matching method for an application and a computing device. The method includes: starting an application in a virtual operating system; performing rendering processing on a to-be-presented virtual scene of the application, to obtain rendering data used for rendering the virtual scene; invoking a corresponding key position configuration file in a case that it is recognized that the rendering data includes a preset map picture, and performing matching processing between the preset map picture and a corresponding physical key of the computing device; and presenting the virtual scene and key configuration information corresponding to the virtual scene on a display screen of the computing device, the key configuration information being associated with the matched physical key. According to the method, a game scene can be quickly and efficiently recognized based on recognition of a map picture in a mobile game application, and game operation keys are dynamically distributed in the game scene in real time, so that the game operation keys are intelligently set.