Game assistance method, system and program product providing personalized policy guidance

Abstract

The invention discloses a game assisting method and system for providing personalized strategy guidance and a program product, and the method comprises the steps: collecting player actions and player voices in real time, and carrying out the recognition to obtain corresponding player instructions; according to the player instruction, a current game picture is collected and sent to a server, the server is provided with an AI large model, and the AI large model integrates an electricity competitor tactical library and a strategy; and the AI large model analyzes a current game picture and generates a personalized strategy guidance to be fed back to a player according to a corresponding player instruction. According to the method and the device, accurate and effective strategy suggestions are provided in the game in real time, and game players are helped to better perform game operation and plot exploration. A head action, gesture action and voice input multi-mode fusion interaction mode is adopted, compared with a traditional single interaction mode, the method is more convenient and natural, the reaction time is short, and the requirements of players for immersive game experience are met.

Description

Technical Field

[0001] The present invention relates to the technical field of game assistance devices and methods, and in particular to a game assistance method, system and program product that provides personalized strategy guidance. Background Art

[0002] During the process of playing electronic games, players often hope that the game console can provide some game strategy guidance in real time to improve their winning rate in the game.

[0003] To this end, Chinese invention patent CN118286683A discloses a game assistance mode data processing method, device, electronic device, and storage medium. This method monitors the player's gaming progress to determine the game status. If the player encounters a problem in the game, the method proactively inquires and responds to the player's game assistance request, providing different assistance modes, such as real-time graphic assistance based on help-seeking graphic information. However, due to its proactive inquiry and response method, this solution is inconvenient to operate and has a long response time, failing to meet players' demand for an immersive gaming experience. Summary of the Invention

[0004] In response to the above-mentioned defects, the technical problem to be solved by the present invention is to provide a game assistance method, system and program product that provides personalized strategy guidance, so as to solve the problem that the game assistance operation of the existing technology is not convenient enough, the response time is long, and it cannot meet the players' needs for immersive gaming experience.

[0005] To this end, a first aspect of an embodiment of the present application provides a game assistance method for providing personalized strategy guidance, comprising the following steps:

[0006] Collect player actions and voices in real time, and recognize and obtain corresponding player commands;

[0007] According to the player's instructions, the current game screen is collected and sent to the server, which is equipped with an AI model that integrates the e-sports player's tactical library and strategy;

[0008] The AI ​​big model analyzes the current game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

[0009] Based on the above technical solutions, this application adopts a multimodal fusion interaction method of head movements, gestures and voice input to generate player commands, which is more convenient and natural than the traditional single interaction method, and meets the players' needs for immersive gaming experience.

[0010] In the above method, preferably, the player's actions include head movements and gesture movements, the current game screen and player's gesture movements are collected through the camera module, the player's head movements are captured through the sensor module, and the player's voice is collected through the microphone array.

[0011] In the above method, preferably, the camera module, sensor module and microphone array are integrated on the game auxiliary device, and the sensor module includes a gyroscope and an acceleration sensor.

[0012] In the above method, the gaming auxiliary device is preferably connected to the game console via a USB cable. Using a standalone gaming auxiliary device provides personalized strategy guidance, facilitates portability and compatibility with different game consoles, and is easy to use. Furthermore, the gaming auxiliary device operates independently, does not occupy resources of the game console or online game server, and offers fast response times and excellent real-time performance.

[0013] In the above method, preferably, the personalized strategy guidance is fed back to the player in the form of audio playback or displayed in a floating window on the game console interface. A variety of feedback forms are available for players to choose from, suitable for different game scenarios, and more convenient to use.

[0014] A second aspect of an embodiment of the present application provides a game assistance system that provides personalized strategy guidance, including a game assistance device and a server. The server is provided with an AI large model that integrates an esports player's tactical library and strategy. The game assistance device is provided with:

[0015] The acquisition unit is used to collect the current game screen, player actions and player voice;

[0016] A recognition unit, used to obtain corresponding player instructions based on player actions and player voice recognition;

[0017] A response unit, configured to capture the current game screen and send it to the server according to the player's instructions;

[0018] The server uses the AI ​​big model to analyze the previous game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

[0019] In the above system, preferably, the acquisition unit includes a camera module, a sensor module and a microphone array, the player's actions include head movements and gesture movements, the current game screen and gesture movements are collected by the camera module, the head movements are captured by the sensor module, and the voice commands are collected by the microphone array, and the sensor module includes a gyroscope and an acceleration sensor.

[0020] In the above system, preferably, the game auxiliary device is connected to the game console via a USB cable.

[0021] In the above system, preferably, the personalized strategy guidance is fed back to the player in the form of audio playback, or is fed back to the player in the form of a floating window displayed on the game console interface.

[0022] A third aspect of an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the above-mentioned game assistance method for providing personalized strategy guidance.

[0023] As can be seen from the above technical solutions, the game assistance method, system, and program product provided by the present invention for providing personalized strategic guidance solve the problems of existing game assistance technologies, such as inconvenient operation, long response time, and inability to meet players' needs for an immersive gaming experience. Compared with existing technologies, the present invention has the following beneficial effects:

[0024] It provides accurate and effective strategic suggestions in real time within the game, helping players better operate the game and explore the plot. It uses a multi-modal interaction method that integrates head movements, gestures, and voice input. Compared with traditional single interaction methods, it is more convenient and natural, with a shorter response time, meeting players' needs for an immersive gaming experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces and describes the drawings required for use in the embodiments of the present invention or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0026] Figure 1 A flowchart of a game assisting method for providing personalized strategy guidance provided by the present invention;

[0027] Figure 2 This is a schematic diagram of a game assistance system that provides personalized strategy guidance provided by the present invention. DETAILED DESCRIPTION

[0028] This application provides immersive interactive experience and precise and effective game strategies for different types of game players, meeting the needs of e-sports players for tactical optimization, casual players for plot guidance and operation assistance, and live broadcast creators for interactive content provision.

[0029] The following will clearly and completely describe the technical solutions of the embodiments of the present invention in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0030] In order to more clearly explain and illustrate the technical solution and implementation of the present invention, several preferred specific embodiments for implementing the technical solution of the present invention are introduced below.

[0031] It should be noted that the directional words such as "inside, outside", "front, back" and "left, right" in this article are expressed based on the product usage status. Obviously, the use of the corresponding directional words does not constitute a limitation on the scope of protection of this scheme.

[0032] like Figure 1 As shown, the embodiment of the present application provides a game assistance method for providing personalized strategy guidance, including the following steps:

[0033] Step 110: collect player actions and voice in real time, and identify and obtain corresponding player instructions.

[0034] In this application, the current game screen, player actions, and player voice are collected through a game auxiliary device. The game auxiliary device is connected to the game console via a USB cable and connected to the server via the network. The server is equipped with an AI model that integrates the e-sports player's tactical library and strategy to provide personalized strategic guidance.

[0035] Player movements include head movements and gestures. The game auxiliary device is equipped with a camera module, a sensor module and a microphone array. The camera module is used to collect the current game screen and gestures, the sensor module is used to capture head movements, and the microphone array is used to collect voice commands. The sensor module includes a gyroscope and an accelerometer.

[0036] Step 120: According to the player's instructions, the current game screen is collected and sent to the server. The server is equipped with an AI large model, which integrates the e-sports player's tactical library and strategy.

[0037] Different player commands will perform different operations. For example:

[0038] The "Analyze Situation" command captures the current game screen and sends it to the server. The server analyzes the current game screen and provides guidance on the next game strategy based on different game scenarios, such as equipment, operation strategy, and defensive and offensive suggestions.

[0039] The "invalid" command rejects the currently provided game strategy guidance, re-analyzes and provides new game strategy guidance.

[0040] In step 130, the AI ​​model analyzes the current game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

[0041] Personalized strategy guidance can be provided to players in two ways: one is through audio playback, such as playing personalized strategy guidance through headphones or speakers; the other is through a floating window displayed on the game console interface.

[0042] Specifically, the server sends the personalized strategy guidance (text) to the game assistant device, which then sends it to the game console, which then displays it in a floating window. Alternatively, the game assistant device converts the text to speech and plays it directly (if headphones are connected, the connected headphones will play it), without affecting the sound effects of the game console. Of course, it can also be sent to the game console for playback.

[0043] The game assistive device is also equipped with an edge computing unit for performing preprocessing tasks such as removing noise and deleting invalid data.

[0044] In the present application, the gaming auxiliary device can be designed as a wearable structure or a bracket structure, such as smart glasses, headphones, headbands, neck rings, neck-hanging speakers, and sports cameras.

[0045] The server and AI large model can be set up in the cloud or in a local game room. For example, the server and AI large model can be set up in an Internet cafe room to provide services for the game consoles in the Internet cafe.

[0046] This application also provides a game assistance system that provides personalized strategy guidance, such as Figure 2 As shown, the game auxiliary device 100 and the server 200 are provided with an AI large model, which integrates the e-sports player's tactical library and strategy. The game auxiliary device 100 is provided with:

[0047] The acquisition unit 10 is used to acquire the current game screen, player actions and player voice.

[0048] The recognition unit 20 is used to obtain corresponding player instructions based on player actions and player voice recognition.

[0049] The response unit 30 is used to collect the current game screen and send it to the server according to the player's instructions.

[0050] The server 200 uses the AI ​​big model to analyze the previous game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

[0051] Among them, the acquisition unit 10 includes a camera module 11, a sensor module 12 and a microphone array 13. The player's movements include head movements and gesture movements. The current game screen and gesture movements are collected through the camera module 11, the player's head movements are captured through the sensor module 12, and the player's voice is collected through the microphone array 13.

[0052] The game auxiliary device 100 in this application is an independent device, which can be designed to be lightweight to wear (weight <30g, compatible with glasses, headphones, and neck wear) and bracket-mounted (desktop vertical or ground vertical bracket, suitable for PC / console / mobile game platforms). It can meet the usage needs of different players in various scenarios and has a wider range of application scenarios.

[0053] In this application, player commands can be triggered by any one of head movements, gestures, and voice, or combined into more complex commands. Regardless of the game, players can choose different triggering methods based on the operating characteristics of different games.

[0054] For example, when playing card games, gestures or voice can be used to trigger personalized strategy guidance, analyze the current game, and give card-playing suggestions based on the player's role.

[0055] When the game assistive device 100 is worn on the head, two methods can be used to trigger player commands: one is to rotate the head or point to trigger, which is recognized by the sensor module. The other is to wave the palm in front of the face (gesture action), for example, waving from top to bottom triggers a certain command, and waving from bottom to top triggers a different command, which is captured by the camera and recognized by the recognition unit.

[0056] Players can customize head-triggered commands or gesture-triggered commands based on game features and their own preferences. For example:

[0057] Gesture trigger command (camera captures gesture action):

[0058]

[0059] Head motion trigger (when wearing a headset, the sensor captures the head motion):

[0060]

[0061]

[0062] Voice command trigger:

[0063]

[0064] This application solution can be applied to e-sports game scenarios and casual game scenarios, and the results have been tested to be effective.

[0065] Test scenario 1: e-sports game scenario test.

[0066] Test equipment: Game auxiliary equipment provided by this application, PC game console, MOBA games (Multiplayer Online Battle Arena, multiplayer online tactical competitive games), such as a certain alliance.

[0067] Testing process: Esports players were invited to play with gaming assistant devices in a 5v5 scenario. During gameplay, players issued commands through voice, gestures, and head movements. The gaming assistant devices collected data and transmitted it to the AI ​​model for analysis. The data was recorded, along with the device's response time, strategy effectiveness scores, and player feedback on operational ease.

[0068] Test results: The average reaction time was 3 seconds, and the strategy effectiveness score reached 90%. Players reported that the operation was convenient and they could quickly obtain effective tactical guidance.

[0069] Test scenario 2: Casual game scenario test.

[0070] Test equipment: game auxiliary equipment provided by this application, mobile phones, open world adventure games (such as a certain god).

[0071] Testing process: Casual gamers used a stand-mounted gaming assistant device to receive operational assistance and storyline guidance through voice commands while exploring the game's plot. The players' efficiency in completing specific tasks and their evaluation of the gaming experience were observed.

[0072] Test results: Players' task completion efficiency increased by 30%, and they gave a positive evaluation of the gaming experience, believing that the guidance provided by the device was very helpful.

[0073] The above-mentioned game assistance method for providing personalized strategy guidance can be implemented by a computer program. Based on this, an embodiment of the present application also provides a computer program product, including a computer program / instruction. When the computer program / instruction is executed by a processor, the above-mentioned game assistance method for providing personalized strategy guidance is implemented.

[0074] Based on the description of the above specific embodiments, the game assistance method, system, and program product for providing personalized strategy guidance provided by the present invention have the following advantages over the prior art:

[0075] First, the interactive experience is improved: a multi-modal fusion interaction method of head movements, gestures and voice input is used to generate player commands. The diverse input methods bring players an immersive game interaction experience, which is more convenient and natural than the traditional single interaction method.

[0076] Second, the strategic guidance is accurate and timely: the response time is less than 5s, and the tactical effectiveness score is greater than 85%. It can provide accurate and effective strategic suggestions in real time within the game, helping gamers to better operate the game and explore the plot.

[0077] Third, strong adaptability: it can be adopted in lightweight wearable form or bracket-mounted form, suitable for all platforms of PC / console / mobile games), can meet the usage needs of different players in various scenarios, and has a wider range of application scenarios.

[0078] Fourth, the game auxiliary device adopts an independent host design, which can be easily connected to any game host without compatibility issues. The game auxiliary device and server can be trained separately, effectively reducing both design costs and usage costs.

[0079] Finally, it should be noted that the terms "comprise," "include," or any other variations thereof, as used herein, are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0080] The present invention is not limited to the above-mentioned optimal implementation mode. Anyone should be aware that any structural changes made under the inspiration of the present invention, and any technical solutions that are the same or similar to the present invention, fall within the scope of protection of the present invention.

Claims

1. A game assisting method for providing personalized strategy guidance, characterized in that: The following steps are involved: Collect player actions and voices in real time, and recognize and obtain corresponding player commands; According to the player's instructions, the current game screen is collected and sent to the server, which is equipped with an AI model that integrates the e-sports player's tactical library and strategy; The AI ​​big model analyzes the current game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

2. The method according to claim 1, characterized in that The player's actions include head movements and gestures. The current game screen and player gestures are collected through the camera module, the player's head movements are captured through the sensor module, and the player's voice is collected through the microphone array.

3. The method according to claim 2, characterized in that The camera module, sensor module and microphone array are integrated on the game auxiliary device, and the sensor module includes a gyroscope and an acceleration sensor.

4. The method according to claim 3, characterized in that The game auxiliary device is connected to the game host via a USB cable.

5. The method according to claim 1, wherein The personalized strategy guidance is fed back to the player in the form of audio playback, or is fed back to the player in the form of a floating window displayed on the game console interface.

6. A game assistance system that provides personalized strategy guidance, characterized in that: The system includes a game auxiliary device and a server. The server is equipped with an AI large model that integrates the e-sports player's tactical library and strategy. The game auxiliary device is equipped with: The acquisition unit is used to collect the current game screen, player actions and player voice; A recognition unit, used to obtain corresponding player instructions based on player actions and player voice recognition; A response unit, configured to capture the current game screen and send it to the server according to the player's instructions; The server uses the AI ​​big model to analyze the previous game screen and generates personalized strategy guidance feedback to the player based on the corresponding player instructions.

7. The system according to claim 6, characterized in that The acquisition unit includes a camera module, a sensor module and a microphone array. The player's movements include head movements and gestures. The current game screen and gestures are collected through the camera module, the head movements are captured through the sensor module, and the voice commands are collected through the microphone array. The sensor module includes a gyroscope and an acceleration sensor.

8. The system according to claim 6, wherein: The game auxiliary device is connected to the game host via a USB cable.

9. The system according to claim 6, wherein: The personalized strategy guidance is fed back to the player in the form of audio playback, or is fed back to the player in the form of a floating window displayed on the game console interface.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the game assistance method for providing personalized strategy guidance as claimed in any one of claims 1 to 5 is implemented.

Images