Real-person shooting battle game method based on AR (Augmented Reality) technology

Abstract

The invention discloses a real-person shooting battle game method based on the AR technology, the method needs to be based on AR equipment, the AR equipment at least comprises a display module based on a diffraction optical waveguide lens and a monocular camera, and at least one two-dimensional code capable of obtaining the ID of a player to which the equipment belongs through scanning needs to be pasted on the surface of the equipment. After the camera of the AR equipment captures the two-dimensional code of the surrounding equipment, the player ID information of the equipment is displayed; the camera completes recognition of aiming gestures and shooting attack gestures made by a player wearing the equipment through a deep learning method, the game life value of the player to which the equipment which is aimed and attacked belongs is correspondingly reduced, and the equipment is connected with the cloud server through a mobile network. The gesture recognition, judgment and game arbitration are all carried out in a cloud server. The method has the advantages of being immersive, easier to input, safe, free of the eye clogging effect, capable of meeting the requirement for multi-player games, low in implementation cost, low in environment requirement and capable of enhancing the experience effect.

Description

Technical Field

[0001] The present invention relates to the technical field of shooting games, and in particular to a real-person shooting battle game method based on AR technology. Background Art

[0002] Augmented Reality (AR) technology mainly uses computer technology to superimpose virtual objects on the real environment and present the integrated scene to the user. It can superimpose richer information on the real scenes in the real world, thereby improving the immersion of the system and bringing users a more realistic interactive experience.

[0003] In the prior art, there are PC (personal computer) version shooting games and VR (virtual reality) version shooting games. PC version shooting games are played by players in front of the PC using a keyboard and mouse; VR version shooting games are played by players wearing VR helmets through immersive VR reality and holding simulated guns. In actual application, there are several problems: (1) PC version shooting games are not immersive. The game is played in a virtual scene on the screen, and the keyboard and mouse are controlled by the hands, which is not a good experience; (2) Although VR version shooting games have a certain sense of immersion, they are also virtual 3D pictures. Moreover, because the VR equipment almost blocks the outside scene, the player cannot see the real situation outside. After wearing the equipment, the player can only perform gestures in slow motion on the spot to operate the virtual character's behavior, resulting in a poor game experience. (3) With the development of AR technology, applying it to real-life shooting battle games has become a new direction to enhance the immersion and fun of games. However, existing AR games have many deficiencies in terms of player interaction and game mechanism implementation. For example, players need to play games in the same WiFi signal area and cannot play games on different floors with different elevations, which cannot provide players with a high-quality gaming experience. The present invention aims to overcome these deficiencies and provide a novel and efficient method for playing real-life shooting games based on AR technology in real-life activities and real scenes. Summary of the invention

[0004] The core of the present invention is a real-life shooting battle game method based on AR technology, which realizes the organic integration of real scenes and virtual shooting battles through a series of steps, creating a highly immersive and competitive game experience for players. A real-life shooting battle game method based on AR technology is now provided. It includes the following steps:

[0005] Step S1: AR device connection and game preparation.

[0006] Preferably, step S1 comprises the following steps:

[0007] Step S10: The AR device to be used has specific hardware components, including at least a display module based on a diffractive optical waveguide lens and a monocular camera, and the device can be connected to the Internet through a mobile network.

[0008] Step S11: At least one QR code is attached to the surface of the device, and the ID of the player to whom the device belongs can be obtained by scanning the QR code.

[0009] Step S12: Before the game starts, the player needs to turn on the mobile network function of each AR device and use mobile data to establish a connection with the cloud gaming system.

[0010] Step S13: The game organizer or the system automatically defines the red and blue teams and the members of the two opposing teams, enters the player's name into the game system, and accurately binds the name to the ID QR code of the device worn by the player.

[0011] Step S14: Each AR device displays the wearer's team ID, name, and initial health value 100% in the upper right corner of its display screen.

[0012] Step S15: The game administrator or the system pre-sets the attack power of the virtual weapon used in the game, that is, specifies the value of health points deducted when a target is hit once.

[0013] Step S16: Establishing an instant language communication connection between the players' devices of the same team through the network enables the players to have real-time voice conversations during the game, facilitating team collaboration.

[0014] Step S2: aiming gesture recognition and active crosshair display.

[0015] Preferably, step S2 further includes the following steps:

[0016] Step S20: When the player wearing the AR device makes an aiming gesture within the shooting range of the device camera, the device uses an algorithm based on skeleton key point detection to recognize the player's gesture.

[0017] Step S21: By analyzing the real-time image data collected by the camera, the key point positions and movement trajectories of the player's hand bones are accurately captured to determine whether the player has made an aiming gesture.

[0018] Step S22: Once the aiming gesture is recognized during the analysis, the system automatically displays the aiming crosshair icon in the center of the display screen, providing the player with an intuitive aiming reference, greatly improving the convenience and immersion of the player's operation.

[0019] Step S3: Identification and tracking of shooting targets.

[0020] Preferably, step S3 further includes the following steps:

[0021] Step S30: When the player wearing the AR device detects the QR code of another player within the camera capture range of the device, the device automatically starts the scanning function.

[0022] Step S31: After the scan is successful, the device can display the name of the member of the other device and the color logo of the team to which they belong in the corresponding area of ​​the display screen, so that the player can quickly identify the target identity.

[0023] Step S32: The aiming crosshair icon briefly tracks and aims at the enemy target within the camera's imaging range.

[0024] Step S33: To ensure the balance of the game, a tracking distance limit is set when the crosshair icon tracks and aims at the enemy target. Once the target exceeds the distance range, the crosshair icon will stop tracking.

[0025] Step S4: Shooting operation and response.

[0026] Preferably, step S4 further includes the following steps:

[0027] Step S40: After the player wearing the AR device makes aiming gestures and shooting gestures in sequence within the range captured by the device camera, the camera transmits the captured images to the cloud server.

[0028] Step S41: The cloud server uses a convolutional neural network model that has been trained with a large number of shooting combat gesture samples. The model can accurately analyze the characteristics and action sequence of the player's gestures, perform deep learning recognition on the gestures in the camera image, and determine whether the player has made a shooting action.

[0029] Step S42: Once the shooting action is recognized, the server immediately responds accordingly and launches a virtual attack on the enemy target aimed at by the player.

[0030] Step S43: Every time a shot is successfully hit, the system automatically deducts the health value of the attacked player in the game system, achieving accurate and real-time attack feedback.

[0031] Step S5: Feedback of being attacked.

[0032] Preferably, step S5 further includes the following steps:

[0033] Step S50: When the player wearing the AR device is attacked, the health bar area in the display screen of the device will flash brightly to give a prompt.

[0034] Step S51: The length of the health value strip area will be shortened synchronously with the decrease of the health value in the system.

[0035] Step S52: The color and flashing frequency of the highlighted flashing of the health value bar area can be adjusted according to the game settings. For example, in an exciting game scene, it can be set to a high-frequency, eye-catching red flashing to enhance the player's tension and game atmosphere.

[0036] Step S6: Death processing and information broadcast

[0037] Preferably, step S6 further includes the following steps:

[0038] Step S60: When the health value of the corresponding ID of the player wearing the AR device in the system drops to 0, the corresponding area of ​​the device display screen displays a prompt message "You have died", and the device automatically disconnects from the game system.

[0039] Step S61: The game system uses multicast technology to quickly broadcast the player's death prompt to other players who are playing the game normally, and displays the prompt content of "Player ID + Death" in the corresponding area of ​​their device display screen.

[0040] The present invention and embodiments disclose a real-person shooting battle game method based on AR technology, which has any of the following beneficial effects:

[0041] (1) High immersion and real experience: AR technology combines virtual elements with real scenes, allowing players to engage in shooting battles in a real environment. The operation method simulates real shooting actions, such as the recognition of aiming gestures and shooting gestures, which greatly enhances the immersion of the game and makes players feel as if they are on a real battlefield.

[0042] (2) Accurate recognition and fast response: The device camera is used to collect and scan the player's ID QR code to identify and judge the shooting target. It is not limited by the choice of the game venue and can be applied to most outdoor and indoor scenes with good mobile signals. The convolutional neural network model based on skeleton key point detection and trained with a large number of samples is used to recognize aiming gestures and shooting gestures, ensuring accurate recognition of gesture operations. With the rapid response of the cloud server, the operation delay is reduced, making the game process smoother and improving the player's combat experience.

[0043] (3) Good team collaboration and interactivity: Instant voice communication between devices of players on the same team facilitates real-time communication and collaboration between players in the game, enhancing team cohesion. At the same time, clear target identification and information display, such as displaying the names of enemy players and team logos, as well as broadcasting of death information, increase the interactivity between players and the real-time nature of the game.

[0044] (4) Personalized and balanced design: The color and frequency of the highlighted flashing of the health bar area can be adjusted according to the game settings to meet the personalized needs of different players. The setting of the tracking distance limit of the crosshair icon ensures the balance of the game, avoids the imbalance of the game due to long-distance auxiliary tracking, and improves the competitiveness and fairness of the game. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 A flowchart briefly summarizing the steps of the real-person shooting game method based on AR technology of the present invention;

[0046] Figure 2 This is a flowchart of step S1 of the real-person shooting battle game method based on AR technology of the present invention;

[0047] Figure 3 This is a flowchart of step S2 of the real-person shooting battle game method based on AR technology of the present invention;

[0048] Figure 4 This is a flowchart of step S3 of the real-person shooting battle game method based on AR technology of the present invention;

[0049] Figure 5 This is a flowchart of step S4 of the real-person shooting battle game method based on AR technology of the present invention;

[0050] Figure 6 This is a flowchart of step S5 of the real-person shooting battle game method based on AR technology of the present invention;

[0051] Figure 7 This is a flowchart of step S6 of the real-person shooting battle game method based on AR technology of the present invention;

[0052] Figure 8 A schematic diagram of aiming gestures made by a player in steps S20 and S40 of the real-life shooting battle game method based on AR technology of the present invention;

[0053] Fig. 9 This is a schematic diagram of a shooting gesture made by a player in step S40 of the real-person shooting battle game method based on AR technology of the present invention. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] The present invention provides Figure 1 A real-person shooting game method based on AR technology is shown, and there are the following embodiments:

[0056] In the outdoor park battle game scenario, the following steps are taken as an example:

[0057] Step S1: AR device connection and game preparation.

[0058] Step S10: Select an AR helmet with a high-definition camera, supporting 5G mobile network, and having a diffraction light waveguide display resin screen as the AR device.

[0059] Step S11: Paste a unique player ID QR code on the device.

[0060] Step S12: The player turns on the mobile network function of the AR helmet and enters the game system.

[0061] Step S13: Players enter their names into the game system through the mobile phone APP, and the 20 players participating in the game are randomly divided into two teams, red and blue, with 10 players each. The staff completes the binding operation of the name and the device ID QR code in the background of the game system.

[0062] Step S14: The upper right corner of the screen of each AR helmet displays the logo of the team to which the wearer belongs, the name, and the initial health value of 100%.

[0063] Step S15: The game administrator or system sets the virtual assault rifle as the main weapon of this game, and each hit deducts 25% of the enemy's health.

[0064] Step S16: Enable the voice communication function between the devices of the players on the same team in the game system, and set the voice noise reduction mode to adapt to the noisy outdoor environment.

[0065] Steps S2~S6: Game process.

[0066] Step S2: After the player enters the park game area, when he raises his hand and makes a gesture similar to aiming a gun (such as Figure 8 When the aiming gesture is detected, the camera of the AR glasses quickly recognizes the aiming gesture based on the skeleton key point detection algorithm of deep learning gesture recognition, and presents a clear aiming crosshair icon in the center of the glasses display.

[0067] Step S3: When the camera of the AR glasses captures the ID QR code of other players during the player's movement, the scan is completed automatically. The name of the other player and the color of the team to which he belongs are displayed next to the crosshairs on the display screen. At the same time, the aiming crosshair icon automatically tracks the enemy target. The tracking distance limit is set to 3 meters. If the distance exceeds this, the tracking will stop. If you need to continue aiming at the target, you need to make an aiming gesture to point to the ID QR code on the other player's device.

[0068] Step S4: The player makes an aiming gesture (such as Figure 8 ), then immediately make a trigger-pulling gesture (as shown in Fig. 9 As shown in the figure). AR glasses transmit the captured gesture images to the cloud server in real time through the 5G network, and the cloud server uses the trained convolutional neural network model to recognize the gesture. After confirming the shooting action, the server launches a virtual attack on the enemy target aimed at by the player, and the game system health of the player who is hit is deducted accordingly.

[0069] Step S5: When the player is attacked, the health bar area in the upper right corner of the AR glasses display screen flashes in red, and as the health value decreases, the bar area shortens synchronously.

[0070] Step S6: When the player's health value drops to 0, a prompt box "You have died" pops up on the AR glasses display screen, and the connection with the game system is automatically disconnected. The game system broadcasts the player's death information to other normal game players' AR glasses through multicast technology, and it is displayed as "Player [name] + dead".

[0071] Furthermore, by taking a game scenario in which multiple players compete against each other in an outdoor park as an example, the beneficial effects produced are:

[0072] (1) This battle game mode can be used for anti-terrorism drills and exercises in different real environments, which is much cheaper than setting up a simulation environment.

[0073] (2) This battle game mode is suitable for multiple players to experience, and has a strong sense of immersion and security, making it easier for players to get involved and further enhancing the experience.

[0074] The above description is only a preferred embodiment of the present invention, and does not limit the implementation mode and protection scope of the present invention. For those skilled in the art, it should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the description and illustrations of the present invention should be included in the protection scope of the present invention.

Claims

1. A real-person shooting game method based on AR technology, characterized in that: The method includes the following steps S1 to S6. Step S1, game preparation, turn on the mobile network of each AR device, and connect to the cloud game system through mobile data. Define the red and blue teams and the members of the two opposing teams, enter the names of the members into the game system and bind the corresponding QR code of the ID of the device worn; each device displays the team logo, name and initial health value 100% of the wearer in the upper right corner of the device display screen. Set the attack power of the virtual weapon used, that is, the number of health points deducted once the target is hit. Establish an instant language communication connection between the devices of the same team of players, and real-time conversations can be carried out during the game. This step improves the efficiency of players entering the game through convenient network connection and intuitive information display. The instant language communication connection greatly enhances team collaboration and effectively improves the game experience. Step S2, when a player wearing an AR device makes an aiming gesture within the range of the device's camera, the aiming crosshair icon is displayed in the center of the display screen. This method makes the player's operation more natural and intuitive, without the need for complex button operations, and improves the fluency and immersion of the player's operation. Step S3, when the QR code of other players appears within the camera capture range of the device, the player wearing the AR device scans the other QR code and can display the name of the member of the other device and the color logo of the team to which they belong in the corresponding area of ​​the device display screen. The crosshair icon briefly tracks and aims at the enemy target within the camera capture range. This step provides players with clear target recognition information. The crosshair tracking function increases the accuracy of shooting and enhances the competitiveness and ease of use of the game. Step S4, the player wearing the AR device makes aiming gestures and shooting gestures within the camera capture range of the device. The cloud server recognizes the gestures in the camera screen through the deep learning method and responds accordingly, and conducts a virtual attack on the aimed enemy. Each shot deducts the life value of the attacked player in the game system. The gesture recognition response of deep learning is fast and accurate, reducing delays, making the game process smoother, and improving the player's combat experience. Step S5, when the player wearing the AR device is attacked, the life value bar area in the display screen of his device flashes brightly and the corresponding life value in the system is reduced and shortened synchronously. This intuitive feedback method allows players to understand their own status in time and increase the tension and excitement of the game. Step S6: When the health value of the player wearing the AR device in the system is reduced to 0, the corresponding display area of ​​the device screen displays the prompt "You have been killed", and the device exits the game system connection. The system broadcasts the death prompt of the player to the player screen in the normal game, and the corresponding display area of ​​the device screen displays the prompt "Player ID + Death". This process is clear and unambiguous, and the broadcast of the death prompt increases the real-time nature and information transparency of the game, creating a more realistic battle atmosphere.

2. The real-life shooting game method based on AR technology according to claim 1, characterized in that: The AR device in step S1 at least includes a display module based on a diffractive optical waveguide lens and a monocular camera. The device can be connected to the Internet via a mobile network, and at least one QR code that can be scanned to obtain the player ID of the device must be attached to the surface of the device.

3. The real-life shooting game method based on AR technology according to claim 1, characterized in that: In step S2, the aiming gesture is identified using an algorithm based on skeleton key point detection to improve the recognition accuracy. This algorithm can accurately capture the player's gestures, reduce misjudgment, and improve the accuracy of the player's operation and the gaming experience.

4. The real-life shooting game method based on AR technology according to claim 1, characterized in that: In step S3, when the crosshairs automatically assist in tracking and aiming at the enemy target, a tracking distance limit is set. If the distance is exceeded, the tracking is stopped, and the player needs to make an aiming gesture in the target direction again to aim the crosshairs at the target again. Reasonable automatic auxiliary tracking distance limit ensures the balance of the game and avoids the game being too unrealistic due to automatic long-distance tracking.

5. The real-life shooting game method based on AR technology according to claim 1, characterized in that: In step S4, the model used by the deep learning method is a convolutional neural network model, and the model is trained with a large number of shooting battle gesture samples. The model is fully trained, has high recognition accuracy and adaptability, and can quickly and accurately recognize the shooting battle gestures made by the player in real time.

6. The real-life shooting game method based on AR technology according to claim 1, characterized in that: In step S5, the color and frequency of the highlighted flashing of the health value bar area can be adjusted according to the game settings. The adjustable flashing settings meet different game scenes and player preferences, increasing the personalization and fun of the game.

7. The real-life shooting game method based on AR technology according to claim 1, characterized in that: In step S6, when the system broadcasts the death prompt, multicast technology is used to improve information transmission efficiency. Multicast technology can quickly convey the death information to all relevant players and ensure the timely synchronization of game situation information.

Images