A method and system for generating game screen with reality enhancement function

Abstract

This patent relates to a method for generating a game screen, wherein the game screen includes a real scene from the user's first-person perspective constructed by a camera; and game-related data and images are superimposed on the real scene to achieve reality enhancement, so that the game screen and the offline real scene are combined, thereby improving the user's gaming experience. Specifically, the method includes obtaining image data of the current real scene through a camera to construct a game scene screen from the user's first-person perspective; emitting a light beam to a target in the real scene through an infrared laser transmitter; calibrating the aiming point of a virtual aimer in the game scene screen through a red dot aimer or automatically calibrating the aiming point of a virtual aimer through a camera of a gaming device; obtaining game battle data through the user's personal gaming equipment and sending it to a server; the server sending the battle station data to the user's personal gaming equipment; generating a corresponding game rendering image based on the game battle data and superimposing it on the game scene screen from the user's first-person perspective to achieve reality enhancement.

Description

Technical Field

[0001] This patent relates to the field of shooting game technology, and in particular to a method and system for generating shooting game images with reality augmented function. Background Art

[0002] Users can play shooting games in the existing technology through VR, but the game process is still in a purely virtual environment without any real scenes. People's movement, feelings, and reactions are greatly restricted, and the experience is not strong. In addition, VR is costly and difficult to popularize. Summary of the invention

[0003] This patent proposes a low-cost, reality-enhanced system that can integrate and overlay offline battle scenes and other game elements to provide a game screen with a stronger sense of experience. Specifically:

[0004] Obtain image data of the current real scene through the camera to construct the game scene screen from the user's first-person perspective;

[0005] Use an infrared laser transmitter to emit a light beam to a target in a real scene;

[0006] Calibrate the aiming point of the virtual aiming device in the game scene screen through the red dot aiming device or automatically calibrate the aiming point of the virtual aiming device through the camera;

[0007] The game battle data is obtained through the user's gaming equipment and sent to the server via the smartphone; the server sends the battle station data to other users; the corresponding game rendering image is generated based on the game battle data and superimposed on the game scene screen from the user's first-person perspective, realizing augmented reality of the game screen.

[0008] Furthermore, the user's personal gaming equipment includes: gaming guns, wearable equipment, and smart phones, wherein:

[0009] The game gun is provided with a mobile phone holder, an infrared transmitting tube, an infrared receiving tube, and a laser transmitting tube;

[0010] The wearable equipment includes a headband, a chest armor, and leg armor, all of which are provided with infrared receiving tubes;

[0011] The smart phone is installed on the mobile phone holder and is wirelessly connected to the game gun and the wearable device; the wearable device senses the infrared signal of the outgoing transmitting tube through the infrared receiving tube and transmits it to the smart phone through Bluetooth; the smart phone is wirelessly connected to the server; the signal during the battle is sent to the server; the corresponding game rendering image is generated according to the battle signal and superimposed on the game scene screen from the user's first-person perspective.

[0012] Furthermore, the server calculates game data such as player scores and life indexes based on the received battle data, sends them to the user, updates the battle status, and displays them on the game scene screen from the user's first-person perspective.

[0013] Furthermore, the automatic calibration of the aiming point of the virtual aiming device by the camera of the gaming equipment comprises the following steps:

[0014] Acquire image: Capture target image through camera;

[0015] Set the reference image to record the current target image as the reference image;

[0016] Preprocessing: preprocess the reference image and target image: convert them into grayscale images, and perform filtering or binarization processing;

[0017] Feature extraction: Use Harris corner detection algorithm and ORB algorithm to extract and save the feature points of the target image and reference image;

[0018] Start the gyroscope and emit infrared light at the same time to record the beam tracking target image: (1) Determine the rotation direction and acceleration of the mobile phone based on the gyroscope, and record the time, direction and acceleration; (2) Record the beam tracking image and the time when the image is generated;

[0019] Feature matching: Use brute force matching algorithm and Homography matching algorithm to match the feature points and feature descriptors of the target image and the reference image according to time;

[0020] Filter matching: Filter the matching results according to the angle of the corresponding mobile phone, filter based on the matching feature value to determine the best matching result, and record the current aiming point position;

[0021] Determine the aiming point position: Automatically move the aiming point displayed on the phone to the correct position based on the matching results and the known aiming point position in the reference image.

[0022] A game screen generation system with reality augmentation function, characterized by comprising:

[0023] Servers, smartphones, gaming guns, wearable equipment, among which,

[0024] The game gun is provided with a mobile phone holder, an infrared transmitting tube, an infrared receiving tube, and a laser transmitting tube;

[0025] The wearable equipment includes a headband, a chest armor, and leg armor, all of which are provided with infrared receiving tubes;

[0026] The mobile phone is wirelessly connected to the game gun and the wearable device;

[0027] The wearable device senses the infrared signal of the external transmitting tube through the infrared receiving tube and transmits it to the smart phone through Bluetooth;

[0028] The smart phone is wirelessly connected to the server; the battle signal is sent to the server, and the server generates a corresponding game rendering image according to the game battle signal and superimposes it on the game scene screen from the user's first-person perspective.

[0029] Furthermore, the headband, breastplate and leg armor are all provided with flash feedback lights, and the breastplate and leg armor are also respectively provided with vibration motors.

[0030] Furthermore, a game screen generation system with reality enhancement function is characterized in that the headband is also provided with a ribbon or color powder launcher, including a launcher cover, a ribbon or color powder filling area, a ribbon launcher shell, a spring cover, a spring, a trigger gear, a transmission gear, and a motor. When the motor receives an electrical signal, it starts, drives the transmission gear, transmits it to the trigger gear, and rotates to unlock the spring cover to launch the ribbon or color powder.

[0031] Beneficial Effects

[0032] The traditional infrared shooting game process is difficult to record, express and disseminate. The third-person camera is used for shooting, but the third-person perspective content shooting is difficult to express the tense, exciting, and thrilling side of FPS sports, and it is difficult to bring a sense of immersion to the audience, which is not conducive to dissemination. The method of this patent records the actual battle scenes and combat data in real time, and generates a first-person perspective game screen, which can effectively reconcile the motion attributes (real) of offline shooting games and the online game attributes (virtual), so that users can get a better experience and make the picture more ornamental. In a relatively cost-effective way, an effective combination of the real sports experience and the virtual game experience of FPS sports is achieved, which not only provides players with a richer game experience, but also brings better viewing and dissemination through the first-person perspective screen of the battle process.

[0033] At the same time, the headbands or breastplates worn by players, the mechanical ribbons on the vest, and the color powder launchers are safer. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 , the game screen generation process in this patent;

[0035] Figure 2 , a flow chart of the method when multiple users start a game against each other in this patent;

[0036] Figure 3 , the automatic calibration step process in the game method of this patent;

[0037] Figure 4 , a system diagram for generating the game screen in this patent;

[0038] Figure 5 , a schematic diagram of the connection relationship of the components of the game gun of this patent;

[0039] Figure 6 , schematic diagram of the game gun structure;

[0040] Figure 7 , Schematic diagram of the connection relationship between wearable device components;

[0041] Figure 8 , a schematic diagram of a color ribbon and a color powder launching device;

[0042] Fig. 9 , a partial schematic diagram of the ribbon and color powder launching device;

[0043] Fig.10 , a partial schematic diagram of the ribbon and color powder launching device;

[0044] Fig.11 , schematic diagram of the wearable device structure;

[0045] Fig.12 , schematic diagram of the rendered game screen of this patent. DETAILED DESCRIPTION

[0046] Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative work shall fall within the scope of protection of the present invention.

[0047] In the existing shooting games, such as online CS shooting games and offline shooting battle games, users usually play games in a purely virtual environment or a purely real environment. Users and players can play games through VR, but the game battle process is still in a purely virtual environment without any real scenes. People's movement, feelings, and reactions are greatly restricted, and the experience is not strong. In addition, the VR method is costly and difficult to popularize.

[0048] The technical solution disclosed in this patent is to effectively and quickly reconcile the offline sports attributes (reality) and online game attributes (virtual) of shooting games, bringing better experience and viewing experience to shooting game players. Players are equipped with game guns, and the structure of the game guns is as follows: Figure 5 , Figure 6 ; A mobile phone holder is set on the game gun to install the mobile phone; the player wears armor, leg armor, and headband, which are mainly used to sense and receive the signal of the game gun, determine whether it is "shot", and send a signal to the mobile phone; the mobile phone is connected to the server, and the data of the battle game is connected and updated. The details are as follows:

[0049] First, before starting the game, you need to connect and pair your devices. Figure 5 , Figure 6 , the user's game gun is connected to the mobile phone via Bluetooth. The game gun and breastplate are used as Bluetooth slave nodes. The mobile phone can find the address of the gun and breastplate by scanning or scanning, and then connect;

[0050] After the connection is made, the mobile phone can set the working mode of the gun or breastplate through Bluetooth commands. When the button on the gun is triggered or the infrared signal triggers the breastplate, the corresponding information will be converted into a Bluetooth signal and transmitted to the mobile phone in real time.

[0051] In addition to Bluetooth, you can also communicate via wired or WIFI. The wired method can be connected via a network cable or data cable, and communicate with the mobile phone via USB. The WIFI method can use the mobile phone wifi as a gateway, and the gun or chest armor can be connected to the mobile phone through a wireless network card for communication.

[0052] The image data of the current real scene is obtained through the camera of the mobile phone to construct the game scene picture or background picture from the user's first-person perspective. Fig.12 The background picture shown has trees and grass. If the user plays in other environments, the corresponding background picture will also change. The camera can also be a camera equipped with a game gun.

[0053] like Figure 2 As shown, multiple users join the game and share battle data through the server. During the battle, each player or user captures the current environment through the iOS and (or) Android phone camera connected to the device, obtains real video data, and displays it on his own phone screen. The real picture from his first-person perspective becomes the game background.

[0054] like Figure 1 As shown, the purpose of this patent is to produce a game screen that integrates online and offline games and provide a more realistic game experience. Therefore, before the user starts the game, the user needs to calibrate the aiming point of the game gun: there are two ways: use the infrared laser transmitter of the game gun to emit a light beam to the target in the real scene; or use the red dot sight of the game gun to calibrate the aiming point of the virtual aiming device in the game scene screen or automatically calibrate the aiming point of the virtual aiming device through the camera of the game device;

[0055] Specific calibration steps:

[0056] Players need to perform manual calibration or automatic calibration:

[0057] Press the calibration button on the game gun, and the red dot sight will emit near-infrared light to illuminate the target. The target will reflect the infrared light and emit a red dot. Long press the aiming point of the mobile phone virtual sight and drag it to make the aiming point coincide with the red dot emitted by the gun. Then the gun calibration is successful. Press the calibration button on the gun again to exit the gun calibration mode. After that, as long as the mobile phone and the aiming point are not aligned, you can use the aiming point on the gun as the standard for combat shooting.

[0058] Or automatic calibration: When the shooter aims the gun at the target, the aiming point in the phone's camera captures the target's image. By processing the image, the aiming point can automatically adjust its position and direction to accurately aim at the target.

[0059] Specific as Figure 3 As shown in the figure: Automatic calibration, when the shooter aims the gun at the target, the aiming point in the mobile phone camera will capture the image of the target. By processing the image, the aiming point can automatically adjust its position and direction to accurately align it with the target.

[0060] The specific steps include:

[0061] 1) Get the image: Use the mobile phone camera or other equipment to capture the image of the target and load it into the mobile phone.

[0062] 2) Set the reference image: Before emitting the infrared beam, record the current image as the reference image.

[0063] 3) Preprocessing the reference image: The reference image is preprocessed in the same way as the target image, converted into a grayscale image, and filtered or binarized.

[0064] 4) Feature extraction: Use Harris corner detection algorithm and ORB algorithm to extract and save the feature points of the target image and reference image.

[0065] 5) Start the mobile phone's gyroscope and emit infrared light at the same time to record the beam tracking target image: (1) Determine the mobile phone's rotation direction and acceleration based on the gyroscope, and record the time, direction and acceleration. (2) Record the beam tracking image and the time when the image was generated.

[0066] 6) Feature matching: Use brute force matching algorithm and Homography matching algorithm to match the feature points and feature descriptors of the target image and the reference image according to time.

[0067] 7) Filter matching: Filter the matching results according to the angle of the corresponding mobile phone, filter based on the matching feature value to determine the best matching result, and record the current aiming point position.

[0068] 8) Determine the aiming point position: Based on the matching results and the known aiming point position in the reference image, the aiming point displayed on the mobile phone is automatically moved to the correct position.

[0069] Ensuring the shooter can aim with the highest precision and accuracy at all times.

[0070] After calibration, multiple users start offline games and simultaneously generate a first-person perspective augmented reality game screen. Specifically, the game battle signal is obtained through the game equipment and sent to the server. Specifically, each user is equipped with a game gun, wearable equipment (chest armor, leg armor, helmet or headband), and a smart phone. The game gun is equipped with an infrared transmitter, and the wearable equipment is equipped with an infrared receiver. The infrared rays of the infrared transmitter can trigger the infrared receiver of the hit wearable device. The server can synchronously record the information of each user participating in the battle, calculate the player's score, life value and other parameters based on this information, and send these parameters back to the mobile phone to update the battle status in the game for each user. The server generates a corresponding game rendering image based on the game battle signal and superimposes it on the real scene screen of the user's first perspective. The constantly changing real scene screen and the constantly updated battle status display screen on it are superimposed on the real scene screen, together forming an augmented reality game screen. The game screen realizes reality enhancement by superimposing different rendering screens on the game background screen. For example, when the user or player shoots, the game will start a shooting animation. This animation can include the player raising the weapon, aiming, firing and recoil effects. When the player is walking, the moving gun animation can be activated, including the footsteps of the player walking, the shaking of the muzzle and the recoil effects, which are superimposed on the screen. When the player adds bullets, the game will start the loading animation, which can include the player taking out the magazine, disassembling the magazine, loading bullets and slapping the magazine. When the player hits the enemy, the game will start a prompt of hitting the enemy and the blood loss process. When the player is hit by the enemy, the game will start a wounded prompt; when the player kills the first person, the game will start a kill prompt and display it on the first-person perspective game screen; the physical buttons of the game gun or other equipment will send new information to the mobile phone, and the mobile phone will notify the server through the network. The server will check whether the launching player is activating a skill. The central controller will calculate the player's score, health and other parameters based on this information, and send these parameters back to the battle gun and other sensing wearable devices so that they can update the battle status.

[0071] Specifically, Figure 2, the real video of the player's current first-person perspective captured by the mobile phone camera is used as the current game background; the mobile phone uploads the battle data to the cloud server in real time, and the cloud server calculates the global battle data and sends it back to the mobile phone; the load balancing (Cloud Load Balancer, CLB) provides a safe and fast traffic distribution service, and the access traffic can be automatically distributed to multiple cloud servers in the cloud through CLB. The mobile phone superimposes the battle data required by the user on the first-person perspective scene constructed by the camera and displays it on the user's mobile phone. This is a combination of online game screens and offline game live broadcasts, which enhances the player experience, and the game screen can be spread, appreciated, and interacted.

[0072] Game data, such as: (1) All users' geographic location data (2) All users' battle data (3) Online voice data during the battle (4) Current user's equipment link blood, damage, points and skill data, device type, bullet information and equipment power status. (5) All users' kill information (6) Matching gun's auxiliary crosshair mark. You can choose to overlay it on the upper layer of the first-person perspective screen, and finally achieve the game screen effect of augmented reality, such as Fig.12 .

[0073] like Figure 4 , Figure 5 , Figure 6 The system required for the game screen production method includes:

[0074] Gaming guns, wearable equipment, smartphones, servers;

[0075] Among them, the game gun is equipped with a mobile phone holder, infrared transmitting tube, infrared receiving tube, laser transmitting tube, etc.; the wearable equipment includes a headband, chest armor, and leg armor, and its appearance is similar to the headband or chest armor of common shooting games. The core is that they are all equipped with infrared receiving tubes.

[0076] Specifically, Figure 5 The game gun in the equipment is equipped with an MCU chip; the infrared transmitting tube, infrared receiving tube, and game gun trigger are all connected to the MCU chip; the game gun can also be equipped with a separate camera; the user's personal equipment, including the game gun, is connected to the cloud server through a mobile phone.

[0077] like Figure 6 , the game gun structure includes:

[0078] Tighten the nut 21: After installing the mobile phone, tighten the nut and shrink the bracket to clamp the mobile phone;

[0079] Mobile phone holder 22: mobile phone holder with padded protection;

[0080] Mobile phone 23; or camera 4, real-time video recording in the game, generating a first-person perspective game screen;

[0081] Infrared transmitting tube 25: a virtual "bullet" transmitting tube, which emits invisible infrared light; an infrared transmitting head and an optical lens group are installed inside the infrared transmitting tube, the purpose of which is to adjust the infrared light, achieve focusing, large light flux, uniform, and collimated emission, so that the infrared emission is more accurate and the range is longer.

[0082] Laser emission tube 26: used for calibration before the game starts, to assist calibration;

[0083] Infrared receiving tube 27: used to receive infrared "bullets" fired by other players' guns;

[0084] The game gun is also provided with: a mechanical front sight 28, a bullet adding slider 29, a micro switch installed inside, sliding the slider simulates adding bullets; skill button 210: has different functions (opening a map, opening an aiming scope, voice intercom, releasing skills of special characters, etc.); a gun hanger 211: can be used to hang the gun on a belt or a tactical waist bag, or a leg hanger; a tactical side rail mounting slot 212: players can install a tactical standard rail to add external accessories (flashlights, side sights, laser sights, etc.); a gun trigger 213: a micro switch installed inside, simulating firing by pulling the trigger; an RGB light ring 214: a color-changing light ring, which displays the gun in real time The gun has various states (low battery, charging, fully charged, unmatched, matched, alive, killed, etc.); buttstock removal lock 215: the buttstock can be removed or installed by pulling the lock; mechanical front sight 216: the most basic rear sight of the gun; buttstock installation module 217: the connection between the buttstock and the gun body; soft rubber grip 218: a vibration motor is installed inside, which will vibrate when shooting to enhance the player experience, and the soft rubber increases the comfort of holding the gun; telescopic rod 219: the player can extend and retract the appropriate gun size according to the length of the arm; buttstock cover 220: it is more comfortable to hold the gun against the shoulder; telescopic rod button 221: press the button to open the fixed structure and achieve telescopic.

[0085] like Figure 7 , Fig.11 Wearable devices are vests, helmets, headbands, leggings, etc. worn by players in real-life CS games. These devices are mainly used to sense the "hit" signals sent by game guns.

[0086] The headband or helmet structure includes:

[0087] Infrared receiving tube: used to receive infrared "bullets" fired by other players' guns; strobe feedback light: the light flashes after being "hit" by other players; control circuit board, infrared receiving head, strobe light, RGB light ring, ribbon launch tube;

[0088] Among them, Figure 8 , Fig. 9 , Fig.10The ribbon and powder launcher uses a mechanical spring to spray out ribbons and powder, which is safer:

[0089] When the player's last life is hit, the ribbon launcher will spray out degradable ribbons or corn running powder to remind the player that he has "died". In specific use, when the game gun is hit, it is converted into an electrical signal. After receiving the electrical signal, the motor 9 starts to rotate the transmission gear 7, which is transmitted to the trigger gear 6, and the unlocking spring cover 4 is rotated to launch the ribbon or color powder. Figure 8 , 9 , 10 adopts mechanical spring ejection. Specifically, a protrusion 41 is provided on the spring cover 4, which is stuck in the groove 61; when triggered, the gear rotates, driving the protrusion 41 to rotate until the groove 61 and the inner wall groove 42 of the launch tube are on a vertical line. At this time, the protrusion 41 slides into the inner wall groove 42 under the pressure of the spring. At this time, the groove 42 acts as a slideway for the protrusion 41, and the protrusion and the edge of the groove are provided with corresponding inclined surfaces to facilitate the protrusion to slide in. The diameter of the launch tube cover is smaller than the spring cover 4, ensuring that the spring cover 4 is still in the tube when ejected, thereby improving safety. Furthermore, there is a safety slider 10 on the outside of the launch tube to ensure that the launch tube and the gear do not rotate relative to each other. When the launch tube is inserted into the shell, the safety slider 10 is pushed up by the boss in the shell. At this time, the motor gear can be used to trigger the ejection of ribbons or colored powder.

[0090] Specifically, Figure 7 , chest armor or tactical vest in wearable equipment, including:

[0091] Main control box: The main control circuit board, battery, type-c charging port, and power switch are installed inside.

[0092] Vibration motor: When being hit, there will be real-time vibration feedback, prompting the player that he is being hit by the enemy.

[0093] Flash feedback light: The light flashes after being "hit" by other players. Infrared receiving tube: Used to receive infrared "bullets" fired by other players' guns.

[0094] Elastic adjustment buckle: players can freely adjust the size to improve wearing comfort.

[0095] Leg armor in wearable equipment, including:

[0096] Flashing feedback light: The light will flash when you are hit by other players.

[0097] Infrared receiving tube: used to receive infrared "bullets" fired by other players' guns.

[0098] Adjustable straps: Players can freely adjust the size to improve wearing comfort.

[0099] Vibration motor: When being hit, there will be real-time vibration feedback, prompting the player that he is being hit by the enemy.

[0100] Main control box: The main control circuit board, battery, type-c charging port, and power switch are installed inside.

[0101] like Figure 4 , the smartphone is installed on the game gun mobile phone holder and wirelessly connected to the game gun and wearable device; the wearable device senses the infrared signal of the outgoing transmitting tube through the infrared receiving tube and transmits it to the smartphone through Bluetooth; the smartphone is wirelessly connected to the server; the signal during the battle is sent to the server; the corresponding game rendering image is generated according to the battle signal and superimposed on the game scene screen of the user's first-person perspective. During the battle, if the player is hit, the sensing wearable device will sense the hit information and send the information to the mobile phone, and then forward it to the server. The server will calculate the player's score, life value and other parameters based on this information and send these parameters back. The server will collect data such as the number of shots, accuracy, damage caused, number of kills, number of kills, etc. of each player, integrate and process these data, and send these data and scores back to the client for players to view and analyze. These data may include information such as the number of kills, deaths, scores, rankings, best performances, etc. of each player. It helps players understand their performance in the game and can also be used to compare the skills and abilities of different players. The mobile phone superimposes the battle data on the first-person perspective scene constructed by the camera to achieve augmented reality.

[0102] The method of this patent records the real battle scene and battle data in real time, and generates a first-person perspective game screen, which can effectively reconcile the motion attributes (real) of offline shooting games and the online game attributes (virtual), so that users can get a better experience and make the screen more ornamental. In a relatively cost-effective way, it realizes the effective combination of the real motion experience of FPS sports and the virtual game experience, which not only provides players with a richer game experience, but also brings better ornamentality and dissemination through the first-person perspective screen of the battle process.

[0103] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments may still be modified, or some or all of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for generating a game screen with a reality augmentation function, It is characterized in that include: Obtain image data of the current real scene through the camera to construct the game scene screen from the user's first-person perspective; Use an infrared laser transmitter to emit a light beam to a target in a real scene; Automatically calibrate the aiming point of the virtual aiming device in the game scene screen through the camera; Gain game data through the user's gaming equipment and send it to the server via the smartphone; The server sends the battle data to other users; Generate corresponding game rendering images based on game battle data and overlay them on the game scene screen from the user's first-person perspective to achieve game screen reality enhancement. The automatic calibration of the aiming point of the virtual aiming device by using a camera includes: Get image: Capture the image of the target through the camera; Set reference image: before emitting infrared beam, record the current image as the reference image; Preprocessing: preprocess the reference image and target image: convert them into grayscale images, and perform filtering or binarization processing; Feature extraction: extract feature points of target image and reference image and save them; Start the gyroscope and emit infrared at the same time to record the beam tracking target image; Feature matching: Matching the feature points and feature descriptors of the target image and the reference image according to time; Filter matching: The matching results are filtered according to the feature points and feature descriptors of the target image captured by the corresponding mobile phone camera. Based on the screening of feature points and feature descriptors, the best matching result is determined and the current aiming point position is recorded. Determine the aiming point position: Automatically move the aiming point displayed on the phone to the correct position based on the matching results and the known aiming point position in the reference image.

2. A method for generating a game screen with an augmented reality function according to claim 1, It is characterized in that The user's gaming equipment includes: gaming guns, wearable equipment, and smart phones, among which: The game gun is provided with a mobile phone holder, an infrared transmitting tube, an infrared receiving tube, and a laser transmitting tube; The wearable equipment includes a headband, a chest armor, and leg armor, all of which are provided with infrared receiving tubes; The smart phone is installed on the mobile phone holder and is wirelessly connected to the game gun and the wearable equipment; the wearable equipment senses the infrared signal of the outgoing transmitting tube through the infrared receiving tube and transmits it to the smart phone through Bluetooth; the smart phone is wirelessly connected to the server; the signal during the battle is sent to the server; the corresponding game rendering image is generated according to the battle signal and superimposed on the game scene screen from the user's first-person perspective.

3. The method for generating a game screen with an augmented reality function according to claim 1, It is characterized in that The server calculates the player's score and life value game data based on the received battle data, sends them to the user, updates the battle status, and displays them on the game scene screen from the user's first-person perspective.

4. The method for generating a game screen with an augmented reality function according to claim 1, It is characterized in that The extracting and saving the feature points of the target image and the reference image comprises: using the Harris corner detection algorithm and the ORB algorithm to extract and save the feature points of the target image and the reference image; The method of starting the gyroscope and emitting infrared light simultaneously to record the beam tracking target image includes: (1) judging the rotation direction and acceleration of the mobile phone according to the gyroscope, and recording the time, direction and acceleration; (2) recording the beam tracking image and the time when the image is generated; The matching of the feature points and feature descriptors of the target image and the reference image according to time includes: using a brute force matching algorithm and a Homography matching algorithm to match the feature points and feature descriptors of the target image and the reference image according to time.

5. A game screen generation system with reality enhancement function, It is characterized in that include: Servers, smartphones, gaming guns, wearable equipment, among which, The game gun is provided with a mobile phone holder, an infrared transmitting tube, an infrared receiving tube, and a laser transmitting tube; The wearable equipment includes a headband, a chest armor, and leg armor, all of which are provided with infrared receiving tubes; The mobile phone is wirelessly connected to the game gun and the wearable equipment; The wearable device senses the infrared signal of the external transmitting tube through the infrared receiving tube and transmits it to the smart phone through Bluetooth; The smart phone is wirelessly connected to the server; the battle signal is sent to the server; the corresponding game rendering image is generated according to the game battle signal and superimposed on the game scene screen from the user's first-person perspective. The smart phone or the game gun is equipped with a camera, which is used to construct a game scene screen from the user's first-person perspective, and is also used to automatically calibrate the aiming point of the virtual sight. The automatic calibration of the aiming point of the virtual aiming device comprises: Get image: Capture the image of the target through the camera; Set reference image: before emitting infrared beam, record the current image as the reference image; Preprocessing: preprocess the reference image and target image: convert them into grayscale images, and perform filtering or binarization processing; Feature extraction: extract feature points of target image and reference image and save them; Start the gyroscope and emit infrared at the same time to record the beam tracking target image; Feature matching: Matching the feature points and feature descriptors of the target image and the reference image according to time; Filter matching: The matching results are filtered according to the feature points and feature descriptors of the target image captured by the corresponding mobile phone camera. Based on the screening of feature points and feature descriptors, the best matching result is determined and the current aiming point position is recorded. Determine the aiming point position: Automatically move the aiming point displayed on the phone to the correct position based on the matching results and the known aiming point position in the reference image.

6. A game screen generation system with reality augmentation function according to claim 5, It is characterized in that The headband, breastplate and leg armor are all provided with flash feedback lights, and the breastplate and leg armor are also respectively provided with vibration motors.

7. A game screen generation system with reality augmented function according to claim 6, It is characterized in that The headband is also provided with a ribbon or color powder launching tube, including a launching tube cover, a ribbon or color powder filling area, a ribbon launching tube shell, a spring cover, a spring, a trigger gear, a transmission gear, and a motor. When the motor receives an electrical signal, it starts, drives the transmission gear, transmits it to the trigger gear, and rotates to unlock the spring cover to launch the ribbon or color powder.

Images