Shooting teaching system based on image recognition
By using an image recognition-based shooting instruction system to collect shooting information through cameras and sensors, and combining it with a neural network analysis model, the system achieves accurate assessment of shooting quality and problems, solving the problem of insufficient evaluation in traditional shooting training and improving training efficiency.
Patent Information
- Application Number
- CN202310154174.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-23
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2043-02-23
AI Technical Summary
Traditional shooting training lacks an effective evaluation mechanism, making it impossible to accurately assess trainees' mastery of aiming techniques and thus failing to pinpoint the reasons for poor performance.
Design a shooting teaching system based on image recognition, including a shooting device, a data acquisition module, a data analysis module, a shooting analysis module, and a display module. The system uses a camera, optical motion capture equipment, and wind speed and direction sensors to collect shooting information, and uses a neural network analysis model to analyze shooting quality and existing problems.
It enables accurate assessment before live-fire training, allowing for timely detection and correction of shooters' errors, thereby improving training effectiveness.
Smart Images

Figure CN116294784B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of computer technology, and particularly relates to a shooting teaching system based on image recognition. BACKGROUND
[0002] In the traditional basic shooting training, the instructor explains the aiming essentials and firing essentials, and then the trainees practice by themselves. After sufficient practice, live ammunition is used for live shooting. During this period, there is no good mechanism to measure and check the trainees' mastery of the aiming essentials. Then the overall mastery of the trainees on these essentials can only be checked by the live shooting results. The biggest problem of the traditional shooting target or laser target shooting is that the reason for the poor shooting result cannot be found. SUMMARY
[0003] The present application is designed to solve the above problems, and provides a shooting teaching system based on image recognition.
[0004] The present application achieves the above-mentioned purposes through the following technical solutions:
[0005] The shooting teaching system based on image recognition comprises:
[0006] a shooting device;
[0007] a collection module for collecting relevant information during shooting;
[0008] a data analysis module for analyzing the shooting information to obtain a shooting result, wherein the data signal input end of the data analysis module is connected with the data signal output end of the collection module;
[0009] a shooting analysis module for analyzing the shooting quality and shooting problems according to the shooting result, wherein the data signal input end of the shooting analysis module is connected with the data signal output end of the data analysis module;
[0010] a display module for displaying the shooting result, shooting quality and shooting problems, wherein the data signal input end of the display module is connected with the data signal output end of the shooting analysis module.
[0011] The present application has the advantages that the shooting training before live shooting training can be accurately judged by computer technology, and the problems of the shooter during shooting can be analyzed, so that the instructor can timely and effectively find and correct the problems of the shooter. BRIEF DESCRIPTION OF DRAWINGS
[0012] Figure 1 is a schematic diagram of the shooting teaching system based on image recognition of the present application;
[0013] Figure 2 is a data processing schematic diagram of the shooting teaching system based on image recognition of the present application. DETAILED DESCRIPTION
[0014] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings can be arranged and designed in various different configurations.
[0015] Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative labor are within the scope of protection of the present application.
[0016] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.
[0017] In the description of the present application, it should be understood that the terms "upper", "lower", "inner", "outer", "left", "right", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship commonly placed when the product of the present application is used, or the orientation or positional relationship commonly understood by those skilled in the art, which is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply that the indicated device or element must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application.
[0018] In addition, the terms "first", "second", etc. are only used for differentiation in description, and cannot be understood as indicating or implying relative importance.
[0019] In the description of the present application, it should also be noted that, unless otherwise explicitly specified and limited, the terms "arranged", "connected", etc. should be understood broadly, for example, "connected" can be fixedly connected, or detachably connected, or integrally connected; can be mechanically connected, or electrically connected; can be directly connected, or indirectly connected through an intermediate medium, or the internal communication of two elements. For those of ordinary skill in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.
[0020] The specific embodiments of the present application will be described in detail below with reference to the drawings.
[0021] As Figure 1 , Figure 2 indicated, the shooting teaching system based on image recognition comprises:
[0022] a shooting device;
[0023] a collection module for collecting relevant information at shooting determination time;
[0024] a data analysis module; the data analysis module is used for analyzing shooting related information to obtain shooting results, and a data signal input end of the data analysis module is connected with a data signal output end of the collection module;
[0025] a shooting analysis module; the shooting analysis module is used for analyzing shooting quality and shooting problems according to shooting results, and a data signal input end of the shooting analysis module is connected with a data signal output end of the data analysis module;
[0026] a display module; the display module is used for displaying shooting results, shooting quality and shooting problems, and a data signal input end of the display module is connected with a data signal output end of the shooting analysis module.
[0027] The collection module comprises a camera, an optical motion capture device and a wind speed and direction sensor, the camera is installed on the shooting device, a camera direction of the camera is consistent with a shooting direction of the shooting device, the camera direction of the camera is parallel to a central axis of a shooting pipeline of the shooting device, and the optical motion capture device is used for collecting action postures of a shooter when shooting.
[0028] The data analysis module comprises a first analysis module, a second analysis module, a third analysis module and a fourth analysis module, the first analysis module is used for analyzing aiming results of the shooting device according to image information collected by the camera, the second analysis module is used for analyzing shooting time according to the image information collected by the camera, the shooting time is a time from when a bullet is shot out of the shooting pipeline to when the bullet hits a target object, the third analysis module is used for analyzing wind force results according to data collected by the wind speed and direction sensor, and the fourth analysis module is used for analyzing final shooting results according to the wind force results, the aiming results and the shooting time, a data signal output end of the camera is connected with data signal input ends of the first analysis module and the second analysis module respectively, a data signal output end of the wind speed and direction sensor is connected with a data signal input end of the third analysis module, and data signal output ends of the first analysis module, the second analysis module and the third analysis module are all connected with a data signal input end of the fourth analysis module.
[0029] The first analysis module, the second analysis module, the third analysis module and the fourth analysis module are a first neural network analysis model, a second neural network analysis model, a third neural network analysis model and a vector superposition layer respectively, and the output of the first neural network analysis model, the output of the second neural network analysis model and the output of the third neural network analysis model are all taken as the input of the vector superposition layer; before shooting training evaluation is performed, the first neural network analysis model, the second neural network analysis model and the third neural network analysis model are first trained and optimized using a training set.
[0030] Collection of the training set: a teacher uses the shooting device to perform shooting sampling in a shooting place where a camera group is arranged, at this time, a camera is installed on the shooting device, and it is additionally required to arrange the camera group in the shooting place, the shooting place including an indoor place and an outdoor place, the data of the indoor place including video data of the camera and the camera group, and the shooting data of the outdoor place including video data of the camera and the camera group and wind speed and direction data.
[0031] The training optimization includes:
[0032] The video data of the camera in the indoor place is imported into the first neural network analysis model and is trained and optimized; the video data of the camera and the camera group in the indoor place is imported into the second neural network analysis model and is trained and optimized; the video data of the camera in the outdoor place is imported into the first neural network analysis model which is optimized, and the wind speed and direction data is imported into the third neural network analysis model which is optimized and is trained and optimized;
[0033] The shooting analysis module includes a quality analysis module and a problem analysis module, the quality analysis module is used for analyzing shooting quality of the present shooting according to shooting results and position data of the target object, and the problem analysis module is used for analyzing problems existing in shooting according to the shooting quality and action postures captured when shooting.
[0034] The working principle of the shooting teaching system based on image recognition is as follows:
[0035] The shooter uses the shooting device to shoot at the shooting site, aims at the target object, and determines the shooting time when the trigger is pressed, the shooting device is not installed with a bullet, and the trigger is pressed to trigger the shooting; the camera, the optical motion capture device, and the wind speed and direction sensor respectively collect image information, the action state of the shooter, and the wind speed and direction data of the shooting site at the shooting time; the image information is transmitted to the first analysis module and the second analysis module, the first analysis module analyzes the aiming result of the shooting device according to the image information, the aiming result is the aiming result under the action of no wind force, the second analysis module analyzes the shooting time t of the shooting according to the image information, the wind speed and direction data of the shooting site at the shooting time is transmitted to the third analysis module, the third analysis module analyzes the wind force result according to the wind speed and direction data, the aiming result includes the horizontal position X0 and the longitudinal position Y0 when hitting the target, the wind force result includes the horizontal wind speed x1 and the longitudinal wind speed y1, the aiming result, the shooting time, and the wind force result are transmitted to the fourth analysis module, the fourth analysis module analyzes the shooting result according to the aiming result, the shooting time, and the wind force result, and the shooting result X and Y are respectively represented as: X=X0+x1t, Y=Y0+y1t.
[0036] The shooting result and the data collected by the collection module are transmitted to the shooting analysis module, the quality analysis module of the shooting analysis module compares and analyzes the shooting result and the position data of the target object, compares the vector difference between the two with the pre-set threshold value, and the shooting quality of the shooting is obtained, the problem analysis module of the shooting analysis module compares the shooting quality with the pre-set shooting quality standard file, the action posture captured at the shooting time is compared with the pre-set action posture standard file, and the shooting problem of the shooting is obtained.
[0037] Finally, the shooting result, the shooting quality, and the shooting problem are displayed through the display module.
[0038] The aiming shooting training before the live ammunition shooting training is accurately judged through the computer technology, the problems of the shooter during the aiming shooting are analyzed, and the problems of the shooter can be found and corrected by the instructor in time.
[0039] The technical scheme of the present application is not limited to the above specific embodiments, and any technical modification made according to the technical scheme of the present application falls within the protection scope of the present application.
Claims
1. A shooting teaching system based on image recognition, characterized in that, The application relates to a shooting device, a shooting information collecting module, a data analysis module, a shooting analysis module and a display module. The data analysis module is used for analyzing shooting-related information to obtain shooting results, and a data signal input end of the data analysis module is connected with a data signal output end of the collecting module. The shooting analysis module is used for analyzing shooting quality and shooting problems according to the shooting results, and a data signal input end of the shooting analysis module is connected with a data signal output end of the data analysis module. The display module is used for displaying the shooting results, the shooting quality and the shooting problems, and a data signal input end of the display module is connected with a data signal output end of the shooting analysis module. The data analysis module comprises a first analysis module, a second analysis module, a third analysis module and a fourth analysis module. The first analysis module is used for analyzing aiming results of the shooting device according to image information collected by a camera, the second analysis module is used for analyzing shooting time according to the image information collected by the camera, the shooting time is the time from the shooting of a bullet from a shooting pipeline to the hitting of a target, the third analysis module is used for analyzing wind force results according to data collected by a wind speed and direction sensor, and the fourth analysis module is used for analyzing final shooting results according to the wind force results, the aiming results and the shooting time. A data signal output end of the camera is connected with data signal input ends of the first analysis module and the second analysis module respectively, a data signal output end of the wind speed and direction sensor is connected with a data signal input end of the third analysis module, and data signal output ends of the first analysis module, the second analysis module and the third analysis module are connected with a data signal input end of the fourth analysis module. The first analysis module, the second analysis module, the third analysis module and the fourth analysis module are respectively a first neural network analysis model, a second neural network analysis model, a third neural network analysis model and a vector superposition layer. Before shooting training evaluation, the first neural network analysis model, the second neural network analysis model and the third neural network analysis model are trained and optimized by using a training set. The video data of the indoor camera is input into the first neural network analysis model and is optimized and trained.
2. The image recognition-based shooting teaching system according to claim 1, characterized in that, The video data of the indoor camera and the camera group are input into the second neural network analysis model and are optimized and trained. The video data of the outdoor camera is input into the optimized first neural network analysis model, and the wind speed and direction data are input into the third neural network analysis model and are optimized and trained. The collecting module comprises the camera, an optical motion capture device and the wind speed and direction sensor. The camera is installed on the shooting device, the camera direction of the camera is consistent with the shooting direction of the shooting device, and the camera direction of the camera is parallel to the central axis of the shooting pipeline of the shooting device. The optical motion capture device is used for collecting the action posture of a shooter when shooting.
3. The image recognition-based shooting teaching system according to claim 1, characterized in that, The shooting analysis module includes a quality analysis module for analyzing shooting quality of the current shooting according to the shooting result and the position data of the target object, and a problem analysis module for analyzing problems existing in the shooting according to the shooting quality and the action posture captured when the shooting is performed.
Citation Information
Patent Citations
Apparatus for displaying information of wind direction and wind speed for shooting training
KR1020110002449A
Firearms marksmanship improvement product and related system and methods
US20180216916A1