Device and Method for Shot Analysis

Abstract

The invention relates to a device and method for analyzing a shot. The present invention relates to a device and method for analyzing a shot. The method comprises steps of detecting the triggering of a shot; recording line-of-sight image data before the shot, immediately after the shot, and after the shot; analyzing the resolution of the shot by processing the data recorded immediately after the shot; and analyzing the timing of the shot by processing the data recorded immediately after the shot, the data recorded before the shot, the data recorded after the shot, and the results of the analysis of the resolution of the shot. Figure for abstract: Fig. 2.

Description

[0001] Device and Method for shooting analysis. Technical field

[0002] The invention relates to the field of shooting analysis, and relates to a device and a method allowing automated analysis of a shot, in particular in the field of training. State of the art

[0003] During shooting training, it is necessary to be able to reliably report in real time the firing of projectiles, whether real or simulated. Such requirements impose certain characteristics on the analysis systems envisaged. These must have a precision comparable to that which would be obtained in real situations, while being minimally intrusive, that is to say requiring the minimum of additional equipment mounted on the weapon used.

[0004] These requirements must face several practical operational locks such as the weight of the additional on-board equipment, the performances (precision and latency), the autonomy of the kit, but also technological locks which are mainly the precision of the data recorded and analyzed, the reliability of the image analysis, the minimum computing power embedded in the device, the flow rate and the consumption of the wireless link.

[0005] Currently, several methods exist for simulating projectiles during shooting training. One of the most commonly used techniques is the a posteriori observation of the accuracy of the shot. If the shot is fired at a target, then this serves as a support for verifying the accuracy of the shot fired. If the shot is fired at a real target, then the accuracy of the shot is analyzed by the impact of the ammunition (real or via a paintball for example). Another technique is to film the target via an external device allowing the user to verify the accuracy of the shot. A final approach is to use a laser system coupled to the triggering of the shot and analyzed by an external device, for example by means of markers mounted on the potential targets which transmit to a central system the information whether there is an impact or not.

[0006] The following references are an illustration of various prior art devices:

[0007] Patent EP 0985899 A1 proposes a compact video image recording device that can be mounted on a gun and used to record video images before and after the gun is fired. The recording device comprises a camera comprising a lens and a video image sensor. The video recording device is mounted on the gun such that the viewing area of ​​the camera includes the target area of ​​the gun. The video image sensor generates a signal electronics representative of a video image striking the respective sensor. The output of the image sensor is processed and generally used to produce successive frame data which are stored sequentially in locations of a semiconductor memory organized as a circular buffer while the video recording device is in an active state. When the shot is triggered, additional frames are stored in the buffer for a short period of time and a portion of the buffer is used to keep a video record of the shot before and after the event. Additional frames are stored successively in the unused portion of the buffer.

[0008] Jekel's US patent 8,022,986 provides a weapon orientation measuring device that includes a processor configured to receive first location information indicating the locations of a first point and a second point on a weapon, the first and second points being separated by a distance parallel to a pointing axis of the weapon, and to receive second location information indicating the locations of the first and second points on the weapon. The processor is further configured to receive information indicating a first terrestrial orientation and determine a second terrestrial orientation corresponding to the weapon based on the first and second location information and the information indicating the first terrestrial orientation.The first location information represents a location relative to a first sensor at a first location and the second location information represents a location relative to a second sensor at a second location, and the first and second sensors are separated by a given distance.

[0009] US Patent Application 2012 / 0178053 A1 by D'Souza et al. relates to a method and system for a gunnery training system that automatically predicts ballistics based on both automatically collected weather and distance information. The projectile gunnery training system also confirms that manual efforts made by an operator to adjust the turrets would allow hitting or not hitting the target after a shot. Both the turret adjustments and the target parameters to distinguish after a shot between the following states: Hit; Destroyed; Miss; Near Miss. A light or other signal is sent from the weapon to the target to indicate that a shot has been made by the weapon.

[0010] The disadvantages of existing methods are that generally speaking, shooting training requires reporting the shooting, getting as close as possible to real ballistics while avoiding the associated dangers. And as a result, the analysis of a shot can be seen as a designation problem where it is necessary be able to label a target by passing through certain opaque and blurred obstacles, or by making a curved trajectory.

[0011] A method known for more than 20 years to address this problem consists of equipping potential targets with photosensitive sensors that can send information when they are illuminated by a LASER. The disadvantages of this method are numerous: attenuation of the LASER over long distances, impossibility of shooting through blurred obstacles (for example foliage), need to equip the target with sufficient photosensitive sensors, among others.

[0012] To be usable, a digital designation must be able to simulate a shot by subjecting the impact of the bullet to a random distribution close to that which a real shot would have. However, the techniques currently proposed do not allow this problem to be resolved satisfactorily.

[0013] Furthermore, it is also a question of being able to present the results of a shot quickly and in a synthetic manner, by indicating and identifying which object in a scene was hit.

[0014] There is no known system combining the different technologies for detection, recording, and image analysis, for an indoor and outdoor environment. There is no complete system allowing the recording and analysis in real time of shots fired by a weapon that can be used anywhere, anytime and does not involve any modification of the weapon other than the addition of a self-contained and removable kit.

[0015] The present invention proposes to meet these needs. Summary of the invention

[0016] An object of the present invention is to propose a device autonomous in energy and calculation, capable of detecting the departure of a shot and of recording via an electro-optical device the place and the date of the impact of the ammunition if it is present or the position simulated by calculation of the impact in the case of the use of a blank bullet without real impact.

[0017] Advantageously, the device of the invention is available in the form of a kit which can be simply added to the rails of a weapon (for example on a MIL-STD 1913 “picatinny” rail).

[0018] Another object of the present invention is to propose a method for precise analysis of the performance of a shot which makes it possible to generate in real time a report on the accuracy of an impact, and to record it for later consultation.

[0019] The advantages of the device of the invention are multiple: -it is miniaturized, with a simple and extensible architecture; - it is inexpensive, in that on the one hand the sensors required to produce the proposed system are low cost (common commercial sensors such as those fitted to smartphones for example can be used), and on the other hand, the image capture and associated calculations are only carried out at the time of the shot, enabling significant energy savings and making the proposed solution viable for application in the military field; -it is on-board and completely autonomous; - it can be used anywhere and anytime, in indoor and outdoor environments without additional instrumentation; - it can be used day and night thanks to the use of IR cameras; - the shooter's environment does not need to be instrumented; - - it is compatible with: - - live ammunition; - - dummy ammunition (paintballs for example); - - compressed air simulation systems (such as “Airsoft”) - the report can be directly used by the user on a smartphone or tablet or a virtual reality headset; - the analysis of a shot is made from the analysis of the movement of the weapon and the posture of the shooter, a ballistics calculation is carried out according to the ammunition used, and there is a precise, automated and real-time identification during the shot, of an impact (which entity, which part of the entity) allowing to determine a level of damage of the impacts; - in the case of a multiple-shot automatic weapon (submachine gun), each impact can be analyzed individually; - the device can be deployed and used anywhere, without special instrumentation; - there is no longer any need to know the position or direction of the weapon.

[0020] The invention will find an advantageous application in the field of simulation, and more particularly in the context of military or police training, for which it is necessary to be able to designate targets realistically without resorting to real projectiles for security reasons. More generally, the invention can also be implemented for an application dedicated to collective military training, with weapon sizes much larger than light weapons such as that described as an example.

[0021] In one embodiment, the device of the invention can be coupled to a system of effectors, thus making it possible to simulate an impact on a target or on an individual instrumented by this same effector, whether it is light or vibration-based.

[0022] In one embodiment, the device of the invention can be used to calculate a trajectory in traversable obstacles (a door, foliage, etc.) and thus remove the limitations (inaccuracies of the laser at long distance, and need for a direct view of the target) of laser equipment (STC laser Combat Shooting Simulator).

[0023] In one embodiment, the device of the invention can be coupled to a set of sensors arranged on the ground, and thus make it possible to make a realistic calculation of a trajectory by taking into account parameters such as wind, pressure, air humidity.

[0024] To achieve these objectives, the invention relates to a device for analyzing the impact of a shot from a weapon on a target, comprising: - a data acquisition module capable of determining the time of departure of a projectile from a weapon and of acquiring video and spatial data relating to a target; - a calculation and storage module capable of analyzing the acquired temporal, video and spatial data; and - a data transmission module capable of transmitting the analyzed data. According to alternative or combined embodiments: - the data acquisition module is composed of at least one inertial unit capable of detecting the movement of the breech of the weapon, a rangefinder capable of acquiring distance data from the intended target, at least one camera capable of acquiring line-of-sight images. - the data acquisition module includes two multi-spectral and multi-field cameras. - the data transmission module allows transmission via a wireless link. - the calculation and storage module comprises at least one calculator, a data storage capacity, a learning database, and a real-time clock.

[0025] The invention also covers a shooting weapon comprising a device as claimed.

[0026] The invention also covers a shooting simulator comprising a device as claimed.

[0027] Another object of the invention is a method for analyzing the impact of a shot by a weapon on a target, which comprises the following steps: - detection of the triggering of a shot; - recording of line-of-sight image data before firing, immediately after firing, and after firing; - analysis of the shooting resolution by processing the data recorded immediately after the shooting; and - temporal analysis of the shot by processing the data recorded immediately after the shot, the data recorded before the shot, the data recorded after the shot, and the results of the shot resolution analysis.

[0028] In one embodiment, the method comprises a step of generating a shooting resolution analysis report, and a shooting time analysis report.

[0029] In one embodiment, the method comprises a step of sending the analysis reports.

[0030] The invention in another aspect covers a computer program product comprising non-transitory code instructions for carrying out the steps of the method as claimed when said program is executed on a computer. Description of the figures

[0031] Different aspects and advantages of the invention will appear in support of the description of a preferred but non-limiting mode of implementation of the invention, with reference to the figures below:

[0032] [Fig-1] schematically illustrates the device of the invention in a mode of realization ;

[0033] [Fig.2] schematically illustrates the general functions operated by the different components of the device of the invention;

[0034] [Fig.3] schematically illustrates the data recording phase according to an embodiment of the method of the invention according to; and

[0035] [Fig.4] schematically illustrates the data processing phase according to a mode of carrying out the method of the invention. Detailed description of the invention

[0036] Generally speaking, to address the problem raised, the device (100) of the invention is shown in [Fig.l] as equipping a weapon. It is mainly composed of: - a data acquisition module (102, 104, 106, 108); - a storage and calculation module (110); and - a data transmission module (112).

[0037] More specifically, in one embodiment of the device of the invention for equipping a weapon, the data acquisition module is composed of at least one rangefinder (102) capable of acquiring distance data from a target (10), at least one camera (104, 106) capable of acquiring line-of-sight images and at least one inertial unit (108) of the 3-axis IMU type capable of detecting the movement of the breech of the weapon at the time of a shot. However, the data acquisition module can be adapted according to the operational context, such as for example for short-range shots, it only requires a single wide-field camera, and an IMU. In another embodiment, the module comprises two cameras (104, 106) having different field widths, one with a wide field and the other with a narrow field.

[0038] The storage and calculation module (110) allows the analysis, processing and storage of data. In one embodiment, it is composed of a calculator using CPU and GPU type resources (dedicated to calculations carried out by neural networks for example), a learning database (208) comprising information relating to targets (people, vehicles, etc.) used for target detection calculations, and a data storage capacity (210). The calculation module also includes a real-time clock which makes it possible to guarantee precise and drift-free dating of the collected data.

[0039] The data transmission module (112) allows communication to a remote device, preferably via a wireless link.

[0040] [Fig. 2] schematically illustrates the general functions performed by the various components of the device of the invention, and Figures 3 and 4 detail them.

[0041] The analysis method begins with the detection of the triggering of a shot (202). The measurement of the moment of departure of a projectile is made by the sensors of the inertial unit (108) which detect the movement of the breech of the weapon, i.e. the simultaneous vibrations on the three axes.

[0042] The detection of the instant of departure of the shot triggers the recording (204) of the views by the camera(s) (104, 106). The target (10) aimed at by the gun is digitally recorded electro-optically by means of preferably several cameras, which are both multi-spectral (visible / infrared) and multi-field, and this throughout the time of the movement of the ammunition as well as after the impact. In order to determine the line of sight, the device uses a real wide-field image and a real narrow-field image, the images being obtained during the aiming captured by the high-resolution multi-spectral camera system. The wide-field / narrow-field switching is done automatically on a distance criterion in order to ensure the optimal resolution for the subsequent segmentation (214) of the image.Preferably, two cameras are used, each camera being calibrated independently to allow parallax and ballistics correction by the calculation module.

[0043] The digital video recording (204) made by all the sensors is stored and analyzed (206) directly by the computer (110) embedded in the device. The computer which analyzes the images from the cameras is able to: - calculate the impact position in the image; - detect and recognize the elements touched in the image (people, animals, objects).

[0044] Those skilled in the art understand that the present invention can be implemented using hardware and software elements. The data processing can be carried out by a computer program product comprising non-transitory code instructions.

[0045] A synchronization mechanism makes it possible to synchronize the data recorded by all the components in order to ensure the consistency of the debriefing information.

[0046] The images are stored on the onboard memory (210). If the broadcast mode is activated, these images are transmitted (212) in real time for analysis and segmentation (214) to an external device (216) in order to control the evolution of the aiming before and after the shot.

[0047] The operation of the system can be divided into two main phases: a first phase of data recording represented by [Fig.3], and a second phase of data processing represented by [Fig.4].

[0048] The data recording phase includes the following sequence of steps: 301: Firing: the operator presses the trigger of the weapon. 302: Shot Detection: - - the accelerometer (IMU) detects the movement of the cylinder head; and - - the computer interprets the movement of the breech over a time window to deduce the triggering of the shot by comparison with a pre-recorded shot signature. - 303: Recording of “A” data available immediately after firing: - - recovery in a circular buffer of the image at the time of shooting. This image is noted image 'C' (as central); - - acquisition of the distance to the target using the rangefinder; and - - generation of a data packet “A” sent to the computer for processing. - 304: Recording of data “B” available 'M' seconds after firing: - - triggering a waiting loop of M seconds. In one embodiment, the parameter 'M' can be set to M=1 second; - - at the end of the wait, recovery from the circular buffer of the images corresponding to 'N' seconds before the shot and to 'M' seconds after the shot. In one embodiment, the parameter 'N' can be set to N= 2 seconds; and - - generation of a data packet “B” sent to the computer for processing. - 305: End of recording

[0049] The data processing phase illustrated by [Fig. 4], comprises two processing sequences carried out in separate processes (400, 410). A first sequence (400) is dedicated to the resolution of the shot. It is very fast (of the order of the flight time of the munition) and is based only on the “A” data available immediately after the shot. A second processing sequence (410) is slower and allows a temporal analysis of the shot. It is based on the "A" and "B" data and on the first sequence, and allows a shot report to be generated.

[0050] The first sequence (400) of processing the data “A” allows an analysis of the resolution of a shot, and comprises the following steps: - 401: Detection of objects present on the image C via detection and recognition algorithms. This step makes it possible to identify static targets, humans, interior or urban furniture elements, weapons, vehicles, etc. - 402: Ballistic calculation. This step determines the position hit in image C by the ammunition, using the rangefinder data, the projection information from the camera(s) and the ballistic profile of the weapon and its ammunition. - 403: Detection of the target object: if an object detected in the previous step is present at the position hit in the image by the ammunition (calculated in step 6), the method goes to the next step 404, otherwise the process of the first sequence stops and the ballistic information is communicated to the second sequence. - 404: Target identification (known person, target of a certain type, particular vehicle, etc.). In the case of an object with identified sub-parts, the process makes it possible to identify the affected sub-part. For example, for a human, an arm, a trunk, a leg or a head. - 405: Plotting and recording of identification and ballistic data on image C. Communication of this information for the second sequence. - 406: Report to the affected target to notify them that they have been hit. - 408: Optional sending of the report via wireless link.

[0051] The second data processing sequence (410) allows a temporal analysis of the shot, and comprises the following steps: - 411: Calculation of the optical flow to deduce the deviation of the weapon in pixels, before and after the shot. - 412: Using camera projection parameters to calculate the angular movement of the weapon (in degrees). - 413: Use of target distance information to calculate the linear movement of the aiming point in the target coordinate system (in meters). - 414: Aggregation and plotting of shooting information on image C: - - movement of the line of sight; - - target identification data (if available); - - point of impact calculated by ballistics; - 415: Generation of quality data on the shot taken: - - weapon deflection; - - shooting score if the target hit allows a score to be established; - - others ... - 416: Establishment of a digital shooting report: generation of a synthetic report (image, data file); - 418: Optionally, sending via wireless connection (4G, 5G, Bluetooth, Wi-Fi) to a remote computer (tablet, smartphone, augmented reality headset) for viewing by an instructor; and - 420: Saving the report on static memory, flash memory type.

[0052] The present description illustrates an embodiment of the invention, but is not limiting. The example has been chosen to allow a good understanding of the principles of the invention, and a concrete application, but is not exhaustive but the description must allow the person skilled in the art to make modifications and implementation variants while keeping the same principles. Thus, for example, it is possible to envisage extensions of the functionalities of the system by adding for example a player positioning system in the case of collective training involving large movements.

Claims

Claims

1. A method for analyzing the performance of a weapon shot at a target, comprising the following steps: - recording (304) line-of-sight image data of a weapon before the triggering of a shot; - detecting (302) the triggering (301) of a shot; - recording (303, 304) line-of-sight image data of the weapon after the shot, the recorded data comprising data A available immediately after the detection of the triggering of a shot and data B available after the detection of the triggering of a shot for a time M; - analyzing the resolution of the shot (400) by processing the recorded data A; and - temporal analysis of the shot (410) by processing the data recorded before the triggering of the shot and after the shot, and by the results of the analysis of the resolution of the shot.

2. The method according to claim 1 wherein the step (302) of detecting the triggering of a shot comprises the steps of: - detecting the movement of the breech of the weapon; and - calculating from the movement of the breech detected the moment of departure of a projectile.

3. The method according to claim 1 or 2 wherein the step (303) of recording the data A available immediately after the detection of the triggering of a shot, comprises the steps of: - acquiring a line-of-sight image of the weapon at the time of the shot; - acquiring the distance to the target; and - generating a line-of-sight image data packet of the weapon immediately after the shot.

4. The method according to any one of claims 1 to 3 wherein the step (304) of recording the line-of-sight image data before the triggering of a shot and the data B available after the detection of the triggering of a shot for a time M, comprises the steps of: - triggering a waiting time 'M'; - retrieving at the end of the waiting time, line-of-sight images for a time 'N' before the triggering of a shot and line-of-sight images for the time 'M' after the shot; and - generate a pre-shot line-of-sight image data packet and a post-shot line-of-sight image data packet.

5. The method according to any one of claims 1 to 4 wherein the step (400) of analyzing the resolution of the shot comprises the steps of: - detecting (401) objects present on the line-of-sight image at the time of the shot; - determining (402) on the line-of-sight image at the time of the shot, the position hit by the shot; - determining (403) whether a detected object is at the position hit by the shot: - if a detected object is present at the hit position, identifying (404) the object and plotting (405) the identification data of the object and the ballistics on the line-of-sight image at the time of the shot; - if there is no object detected at the hit position, generating ballistics information.

6. The method according to claim 5 further comprising after the step of identifying the object, a step (406) of establishing a resolution report of the shot.

7. The method according to any one of claims 1 to 6 wherein the step (410) of temporal analysis of the shot comprises the steps of: - determining (411) the deviation of the weapon, before and after the shot; - calculating (412) the angular movement of the weapon; - calculating (413) the linear movement of the aiming point in the target frame; - aggregating and plotting (414) the shooting information on the line-of-sight image at the time of the shot; and - generating (415) quality data on the shot carried out.

8. The method of claim 7 further comprising a step (416) of establishing a shooting time analysis report.

9. The method according to claim 6 or 8 further comprising a step of sending (408, 418) the analysis reports.

10. A computer program product comprising non-transitory code instructions for carrying out the steps of the method according to any one of claims 1 to 9, when said program is executed on a computer.

11. Device for analyzing the performance of a weapon shot at a target comprising means for implementing the steps of the method according to any one of claims 1 to 9.

12.

13. Shooting weapon comprising a device according to claim 11. Shooting simulator comprising a device according to claim 11.

Images