Shooting training system

Abstract

To provide a shooting training system that enables correct shooting training to be easily performed.SOLUTION: A shooting training system (1) comprises a memory unit (112) storing information on the reference posture of a model shooter with respect to a predetermined part of a firearm when the model shooter is holding the firearm, a posture detection unit (41) that detects the shooting posture of a user, a posture acquisition unit (24) that acquires the shooting posture of the user from the posture detection unit at a predetermined timing, a posture comparison unit (25) that compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture stored in the memory unit, and a result output unit (26) that outputs the result of the comparison by the posture comparison unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a shooting training system. [Background technology]

[0002] In order to improve skills in shooting with a firearm, shooting training has been conventionally conducted under the guidance of an instructor at a shooting range. At the shooting range, a person undergoing training (trainee) fires a live bullet from a firearm at a target set up at a predetermined distance away, and the instructor gives instructions to the trainee on the shooting posture, etc., so that the accuracy of the impact position of the bullet can be improved.

[0003] Because shooting using live ammunition involves noise and safety issues, shooting ranges are limited to locations away from urban areas. Therefore, Patent Document 1 describes a shooting training system in which, instead of using live ammunition, a laser beam is emitted from a dummy gun, which is a laser beam emitting device, to a target, which is a receiver. In such a shooting training system, it is possible to determine whether the target is on target or not based on the presence or absence of light reception by the receiver, and to determine the accuracy of the shot based on the position of the light reception. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-12615 A Summary of the Invention [Problem to be solved by the invention]

[0005] Using the shooting training system described in Patent Document 1, shooting training can be performed more easily than at a shooting range. However, shooting skills will not improve simply by repeatedly shooting randomly. Shooting accuracy is greatly affected by the posture when shooting, and the higher the skill level of a person, the higher the reproducibility of the posture when shooting. Therefore, in both the shooting range and the shooting training system, it is desirable to perform shooting training while receiving guidance on shooting posture from an instructor. However, there is a problem that the number of instructors is limited, and it is not easy to obtain an opportunity to perform shooting training under the guidance of an instructor.

[0006] In view of the above circumstances, there is a demand for a shooting training system that allows correct shooting training to be carried out easily.

[0007] The problem to be solved by the present invention is to provide a shooting training system that enables correct shooting training to be carried out easily. [Means for solving the problem]

[0008] In order to solve the above problems, the shooting training system according to the present invention is A memory unit in which information on the standard posture of a model shooter is stored; A posture detection unit that detects a user's shooting posture; a posture acquisition unit that acquires the shooting posture of the user from the posture detection unit at a predetermined timing; a posture comparison unit that compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture stored in the memory unit; a result output unit that outputs a result of the comparison by the posture comparison unit; The present invention is characterized by comprising:

[0009] In the shooting training system according to the present invention, information on the reference posture of an exemplary shooter with respect to a predetermined part of a firearm is stored in advance in a storage unit. The exemplary shooter means a shooter with high skill. The reference posture means an ideal shooting posture at the timing when the shooter fires a bullet from the firearm. Preferably, information on the reference posture is acquired from the shooting posture of an exemplary shooter who has a similar physique to the user. The shooting posture of the user is typically the posture of the user holding an actual firearm or a simulated gun, but may also be a posture assuming that the user holds an actual firearm (a posture without holding an actual firearm or a simulated gun). When an actual firearm or a simulated gun is used, for example, an actual firearm or a simulated firearm equipped with sensors for acquiring the user's shooting posture can be used.

[0010] The shooting training system according to the present invention includes a posture detection unit that detects the shooting posture of the user. The shooting posture of the user preferably includes at least the posture of the head. In addition, the posture of the chest, the waist, both hands (the arm or hand supporting the gun and the hand operating the trigger), both feet, etc. may be included.

[0011] The posture acquisition unit acquires the user's shooting posture from the posture detection unit at a predetermined timing, and the posture comparison unit compares it with the reference posture stored in the storage unit. The result of the comparison by the posture comparison unit is output by the result output unit. For example, if a display unit is provided, the result can be displayed on the screen of the display unit. Other suitable methods such as paper output and audio output can also be used. In addition, the result of the comparison by the posture comparison unit can include, for example, an evaluation of the degree of agreement between the user's shooting posture and the reference posture, and a display showing the deviation between the user's shooting posture and the reference posture by superimposing them.

[0012] The predetermined timing may be, for example, the timing when an operation unit is operated when an operation unit is provided. The operation unit may be operated by the user himself or by a person other than the user (for example, an instructor). The operation unit may be anything that can input the timing of firing, and when operated by the user, it may be, for example, a unit that can be operated with the hand that holds the gun, or a trigger. Alternatively, for example, when shooting at a static target, the predetermined timing may be the timing when a predetermined time has elapsed during which the amount of variation per unit time of the user's shooting posture acquired by the posture acquisition unit is equal to or less than a predetermined value (i.e., the timing at which the user can be considered to continue to maintain the same shooting posture). Conversely, the predetermined timing may be the timing at which the amount of variation per unit time of the user's shooting posture or the amount of variation in the posture of the gun exceeds a predetermined value (i.e., the timing at which the posture of the user or the gun can be considered to have changed due to the user's action of firing the gun). These can be determined appropriately depending on the posture to be trained (static posture before firing, dynamic posture while firing, or a series of postures before and after firing) and the type of firearm to be used (whether or not the firearm generates recoil when fired, etc.).

[0013] In the shooting training system according to the present invention, The posture detection unit further detects a direction in which a barrel of the gun extends in the shooting posture, The posture acquisition unit acquires, as the shooting posture, a posture of the user relative to a direction in which a barrel of the gun extends. It can be configured as follows.

[0014] In the shooting training system of the above aspect, the shooting posture of the user can be acquired with higher accuracy based on the relative positional relationship between the predetermined part of the gun and the posture of the user. The direction in which the gun barrel extends can be determined based on, for example, the positions of two predetermined points on the gun barrel or an output signal from a sensor attached to the gun. Alternatively, when the user takes a shooting posture without holding the gun, the direction in which the gun barrel extends can be determined based on, for example, an output signal from a center attached to the user's hand.

[0015] The shooting training system according to the present invention further comprises: A display unit; a display processing unit that displays information representing the shooting posture of the user on a screen of the display unit; The above configuration may be adopted.

[0016] In the shooting training system of the above aspect, the shooter can visually check his / her own shooting posture on the display unit.

[0017] The shooting training system according to the present invention also comprises: The display processing unit further displays information representing the reference attitude on a screen of the display unit. It can be said that.

[0018] In the shooting training system of the above aspect, the deviation between the user's posture and the reference posture can be visually confirmed on the display unit.

[0019] The shooting training system according to the present invention comprises: The storage unit stores position information of a virtual target to be displayed on the display unit, The display processing unit displays augmented reality or virtual reality on the display unit, moreover, a target display unit that displays a virtual target on the display unit; a hit determination unit that performs hit determination based on the position of the predetermined part of the firearm acquired by the attitude acquisition unit and the position information of the virtual target; The above configuration may be adopted.

[0020] In the shooting training system of the above aspect, in addition to evaluating the posture during shooting, shooting training at a target can also be performed. Effect of the Invention

[0021] In the shooting training system according to the present invention, by using the reference posture of a model shooter, correct shooting training can be easily performed without the need for an instructor. [Brief description of the drawings]

[0022] [Figure 1] 1 is a configuration diagram of a main portion of a first embodiment of a shooting training system according to the present invention; [Diagram 2] 1A to 1C are diagrams illustrating a user performing shooting training in the shooting training system of the first embodiment. [Diagram 3] 4 is an explanation of a pattern displayed as augmented reality on the display unit of a user terminal in the shooting training system of the first embodiment. [Figure 4] 4 is an example of augmented reality superimposed on the display unit of a user terminal during shooting training in the shooting training system of the first embodiment. [Diagram 5] 4A to 4C are diagrams for explaining the contents of errors that may occur in the shooting posture of a user in the shooting training system of the first embodiment. [Figure 6] 3A to 3C are diagrams for explaining the relationship between shooting forms and possible errors in the shooting training system of the first embodiment. [Figure 7] FIG. 4 is a diagram showing the configuration of a main portion of a second embodiment of a shooting training system according to the present invention. [Figure 8] 13A to 13C are diagrams illustrating a user performing shooting training in the shooting training system of the second embodiment. [Figure 9] 13 is a display example of a screen of a display device in the shooting training system of the second embodiment. [Figure 10] 13A and 13B are diagrams illustrating a user performing shooting training using a modified shooting training system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a shooting training system according to the present invention will now be described with reference to the drawings.

[0024] First Embodiment FIG. 1 is a diagram showing the main components of a shooting training system 1 according to a first embodiment. The shooting training system 1 according to this embodiment includes a control / processing device 10, a user terminal 30, a simulation gun 50, and an external sensor 60. The control / processing device 10 is, for example, a cloud server, and is used by a business operator who operates and manages the shooting training system 1. The user terminal 30 is, for example, a head-mounted display, and is used by a user who has previously concluded a predetermined contract with the business operator. The control / processing device 10 and the user terminal 30 are configured to be able to communicate with each other via a network (not shown). Although only one user terminal is shown in FIG. 1, there may be multiple user terminals.

[0025] The control and processing device 10 includes a memory unit 11. The memory unit 11 includes a user information memory unit 12, a reference posture memory unit 13, a target information memory unit 14, and an evaluation information memory unit 15. The control and processing device 10 also includes, as functional blocks, a user information registration unit 21, a reference posture registration unit 22, a user authentication unit 23, a posture acquisition unit 24, a posture comparison unit 25, a result output unit 26, a target display control unit 27, a hit determination unit 28, and an analysis unit 29. A program 20 for the control and processing device is installed in advance in the control and processing device 10, and these functional blocks are embodied by running the program 20 for the control and processing device by a processor.

[0026] The user terminal 30 includes a memory unit 31, an imaging unit 32, an internal sensor 33, and a display unit 34. The imaging unit 32 is composed of a plurality of cameras provided on both sides of the head mounted display. The plurality of cameras include an out-camera 321 and an in-camera 322. The out-camera 321 photographs a reference position marker 51 of the imitation gun 50 described later. The in-camera 322 photographs the movement of the user's eyes. The display unit 34 is a display unit of the head mounted display, and displays an augmented reality (AR) superimposed on the real space. The internal sensor 33 may include, for example, an acceleration sensor, a tilt sensor, and a magnetic sensor. These internal sensors 33 are used by an attitude detection unit 41 described later to detect the position and attitude of the user terminal 30 (head mounted display) worn by the user on the head, and their changes over time.

[0027] The user terminal 30 also includes, as functional blocks, a posture detection unit 41, a body part detection unit 42, an eye gaze tracking unit 43, a posture acquisition unit 44, and a display processing unit 45. A user terminal program 40 is pre-installed in the user terminal 30, and these functional blocks are embodied by running the user terminal program 40 on a processor.

[0028] The imitation gun 50 is a model that imitates the shape and weight of an actual firearm used by a user in target practice, and is provided with a reference position marker 51 and an operation unit 52, and is also provided with a sensor module 53. Alternatively, the imitation gun 50 may be an actual firearm to which the reference position marker 51, operation unit 52, and sensor module 53 are attached. In this embodiment, the sensor module 53 is built into the imitation gun 50. The reference position marker 51 is attached to a predetermined portion of the firearm and is in a form that can be recognized by the outer camera 321 of the imaging unit 32 (for example, a two-dimensional barcode). In this embodiment, the operation unit 52 is provided at a position or in the vicinity of the position where the imitation gun 50 is supported by a hand (in most cases, the left hand) other than the hand that operates the trigger when the user holds the imitation gun 50. The imitation gun 50 and the user terminal 30 are configured to be able to communicate with each other by wire or wirelessly, and input operations to the operation unit 52 are input to the user terminal 30. The sensor module 53 in this embodiment is, for example, a nine-axis sensor module incorporating a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis magnetic sensor. The sensor module 53 is used by the posture detection unit 41 described later to detect the position and posture of the simulated gun 50 and their changes over time. As the part detection unit 42, a classifier constructed from a trained model that has previously undergone machine learning to identify a specific part of the firearm contained in the image data can also be used. In that case, the reference position marker 51 does not need to be used.

[0029] The external sensor 60 is a sensor used separately from the user terminal 30, and is configured to be able to communicate with the user terminal 30 in a wired or wireless manner. The external sensor 60 is, for example, a nine-axis sensor module incorporating a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis magnetic sensor, or a sensor module integrating a part or all of a tilt sensor and a geomagnetic sensor. In this embodiment, as shown in Fig. 2, the external sensor 60 is attached to each of the chest, waist, and foot of the user.

[0030] Next, the use of the shooting training system 1 of this embodiment will be described.

[0031] When using the shooting training system 1, information about the user who will use this system (user information) and the reference posture are registered in advance.

[0032] User information can be registered, for example, through a dedicated website prepared in advance on the Internet. A person who intends to use the shooting training system 1 registers, for example, through this website, general information about the user himself / herself, such as name, address, and email address, as well as information about the user's physique, such as sex, height, and weight, information about the combination of a login ID and password required for login, the type of firearm for which the user wishes to conduct shooting training, the number of the license to possess the firearm, and the like. When this information is entered through the website, the user information registration unit 21 assigns an identification number (user ID) to the information, and then stores the entered information in the user information storage unit 111.

[0033] Prior to providing the shooting training system 1, the business acquires information on the reference posture of the model shooter. Specifically, for each type of firearm (pistol, hunting gun, sporting gun, etc.), a person (model shooter) who has high skill in shooting with the firearm is photographed actually firing the firearm or a simulant gun that imitates the firearm, and the model shooter's posture with respect to the posture of the firearm, including the axis of the firearm (the direction in which the barrel extends), is acquired at the time when the model shooter fires the firearm and at a predetermined time before and after the time (for example, one second before and after the time of firing, for a total of two seconds). The posture of the model shooter acquired here includes posture data of the same parts (head, chest, waist, feet, and hands in this embodiment) as the posture of the parts acquired when evaluating the shooting posture of the user. Preferably, the shooting posture with the simulant gun 50 is acquired with the user terminal 30 and external sensor 60 of this embodiment attached to the model shooter. This allows measurement data using each sensor equipped in the shooting training system 1 of this embodiment to be acquired simultaneously. When the shooting posture for the model shot is obtained without using the imitation gun 50 or the external sensor 60 (or by using a imitation gun incorporating a different type of sensor module or a different type of sensor), data equivalent to the data measured by each of the above sensors is obtained by performing image analysis of the shooting posture or by converting the output signal of the sensor.

[0034] When the business operator instructs the input of the acquired information on the standard posture of the model shooter, information on the type of firearm, and the shooting style (in the case of the shooting posture when shooting at the target, the type of target, etc.), the standard posture registration unit 22 associates the information, assigns an identification number (standard posture ID), and stores the information in the standard posture storage unit 112. The standard posture registration unit 22 also allows the business operator to input information related to the model shooter's physique, such as the gender, height, and weight, and associates the information with the standard posture data. The business operator also stores in the target information storage unit 113 information on targets used in target shooting training, such as a fixed target (static target) made up of multiple concentric circles, a target shaped to resemble an animal (deer, bird, etc.) that moves at a predetermined speed, and a target (moving target) for clay pigeon shooting, which is a competitive shooting. In addition, information on the trajectory (ballistics) of a bullet fired from the firearm is also stored for each type of firearm.

[0035] The reference position means an ideal shooting position at the timing when the model shooter fires a bullet from the gun. The axis of the gun can be determined based on the positions of two predetermined points on the gun barrel, for example. The predetermined part of the gun is required to be exposed without being hidden by the shooter when the shooter holds the gun, and to be in a position that can be imaged by the outer camera 321 of the imaging unit 32 of the user terminal 30. Therefore, it is preferable that one of the above two points is the muzzle. The other predetermined part may vary depending on the type of gun, but can be, for example, the center position in the longitudinal direction of the gun barrel. The reference position marker 51 is attached, for example, to this one point or near this one point and the muzzle. In the example shown in FIG. 2, the reference position marker 51 is attached to the upper center of the gun barrel.

[0036] Shooting posture training and target shooting training can be performed with the shooting training system 1 of this embodiment. First, a procedure for a user to perform shooting posture training using the shooting training system 1 will be described.

[0037] The user wears the head-mounted display, which is the user terminal 30, on his / her head, and wears the external sensor 60 on a predetermined part (chest, waist, foot, and hand in this embodiment) (the external sensor 60 worn on the hand is not shown in FIG. 2). After that, when the user starts the user terminal program 40 by a predetermined input operation, a login screen is displayed on the display unit 34. The display processing unit 45 has a function of displaying an input keyboard, etc. on the display unit 34, and accepting input to the keyboard, etc. by the user.

[0038] When the user enters a user ID and password using a keyboard or the like displayed on the display unit 34, the information is transmitted to the control and processing device 10. In the control and processing device 10, the user authentication unit 23 searches for user information corresponding to the received user ID and password from the user information stored in the user information storage unit 111, and if matching user information is found, reads out the user information and notifies the user terminal 30 that the login has been authenticated. If there is no user information matching the received user ID and password, an error is notified to the user terminal 30. When an error is notified, a screen prompting the user to re-enter the user ID and password, or to register a new user, is displayed on the display unit 34 of the user terminal 30.

[0039] When the login is authenticated, a screen is displayed on the display unit 34 of the user terminal 30, which allows the user to select either shooting posture training or target shooting training. When the user selects shooting posture training, a list of firearm types that the user has registered in advance as user information is displayed. When the user performs an input operation to select the type of firearm for which shooting training is to be performed from the displayed types of firearms, the display processing unit 45 transmits the selected type of firearm to the control and processing device 10. In the control and processing device 10, the posture comparison unit 25 reads out the received information on the reference posture corresponding to the type of firearm from the reference posture storage unit 112.

[0040] Thereafter, when the user operates the operation unit 52, the fact that the operation unit 52 has been operated is notified to the control / processing device 10. Upon receiving this notification, the control / processing device 10 puts the attitude comparison unit 25 into a standby state.

[0041] In addition, when the user operates the operation unit 52, the imaging unit 32 and the internal sensor 33 in the user terminal 30 are activated and start recording data. Furthermore, the user terminal 30 activates the sensor module 53 attached to the imitation gun 50 and the external sensor 60, and starts communication with the sensor module 53 and the external sensor 60. The out-camera 321 and the in-camera 322 of the imaging unit 32 each acquire images at a predetermined time interval (for example, 60 frames / second) and at a predetermined angle of view, and sequentially store the data in the storage unit 31. The image data stored in the storage unit 31 is accumulated by the number of images corresponding to a predetermined time (for example, one minute), and image data older than that is sequentially erased. Here, in order to reduce the capacity of the storage unit 31, the configuration is such that (old) image data acquired before a predetermined time is erased, but if the storage unit 31 has a sufficient capacity, all acquired image data may be stored in the storage unit 31.

[0042] The attitude detection unit 41 acquires attitude data representing the position and orientation of the user terminal 30 at a predetermined time interval (for example, 60 frames / second) based on the data acquired by the internal sensor 33, and sequentially stores the data in the storage unit 31 together with the output signal from the internal sensor 33. The attitude detection unit 41 also detects the user's line of sight based on the image data of the user's eyes captured by the in-camera 322, and sequentially stores the data in the storage unit 31. Furthermore, the attitude detection unit 41 acquires changes in the attitude of the simulated gun 50, including the axis of the simulated gun 50, at a predetermined time interval (for example, 60 frames / second) based on the position of a predetermined part of the simulated gun 50 determined by the part detection unit 42 from the image captured by the out-camera 321 and the output signal from the sensor module 53, and sequentially stores the changes in the attitude of the simulated gun 50, including the axis of the simulated gun 50. Furthermore, the posture detection unit 41 acquires changes in posture of predetermined parts of the user (chest, waist, feet, and hands) at predetermined time intervals (e.g., 60 frames / second) based on the output signal from the external sensor 60, and sequentially stores the data in the memory unit 31. Hereinafter, these are collectively referred to as "posture data." Only posture data equivalent to a predetermined time period (e.g., one minute) is stored in the memory unit 31, and data older than that is sequentially deleted. If the memory unit 31 has sufficient capacity, all posture data acquired after the start of shooting posture training may be stored in the memory unit 31.

[0043] Fig. 3 shows a pattern displayed as augmented reality on the display unit 34 of the user terminal 30 in a state where the user is holding the imitation gun 50 after operating a button to instruct the user to start shooting posture training. Fig. 4 shows an example of a display on the display unit 34. In this embodiment, the augmented reality shown in Fig. 4 is displayed on the see-through display unit 34. Therefore, the user sees the augmented reality as shown in Fig. 4 superimposed on the scenery captured by the user's own eyes.

[0044] In the example of FIG. 4, information on the user's shooting posture and the model shooter's reference posture is displayed as augmented reality. The information on the user's shooting posture is specifically a mark 81 indicating the direction of the user terminal 30 and a mark 82 indicating the direction of the user's line of sight. The information on the reference posture is a mark 83 indicating the direction of the head in the reference posture and a mark 84 indicating the direction of the line of sight in the reference posture. In addition to these, a guideline 85 indicating the direction in which the barrel of the simulated gun 50 extends, which is obtained from the position of a predetermined part of the simulated gun and the output signal of the sensor module 53, is displayed. Note that the thick arrow 86 in FIG. 4 is represented with reference to the direction in which the barrel of the simulated gun 50 extends as directly viewed by the user (the axis of the simulated gun 50). In this example, the axis of the simulated gun 50 is not displayed as augmented reality, but the axis of the simulated gun 50 may be displayed as augmented reality.

[0045] 4, the user changes his / her posture so that mark 81 indicating the orientation of user terminal 30 matches mark 83 indicating the orientation of the head in the reference posture, and mark 82 indicating the direction of the user's line of sight matches mark 84 indicating the direction of the line of sight in the reference posture. By repeating this, the user can train to maintain the shooting posture of a person (model shooter) who has high skill in shooting with the type of firearm that the user uses.

[0046] After training to maintain the shooting position as described above, the user can test whether he or she has acquired the correct shooting position. In this test, the user performs a firing action using the imitation gun 50 with the display of the reference position information on the display unit 34 turned off.

[0047] When the user holds the simulated gun 50 and operates the operation unit 52, the posture acquisition unit 24 acquires position information of the reference position marker 51 of the simulated gun 50 from the image data captured by the imaging unit 32 at that time, and starts a process of determining the posture of the simulated gun 50, including the axis of the simulated gun 50 (the direction in which the barrel extends), from the position information of the reference position marker 51 and the output signal of the sensor module 53. Then, the posture acquisition unit 24 determines the relationship between the posture of the user detected by the posture detection unit 41 at the above time and the posture of the simulated gun 50 (the user's shooting posture).

[0048] The posture acquisition unit 24 also obtains the amount of variation in posture data during a predetermined time before and after the timing of shooting from posture data (data on the posture of the imitation gun 50 and the posture of the user) acquired during a predetermined time before and after the timing of shooting (for example, one second before and after the time of shooting, a total of two seconds). This amount of variation represents the deviation of the user's shooting posture.

[0049] Next, the posture comparison unit 25 compares the user's shooting posture at each point in time acquired by the posture acquisition unit 24 with the information on the reference posture read from the reference posture memory unit 112 to determine the degree of agreement between the two, and evaluates the user's shooting posture based on the degree of agreement.

[0050] A specific example of evaluating the user's shooting posture will be described.

[0051] As shown in Fig. 2, the posture comparison unit 25 obtains the relationship between the orientation of three axes indicating the posture of the user's head and the orientation of three axes indicating the posture of the simulated gun 50. In particular, among the three axes indicating the posture of the user's head, an axis extending in the same direction as the axis of the simulated gun 50 (in a plan view, in the same direction as the axis of the simulated gun 50) and an offset of the axis of the simulated gun 50 are set as a pitch angle, and a deviation amount is obtained by comparing the orientation (tilt angle) of the chest, waist, feet, and hands of the user acquired by the external sensor 60 and the amount of movement per unit time within the above-mentioned predetermined time with the orientation (tilt angle) of the chest, waist, feet, and hands of the model shooter in the standard posture and the amount of movement per unit time.

[0052] Specifically, the inclination (angle) of each part of the user relative to the axis of the simulated gun 50 when shooting, acquired at a predetermined time before and after the timing of firing by the internal sensor 33 attached to the user, the sensor module 53 attached to the simulated gun 50, and the external sensor 60, is compared with the inclination of each part relative to the axis of the gun in the reference posture to determine the deviation. Also, the time series data of the inclination (angle) of each part of the user relative to the axis of the simulated gun 50 when shooting is vectorized, and the deviation is determined by comparing it with the corresponding vector in the reference posture.

[0053] The time series data is generated for a time range including a time period from the timing t0 when the user starts the shooting action to the timing t1 when the user fires the gun. In this embodiment, the timing when the user operates the operation unit 52 is set as t0. The timing when the amount of upward fluctuation per unit time of the axis of the simulated gun 50 determined by the attitude acquisition unit 24 exceeds a predetermined value (the timing when recoil occurs due to the firing action of the simulated gun 50) is set as the timing t1 when the user fires the gun. Here, it is assumed that the simulated gun 50 is configured to generate recoil when the gun is fired, but when using a simulated gun 50 that does not generate recoil when fired, the timing t1 may be configured to be determined based on the operation of a trigger provided on the simulated gun 50. In the following description, a vector representing the attitude of each part of the user relative to the axis of the gun at t0 is called a "shooting time vector", and the same vector after t1 is called a "post-shooting vector". When a predetermined time (for example, 10 seconds) has elapsed from timing t1 when the user fires the gun, the imaging unit 32, the internal sensor 33, the sensor module 53, and the external sensor 60 stop recording data.

[0054] Next, an explanation will be given of the items that are evaluated based on the deviation between the user's shooting posture and the reference posture calculated as described above.

[0055] As shown in FIG. 5, in this embodiment, errors that may appear in the user's shooting posture, such as halting, unstable aim, unstable left and right movement, hand shooting, jerky pulling, abnormal follow-through, unstable form, head up, fringe, unstable movement when shooting standing, and unstable recoil, and information correlating the contents of each item are stored in advance in the evaluation information storage unit 15.

[0056] The result output unit 26 stores the results of the above comparison by the posture comparison unit 25 in the storage unit 11, and collates them with the information stored in the evaluation information storage unit 15 to determine whether there are any matching items. Then, it transmits the comparison results by the posture comparison unit 25, along with any error items that match the comparison results, to the user terminal 30. In the user terminal 30, the display processing unit 45 displays the received comparison results and error items on the display unit 34 of the user terminal 30. The user can grasp the specific content of the problem with his or her shooting posture by checking the error items and their contents displayed on the display unit 34.

[0057] In the shooting training system 1 of this embodiment, since there is no need to use live ammunition, shooting posture training can be easily performed in various locations. In addition, the user can learn the correct shooting posture by learning the standard posture of a model shooter and checking the result of comparing the user's shooting posture with the standard posture of the model shooter on the display unit 34.

[0058] The shooting training system 1 of this embodiment can be used in various ways other than those described above. Some of these examples will be described below.

[0059] When the user instructs the start of target shooting training by a predetermined input operation, the target display control unit 27 generates screen data that allows the user to specify the type of target prepared in advance and its position, and transmits it to the user terminal 30. In the user terminal 30, the display processing unit 45 displays the received screen data on the display unit 34 and accepts input from the user. The types of targets include, for example, flying targets for clay pigeon shooting, moving targets for single-head shooting, and stationary targets for single-trajectory shooting. Regarding the position of the target, for example, in the case of a stationary target, the distance from the user and the height from the ground surface are included, and in the case of a moving target, the start position of the movement, the direction of movement (only left and right movement in the case of single-trajectory shooting), the movement speed, etc. are included. When the user inputs this information, the display processing unit 45 transmits the input information to the control and processing device 10. One of these input forms may include a random display of fixed and / or moving targets.

[0060] Thereafter, in the case of a fixed target, the target display control unit 27 generates screen data for displaying the type of target input by the user at the position input by the user, and transmits the data to the user terminal 30. In the case of a moving target, the target display control unit 27 generates screen data for prompting the user to start shooting, and transmits the data to the user terminal 30. The user terminal 30 displays the received screen data on the display unit 34.

[0061] In the case of a fixed target, the user operates the operation unit 52 to input the timing to start recording the shooting posture. The hit determination unit 28 starts recording the direction of the gun barrel acquired by the posture acquisition unit 24 when the operation unit 52 is operated, and performs hit determination based on the bullet trajectory information of the gun and the position of the target stored in advance in the storage unit 11 when the amount of upward fluctuation per unit time of the axis of the simulated gun 50 exceeds a predetermined value. Here, it is assumed that the simulated gun 50 is configured to generate recoil when fired, but when using a simulated gun 50 that does not generate recoil when fired, the timing of firing may be determined based on the operation of a trigger provided on the simulated gun 50. Alternatively, the trigger provided on the simulated gun 50 may be used as the operation unit 52, and both the timing of starting recording the shooting posture and the timing of firing may be determined based on the timing of operation of the operation unit 52.

[0062] In the case of a moving target, the user issues an instruction to start shooting by operating the operation unit 52. When the instruction to start shooting is given, the target display control unit 27 generates screen data for displaying the type of target specified by the user based on the movement start position, direction, and speed specified by the user, and transmits the screen data to the user terminal 30.

[0063] When the amount of upward movement of the axis of the imitation gun 50 per unit time exceeds a predetermined value (or when the user operates the trigger), the timing of shooting is input. The hit determination unit 28 performs hit determination based on the direction of the gun barrel acquired by the attitude acquisition unit 24 at the timing of shooting, the bullet trajectory information of the gun previously stored in the memory unit 11, and the position of the target.

[0064] When the hit determination unit 28 completes the determination, the result output unit 26 stores the hit determination result after the shot (indication of hit / miss, the target position and the impact position when shooting, etc.) in the memory unit 11 and transmits it to the user terminal 30. Similarly to the above, the posture comparison unit 25 determines the deviation between the shooting posture of the user when shooting the target and the reference posture. Then, the posture comparison unit 25 stores the comparison result in the memory unit 11, determines the error item that matches the result, reads out the contents of the error item from the evaluation information storage unit 15, and transmits the information to the user terminal 30. In the user terminal 30, the display processing unit 45 displays the received hit determination result and the error content on the display unit 34 of the user terminal 30.

[0065] In shooting training for shooting targets, the type of shooting is associated in advance with possible error items. In this embodiment, for example, as shown in FIG. 6, when shooting clay shooting at a flying target, the error items of form stability, head up, hand shot, jerking, follow-through abnormality, and stopping are associated, and the posture comparison unit 25 judges whether the deviation of the user's shooting posture from the reference posture matches any of these items, and if there is a matching error item, transmits the error item and the contents of the error item to the user terminal 30. As a result, even when shooting at a target, the user can grasp errors in his / her own shooting posture by checking the error items and their contents displayed on the display unit 34.

[0066] The shooting training system 1 of this embodiment also allows the user to check the results of shooting posture training and target shooting training that have been carried out so far.

[0067] When the user instructs to check the past training results, the analysis unit 29 reads out the results of the user's past shooting training stored in the storage unit 11, and displays a screen on the display unit 34 of the user terminal 30 that allows the user to specify the checking method. For example, in the case of shooting posture training, the checking method is the past training results (a superimposed display of the user's posture and the reference posture, a graph showing the shooting posture score and the score related to the deviation of the shooting posture in chronological order, etc.). In the case of target shooting training, for example, the past target shooting results (hit / miss, target position and impact position displayed, etc.). By checking these, the user can check the degree of mastery of the shooting posture and discover the habits of his / her own shooting posture. In addition, the analysis unit 29 can be used to display the results of statistical processing of the user's own shooting posture and the evaluation results of the shooting posture. Any suitable statistical processing method known in the art may be used.

[0068] Furthermore, in the shooting training system 1 of this embodiment, the reference posture can be added or changed as appropriate. When a business operator or the like who operates and manages the shooting training system 1 logs in with a preset ID and password for the business operator or the like and issues an instruction to register a new reference posture of a highly skilled model shooter, the reference posture registration unit 22 causes the business operator or the like to input data on the reference posture together with information on the reference posture to be registered (such as the type of firearm and the gender, height, and weight of the model shooter). When the business operator or the like inputs this information, the input information and the data on the reference posture are stored in the reference posture storage unit 112 in association with each other.

[0069] When data on a plurality of reference postures for a certain type of firearm is thus stored in the reference posture memory unit 112, the user can select from the data the reference posture to be used for his / her own shooting posture training.

[0070] When the user instructs the selection of the reference posture, the reference posture registration unit 22 reads out the information of the reference posture stored for the type of firearm designated by the user from the reference posture storage unit 112 and displays them in a list. The list display includes information related to the physique of the model shooter from whom each reference posture was acquired, such as the sex, height, and weight, and data of the reference posture (for example, video data including a predetermined time before and after the shooting point). When the user selects the reference posture data to be used for his / her own shooting posture training from the listed reference postures, the reference posture registration unit 22 registers the selected reference posture data in the user information storage unit 111 as the reference posture data for the shooting posture training of the user using the firearm. Generally, the shooting posture differs depending on the physique of the shooter, so that the user can learn a shooting posture more suitable for himself / herself by selecting the reference posture of a model shooter whose physique is close to his / her own.

[0071] <Second embodiment> Next, a second embodiment of the shooting training system 100 will be described. In the following description, the same components as those in the first embodiment are given the same reference numerals, and detailed description thereof will be omitted.

[0072] 7 is a diagram showing the main components of a shooting training system 100 according to the second embodiment. The shooting training system 100 according to the present embodiment includes a control and processing device 10, a user terminal 130, an imitation gun 50, an external sensor 60, and a display device 70. The control and processing device 10 is, for example, a cloud server, as in the first embodiment.

[0073] The user terminal 130 is a module smaller than a head mounted display, and includes only a memory unit 31 and an internal sensor 33 as hardware, and is worn on the user's head as shown in Fig. 8. In the second embodiment, the user terminal 130 does not have a display unit, and instead is provided with a display device 70. The display device 70 is also, for example, a small LCD module, and is attached to the barrel of the imitation gun 50.

[0074] The second embodiment operates in the same manner as the first embodiment, except that the evaluation result of the user's shooting posture and the like are displayed on the screen of the display device 70. In the second embodiment, a screen such as that shown in Fig. 9 is displayed on the screen of the display device 70. Here, the display device 70 is provided on the barrel of the imitation gun 50, but the display device 70 may be provided as a monitor separate from the imitation gun 50.

[0075] The above embodiment is merely an example and can be modified as appropriate in accordance with the spirit of the present invention.

[0076] In the above embodiment, the shooting posture is determined by using the head posture and line of sight information of the user wearing the user terminal 30 (head mounted display), and further obtaining the postures of the user's chest, waist, feet, and hands using the external sensor 60. However, the parameters of the shooting posture can be appropriately changed according to the user's skill level. For example, since a skilled user rarely has blurred lines of sight, the shooting posture can be evaluated using only the direction in which the center of gravity of the gun extends and the relative positional relationship of the head. In such a case, for example, as shown in FIG. 10, only the user terminal 30 can be used without using the external sensor 60.

[0077] On the other hand, beginners are likely to have variations not only in their head and line of sight, but also in the position of the center of gravity of the body, the position of both shoulders, the position of the waist, the angle of the arms, etc. Therefore, when assuming use by beginners, it is advisable to include these in the parameters of the shooting posture. If these are to be included in the parameters of the shooting posture, information on these parameters should also be included in the reference posture of the model shooter. Also, when the user performs shooting training, various sensors capable of acquiring these parameters should be used.

[0078] Furthermore, beginners often apply excessive force to specific parts of the body, such as the fingers, arms, or thighs, when attempting to operate a trigger. Therefore, it is advisable to attach an external sensor including a myoelectric potential sensor to the back of the hand, arm (forearm or upper arm), or thigh to detect when the user is applying excessive force to the hand, or to attach an external sensor including a pressure sensor to the trigger to detect when the user is applying excessive force to operate the trigger. Since the parts of the body where excessive force is applied differ from person to person for beginners, it is possible to identify such parts for each individual and attach a myoelectric potential sensor to them for use.

[0079] While the above embodiment has been described as using the imitation gun 50, the present invention does not exclude the use of a firearm that actually fires bullets. An actual firearm may be combined with a configuration similar to that described in the above embodiment, and configured to evaluate the shooting posture when actually firing a bullet.

[0080] At this time, it is dangerous if a beginner fires a live bullet in an obviously incorrect shooting position. In addition, expensive bullets will be wasted. Therefore, it is preferable to configure the device so that the trigger is locked or a warning sound is emitted when the deviation of the shooting position from the reference position exceeds a predetermined threshold value after the user operates the operation unit 52. This makes it possible to prevent the occurrence of danger and the wasteful consumption of live bullets. Of course, the configuration for emitting a warning sound may be used not only in an actual firearm, but also in combination with the imitation gun 50 described in the above embodiment.

[0081] In the above embodiment, the configuration is such that the posture at the time of shooting as well as the shaking before and after the shooting are evaluated, but the configuration may be such that only the posture at the time of shooting is evaluated. In that case, the image data acquired by the imaging unit 32 and the posture data acquired by the posture detection unit 41 do not need to be stored (accumulated) in the storage unit 11.

[0082] In the above embodiment, the user's posture data is acquired using the user terminal having the internal sensor 33 and the external sensor 60, and the gun's posture data is acquired using the outer camera 321, the part detection unit 42, and the sensor module 53, but other configurations may be adopted. For example, information on the user's posture and a specific part of the gun may be acquired by motion capture. In addition, it is not essential to provide a display unit or a display device 70 on the user terminal, and the results of the shooting training may be displayed on the display unit of a computer terminal connected wirelessly or by wire, output as audio, or printed on paper.

[0083] In the above embodiment, the shooting posture of the user holding the simulated gun 50 is acquired, but the posture of holding an actual gun instead of the simulated gun 50 may be evaluated. Alternatively, the user may take a shooting posture of holding a gun without holding the simulated gun 50 or an actual gun, and the shooting posture may be evaluated. In that case, for example, sensors may be attached to both hands of the user, and the posture of the gun may be estimated based on position information acquired from the sensors.

[0084] [Aspects] It will be apparent to those skilled in the art that the above-described exemplary embodiments are illustrative of the following aspects.

[0085] (Section 1) A shooting training system according to one aspect of the present invention comprises: a storage unit that stores information on a reference posture of the model shooter with respect to a predetermined part of a gun when the model shooter is holding the gun; A posture detection unit that detects a user's shooting posture; a posture acquisition unit that acquires the shooting posture of the user from the posture detection unit at a predetermined timing; a posture comparison unit that compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture stored in the memory unit; a result output unit that outputs a result of the comparison by the posture comparison unit; Equipped with.

[0086] In the shooting training system according to paragraph 1, information on the standard posture of the model shooter with respect to a predetermined part of the firearm is stored in advance in a storage unit. The model shooter means a shooter with high skill. The standard posture means an ideal shooting posture at the timing when the model shooter fires a bullet from the firearm. Preferably, information on the standard posture is acquired from the shooting posture of a model shooter with a similar physique to the user. The shooting posture of the user is typically the posture of the user holding an actual firearm or a simulated firearm, but may also be a posture assuming that the user holds an actual firearm (a posture without holding an actual firearm or a simulated firearm). When an actual firearm or a simulated firearm is used, for example, an actual firearm or a simulant of an actual firearm to which sensors for acquiring the user's shooting posture are attached can be used.

[0087] The shooting training system according to the first aspect of the present invention includes a posture detection unit that detects the shooting posture of the user. The shooting posture of the user preferably includes at least the posture of the head. In addition, the positions of the chest, waist, both hands (the arm or hand that supports the gun and the hand that operates the trigger), both feet, etc. may be included.

[0088] The posture acquisition unit acquires the user's shooting posture from the posture detection unit at a predetermined timing, and the posture comparison unit compares it with the reference posture stored in the storage unit. The result of the comparison by the posture comparison unit is output to the result output unit. For example, if a display unit is provided, the result can be displayed on the screen of the display unit. Other suitable methods such as paper output and audio output can also be used. In addition, the result of the comparison by the posture comparison unit can include, for example, an evaluation of the degree of agreement between the user's shooting posture and the reference posture, and a display showing the deviation between the user's shooting posture and the reference posture by superimposing them.

[0089] The predetermined timing may be, for example, the timing when an operating unit is operated by providing an operating unit. The operating unit may be operated by the user himself or by a person other than the user (for example, an instructor). The operating unit may be anything that can input the timing of firing, and when operated by the user, it may be, for example, a trigger or something that can be operated by the hand that holds the gun. Alternatively, for example, when shooting at a static target, the predetermined timing may be the timing when a predetermined time has elapsed during which the amount of variation per unit time of the user's shooting posture acquired by the posture acquisition unit is equal to or less than a predetermined value (i.e., the timing at which the user can be considered to continue to maintain the same shooting posture). Conversely, the predetermined timing may be the timing at which the amount of variation per unit time of the user's shooting posture or the amount of variation in the posture of the gun exceeds a predetermined value (i.e., the timing at which the posture of the user or the gun can be considered to have changed due to the user's action of firing the gun). Furthermore, these may be appropriately determined depending on the posture to be trained (a static posture before firing, a dynamic posture while firing, or a series of postures before and after firing) and the type of firearm to be used (whether or not the firearm produces recoil when fired, etc.).

[0090] (Section 2) The shooting training system according to paragraph 2 is a shooting training system according to paragraph 1, The posture detection unit further detects a direction in which a barrel of the gun extends in the shooting posture, The posture acquisition unit acquires, as the shooting posture, a posture of the user relative to a direction in which a barrel of the gun extends. It can be configured as follows.

[0091] In the shooting training system according to paragraph 2, the shooting posture of the user can be acquired with higher accuracy based on the relative positional relationship between a predetermined part of the gun and the posture of the user. The direction in which the gun barrel extends can be determined based on, for example, the positions of two predetermined points on the gun barrel or an output signal from a sensor attached to the gun. Alternatively, when the user takes a shooting posture without holding the gun, the direction in which the gun barrel extends can be determined based on, for example, an output signal from a center attached to the user's hand.

[0092] (Section 3) The shooting training system according to paragraph 3 is the shooting training system according to paragraph 1 or 2, further comprising: A display unit; a display processing unit that displays information representing the shooting posture of the user on a screen of the display unit; Equipped with.

[0093] In the shooting training system according to paragraph 3, the shooter can check his / her own shooting position.

[0094] (Section 4) The shooting training system according to paragraph 4 is a shooting training system according to paragraph 3, The display processing unit further displays information representing the reference attitude on a screen of the display unit.

[0095] In the shooting training system according to paragraph 4, the difference between the user's posture and the reference posture can be visually confirmed on the display unit.

[0096] (Section 5) The shooting training system according to paragraph 5 is a shooting training system according to paragraph 3 or 4, The storage unit stores position information of a virtual target to be displayed on the display unit, The display processing unit displays augmented reality or virtual reality on the display unit, moreover, a target display unit that displays a virtual target on the display unit; a hit determination unit that performs hit determination based on the position of the predetermined part of the firearm acquired by the attitude acquisition unit and the position information of the virtual target; Equipped with.

[0097] In the shooting training system according to paragraph 5, in addition to evaluating the posture when shooting, shooting training at a target can be conducted.

[0098] (Section 6) The shooting training system according to paragraph 6 is a shooting training system according to paragraphs 1 to 5, The storage unit further stores a plurality of error items and their contents that may occur in the shooting posture of the user, The posture comparison unit determines an item of the error that matches a result of the comparison, The result output unit further outputs the error item.

[0099] In the shooting training system according to paragraph 6, the user can grasp the content of errors occurring in his / her shooting posture.

[0100] (Section 7) The shooting training system according to paragraph 7 is a shooting training system according to paragraphs 1 to 6, The storage unit stores information on the reference posture of the model shooter for each type of firearm, moreover, A gun type input section for accepting input of a gun type Equipped with The posture comparison unit compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture corresponding to the type of firearm inputted to the firearm type input unit.

[0101] The shooting training system under paragraph 7 allows for shooting training with multiple types of firearms.

[0102] (Section 8) The shooting training system according to paragraph 8 is a shooting training system according to paragraph 7, The storage unit further stores information describing a plurality of error items and their contents that may occur in a shooting posture using the firearm according to the type of the firearm, The posture comparison unit determines the type of the firearm received by the firearm type input unit and the error item that matches the result of the comparison, The result output unit further outputs the error item.

[0103] In the shooting training system according to paragraph 8, the user can grasp the type of errors occurring in his / her own shooting posture, which differ depending on the type of firearm he / she is using. [Explanation of symbols]

[0104] 1, 100... Shooting training system 10...Control and processing device 11...Storage section 111...User information storage unit 112...Reference posture memory unit 113...information storage section 20...Program for control and processing device 21...User information registration section 22...Reference attitude registration unit 23...User authentication section 24…Attitude acquisition part 25…Posture comparison section 26...Result output section 27 Display control unit 28… Hit judgment section 29…Analysis Department 30, 130...User terminal 31...Storage section 32...Imaging unit 321…Outside camera 322…In-camera 33…Internal sensor 34…Display section 40...User terminal program 41...Attitude detection unit 42...Part detection unit 43…Eye tracking unit 44…Attitude acquisition part 45...Display processing unit 50…Impersonation gun 51...Reference position marker 52...Operation unit 53...Sensor module 60…External sensor 70…Display device 81...Mark indicating the orientation of the user device 82...Mark showing the direction of the user's gaze 83...Mark showing head direction in standard posture 84…Mark showing the direction of gaze in the standard position 85...Guideline showing the direction in which the barrel of a mock gun extends 86…The direction in which the barrel of the imitation gun actually extends

Claims

1. a storage unit that stores information on a reference posture of the model shooter with respect to a predetermined part of a gun when the model shooter is holding the gun; A posture detection unit that detects a user's shooting posture; a posture acquisition unit that acquires the shooting posture of the user from the posture detection unit at a predetermined timing; a posture comparison unit that compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture stored in the memory unit; a result output unit that outputs a result of the comparison by the posture comparison unit; A shooting training system comprising:

2. The posture detection unit further detects a direction in which a barrel of the gun extends in the shooting posture, The posture acquisition unit acquires, as the shooting posture, a posture of the user relative to a direction in which a barrel of the gun extends.

2. The shooting training system of claim 1 .

3. moreover, A display unit; a display processing unit that displays information representing the shooting posture of the user on a screen of the display unit; 2. The shooting training system of claim 1, comprising:

4. The display processing unit further displays information representing the reference attitude on a screen of the display unit.

4. The shooting training system according to claim 3, characterized in that

5. The storage unit stores position information of a virtual target to be displayed on the display unit, The display processing unit displays augmented reality or virtual reality on the display unit, moreover, a target display unit that displays a virtual target on the display unit; a hit determination unit that performs hit determination based on the position of the predetermined part of the firearm and the position information of the virtual target acquired by the attitude acquisition unit; 4. The shooting training system of claim 3, comprising:

6. The storage unit further stores a plurality of error items and their contents that may occur in the shooting posture of the user, The posture comparison unit determines an item of the error that matches a result of the comparison, The result output unit further outputs the error item.

2. The shooting training system of claim 1, comprising:

7. The storage unit stores information on the reference posture of the model shooter for each type of firearm, moreover, A gun type input section for accepting input of a gun type Equipped with The posture comparison unit compares the shooting posture of the user acquired by the posture acquisition unit with the reference posture corresponding to the type of firearm inputted to the firearm type input unit.

2. The shooting training system of claim 1 .

8. The storage unit further stores information describing a plurality of error items and their contents that may occur in a shooting posture using the firearm according to the type of the firearm, The posture comparison unit determines the type of the firearm received by the firearm type input unit and the error item that matches the result of the comparison, The result output unit further outputs the error item.

8. The shooting training system according to claim 7, characterized in that

Images