Image recording device and gun

Abstract

This image recording device is provided with an image capturing unit capable of continuously capturing images in an aiming direction, an acceleration sensor, and an arithmetic processing unit for detecting an operation timing of a mechanism interlocked to a trigger operation of a gun, on the basis of an output value of the acceleration sensor, wherein the arithmetic processing unit: determines that a state in which an amount of change in the output value of the acceleration sensor is less than a predetermined first threshold is a state of rest; determines that a state in which the state of rest has continued for more than a predetermined time is an aiming state; upon detecting that the amount of change in the output value of the acceleration sensor while in the aiming state is greater than a predetermined second threshold at least equal to the first threshold, determines that the mechanism interlocked to the trigger operation of the gun has operated; and records images for a certain period including the timing, from among the images captured by the image capturing unit.

Description

[Technical Field]

[0001] The present invention relates to an image recording device that can be mounted on a gun, and to a gun equipped with such a device. [Background technology]

[0002] A technology has been proposed that uses an acceleration sensor to detect the timing of the operation of a gun mechanism linked to the action of pulling the trigger of a gun (hereinafter referred to as the "trigger action") and records images before and after that timing.

[0003] For example, Patent Document 1 discloses a technique for detecting the timing of a firing by measuring the frequency spectrum emitted at the time of firing with an accelerometer, focusing on the action of the firing pin striking the cartridge in conjunction with the trigger operation of a gun (hereinafter, this action will be referred to as "firing"). Specifically, the technique applies a fast Fourier transform to the output signal of the accelerometer to filter out frequency components outside the frequency band of approximately 5 kHz to 10 kHz, and then searches for an energy pulse between 5 kHz and 10 kHz. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 4550817 Summary of the Invention [Problem to be solved by the invention]

[0005] However, even with the above-mentioned conventional technology, if the gun is hit or dropped while in use, the accelerometer will emit a wide range of frequency spectrums, which may result in a false detection of a gun firing. In addition, other actions such as operating the bolt, removing or inserting the magazine, and opening and closing the ejector cover may generate vibrations similar to those generated by a gun firing.

[0006] The present invention has been made in response to such conventional circumstances, and aims to provide an image recording device and a gun that can reduce false detection of gun mechanism operations linked to trigger operations such as firing, enable highly accurate detection, and record images (video and / or still images) before and after the detection of the gun mechanism operation. [Means for solving the problem]

[0007] The inventors analyzed the flow of shooting to avoid erroneous recognition, and as a result, they found that by focusing on the shooter's movement when aiming, which involves a certain period of stillness before pulling the trigger (aiming state), and detecting movement above a predetermined value during the aiming state, erroneous detection of the operation of the gun mechanism linked to the gun's trigger operation, such as firing, can be reduced.

[0008] Specifically, the image recording device according to the present disclosure is an image recording device (1) attached to a gun, an imaging unit (12) capable of continuously capturing images in the aiming direction; an acceleration sensor (41); a processing unit (43) for detecting the timing of an operation of a mechanism linked to a trigger operation of the gun based on the output value of the acceleration sensor, The arithmetic processing unit (43) When the amount of change in the output value of the acceleration sensor (41) is smaller than a preset first threshold, it is determined that the gun is in a stationary state, and when the stationary state continues for a preset time or longer, it is determined that the gun is in an aiming state. When it is detected that the amount of change in the output value of the acceleration sensor during the aiming state has become greater than a preset second threshold that is greater than or equal to the first threshold, it is determined that a mechanism linked to the trigger operation of the gun has operated. Among the images captured by the imaging unit (12), images for a certain period including the timing are recorded.

[0009] In particular, the acceleration sensor (41) is a three-axis acceleration sensor, The first threshold value and the second threshold value can be set for each axis, The arithmetic processing unit (43) When the output values ​​of all axes of the three-axis acceleration sensor are smaller than the first threshold value of each axis, the gun is determined to be in a stationary state, and when the stationary state continues for a predetermined time or longer, the gun is determined to be in an aiming state. When the output values ​​of all axes of the three-axis acceleration sensor are detected to be larger than the second threshold value of each axis during the aiming state, the gun is determined to have operated a mechanism linked to the trigger operation of the gun.

[0010] In addition, the three-axis acceleration sensor of the image recording device according to the present disclosure is fixed so that one of the axes can detect acceleration in a line of fire (aiming direction), The second threshold value of each axis of the three-axis acceleration sensor is characterized in that the second threshold value of the one axis capable of detecting acceleration in the line of fire is greater than the second threshold values ​​of the other two axes.

[0011] The first threshold value and the second threshold value may be selectable / settable by a switching means such as a dip switch in the device or an externally rewritable nonvolatile memory. [Effects of the Invention]

[0012] According to the present disclosure, the acceleration sensor is also used to detect the aiming state before the trigger operation of the gun, thereby reducing erroneous detection of the operation of the gun mechanism linked to the trigger operation of the gun, such as firing, and making it possible to record images before and after the operation of the gun mechanism, including the timing of the operation, as well as images of the moment the gun mechanism operates. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is an external view of a gun equipped with an image recording device according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a functional block diagram of the image recording device of FIG. 1. [Figure 3] FIG. 2 is a diagram showing the internal configuration of the image recording device of FIG. [Figure 4]FIG. 2 is a component mounting diagram of the image recording device of FIG. [Figure 5] 3 is a flowchart showing the procedure of the trigger determination process in FIG. 2. [Figure 6] 10A and 10B are diagrams showing an example of display of recorded data in a nonvolatile memory according to an embodiment of the present invention; [Figure 7] FIG. 10 is an explanatory diagram of the flow of image display on a personal computer when a percussion is detected. [Figure 8] FIG. 10 is an explanatory diagram of an image display screen on a personal computer when a percussion is detected. [Figure 9] FIG. 10 is an external view of a gun equipped with an image recording device according to a second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram showing the internal configuration of the image recording device in FIG. [Figure 11] FIG. 10 is a functional block diagram of the image recording device of FIG. 9. DETAILED DESCRIPTION OF THE INVENTION

[0014] A first embodiment of the present invention will be described below with reference to the drawings. The image recording device 1 according to this embodiment can be attached to a commercially available firearm 90 for use. For example, as shown in FIG. 1, the image recording device 1 may be provided with a rail mounting portion 2 compatible with a general-purpose 20 mm rail, and the image recording device 1 may be attached to the rail of the firearm 90 using this rail mounting portion 2. The mounting position is not limited to the position shown in FIG. 1, and the image recording device 1 may be attached to another position, such as below the handguard of the gun barrel. Furthermore, by attaching an adapter to the rail mounting portion 2, the image recording device 1 can be attached to any firearm.

[0015] Next, with reference to FIG. 2, the main functions of the image recording device 1 according to this embodiment will be described.

[0016] The image recording device 1 is composed of a telephoto lens 11, a camera board (imaging unit) 12, a microcomputer board 13, a sensor board 14, and a non-volatile memory 15. The boards 12 to 14 can also be configured as an integrated unit. A microSD card, for example, can be used as the non-volatile memory 15.

[0017] The camera board 12 has a CMOS sensor, captures an image obtained through the telephoto lens 11, and transfers the image data (for example, RGB data) to the microcomputer board 13.

[0018] The sensor board 14 has a three-axis acceleration sensor 41 and a processing unit 43 that executes trigger determination processing 42 to detect the timing of a shot.

[0019] The microcomputer board 13 has a ring buffer 31 for cyclically storing image data and a communication unit 32 for communicating with external devices such as a user's mobile terminal 50. The communication unit 32 and the mobile terminal 50 can be connected via, for example, Bluetooth (registered trademark), but any communication standard can be used. The microcomputer board 13 also has an arithmetic processing unit 36 ​​that executes an image data acquisition process 33 that acquires image data from the camera board 12 and stores it in the ring buffer 31, a recording process 34 that writes the image data stored in the ring buffer 31 to the non-volatile memory 15 based on the result of a trigger determination process 42, and a communication process 35 that communicates with the mobile terminal 50 via the communication unit 32. Process 42 and processes 33 to 35 can each be realized by a program as a function of a computer (CPU).

[0020] The components of the image recording device 1 having the above functions are mounted as shown in FIG. 3. The mounting method of the components is not limited to this, and they may be mounted as shown in FIG. 4, for example. In FIG. 4, a fixed-focal-length lens 11a is provided instead of the telephoto lens 11. Using the fixed-focal-length lens 11a eliminates the need for focusing. The camera board 12, to which the fixed-focal-length lens 11a and a CMOS sensor 12a (not shown) are attached, is connected to the microcomputer board 13 by a flexible cable 17a, and the signal output from the CMOS sensor 12a is passed to the processing unit 36 ​​of the microcomputer board 13. In this way, by separating the camera board 12 and the microcomputer board 13 and connecting them with the flexible cable 17a, it is possible to prevent the impact applied to the camera board 12 during firing from being directly transmitted to the microcomputer board 13. This improves the impact resistance of the image recording device 1. In FIG. 4, the microcomputer board 13 and the sensor board 14 are integrally formed.

[0021] Next, an outline of the operation of the image recording device 1 according to this embodiment will be described. When the image recording device 1 is started by turning on the power switch 19, the arithmetic processing unit 36 ​​of the microcomputer board 13 executes the image data acquisition process 33 and sequentially stores the image data acquired by the imaging unit 12 in the ring buffer 31. Then, upon receiving a detection signal of the timing of the percussion output from the sensor board 14, the arithmetic processing unit 36 ​​executes the recording process 34 and writes the image data stored in the ring buffer 31 to the nonvolatile memory 15. At this time, the nonvolatile memory 15 may store not only video data for a certain period including the timing of the percussion, but also still image data of the moment of the percussion and acceleration sensor values ​​passed from the sensor board 14.

[0022] Next, the arithmetic processing unit 36 ​​executes communication processing 35 to transmit the data stored in the nonvolatile memory 15 to the mobile terminal 50 via the communication unit 32. Note that the mobile terminal 50 may be another computer device such as a general-purpose personal computer (PC).

[0023] The procedure of the trigger determination process 42 of the sensor substrate 14, which is an important function in this embodiment, will be described below with reference to FIG.

[0024] In FIG. 5, when the arithmetic processing unit 43 of the sensor board 14 is activated by powering on, etc., it performs an initialization process (S101) and then reads preset parameters for each of the x, y, and z axes of the three-axis acceleration sensor 41 (S102, S103). These parameters consist of a stillness parameter (first threshold) and a vibration parameter (second threshold). The stillness parameter is a threshold for detecting the shooter's still state when aiming, and the vibration parameter is a threshold for detecting the subsequent firing. The vibration parameter value for each axis is equal to or greater than the stillness parameter value. These parameters can be stored as predetermined fixed values ​​in the program or in a nonvolatile memory dedicated to the parameters. Alternatively, a switching means such as a DIP switch can be provided within the image recording device 1 so that they can be set and changed by this switching means. Each parameter is read into the program by the processing of steps S102 and S103.

[0025] The trigger determination process 42 then repeats the following loop 1 process (stationary state detection process) (S104a, S104b). First, acceleration data for each of the three axes is acquired from the acceleration sensor 41 (S105). Then, the absolute value of the difference from the previous value for each of the three axes is calculated (S106, S107). Then, for each axis, it is determined whether the value calculated in step S107 is smaller than the stationary parameter (S108). If it is smaller for all axes, a counter for counting stationary time is counted up (S109). Then, it is determined whether the counted stationary time exceeds a preset time (S110). If it does, it executes loop 2 process (percussion detection process) (described later) (S113a, S113b). On the other hand, if the counted stationary time does not exceed the preset time in step S110, the acceleration sensor value for each axis is saved (S111). Then, it returns to step S104a and executes the next loop 1 process. If the answer is "NO" in step S108, the stationary time is cleared (S112).

[0026] In the percussion detection process (S113a, S113b), acceleration data for each of the three axes is first acquired from the acceleration sensor 41 (S114). Then, the absolute value of the difference from the previous value for each axis is calculated (S115, S116). Next, it is determined whether the value calculated for each axis in step S116 is greater than the vibration parameter (S117). If the values ​​are greater for all axes, the percussion flag is turned on, and the recording process 34 is initiated to write the video data stored in the ring buffer 31 to the non-volatile memory 15 (S119). At this time, video data up to a certain time after the percussion flag was turned on may also be saved. Once the video data has been saved, the percussion flag is turned off (S120). Then, acceleration data for each of the x, y, and z axes is saved (S121). This acceleration data is used as the previous value for the process of step S115 during the next loop.

[0027] If the answer is "NO" in step S117, it is determined whether the value calculated in step S116 for each axis is smaller than the rest parameter (S122), and if it is smaller for all axes, the process proceeds to step S121 and repeats the subsequent processes. If the absolute value of the difference between the acceleration data and the previous value for even one axis is larger than the rest parameter in step S122, the process proceeds to step S112 of the rest state detection process, the rest time is cleared, and then the processes from step S111 onwards are repeated. The data stored in the nonvolatile memory 15 in step S119 can be reproduced on the mobile terminal 50, a personal computer (PC), or the like.

[0028] Figure 6 shows images of each stage of aiming, firing, recoil, and follow-through, as well as waveforms on each axis of the three-axis acceleration sensor.

[0029] In this embodiment, as shown in FIG. 7, video data covering several seconds before and after the trigger shot is transmitted from the image recording device 1 to, for example, a personal computer (PC). At this time, the time may be synchronized between the personal computer (PC) and the image recording device 1 in advance, and the time at which the trigger shot is detected may be transmitted to the personal computer (PC) as a trigger shot signal. The trigger shot signal may be a frame number instead of a time shot, as long as it can identify the frame at which the trigger shot is fired in the video. Furthermore, by saving a still image of the trigger shot, the user can more accurately grasp the state of the trigger shot, even if the video is shot at a relatively slow speed.

[0030] Figure 8 shows an example of a video or still image display (control screen) that includes the timing of a shot displayed on a personal computer (PC). This control screen allows you to switch between video and still image displays, adjust the display position, and control start and stop for each piece of data saved when a shot is detected. Additionally, it is possible to save and edit profiles that associate image data with the shooter's identification information, information about the gun and bullet used in the shot, the location, and other weather and time information.

[0031] In this embodiment, the system first detects the shooter's stationary state while aiming, and if that stationary state continues for a certain period of time, it determines that the shooter is in an aiming state. During this aiming state, the system detects the firing of the gun as an operation of the gun mechanism linked to the trigger operation of the gun. Therefore, there is no need for a Fourier transform, which requires high-speed processing, as in Patent Document 1, and the system can prevent false detection of the firing of the gun with simple processing and accurately detect the timing of the firing.

[0032] By making it possible to distinguish the images of the specified firing timing from images taken immediately before and after the firing, and by playing back the images in slow motion on a personal computer (PC) in chronological order, starting from the images taken a certain time (certain number of images) before, the user can check and analyze how they aimed, or the recoil and follow-through movement after firing.

[0033] Next, a second embodiment of the present invention will be described with reference to the drawings. 9, the image recording device according to this embodiment has its camera unit 20 attached to a scope 96 of a commercially available long-range shooting rifle 95, and the sensor / microcomputer unit 10 interposed in a rifle scope mount 97. The camera unit 20 and sensor / microcomputer unit 10 are connected by an RGB cable 17 for transmitting image data.

[0034] The image recording device 1 according to this embodiment comprises the sensor / microcomputer unit 10, the camera unit 20, and an RGB cable 17 connecting them. Figure 10 shows the internal configuration of each unit 10, 20. The camera unit 20 includes a half mirror 16 and a camera board 12. The half mirror 16 transmits the sight image that passes through the riflescope 96 toward the shooter and reflects it toward the camera board 12. This sight image passes through a close-up lens 12b on the camera board 12 and is captured by a CMOS sensor 12a. The captured image data is transferred to the sensor / microcomputer unit 10 via the RGB cable 17. The sensor / microcomputer unit 10 includes a microcomputer board 13 that processes image data transferred from the camera unit 20, a sensor board 14 that uses an acceleration sensor to detect certain gun movements, such as firing, and a non-volatile memory (microSD) 15 that stores image data when certain gun movements are detected. The above configuration can be implemented with appropriate modifications.

[0035] Figure 11 is a functional block diagram of an image recording device 1 according to this embodiment. The main difference from Figure 2 is that the functions are divided into multiple units. The main difference is whether a telephoto lens is provided independently or whether a riflescope is used. Other than that, the basic functions are the same as in Figure 2, so the same elements are given the same reference numerals and explanations are omitted.

[0036] In this embodiment, a commercially available scope is used, and a camera unit is attached to the scope. As in the first embodiment, the system first detects the stationary state of the shooter when aiming, and if that stationary state continues for a certain period of time, it determines that the shooter is in an aiming state. During that aiming state, it detects the operation of the gun mechanism that is linked to the gun's trigger operation.

[0037] (Application example) In the above-described embodiments, the description is based on the premise that the vibration (fire timing) of the firing pin is detected as the operation of the gun mechanism linked to the trigger operation of the gun. However, one of the features of the image recording device according to this embodiment is that, as a condition for detecting the operation of the gun mechanism, a stationary state (aiming state) continues for a certain period of time immediately before the operation. Therefore, it is clear that the operation of the gun mechanism linked to the trigger operation of the gun is not limited to the operation of the firing pin, but can also be detected, for example, by adjusting the vibration parameter (second threshold value). In the present invention, when the trigger operation of the gun is performed, the timing of the operation of the mechanism linked to the operation of the trigger can be detected and images can be recorded for a certain period of time before and after the timing, not only when a bullet is actually fired but also when a bullet is not fired.

[0038] It is preferable to set the vibration parameter (second threshold) to an optimal value depending on the type of gun and the sensor's mounting location. For example, if the sensor is located directly above the receiver, the standard vibration parameter value can be set to a high acceleration in the x direction (aiming direction), such as x: 6, y: 4, z: 4 (m / s²). If the sensor is installed near the muzzle, the same value can be set for each direction, such as x: 4, y: 4, z: 4 (m / s²). This can be configured by storing groups consisting of sets of parameter values ​​for each direction in a table, loading a code set using a DIP switch or similar into the computer on the sensor board, and using the parameter value set for the group corresponding to that code. Alternatively, the parameter values ​​for each direction can be set using a variable resistor or similar, and the resistance value can be loaded into the computer and used as the parameter value.

[0039] As described above, according to this embodiment, by detecting a stationary state, it is possible to detect the operation of the gun mechanism with high accuracy simply by setting appropriate parameters.

[0040] The present invention is not limited to the above-described embodiments, and can be realized in various modifications without departing from the spirit of the invention. For example, when the image recording device 1 and a personal computer (PC) are in a communication connection state, video data may be constantly sent from the image recording device 1 to the personal computer (PC) without writing to the nonvolatile memory 15. When the image recording device 1 and the personal computer (PC) are not in a communication connection state, video data for a certain period of time before and after the detection of a shot is written to the nonvolatile memory 15. Then, when the communication connection state is established, the video data stored in the nonvolatile memory 15 is sent from the image recording device 1 to the personal computer (PC).

[0041] In the above embodiment, still image data is acquired when a gunshot is detected and transmitted from the image recording device 1 to a personal computer (PC), but depending on the frame rate and image resolution of the video data, it may not be necessary to transmit still image data. For example, if video data with sufficient resolution can be transmitted in a certain communication environment, it may not be necessary to acquire still image data. [Explanation of symbols]

[0042] 1. Image recording device 10 Sensor microcomputer unit 11 Telephoto Lens 11a prime lens 12 Camera board (imaging unit) 12a CMOS sensor 12b Close-up lens 13 Microcomputer board 14 Sensor board 15 Non-volatile memory 16 Half Mirror 17, 17a cable (flexible cable) 18 Battery 19 Power switch 20 Camera Unit 31 Ring Buffer 32 Communications Department 33 Image data acquisition processing 34 Record Processing 35 Communication Processing 36,43 Processing unit 41 Accelerometer 42 Trigger determination process 50 Mobile Devices 90 Firearms (Guns) 95 Long-range rifle (gun) 96 riflescope 97 riflescope mount

Claims

1. An image recording device mounted on a gun, comprising: an imaging unit capable of continuously capturing images in the aiming direction; An acceleration sensor; a processing unit that detects the timing of an operation of a mechanism linked to a trigger operation of the gun based on the output value of the acceleration sensor, The arithmetic processing unit a determination that the gun is in a stationary state when the amount of change in the output value of the acceleration sensor is smaller than a predetermined first threshold, a determination that the gun is in an aiming state when the stationary state continues for a predetermined time or longer, and a determination that a mechanism linked to the trigger operation of the gun has operated by detecting that the amount of change in the output value of the acceleration sensor during the aiming state has become larger than a predetermined second threshold that is equal to or greater than the first threshold; An image recording device, characterized in that, of the images captured by the imaging section, images for a certain period including the timing are recorded.

2. The acceleration sensor is a three-axis acceleration sensor, The first threshold value and the second threshold value can be set for each axis, The arithmetic processing unit The image recording device of claim 1, characterized in that it determines that the gun is in a stationary state when the change in output values ​​of all axes of the three-axis acceleration sensor is smaller than a first threshold value for each axis, determines that the gun is in an aiming state when the stationary state continues for more than a predetermined time, and determines that a mechanism linked to the trigger operation of the gun has operated by detecting that the change in output values ​​of all axes of the three-axis acceleration sensor is larger than the second threshold value for each axis during the aiming state.

3. A gun equipped with the image recording device according to claim 1 or 2.

Images