TUNNEL DETECTION DEVICE FOR AUGMENTED REALITY TRAINING
Patent Information
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- HOLOGATE GMBH
- Filing Date
- 2024-06-11
- Publication Date
- 2026-08-05
AI Technical Summary
Existing extended reality training systems for security personnel are limited in realism, particularly in simulating the use of multiple security tools and decision-making processes, and often fail to accurately replicate the handling of real tools due to differences in weight and dimensions between replicas and actual weapons.
A trigger detection device with a housing and a trigger sensor, capable of detecting trigger movements, is attached to a weapon to transmit data to an extended reality system, allowing realistic simulations of various weapons and tools, including actual weapons, through a communication interface and optional tracking systems.
Enhances the realism of extended reality training by accurately simulating the actuation of different security tools and their handling, improving user decision-making and tool selection skills in realistic scenarios.
Description
Technical Field
[0001] The present disclosure generally relates to extended reality (XR) training of a user, e.g., for training police, military or security personnel. In particular, a trigger detection device for detecting an actuation of a trigger of a weapon to enable a simulation of the trigger actuation in a program executed by an extended reality system, a system comprising the trigger detection device, and a method for simulating an actuation of a trigger of a weapon are provided, as for instance described in US2024 / 157232 A1.Background
[0002] Security personnel employed in jobs in the security sector, e.g., in law enforcement, in the military or in other organizations employing security personnel, can be confronted with very challenging situations in which they need to use security tools, for example a baton, pepper spray, handcuffs, a flashlight, a non-lethal weapon like a stun gun or a lethal weapon like a short gun or a long gun.
[0003] To ensure a high probability for use of a correct security tool in a given situation, as well as a correct handling of the selected security tool, it is crucial that the security personal is well-trained for such situations. Commonly, the security personnel is thus trained over several years before being admitted to the job and paired with personnel having years of experience in the profession.
[0004] With the advance in technology, an increasing part of the training of security personnel comprises training by the assistance of extended reality (XR) training programs, e.g., virtual reality (VR) or augmented reality (AR) training programs. For example, existing virtual reality training programs utilize a replica of a specific gun together with a virtual reality headset.
[0005] However, such extended reality training programs are limited to a specific setup, e.g., simulating the use of a specific gun. While such training may improve the handling of the specific gun, the training situations are far from realistic situations and thus of limited value. For example, the use of multiple different security tools and in particular the decision-making process of which security tool to use at which situation cannot be trained with the specific setups of existing extended reality training programs.
[0006] Further, the replica used in such a specific setup, e.g., a replica of a pistol, is often handled differently compared to the real security tool, e.g., the real pistol. For example, the replica may have a different weight or different dimensions compared to the real security tool, which may have a negative effect on the preparation of the security personnel for the application of the real gun in real professional life later on.
[0007] Patent application US 2021 / 0199408 A1 discloses a device including one or more sensors configured to output sensor data, and a trigger detection module configured to receive the sensor data from the one or more sensors and to determine whether a trigger event has occurred. The trigger detection module can be configured to output a trigger detection signal when the trigger event is detected. The trigger detection signal can be configured to be used by an augmented reality or virtual reality system to cause an augmented reality or virtual reality event. The one or more sensors may include an accelerometer that can provide shock info and orientation info, an acoustic sensor for determining if a gun is fired, and / or a Hall sensor used to at least detect when a user's hands have come up to grip the pistol grip.Summary
[0008] There is a need for providing an improved technique for extended reality training of a user, e.g., law enforcement, military or other security personnel, that addresses at least some of the aforementioned problems, or other problems. In particular there is a need for a technique that improves the realism of extended reality training.
[0009] According to a first aspect of the present invention, a trigger detection device for detecting an actuation of a trigger of a weapon to enable a simulation of the trigger actuation in a program executed by an extended reality system according to claim 1 is provided. The trigger detection device comprises a housing configured to fasten the trigger detection device to the weapon, a trigger sensor configured and positionable to detect a movement of the trigger from a released position to an actuated position, and a communication interface coupled to the trigger sensor and configured to transmit data indicative of an actuation of the trigger to the extended reality system in reaction to detecting the movement of the trigger from the released position to the actuated position.
[0010] The extended reality may comprise virtual reality (VR) or augmented reality (AR), and the extended reality system may be configured to execute a program, e.g., a simulation, based at least in part on the data transmitted by the communication interface. The weapon may be any weapon having a trigger, such as a gun, e.g., one of a lethal gun or a non-lethal gun, in particular a long gun or a short gun, e.g., a pistol or a stun gun, such as a taser. The weapon may even be pepper spray when the pepper spray has a trigger for actuation, for example. The weapon may be an actual weapon as used by a user in the profession the user is trained for or a replica thereof.
[0011] The released position may be any position from a most distal position, i.e., a default position when the trigger is not touched, to any position proximal to the default position and prior to the point where a release of a shot from the weapon is triggered. The actuated position may be any position from the point where a release of a shot from the weapon is triggered to a most proximal position the trigger can mechanically be moved to. In one variant, the actuated position may be the most proximal position the trigger can mechanically be moved to.
[0012] In some variants, the trigger sensor may be detachably fastenable to the housing. Additionally or alternatively, the trigger sensor may be fastenable to the housing at a variable position relative thereto for allowing adaptation of the position of the trigger sensor after the trigger detection device has been fastened to the weapon. In other words, the trigger sensor may be positionable to detect a movement of the trigger due to having a variable fastening position relative to the housing. For example, the housing may comprise an elongated receiving element. The elongated receiving element may be configured to receive a fastening element at different positions thereof, and the fastening element may be configured to fasten the trigger sensor to the housing. Alternatively or additionally, the housing may have a plurality of receiving elements located at different positions of the housing. As a result, the trigger sensor may be fastenable to the housing and positionable relative thereto so that, when the trigger detection device is fastened to the weapon, the trigger sensor extends from the housing so that at least a part of the trigger sensor is positioned adjacent to the trigger of the weapon allowing the trigger sensor to detect movement of the trigger from the released position to the actuated position.
[0013] Additionally or alternatively, the housing may be configured to be fastenable to the weapon at different positions of the weapon so that the trigger detection device may be positionable to detect a movement of the trigger from a released position to an actuated position.
[0014] Configuring the trigger sensor to be positionable to detect a movement of the trigger, i.e., fastenable to the housing at a variable position relative thereto allows adapting the trigger detection device to be used with a plurality of different weapons.
[0015] According to the first aspect of the present invention, the trigger sensor comprises a photoelectric sensor comprising an emitter configured to emit a light beam and a receiver configured to detect the emitted light beam. The emitter and the receiver may be positioned relative to the trigger so that the trigger prevents a detection of the light beam in the released position and allows a detection of the light beam when moved to the actuated position (called light-switching mode herein). Alternatively, the emitter and the receiver may be positioned relative to the trigger so that the trigger allows a detection of the light beam in the released position and prevents a detection of the light beam when moved to the actuated position (called dark-switching mode herein).
[0016] These two alternative actuation detection modes may allow a use of the trigger detection device with a wide variety of weapon types. In particular, depending on the distance between the default position when the trigger is not touched, to the point where a release of a shot from the weapon is triggered, one or the other detection mode may be preferable. For example, the light-switching mode may be generally preferable in conjunction with shorter weapons like handguns, e.g., pistols, and the dark-switching mode may be generally preferable in conjunction with larger weapons, e.g., rifles.
[0017] In some variants, the emitter of the photoelectric sensor may be configured to emit infrared (IR) light and the receiver may comprise a corresponding light filter allowing only IR light to pass therethrough. Such a setup may provide a robust detection technique that is not prone to erroneous trigger detections, e.g., due to detected ambient or scattered light. Further, the emitter and receiver may be precisely aligned relative to each other to reduce disturbances from other light sources that may be detected by the receiver.
[0018] In some variants, the trigger sensor comprises a flexible printed circuit board and one or more surface mounted devices (SMDs). The combination of a flexible printed circuit board with one or more surface mounted devices allows a high control of the dimensions of the trigger sensor. In some variants, a height of the trigger sensor may be less than 5 mm, preferably less than 4, 3 or 2 mm. Such a small height compared to e.g. the trigger itself prevents or at least reduces hindrance of the user due to the trigger sensor, and thus allows for a high realism when using the trigger detection device with a weapon.
[0019] In some variants, the trigger sensor may be at least one of detachably attachable to the housing, configured to enclose the trigger to prevent accidental activation of the trigger sensor by a user, and configured to extend along a portion of the underside of the weapon, wherein, optionally, the trigger sensor covers a portion of the underside that is located between a trigger guard and the trigger of the weapon. Like the small height of the trigger sensor, enclosure of the trigger and extending along a portion of the underside of the weapon may further reduce hindrance of the user due to the trigger sensor, and thus likewise allow for a high realism when using the trigger detection device with a weapon.
[0020] In some variants, the housing may be configured to clampingly engage with the weapon to fasten the trigger detection device to the weapon. Additionally or alternatively, at least a part of the housing may be designed as a sleeve configured to receive a part of the weapon. In particular, the housing may be configured to be fastenable to the weapon without necessitating any structural amendments to the weapon, thus preventing any legal issues that may occur when weapons are physically altered.
[0021] In some variants, the housing may comprise an electronics housing configured to accommodate at least the communication interface coupled to the trigger sensor. The electronics housing may further be configured to accommodate at least one of a battery configured to power the trigger detection device, a port enabling charging of the battery, a switch configured to turn on or off the trigger detection device, and at least one status light emitting diode (LED) indicating at least one of battery life and a connection that has been established with the communication interface coupled to the trigger sensor. The aforementioned electronic elements may improve the usability of the trigger sensor.
[0022] In some variants, the housing may comprise a tracker configured to enable tracking of a position and / or an orientation of the weapon, when the trigger detection device is attached thereto. The tracker may be detachably attached to the housing. The tracker may be an optical tracker or an electromagnetic tracker. Tracking the position and / or orientation of the trigger detection device may allow simulating the position and / or orientation of the weapon the trigger detection device is attached to in a program executed by the extended reality system, and thus may further improve the realism of the training.
[0023] According to a second aspect of the present invention, a system according to claim 12 is provided, wherein the system comprises the trigger detection device and at least one of: a weapon (e.g., as defined above), wherein the trigger detection device is fastened to the weapon, and an extended reality system configured to receive the data indicative of the actuation of the trigger, and simulate, based on the received data, a trigger actuation in a program executed by the extended reality system.
[0024] When the trigger detection device comprises the tracker, the system may further comprise a tracking system configured to track the position and / or orientation of the weapon and to transmit data indicative of the tracked position and / or orientation to the extended reality system. The extended reality system may be further configured to simulate, based on the data received from the tracking system, the position and / or orientation of the weapon.
[0025] The tracking system may comprise an optical sensor, e.g., a camera, or an electromagnetic sensor, e.g., a sensor coil. The tracking system may comprise a communication interface configured to transmit data indicative of the tracked position and / or orientation to the extended reality system.
[0026] According to a third aspect of the present invention, a method for simulating an actuation of a trigger of a weapon in a program executed by an extended reality system according to claim 14 is provided. The method comprises receiving data indicative of an actuation of the trigger of the weapon from a trigger detection device as described herein. The method further comprises simulating, based on the received data, an actuation of the trigger in the program executed by the extended reality system. It will be understood that such method steps may be performed in combination with the trigger detection device of the first aspect and the system of the second aspect described above. As such, it will be understood that the extended reality system described above with respect to the first and second aspects may be configured to execute the method according to the third aspect, for example. Also, it will be understood that the method of the third aspect may comprise method steps corresponding to method steps described in relation to the trigger detection device of the first aspect and the system of the second aspect described above as well as later herein.
[0027] In some variants, the trigger detection device according to the first aspect, the system according to the second aspect and the method according to the third aspect may be used in a greater system context in accordance with further technical characteristics. As an exemplary greater system context, a belt system will be described in the following in which the trigger detection device of the first aspect, the system of the second aspect and the method of the third aspect may be employed. It will be understood that any aspects which are applicable to the trigger detection device, the system in general and any associated method steps described below with regard to the belt system may be comprised as corresponding characteristics (even independently of other features of the belt system, if not functionally related) of the trigger detection device of the first aspect, the system of the second aspect and the method of the third aspect described above. As an example, the trigger detection device may be used as a trigger detection device for a weapon-like training tool described below with respect to the belt system.
[0028] In some variants, the system may thus further comprise a belt system for enabling security tool-based extended reality (XR) training of a user. The system may comprise a training tool, a belt configured to detachably receive the training tool, an attachment sensor configured to detect an attachment status of the training tool, wherein the attachment status indicates whether the training tool is attached to the belt, and a communication interface coupled to the attachment sensor and configured to transmit data indicative of the attachment status to the extended reality system. The belt may be any commercially available belt, for example. In some variants, the belt may be one of a tactical belt, a battle belt, a gun belt and a duty belt.
[0029] In some variants, the attachment sensor may comprise an electromagnetic sensor, an optical sensor or a mechanical sensor. For example, the attachment sensor may comprise one of a proximity sensor, e.g., a Hall-sensor, a pressable button, and a photoelectric sensor, e.g., a light barrier. In a preferred variant, a Hall-sensor may be configured to detect one of a proximity and a relative position of a magnet thereto. The attachment status may then be detected based at least in part on the proximity and the position of the Hall-sensor relative to the magnet. Additionally or alternatively, other known sensors may be utilized.
[0030] The communication interface may be configured to receive one or more signals from the attachment sensor coupled thereto. In some variants, the communication interface may be further configured to process the received one or more signals and to forward the processed one or more signals to the extended reality system, e.g., The communication interface may be configured to receive one or more signals from the attachment sensor coupled thereto. In some variants, the communication interface may be configured to forward the one or more signals to the extended reality system, e.g., directly or indirectly using a communication bridge as explained later herein. Before forwarding the one or more signals, the communication interface may process the one or more signals, if needed. To forward the received or processed one or more signals, the communication interface may be configured to generate one or more further signals and / or data based on the received one or more signals and to transmit the generated one or more further signals and / or data to the extended reality system in the manner described above.
[0031] In some variants, one of the belt and the training tool may comprise the attachment sensor and the communication interface. For example, one of the belt and the training tool may comprise a Hall-sensor and the communication interface coupled thereto and the other one may comprise a magnet configured to be detectable by the Hall-sensor.
[0032] In some variants, the belt may comprise a holding element, e.g., a holster or a belt clip, configured to detachably receive the training tool. The holding element may be associated with a specific training tool and located at a predefined location of the belt, for example. As a result, the realism of the training may be improved since e.g. a predefined position of a tool on a police belt used in practice may be accurately simulated.
[0033] In some variants, the holding element may comprise the attachment sensor and the communication interface. For example, a holster may comprise a Hall-sensor and a communication interface coupled thereto. In this variant, the training tool may comprise a magnet detectable by the Hall-sensor of the holster when the tool is received by the holster.
[0034] In some variants, the holding element may comprise a security element movable between a secured state and an unsecured state. The security element may be configured to prevent a detachment of the training tool from the belt when the training tool is attached to the belt and the security element is in the secured state, and allow a detachment of the training tool from the belt when the training tool is attached to the belt and the security element is in the unsecured state. For example, the security element may comprise a latch with a snap fastener and the secured state may be identified based on the snap fastener being in a fastened or an opened state.
[0035] The holding element may further comprise a security sensor configured to detect a security status of the security element. The security status may indicate whether the security element is in the secured state. The holding element may still further comprise a communication interface coupled to the security sensor and configured to transmit data indicative of the security status to the extended reality system. The communication interface coupled to the security sensor may be the communication interface coupled to the attachment sensor, e.g., in case the belt, and in particular the holding element, comprises the attachment sensor.
[0036] In some variants, the training tool may comprise one of a weapon, a flashlight and handcuffs. The weapon may be a baton, pepper spray or a gun, e.g., one of a lethal gun or a non-lethal gun, in particular a long gun or a short gun, e.g., a pistol or a stun gun, such as a taser. In these variants, the realism of the training may be improved compared to variants using a replica of one of the aforementioned security tools, since the training tool may comprise the actual weapon, flashlight or handcuffs to be used by the user in the profession the user is trained for.
[0037] In some variants, when the training tool comprises a weapon, the training tool may further comprise an actuation sensor configured to detect an actuation of the weapon and a communication interface coupled to the actuation sensor and configured to transmit data indicative of the actuation of the weapon to the extended reality system. The actuation sensor may be configured to detect actuation of a trigger of the weapon. In particular, the actuation sensor may be the trigger sensor and the communication interface coupled to the actuation sensor may be the communication interface coupled to the trigger sensor according to the first aspect. In some variants, the actuation sensor may be configured for detecting a reload of the weapon or a change of an operating mode of the weapon, e.g., secured or unlocked. In some variants, the training tool may comprise a plurality of actuation sensors, e.g., one for detecting each of the actuation of the trigger, the reload and the change of the operating mode. As a result, at least one of an actuation of a weapon, e.g., firing of a gun, a reload of the weapon and a currently active operating mode may be simulated in a program executed by the extended reality system.
[0038] The communication interface coupled to the actuation sensor may be the communication interface coupled to the attachment sensor, e.g., in case the training tool comprises the attachment sensor. In other words, one communication interface may be coupled to one or more of the attachment sensor, the security sensor and the actuation sensor. Alternatively, each of the attachment sensor, the security sensor and the actuation sensor may be coupled to a different communication interface.
[0039] In some variants, the belt system may comprise a plurality of training tools. At least two of the plurality of training tools may comprise a different one selected from a taser, a pistol, any of the other gun types mentioned above, pepper spray, a flashlight, a baton, and handcuffs. In some variants, each of the plurality of training tools may comprise a different one selected from a taser, a pistol, any of the other gun types mentioned above, pepper spray, a flashlight, a baton, and handcuffs. Each of the plurality of tools may comprise at least one communication interface as described herein. Further, the belt may comprise a holding element for each of the plurality of training tools. In some variants, the belt, and in particular one or more of the holding elements, may comprise a communication interface for each of the plurality of training tools.
[0040] As a result, the realism of training of the user can be improved compared to only using one training tool in that the user can be trained on deciding which one of the provided tools is to be used in a given situation. Further, each of the plurality of training tools may be associated with a predefined position on the training belt so that the user may be trained to use a given tool without having to watch / focus on which tool the user has selected, e.g., to improve user behavior during limited visibility, or to train usage of the right tool out of reflex.
[0041] In some variants, the training tool, or at least one of the plurality of training tools, may comprise a replica of a weapon (e.g., a gun, such as a taser, a pistol or any of the other gun types mentioned above, pepper spray, or a baton), a flashlight, and handcuffs. The replica may comprise an actuation sensor configured to detect an actuation of the replica and a communication interface coupled to the actuation sensor and configured to transmit data indicative of the actuation of the replica to the extended reality system.
[0042] In some variants, the belt system may further comprise a communication bridge, wherein the communication bridge may optionally be attachable to the belt or to a piece of clothing of a user, for example. The communication bridge may be configured to receive data from the communication interface coupled to the attachment sensor using a first data communication technology, and forward the received data using a second data communication technology to the extended reality system. The first data communication technology may be Bluetooth and the second data communication technology may be WiFi, for example. The communication bridge may further be configured to receive and forward data from multiple communication interfaces, e.g., any communication interface of the belt system described herein, and in particular from a plurality of communication interfaces when the belt system comprises a plurality of training tools, as described above. Such a communication setup allows for an increased communication range between the belt system and the extended reality system compared to a system where e.g. the communication interface coupled to the attachment sensor has to directly communicate with the extended reality system. Further, the communication interface coupled to the attachment sensor, or any other of the described communication interfaces of the belt system, may be generally located closer to the communication bridge than to the extended reality system when the belt system is in use. As a result, the communication setup comprising the bridge may allow for the data to be transmitted from the communication interface over the bridge to the extended reality system in a very robust and efficient manner, allowing for a correct and near real-time simulation based on the transmitted data.
[0043] The communication between the communication interfaces and the communication bridge as well as the communication between the communication bridge and the extended reality system may be established using bidirectional data transfer. Once the communication is established, the data transfer may be unidirectional from the communication interfaces to the communication bridge and / or from the communication bridge to the extended reality system. Utilizing unidirectional data transfer after a communication (or connection in general) has been established reduces the latency of the data transfer and thus allows for a more precise simulation in near real-time.
[0044] In some variants, the communication bridge may comprise a connection status display configured to indicate at least one of a connection that has been established using the first data communication technology and a connection that has been established using the second data communication technology. In some variants, when the belt system comprises the plurality of training tools, the display may indicate a connection that has been established for each of the training tools. Displaying established connections may facilitate setup of the belt system.
[0045] In some variants, the training tool may comprise a tracker configured to enable tracking of a position and / or an orientation of the training tool. The tracker may be an optical tracker or an electromagnetic tracker, for example. Tracking the position and / or orientation of the training tool may allow simulating the position and / or orientation of the tool in a program executed by the extended reality system and thus may further improve the realism of the training.
[0046] At least one of the belt and the training tool may comprise a battery and an onboard charging board for handling power management of at least some of the electronic elements described herein, e.g., at least one of the sensor(s), the communication interface(s) and the tracker. The battery may be a rechargeable battery and the charging board may comprise a charging interface, e.g., a USB-C port. The charging board may further comprise one or more light emitting diodes (LEDs) configured to indicate a charging state of the battery. In some variants, when the belt system comprises a plurality of training tools, each of the plurality of training tools may comprise a battery and an onboard charging board as described herein.
[0047] In some variants, the belt system may further comprise the extended reality system. The extended reality system may be configured to receive data from the communication interface coupled to the attachment sensor and execute an extended reality program based at least in part on the received data.
[0048] Executing the extended reality program may comprise receiving data from the communication interface coupled to the attachment sensor, e.g., directly or indirectly using the communication bridge, and providing a simulated training tool in the executed program based on the indicated attachment status. Executing the extended reality program may further comprise receiving data from at least one of the communication interface coupled to the security sensor, the communication interface coupled to the actuation sensor of the training tool, and a tracking system configured to track the position and / or orientation of the tracker. The data may be received directly or indirectly using the communication bridge. Executing the extended reality program may still further comprise simulating, based on the received data, at least one of the security status, an actuation of the training tool and a position and / or orientation of the training tool in the extended reality system. The extended reality system may comprise a processor configured for executing the extended reality program. The extended reality system may as such comprise a computing device. In some variants, the computing device may be or may be coupled to a virtual reality headset, for example.
[0049] In a further aspect not forming part of the present invention, a belt or a holding element attachable to a belt for enabling security tool-based extended reality training of a user may be provided. The belt or the holding element may be configured to detachably receive a training tool, e.g., a weapon the trigger detection device according to the first aspect may be attachable to. The training tool may comprise an attachment sensor configured to detect an attachment status of the training tool. The attachment status may indicate whether the training tool is attached to the belt. The belt or the holding element may further comprise a communication interface coupled to the attachment sensor and configured to transmit data indicative of the attachment status to an extended reality system.
[0050] The belt, the holding element, the attachment sensor and the communication interface coupled to the attachment sensor may be the belt, holding element, attachment sensor and communication interface as described herein with respect to the belt system. As such, those aspects described with regard to the belt system which are applicable to the belt or holding element may be comprised by the belt or holding element as well.
[0051] In an even further aspect not forming part of the present invention, a training tool for security tool-based enabling extended reality training of a user may be provided. The training tool, e.g., a weapon the trigger detection device according to the first aspect may be attachable to, may be configured to be detachably attachable to a belt and may comprise an attachment sensor configured to detect an attachment status of the training tool. The attachment status may indicate whether the training tool is attached to the belt. The training tool may further comprise a communication interface coupled to the attachment sensor and configured to transmit data indicative of the attachment status to an extended reality system.
[0052] The training tool, the attachment sensor and the communication interface coupled to the attachment sensor may be the training tool, attachment sensor and communication interface as described herein with respect to the belt system. As such, those aspects described with regard to the belt system which are applicable to the training tool may be comprised by the above training tool as well.Brief Description of the Drawings
[0053] Further details, advantages and aspects of the present disclosure will become apparent from the following embodiments taken in conjunction with the drawings, wherein: Fig. 1shows a belt system for enabling security tool-based extended reality (XR) training of a user; Fig. 2shows the belt of the system of Fig. 1 including the multiple different training tools attached thereto in more detail; Fig. 3shows one of the training tools of Figs. 1 and 2, namely a pistol, and a trigger detection device attached to the pistol; Fig. 4shows the pistol with the trigger sensor of the trigger detection device of Fig. 3; Fig. 5shows the trigger sensor of Figs. 3 and 4 in detail; Fig. 6shows a schematic overview of electronic elements of a training tool; Fig. 7shows multiple communication interfaces of the belt system of Fig. 1 in direct communication with the extended reality system of Fig. 1; Fig. 8shows multiple communication interfaces of the belt system of Fig. 1 in communication with the extended reality system of Fig. 1 using a communication bridge; and Fig. 9shows a flow diagram of a method for simulating an actuation of a trigger of a weapon in a program executed by an extended reality system. Detailed Description
[0054] In the following description of exemplary embodiments, the same reference numerals are used to denote the same or equivalent components.
[0055] Fig. 1 shows a belt system 100 for enabling security tool-based extended reality (XR) training of a user. The system comprises a belt 200, multiple different training tools 300 attached to the belt 200, an extended reality system 400 and a tracking system 500. The belt 200 of Fig. 1 and the multiple different training tools 300 attached thereto are also shown in Fig. 2 in more detail.
[0056] The belt 200 may be a commercially available belt 200 comprising multiple holding elements 210 (see Fig. 2). Each holding element 210 is positioned at a predefined location of the belt 200 and configured for holding one of the different training tools 300. The shown holding elements 210 comprise holsters specifically shaped to receive one of the different training tools 300 associated therewith, wherein the training tools 300 shown in Figs. 1 and 2 comprise, from left to right, a taser 300a, a flashlight 300b, handcuffs 300c, a baton 300d, pepper spray 300e and a pistol 300f. In some variants, one or more of the taser 300a, flashlight 300b, handcuffs 300c, baton 300d, pepper spray 300e and pistol 300f may be a replica thereof.
[0057] In some variants, one or more of the holding elements 210 may each comprise a security element (not shown) configured for securing the received training tool 300 to the holding element, i.e., to prevent removal of a received training tool 300 from the holding element in a first, secured state and to allow removal of the received tool 300 from the holding element in a second, unsecured state. For example, the security element may be a latch with a snap fastener. The holding element 210 may further comprise a security sensor (not shown) configured to detect a security status of the security element, i.e., whether the security element is in the secured state or the unsecured state. The holding element 210 may further comprise a communication interface (not shown) coupled to the security sensor and configured to transmit data indicative of the security status, i.e., the state of the security element, to the extended reality system 400 (shown in Fig. 1). The extended reality system 400 comprises a computing device 410 configured for executing an extended reality program, e.g., a virtual reality (VR) program or an augmented reality (AR) program. Providing data indicative of the security status to the extended reality system 400 enables simulating the security element state in the executed extended reality program to increase the realism of the program.
[0058] In the variant shown in Figs. 1 and 2, each of the holding elements 210 comprises a magnet (not shown) and each of the training tools 300 comprises an attachment sensor 310 (see Fig. 6), e.g., a hall sensor 310. The hall sensors 310 are positioned and configured to detect the proximity of the magnets when the training tools 300 are received by the holding elements 210. Based on the detected proximity, an attachment status indicating whether a respective training tool 300 is attached to the belt 200, i.e., received by the respective holder 210 associated with the training tool 300, can be determined.
[0059] Further, each of the training tools 300 shown in Figs. 1 and 2 comprises a communication interface (not shown) coupled to the attachment sensor 310 thereof and configured to transmit data indicative of the attachment status of the training tool 300 to the extended reality system 400 shown in Fig. 1. Providing data indicative of the attachment status of a respective one of the training tools 300 to the extended reality system 400 enables simulating a training tool 300 in the executed extended reality program to increase the realism of the program. In particular, the computing device 410 is configured to provide a simulated training tool 300 in the executed program when the attachment status indicates that the tool 300 is detached from the belt and to remove the simulated training tool 300 from the executed program when the attachment status indicates that the tool 300 is attached to the belt 200, i.e., received by the holding element 210.
[0060] Still further, each of the training tools 300 comprises an actuation sensor 340 (see Fig. 6), e.g., a button configured to detect an actuation of the training tool 300. In case of the training tool 300 comprising a replica, the actuation sensor 340 may be integrated in the replica, e.g., in the form of a pressable button. In case of the training tool 300 comprising an actual tool as used in the profession of a user (instead of a replica), the actuation sensor 340 may be a sensor configured to be detachably attachable to the tool 300.
[0061] In the following, the details of an actuation sensor 340 are described with reference to Figs. 3 and 4.
[0062] Fig. 3 shows one of the training tools 300 of Figs. 1 and 2, namely a pistol 300f comprising a trigger detection device 600 attached thereto. The trigger detection device 600 comprises a housing 610 configured to receive a part of a shaft 700 of the pistol 300f therein. The housing 610 is further configured to receive a screw (not shown) configured to clampingly engage with a rail 710 of the pistol 300f. As a result, the trigger detection device 600 is attachable to the pistol 300f without physically altering any parts of the pistol 300f. Additionally or alternatively, other attachment mechanisms for attaching the housing 610 to the pistol 300f may be used. For example, the housing 610 may comprise parts configured to be movable relative to each other to clampingly engage with the pistol 300f.
[0063] The trigger detection device 600 further comprises an actuation sensor 340 in the form of a trigger sensor 640. The trigger sensor 640 is detachably attached to the housing 610. The housing 610 comprises an elongated receiving element 620 extending in a direction parallel to the shaft 700 of the pistol 300f to a certain extent (seen as an oval-like hole 620 in Fig. 3) when the trigger detection device 600 has been attached to the pistol 300f. The elongated receiving element 620 is configured to receive a fastening element 630 at different positions thereof (i.e., along its mentioned extension direction), wherein the fastening element 630 is configured to fasten the trigger sensor 640 to the housing 610. Due to the elongated extension of the receiving element 620 parallel to the shaft 700, the trigger sensor 640 is movable relative to the housing 610 of the trigger detection device 600 in a translatory manner to a certain extent along a direction parallel to the extension direction of the elongated receiving element 620, after the trigger detection device 600 has been attached to the pistol 300f, as indicated by the black arrows in Figs. 3 and 4. The horizontal movement may be a continuous movement allowing a precise positioning of the trigger sensor 640 relative to the housing 610. As a result, the trigger sensor 640 is positionable relative to the trigger 720 of the pistol 300f so that the trigger sensor 640 may detect movement of the trigger from a released position to an actuated position as described herein. In other words, the trigger detection device 600 may be calibrated by moving the trigger sensor 640 relative to the housing 610 after the trigger detection device 600 has been attached to the pistol 300f. Since the trigger sensor 640 is movable relative to the housing 610, the trigger detection device 600 is usable with a plurality of different weapons or replicas thereof having different dimensions. In particular, the trigger detection device 600 may be usable with any weapon or replica of a weapon that comprises a trigger.
[0064] The housing 610 further comprises an electronics housing 612. The electronics housing 612 is detachably attached to the housing 600 and is configured to accommodate the electronic elements (not shown) of the trigger detection device 600. The electronic elements may comprise a communication interface coupled to the trigger sensor 640, a battery, a port enabling charging of the battery, a switch configured to turn on or off the trigger detection device and at least one status light emitting diode (LED) indicating at least one of battery life and a connection that has been established with the communication interface coupled to the trigger sensor 640. The communication interface coupled to the trigger sensor 640 is configured to transmit, based on the detected movement of the trigger 720, data indicative of an actuation of the trigger 720 to the extended reality system 400 shown in Fig. 1. The extended reality system 400 is further configured to simulate an actuation of the trigger 720, i.e., firing of the pistol 300f, based on the data received from communication interface coupled to the trigger sensor 640.
[0065] Further, as can be seen best in Fig. 4, the trigger sensor 640 is configured to cover a portion of the underside of the pistol 300f, in particular, a portion of the underside of the shaft 700 of the pistol 300f. The trigger sensor 640 shown in Fig. 4, for example, covers essentially the portion of the pistol located between the trigger 720 and a trigger guard 730 extending downwardly from the underside of the pistol 300f in front of the trigger 720. As a result, a user may only perceive a surface similar to the underside of a gun so that the user is not hindered or distracted by the trigger sensor 640. Further, since the trigger sensor 640 is configured to have a small height (e.g., less than 5 mm, preferably less than 4, 3 or 2 mm) compared, e.g., to the trigger 720, the difference in handling of the pistol 300f with an attached trigger detection device 600 and without an attached trigger detection device 600 is minimized.
[0066] Fig. 5 shows the trigger sensor 640 of Figs. 3 and 4 in more detail. In the given example, the shown trigger sensor 640 is a photoelectric sensor comprising an emitter 810 configured to emit a light beam. The light beam shown in Fig. 5 is a schematic representation thereof. In practice, a light beam may e.g. be more focused than exemplarily illustrated. The trigger sensor 640 further comprises a receiver 820 configured to detect the emitted light beam. The trigger sensor 640 shown in Figs. 3 and 4 is positioned relative to the trigger 720 so that the trigger 720 prevents a detection of the light beam in a released position and allows a detection of the light beam when moved to an actuated position, i.e., the trigger sensor 640 is positioned in the light-switching mode as described herein.
[0067] The trigger sensor 640 shown in Fig. 5 is further coupled to the electronic elements located in the electronics housing 612 by wire, e.g., for powering the trigger sensor 640 and for enabling a communication between the trigger sensor 640 and the communication interface coupled thereto. In other variants, the trigger sensor 640 may be configured for wireless communication, e.g., with the communication interface.
[0068] Returning to Figs. 1 and 2, each of the taser and the pistol 300f further comprises a tracker 330 attached thereto. The trackers 330 attached to the taser and the pistol 300f may be identical trackers 330. Each tracker 330 is an electromagnetic tracker 330 comprising a tracking coil (not shown) configured to emit a magnetic field. The emitted magnetic field may be detected by the tracking system 500 shown in Fig. 1. In particular, the tracking system 500 comprises a sensor coil (not shown) configured to detect the magnetic field emitted by the tracking coil of the tracker 330. The tracking system 500 further comprises a communication interface (not shown) coupled to the sensor coil and configured transmit data indicative of the position and / or orientation of the tracker 330, and thus of the taser or the pistol 300f the tracker 330 is attached to, to the extended reality system 400 shown in Fig. 1. The computing device 410 is further configured to simulate a position and / or orientation of the taser and the pistol 300f based on the data received from the tracking system 500 to further increase the realism of the executed program.
[0069] As explained in detail above, a training tool 300 of the system may comprise a plurality of electronic elements, such as a plurality of sensors, e.g., an attachment sensor 310, one or more actuation sensors 340, and one or more communication interfaces 320.
[0070] A schematic overview of the electronic elements of a training tool 300 is shown in Fig. 6. In the shown example, the training tool 300 comprises an attachment sensor 310 and four actuation sensors 340. The sensors 310, 340 are coupled to a processor 800 comprising a single communication interface (not shown). The communication interface comprises a Bluetooth chip (not shown). The training tool 300 further comprises two status LEDs 822, a switch 824 configured to turn on or off the electronic components of the training tool 300, a battery 830 and a port 840 for charging the battery 830, all coupled to the processor 800.
[0071] Fig. 7 shows a plurality of communication interfaces 320 in direct communication with the extended reality system 400 shown in Fig. 1. In the shown variant, each communication interface 320 is a communication interface 320 of a different training tool 300 as described with reference to Figs. 1 to 6 and configured to transmit data to the extended reality system 400 using Bluetooth.
[0072] In other variants, a training tool 300 and / or a holding element 210 may comprise one or more communication interfaces 320 as described herein (i.e., coupled to one of the attachment sensor 310, the security sensor and the actuation sensor 340) and each of the communication interfaces 320 may be in direct communication with the extended reality system 400.
[0073] In still another variant shown in Fig. 8, the system 100 further comprises a communication bridge 900 in communication with each of the communication interfaces 320 and with the extended reality system 400 shown in Fig. 7. The communication bridge 900 is configured to receive data from the communication interfaces 320 using Bluetooth and to forward the received data to the extended reality system 400 using WiFi. The communication bridge 900 may be configured to be attachable to the belt 200 ensuring that during use of the system 100, the communication interfaces 320 are in a Bluetooth reception range with respect to the communication bridge 900. The WiFi communication between the communication bridge 900 and the extended reality system 400 allows for greater communication ranges compared to direct Bluetooth communication.
[0074] Fig. 9 shows a flow diagram of a method 1000 for simulating an actuation of a trigger 720 of a weapon 300f in a program executed by an extended reality system 400, in particular, by the computing device 410 of the extended reality system 400 as shown in Fig. 1.
[0075] The method 1000 comprises a first step 1100 of receiving data indicative of an actuation of a trigger 720 of a weapon 300f from a trigger detection device 600 as described herein. In a second step 1200, the method comprises simulating, based on the received data, an actuation of the trigger 720 in a program executed by an extended reality system 400.
[0076] The method may comprise additional steps not shown in Fig. 9. The additional steps may comprise the associated method step described herein, including one or more of the data transmission and / or simulation steps described with reference to Figs. 1 to 8, for example. In particular, data transmissions from one or more communication interfaces 320 of one or more tools 300 and / or holding elements 210 to the extended reality system 400 as described herein may be comprised, allowing the extended reality system to execute a program based at least in part on the received data, i.e., to simulate at least one of a presence of a training tool 300, the position and / or orientation of the present tool 300, and an actuation thereof.
[0077] As has become apparent from the above description, the belt system 100 described herein allows for training a user with an extended reality system 400 with an improved realism compared to existing training systems. In particular, the belt system 100 allows utilizing a plurality of different training tools 300 as well as training e.g. with an actual weapon 300f as used by the user in the intended profession instead of being limited to a mere replica of the weapon. Still further, since the weapon 300f can be used in the belt system 100 without the need for any physical alterations thereof, possible legal problems with using an altered weapon are prevented.
[0078] The features described in relation to the exemplary embodiments shown in the drawings can be readily combined to result in different embodiments. It is apparent, therefore, that the present disclosure may be varied in many ways. Such variations are not to be regarded as a departure from the scope of the invention as defined by the claims appended hereto.
Claims
1. A trigger detection device (600) for detecting an actuation of a trigger (720) of a weapon (300f) to enable a simulation of the trigger actuation in a program executed by an extended reality system (400), the device (600) comprising: a housing (610) configured to fasten the trigger detection device (600) to the weapon (300f); a trigger sensor (640) configured and positionable to detect a movement of the trigger (720) from a released position to an actuated position; and a communication interface coupled to the trigger sensor (640) and configured to transmit data indicative of an actuation of the trigger (720) to the extended reality system (400) in reaction to detecting the movement of the trigger (720) from the released position to the actuated position, wherein the trigger sensor (640) comprises a photoelectric sensor (800) comprising an emitter (810) configured to emit a light beam and a receiver (820) configured to detect the emitted light beam.
2. The trigger detection device (600) of claim 1, wherein the emitter (810) and the receiver (820) are configured to be positioned relative to the trigger (720) so that the trigger (720) prevents a detection of the light beam in the released position and allows a detection of the light beam when moved to the actuated position.
3. The trigger detection device (600) of claim 1, wherein the emitter (810) and the receiver (820) are configured to be positioned relative to the trigger (720) so that the trigger (720) allows a detection of the light beam in the released position and prevents a detection of the light beam when moved to the actuated position.
4. The trigger detection device (600) of any of claims 1 to 3, wherein the emitter (810) of the photoelectric sensor is configured to emit infrared, IR, light and the receiver (820) comprises a corresponding light filter allowing only IR light to pass therethrough.
5. The trigger detection device (600) of any preceding claim, wherein the trigger sensor (640) comprises a flexible printed circuit board and one or more surface mounted devices, SMDs.
6. The trigger detection device (600) of claim 5, wherein a height of the trigger sensor (640) is less than 5 mm, preferably less than 4, 3 or 2 mm.
7. The trigger detection device (600) of any preceding claim, wherein the trigger sensor (640) is at least one of: detachably attachable to the housing (610); and configured to extend along a portion of the underside of the weapon (300f), wherein, optionally, the trigger sensor (640) covers a portion of the underside that is located between a trigger guard (730) and the trigger (720) of the weapon (300f).
8. The trigger detection device (600) of any preceding claim, wherein the housing (610) is configured to clampingly engage with the weapon (300f) to fasten the trigger detection device (600) to the weapon (300f).
9. The trigger detection device (600) of any preceding claim, wherein at least a part of the housing (610) is designed as a sleeve configured to receive a part of the weapon (300f).
10. The trigger detection device (600) of any preceding claim, wherein the housing (610) comprises an electronics housing (610) configured to accommodate at least the communication interface coupled to the trigger sensor (640), and, optionally, at least one of a battery (830) configured to power the trigger detection device (600), a port (840) enabling charging of the battery (830), a switch (824) configured to turn on or off the trigger detection device (600), and at least one status light emitting diode, LED, (822) indicating at least one of battery life and a connection that has been established with the communication interface coupled to the trigger sensor (640).
11. The trigger detection device (600) of any preceding claim, wherein the housing (610) comprises a tracker (330) configured to enable tracking of a position and / or an orientation of the weapon (300f), when the trigger detection device (600) is attached thereto.
12. A system (100) comprising: the trigger detection device (600) according to any preceding claim; and at least one of: a weapon (300f), wherein the trigger detection device (600) is fastened to the weapon; and an extended reality system (400) configured to: receive the data indicative of the actuation of the trigger (720); and simulate, based on the received data, a trigger actuation in a program executed by the extended reality system (400).
13. The system (100) of claim 12, wherein the trigger detection device (600) is the trigger detection device (600) of claim 11 and wherein the system (100) further comprises: a tracking system (500), configured to track the position and / or orientation of the weapon (300f) and to transmit data indicative of the tracked position and / or orientation to the extended reality system (400); wherein the extended reality system (400) is further configured to simulate, based on the data received from the tracking system (500), the position and / or orientation of the weapon (300f).
14. A method (1000) for simulating an actuation of a trigger (720) of a weapon (300f) in a program executed by an extended reality system (400), the method (1000) comprising: receiving (1100) data indicative of an actuation of the trigger (720) of the weapon (300f) from a trigger detection device (600) according to any one of claims 1 to 11; simulating (1200), based on the received data, an actuation of the trigger (720) in the program executed by an extended reality system (400).