A battlefield sound effect simulation system

Abstract

The present application discloses a battlefield sound effect simulation system, including: a trigger detection unit, which is used to obtain the position of the weapon equipment after the weapon equipment is triggered; an image acquisition unit, which is used to acquire the head image of the trainee; a positioning unit, which is used to acquire the position of the trainee; a remote processing device, including a posture extraction module and an audio synthesis module, the posture extraction module is used to extract the head posture of the trainee in the head image, the audio synthesis module is used to determine the relative direction according to the position of the weapon equipment and the position of the trainee, determine the channel delay according to the relative direction and the head posture, and synthesize the triggering sound effect of the weapon equipment according to the channel delay; an audio playback unit, which is set on the trainee and is used to play the triggering sound effect. The present application completes the work of head posture detection and audio synthesis in the remote processing device, and the trainee only needs to carry the positioning unit and the audio playback unit, which greatly reduces the weight pressure of the trainee.

Description

Technical Field

[0001] This application relates to the field of military training technology, and in particular to a battlefield sound effect simulation system. Background Technology

[0002] With the acceleration of the informatization of military training, live-fire exercises, which are highly dangerous, have been abandoned in live-fire training. Instead, a combination of real-scene and simulated combat is adopted. Personnel use various digitally modified equipment in real-world training grounds to complete predetermined training tasks. The equipment in the training grounds uses laser simulation or digital simulation to simulate shooting, explosions, and other behaviors in a real combat environment, thereby improving the safety of live-fire training.

[0003] However, after adopting the above simulation method, various sounds during the training process, such as shooting sounds, firing sounds, and explosion sounds, are significantly reduced or even eliminated. This prevents trainees from obtaining useful information from the sounds, such as determining the direction of enemy personnel, which has an adverse effect on the training effect. To address this problem, CN114777563A proposes a battlefield sound effect simulation system and method for live-fire combat training. This method requires personnel to carry a head posture measurement device, a sound effect synthesis module, communication equipment, a positioning module, and an audio playback device. By simulating battlefield sounds and playing them back to the personnel, it provides a sound experience that approximates a realistic environment. However, this patent requires personnel to carry a lot of items, especially the head posture measurement device, which needs to be worn correctly to function properly. Since personnel already carry a lot of items during training, adding the items needed for sound effect simulation increases the burden on personnel, which is not conducive to improving training effectiveness. Summary of the Invention

[0004] This application provides a battlefield sound effect simulation system to solve the problem in the prior art where personnel have to carry too many sound effect simulation items, resulting in excessive weight and pressure on them.

[0005] On one hand, embodiments of this application provide a battlefield sound effect simulation system, including:

[0006] Trigger detection unit, installed on weapon equipment, is used to obtain the position of weapon equipment after it is triggered;

[0007] An image acquisition unit, set up in the training area, is used to acquire head images of trainees;

[0008] A positioning unit, installed on the trainee, is used to collect the trainee's position.

[0009] The remote processing device includes a posture extraction module and an audio synthesis module. The posture extraction module is used to extract the head posture of the trainee in the head image. The audio synthesis module is used to determine the relative direction based on the position of the weapon and the position of the trainee, determine the channel delay based on the relative direction and head posture, and synthesize the trigger sound effect of the weapon based on the channel delay.

[0010] An audio playback unit, installed on the trainee, is used to play trigger sound effects.

[0011] In one possible implementation, a BeiDou ground-based augmentation system is installed in the training ground, and the positioning unit collects the location of the trainees based on the BeiDou ground-based augmentation system.

[0012] In one possible implementation, the remote processing device further includes a face recognition module, which is used to identify facial features in a head image. After the audio synthesis module synthesizes the triggered sound effect, it is sent by the communication module to the audio playback unit corresponding to the facial features identified by the face recognition module.

[0013] In one possible implementation, the image acquisition unit acquires head images in real time, and the face recognition module identifies facial features in the head images and then tracks the trainee in the field of view.

[0014] In one possible implementation, the face recognition module adds a tracking box to the recognized head image, and the tracking box is labeled with the name of the trainee.

[0015] In one possible implementation, the pose extraction module extracts the head contour from the head image, compares the extracted head contour with the pre-stored head contour at the frontal angle to determine the relative orientation of the trainee, and determines the trainee's head pose based on the orientation of the image acquisition unit and the relative orientation of the trainee.

[0016] In one possible implementation, there are multiple image acquisition units, which are set in different positions in the training field. The multiple image acquisition units acquire head images from different directions, and the pose extraction module selects the best quality image among the multiple head images to extract the head pose.

[0017] In one possible implementation, the audio synthesis module determines the angle between the trainee's head orientation and the weapon's direction based on the relative direction and head posture, and determines the channel delay of the left and right channels based on the angle and the distance between the trainee and the weapon.

[0018] The battlefield sound effect simulation system of this application has the following advantages:

[0019] The image processing method is used to obtain the posture of the trainee's head, and the audio synthesis is completed in a remote processing device. The trainee only needs to carry the positioning unit and the audio playback unit, and the requirements for wearing these two units are not high, which greatly reduces the burden on the trainee. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 A schematic diagram of the composition of a battlefield sound effect simulation system provided in this application embodiment;

[0022] Figure 2 This is a calculation diagram of the audio synthesis module provided in an embodiment of this application. Detailed Implementation

[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0024] Figure 1 This is a schematic diagram illustrating the composition of a battlefield sound effect simulation system provided in an embodiment of this application. This application provides a battlefield sound effect simulation system, including:

[0025] Trigger detection unit, installed on weapon equipment, is used to obtain the position of weapon equipment after it is triggered;

[0026] An image acquisition unit, set up in the training area, is used to acquire head images of trainees;

[0027] A positioning unit, installed on the trainee, is used to collect the trainee's position.

[0028] The remote processing device includes a posture extraction module and an audio synthesis module. The posture extraction module is used to extract the head posture of the trainee in the head image. The audio synthesis module is used to determine the relative direction based on the position of the weapon and the position of the trainee, determine the channel delay based on the relative direction and head posture, and synthesize the trigger sound effect of the weapon based on the channel delay.

[0029] An audio playback unit, installed on the trainee, is used to play trigger sound effects.

[0030] For example, the trigger detection unit can be set on the triggering component of the weapon equipment, such as the trigger of a firearm or the firing switch of an artillery piece. At the same time, the trigger detection unit also has a positioning function. When the weapon equipment is detected to be triggered, the trigger detection unit immediately obtains the current position and then sends it to the remote processing device.

[0031] Multiple image acquisition units can be installed and positioned at different locations within the training area. After setting up the image acquisition units, the orientation data of each unit needs to be recorded. Furthermore, when sending a head image to the remote processing device, each image acquisition unit must also send its own identification information. The remote processing device can determine the orientation data of the image acquisition unit based on this identification information. Since existing training areas already have cameras installed for monitoring the field, this application can utilize these cameras as image acquisition units, eliminating the need for additional cameras and saving on site construction costs.

[0032] The positioning unit can use BeiDou positioning technology to obtain the real-time location of trainees. In the embodiments of this application, a BeiDou ground-based augmentation system is set up in the training ground, and the positioning unit collects the location of trainees based on the BeiDou ground-based augmentation system. Through the BeiDou ground-based augmentation system, the positioning accuracy of trainees can be improved to the centimeter level, and the trigger detection unit can also locate weapons and equipment based on the BeiDou ground-based augmentation system. By improving the positioning accuracy of trainees and weapons and equipment, the accuracy of subsequent processing results can be effectively improved.

[0033] The remote processing device can be a server located outside the training ground. This remote processing device can communicate with the trigger detection unit, image acquisition unit, positioning unit, and audio playback unit via a wireless network. The attitude extraction module and audio synthesis module in the remote processing device process the received head image, weapon and equipment position, and trainee position data in real time, and feed back the processing results in real time so that the final trigger sound effect matches the real-time state of the trainee.

[0034] Furthermore, in addition to the firing sounds of weapons such as firearms and artillery, the simulated sound effects in this application also include the explosion sound effects of shells fired by indirect fire weapons such as artillery. Before the simulation, a training data processing device needs to simulate the impact point of the shell based on the artillery's firing parameters, orientation, elevation angle, and other data. Then, a remote processing device obtains the impact point's location, processes it using the same method as other data, and finally obtains the corresponding trigger sound effect.

[0035] The audio playback unit can be headphones worn by the trainee, which must be correctly worn in both ears simultaneously to ensure smooth playback of the trigger sound effects with channel delay. Since this application simulates a variety of sound effects, including gunfire, artillery fire, and shell explosions, and these effects vary depending on the type of gun, artillery, and shell, the trigger detection unit in this application, after determining the location of the weapon, also needs to send the weapon's identification information to the remote processing device. The audio synthesis module then determines the appropriate sound file based on this identification information. In the embodiments of this application, the sound intensity changes depending on the distance between the weapon and the trainee. Therefore, the audio synthesis module in this application also adjusts the sound intensity of the selected sound file according to the distance between the weapon and the trainee; specifically, the greater the distance, the lower the sound intensity.

[0036] In one possible embodiment, the remote processing device further includes a face recognition module, which is used to identify facial features in a head image. After the audio synthesis module synthesizes the triggered sound effect, it is sent by the communication module to the audio playback unit corresponding to the facial features identified by the face recognition module.

[0037] For example, since there are multiple trainees in the training area, the head images captured by the image acquisition unit will also contain multiple trainees simultaneously. Because the positions of each trainee differ, the sound emitted by the same weapon will be perceived differently by different trainees. Therefore, this application also needs to use a facial recognition module to determine the identity of each trainee and send the synthesized trigger sound effect to the audio playback unit corresponding to each trainee.

[0038] Furthermore, the image acquisition unit acquires head images in real time. After the face recognition module identifies facial features in the head image, it tracks the trainee within the field of view. During tracking, the face recognition module adds a tracking bounding box to the identified head image, with the trainee's name marked within the box. Since the trainee's position and head posture are constantly changing, in some extreme cases, it may be impossible to identify the trainee based solely on the head image. In such cases, the face recognition module needs to track the trainee's position within the field of view. If head posture identification is required during tracking, there is no need to re-identify the trainee; the name information attached to the tracking bounding box is sufficient to determine the trainee's identity. Moreover, regardless of whether head posture extraction is required, the trainee's identity and position must be tracked continuously to provide the necessary information for head posture extraction as soon as needed.

[0039] In one possible embodiment, the pose extraction module extracts the head contour from the head image, compares the extracted head contour with the pre-stored head contour at the frontal angle to determine the relative orientation of the trainee, and determines the trainee's head pose based on the orientation of the image acquisition unit and the relative orientation of the trainee.

[0040] For example, extracting the trainee's head pose involves two steps. The first step is to determine the angle of the trainee's head relative to the image acquisition unit, i.e., the relative orientation. The second step is to determine the absolute orientation of the trainee's head, i.e., the head pose, based on the relative orientation. In the first step, the pose extraction module first identifies head features in the head image, extracts the head region from the head image based on the head features, and then uses an edge detection algorithm to extract the contour of the head region, i.e., the head contour. If the head contour is different from the head contour captured by the trainee's frontal view image acquisition unit, it indicates that there is a non-zero angle between the trainee's head and the image acquisition unit. This angle can be obtained by comparing the extracted head contour with the head contour under the frontal view angle. When viewed directly, the trainee's head contour is identical to the pre-stored head contour, and the angle between the trainee's head and the image acquisition unit is 180 degrees. When the extracted head contour only includes the left or right half of the trainee's face, the angle between the trainee's head and the image acquisition unit is 90 degrees or 270 degrees. In other cases, the extracted head contour may include most of the trainee's face; in these cases, the angle between the trainee's head and the image acquisition unit is directly related to the comparison result. Therefore, the angle can be determined based on the comparison between the extracted head contour and the head contour at the direct viewing angle. After determining the angle in the first step, each image acquisition unit sends its own identity information to the posture extraction module. The posture extraction module can then obtain the orientation of the image acquisition unit based on this identity information. Combined with the angle between the trainee's head and the image acquisition unit, the absolute direction of the trainee's head can be determined. For example, if the image acquisition unit faces due south and the angle between the trainee's head and the image acquisition unit is 90 degrees, the absolute direction of the trainee's head can be determined as due east.

[0041] In one possible embodiment, there are multiple image acquisition units, which are set in different positions in the training field. The multiple image acquisition units acquire head images from different directions, and the pose extraction module selects the image with the best quality among the multiple head images to extract the head pose.

[0042] For example, since the trainee's head posture changes constantly, when the angle between the trainee's head and the image acquisition unit is too large, or when the trainee is directly facing away from the image acquisition unit, the head image acquired by the image acquisition unit contains too few head features, causing the posture extraction module to be unable to correctly identify the trainee's head posture. In this case, it is necessary to use head images acquired by other image acquisition units to ensure the accuracy of the extraction results.

[0043] In one possible embodiment, the audio synthesis module determines the angle between the trainee's head orientation and the weapon's direction based on the relative direction and head posture, and determines the channel delay of the left and right channels based on the angle and the distance between the trainee and the weapon.

[0044] For example, such as Figure 2 As shown, when the angle between the trainee's head and the direction of the weapon is 'a', the distance between them is 'D', and the distance between the trainee's left and right ears is 'D'. E At that time, the distance D between the left and right ears of the weapons, equipment, and trainees is... L and D R They are respectively:

[0045]

[0046]

[0047] Therefore, the sound path difference between the trainee's left and right ears and the weapon is D. D =D L -D R The sound path difference D D and the speed of sound in air, V S This allows us to determine the tract delay between the left and right ears of the trainee.

[0048] After determining the channel delay, the audio synthesis module obtains the sound file corresponding to the weapon and equipment. The two identical sound files are then processed according to the channel delay and combined into a trigger sound effect. The communication module sends the trigger sound effect to the audio playback unit to simulate battlefield sound effects for the trainees.

[0049] Although preferred embodiments of this application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this application.

[0050] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A battlefield sound effect simulation system, characterized in that: include: A trigger detection unit is provided on the weapon equipment and is used to obtain the position of the weapon equipment after the weapon equipment is triggered; An image acquisition unit, arranged in the training field, for acquiring a head image of a trainee; A positioning unit, which is arranged on the trainee and is used to collect the position of the trainee; The remote processing device includes a posture extraction module and an audio synthesis module, wherein the posture extraction module is used to extract the head posture of the trainee in the head image, and the audio synthesis module is used to determine the relative direction according to the position of the weapon equipment and the position of the trainee, determine the channel delay according to the relative direction and the head posture, and synthesize the triggering sound effect of the weapon equipment according to the channel delay; An audio playback unit, arranged on the trainee, for playing the trigger sound effect; The remote processing device further includes a face recognition module, which is used to recognize facial features in the head image, and the audio synthesis module synthesizes the trigger sound effect and then sends it to the audio playback unit corresponding to the facial features identified by the face recognition module through the communication module; The image acquisition unit acquires the head image in real time, and the face recognition module tracks the trainee in the field of view after recognizing the facial features in the head image.

2. A battlefield sound effect simulation system according to claim 1, characterized in that: A BeiDou Ground-Based Augmentation System is provided in the training ground, and the positioning unit collects the positions of the trainees based on the BeiDou Ground-Based Augmentation System.

3. A battlefield sound effect simulation system according to claim 1, characterized in that: The face recognition module adds a tracking frame to the recognized head image, and the tracking frame is marked with the name of the trainer.

4. A battlefield sound effect simulation system according to claim 1, characterized in that: The posture extraction module extracts the head contour in the head image, compares the extracted head contour with the pre-stored head contour at the frontal view angle, determines the relative orientation of the trainee, and determines the head posture of the trainee according to the orientation of the image acquisition unit and the relative orientation of the trainee.

5. A battlefield sound effect simulation system according to claim 4, characterized in that: There are multiple image acquisition units, which are arranged at different positions in the training field. The multiple image acquisition units acquire the head images in different directions. The posture extraction module selects the image with the best quality from the multiple head images to extract the head posture.

6. A battlefield sound effect simulation system according to claim 1, characterized in that: The audio synthesis module determines the angle between the trainee's head orientation and the direction of the weapon equipment according to the relative direction and the head posture, and determines the channel delay of the left and right channels according to the direction angle and the distance between the trainee and the weapon equipment.

Images