Augmented reality networking combat device based on integrated vision fusion
Through the integrated augmented reality networking combat device with visual fusion, the three-dimensional virtual scene is constructed using information fusion servers and wireless ad hoc networking equipment, which solves the problem of insufficient perception capabilities of traditional individual combat equipment, and realizes real-time data sharing and efficient battlefield situations. Perception improves the combat and survivability of combatants.
Patent Information
- Application Number
- CN202410995476.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Traditional individual combat equipment has weak perception of battlefield situations, and most of them rely on vision and hearing, lacks interaction and data sharing coordination, which affects combat capabilities and coordinated combat capabilities.
Using an augmented reality networking combat device based on integrated visual fusion, including information fusion servers and wireless ad hoc networking equipment, a three-dimensional virtual scene is constructed by receiving satellite remote sensing images and drone surveying and mapping data, and using an augmented reality helmet to collect environmental information for visual purposes Fusion and AI analysis to realize data sharing and transmission.
It improves soldiers' close combat capabilities, coordinated combat capabilities, over-visual reconnaissance perception capabilities and battlefield survivability, allowing soldiers to obtain battlefield situation information that exceeds visual range and data coordination under all weather conditions.
Smart Images

Figure CN118945208A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of intelligent equipment for individual combat, and specifically to an augmented reality networking combat device based on integrated visual fusion. Background Art
[0002] Individual comprehensive combat takes the individual soldier as the basic unit, comprehensively considers one person, one machine and one environment, and integrates high-tech soldier equipment with multiple advanced technologies, so that soldiers, weapons and equipment form an organic whole, thereby comprehensively enhancing the firepower, mobility, communication, sighting and protection capabilities of the individual soldier. It makes each soldier an effective fire attack unit, which can fight independently and coordinate actions, comprehensively improves the combat effectiveness of the individual soldier, and enables soldiers to gain advantages on the future information battlefield.
[0003] However, traditional individual combat has a weak perception of battlefield situation, and most of them rely on vision and hearing to obtain information, which greatly affects the individual combat capability and coordinated combat capability. In addition, most of the existing individual combat reconnaissance and perception equipment do not have interactivity and data sharing coordination, which seriously affects the close combat capability, coordinated combat capability, over-the-horizon reconnaissance and perception capability and battlefield survivability of combat personnel. Summary of the invention
[0004] In order to overcome the deficiencies of the above-mentioned prior art, the present application provides an augmented reality networking combat device based on integrated visual fusion, which specifically adopts the following technical solutions:
[0005] An augmented reality networked combat device based on integrated visual fusion, comprising:
[0006] The information fusion server is used to receive satellite remote sensing image data and drone mapping data and build a three-dimensional virtual battlefield scene; at the same time, it receives sensor data collected by the augmented reality helmet and performs visual fusion and AI analysis and calculation.
[0007] Wireless self-organizing network equipment, used to realize the rapid self-organizing network connection between the information fusion server and the enhanced display helmet for data sharing and transmission;
[0008] At least one augmented reality helmet is used to collect real environment information and location information around the user in all-weather complex environments and forward it back to the information fusion server for integrated visual fusion and three-dimensional virtual scene reconstruction.
[0009] Optional: The information fusion server adopts the Loongson CPU3C5000L architecture, and the information fusion server includes a geographic information device and a virtual environment construction device, the geographic information device is used to receive satellite remote sensing image data and drone mapping data and forward them to the virtual environment construction device, and the virtual environment construction device automatically constructs a three-dimensional virtual battlefield scene based on the satellite remote sensing image data and drone mapping data.
[0010] Optionally: the physical layer of the wireless ad hoc network device adopts an OFDM waveform, the large-bandwidth data channel of the wireless ad hoc network device adopts a turbo coding method, and the small-bandwidth control channel adopts an RM coding method.
[0011] Optionally: the data encryption method of the wireless ad hoc network device adopts one or more combinations of DES56, AES128 or AES256 standards.
[0012] Optional: The augmented reality helmet includes an integrated sensor array, a self-organizing network communication terminal, a microcomputer PC and a power supply component, wherein the integrated sensor array is used to collect real environmental information and positioning information of objects around the user; the self-organizing network communication terminal is used to maintain real-time data connection between the wireless self-organizing network device and the augmented reality helmet; the microcomputer PC is used to process data from the integrated sensor array and the information fusion server and identify the target; the power supply component is used to provide power to the internal devices of the augmented reality helmet.
[0013] Optionally: the integrated sensor array includes an image sensor, a sound sensor, a ranging sensor, a vital sign sensor and a positioning sensor, the image sensor is used to collect environmental image data around the user; the sound sensor is used to collect sound data around the user; the ranging sensor is used to obtain distance data of surrounding objects; the vital sign sensor is used to obtain real-time vital sign data of the user; and the positioning sensor is used to locate the user's current location information.
[0014] Optionally: the image sensor includes one or more combinations of a fixed-focus lens, a telephoto lens, a night vision lens, a multi-spectral lens or a wide-angle lens.
[0015] Optionally: the sound sensor includes a wired headset or a wireless headset.
[0016] Optionally: the positioning sensor includes a GPS positioning module, a Beidou positioning module or a UWB positioning module.
[0017] Optionally: the augmented reality helmet also includes a head-up display, which is fixed to the front of the augmented reality helmet, and the head-up display receives data transmitted by the microcomputer PC and displays it dynamically.
[0018] Beneficial Effects
[0019] The technical solution of this application has the following beneficial effects:
[0020] The augmented reality networking combat device of the present application can connect each augmented reality helmet to the information fusion server through a wireless self-organizing network device, and use each augmented reality helmet as an information collection terminal to collect the user's surrounding environment data and location data in real time, and perform visual fusion and AI analysis through the information fusion server to dynamically build a battlefield virtual environment in real time, so that soldiers can obtain beyond-visual-range, data-coordinated battlefield situation information in a timely manner under all-weather conditions and under the premise of being protected by a helmet, which greatly improves the combat personnel's close combat capability, coordinated combat capability, beyond-visual-range reconnaissance perception capability and battlefield survivability. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 This is a schematic diagram of the structure of the augmented reality networking combat device in the embodiment of the present application.
[0022] Figure 2 This is a schematic diagram of the structure of the augmented reality helmet in an embodiment of the present application.
[0023] The specific meanings of the reference numerals in the accompanying drawings:
[0024] 1-information fusion server; 2-wireless ad hoc network device; 3-augmented reality helmet; 301-ad hoc network communication terminal; 302-integrated sensor array; 303-microcomputer PC; 304-power supply component. DETAILED DESCRIPTION
[0025] The present application is further described below in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present application, and cannot be used to limit the scope of protection of the present application. It should be noted that the following detailed descriptions are all exemplary and are intended to provide further explanation of the present application.
[0026] like Figure 1 As shown, the embodiment of the present application specifically discloses an augmented reality networking combat device based on integrated visual fusion, which includes:
[0027] The information fusion server 1 is used to receive satellite remote sensing image data and drone mapping data and build a three-dimensional virtual battlefield scene; at the same time, it receives sensor data collected by the augmented reality helmet 3 and performs visual fusion and AI analysis and calculation.
[0028] The wireless ad hoc network device 2 is used to realize a fast ad hoc network connection between the information fusion server 1 and the enhanced display helmet for data sharing and transmission;
[0029] At least one augmented reality helmet 3 is used to collect real environment information and location information around the user in a complex environment around the clock and forward it back to the information fusion server 1 for integrated visual fusion and three-dimensional virtual scene reconstruction.
[0030] Specifically, the information fusion server 1 described in the embodiment of the present application adopts the Loongson CPU3C5000L architecture, and the information fusion server 1 includes a geographic information device and a virtual environment construction device. The geographic information device is used to receive satellite remote sensing image data and drone mapping data and forward them to the virtual environment construction device. The virtual environment construction device automatically constructs a three-dimensional virtual scene of the battlefield based on the satellite remote sensing image data and drone mapping data.
[0031] More specifically, the physical layer of the wireless ad hoc network device 2 described in the embodiment of the present application adopts an OFDM waveform, which belongs to a type of MCM multi-carrier modulation. It realizes parallel transmission of high-speed serial data through frequency division multiplexing, has good anti-multipath fading capability, and can support multi-user access. The large-bandwidth data channel of the wireless ad hoc network device 2 adopts turbo coding, and the small-bandwidth control channel adopts RM coding. Through the wireless ad hoc network device 2, any augmented reality helmet 3 can be grouped into or removed from the network at any time, which is more convenient for combat personnel to group, and each augmented reality helmet 3 can be used as an independent data acquisition device to collect the surrounding real environment in real time, and the data collected by each augmented reality helmet 3 is fused and AI analyzed through the information fusion server 1, and the results are distributed to each augmented reality helmet 3 user, realizing data sharing and collaborative combat.
[0032] In addition, since the information fusion server 1 and the augmented reality helmet 3 realize the distribution and data sharing of battlefield virtual environment data, visual fusion data and AI analysis and calculation data through the wireless self-organizing network device 2, the wireless self-organizing network device 2 must encrypt the transmitted data. The data encryption method of the wireless self-organizing network device 2 in the embodiment of the present application adopts one or more combinations of DES56, AES128 or AES256 standards to ensure data communication security.
[0033] More detailed, such as Figure 2As shown, the augmented reality helmet 3 in the embodiment of the present application is a medium for combat personnel to participate in the entire augmented reality networking combat device. The augmented reality helmet 3 includes an integrated sensor array 302, a self-organizing network communication terminal 301, a microcomputer PC303 and a power supply component 304, wherein the integrated sensor array 302 is used to collect real environmental information and positioning information of objects around the user; the self-organizing network communication terminal 301 is used for the wireless self-organizing network device 2 and the augmented reality helmet 3 to maintain real-time data connection; the microcomputer PC303 is used to process data from the integrated sensor array 302 and the information fusion server 1 and identify the target; the power supply component 304 is used to provide power to the internal devices of the augmented reality helmet 3.
[0034] Specifically, the integrated sensor array 302 includes an image sensor, a sound sensor, a ranging sensor, a vital sign sensor, and a positioning sensor. The image sensor is used to collect environmental image data around the user; preferably, the image sensor in the embodiment of the present application may include one or more combinations of a fixed focus lens, a telephoto lens, a night vision lens, a multi-spectral lens, or a wide-angle lens. The above-mentioned image sensor can realize the collection of environmental data within the user's peripheral visual range or outside the visual range, and the above-mentioned image sensor can perform tactical actions such as over-the-horizon reconnaissance, camouflage reconnaissance, night vision reconnaissance, infrared reconnaissance, ranging, and mark threatening targets. It should be noted that the AI analysis function can be built into the augmented reality helmet 3 to perform AI automatic identification of weapons and equipment, armed enemies, strike targets, etc. in real time. The sound sensor is used to collect or output the user's sound data; preferably, the sound sensor in the embodiment of the present application includes a wired headset or a wireless headset, which can facilitate the user to communicate with the team members and the command unit in real time. The ranging sensor is used to obtain the distance data of surrounding objects, such as infrared ranging sensors, laser ranging sensors, radar ranging sensors, etc.; the vital sign sensor is used to obtain the user's real-time vital sign data, so that the command unit can know the combat personnel's physical signs in real time, which is convenient for subsequent combat arrangements; the positioning sensor is used to locate the user's current location information; preferably, the positioning sensor in the embodiment of the present application can adopt a GPS positioning module, a Beidou positioning module or a UWB positioning module.
[0035] In addition, it should be noted that the augmented reality helmet 3 of the embodiment of the present application also includes a head-up display, which is fixed to the front of the augmented reality helmet 3, and the head-up display receives data transmitted by the microcomputer PC303 and displays it dynamically. The device can integrate visual information such as infrared, night vision, ultra-telephoto, battlefield geographic information, combat information reconnaissance by unmanned combat equipment, team member position information, and enemy position information on the head-up display of the augmented reality helmet 3 through the augmented reality helmet 3, so that soldiers can obtain complete battlefield information and real-scene information in real time, and soldiers can obtain beyond-visual-range information and coordinated battlefield situation information in a timely manner under all-weather conditions.
[0036] When the above-mentioned augmented reality networking combat device is applied to the combat environment, firstly, the augmented reality helmets 3 of the combatants can be grouped and connected to the wireless self-organizing network device 2 based on the grouping of the combatants, and the wireless self-organizing network device 2 can be connected to the information fusion server 1 at the same time, so as to ensure the real-time data transmission between the augmented reality helmet 3 and the information fusion server 1. After entering the battlefield environment, the combatants can collect real environment information and position information in real time in a complex environment around the clock through the integrated sensor array 302 of the augmented reality helmet 3, and send it back to the information fusion server 1 for integrated visual fusion and three-dimensional virtual scene reconstruction; at the same time, the data collected by the integrated sensor array 302 can be processed by the microcomputer PC303 and displayed in real time on the head-up display in front of the helmet, so that the combatants can perform tactical actions such as over-the-horizon reconnaissance, camouflage reconnaissance, night vision reconnaissance, infrared reconnaissance, ranging, etc., and mark threat targets, and can also perform AI automatic identification of weapons and equipment, armed enemies, and strike targets; in addition, the head-up display can display the location of each combatant and the location and vital signs of team members, and tactical coordination can be carried out through combat mapping or voice. The information fusion server 1 can distribute the constructed battlefield virtual environment data to the augmented reality helmet 3 of each combatant, so that the combatant can obtain complete battlefield information and real scene information in real time. The device overcomes the problem that traditional individual combatants have weak perception of battlefield situation and can only obtain information through vision and hearing. It uses each augmented reality helmet 3 as a data collection terminal and constructs the overall battlefield situation, which greatly improves the individual combat capability and coordinated combat capability of combatants and greatly improves the survivability of combatants.
[0037] It should be noted that the information fusion server 1 of the present application not only maintains a communication connection with the combat personnel's augmented reality helmet 3, but can also achieve networking and information sharing with the combat unit's command vehicle, reconnaissance drone equipment, other team members and even weapon systems, thereby improving collaborative combat capabilities and greatly improving the combat personnel's close combat capabilities, collaborative combat capabilities, beyond-visual-range reconnaissance and perception capabilities, and battlefield survivability.
[0038] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. An augmented reality network combat device based on integrated visual fusion, characterized in that: include: Information fusion server, used to receive satellite remote sensing image data and drone mapping data and build a three-dimensional virtual battlefield scene; At the same time, it receives sensor data collected by the augmented reality helmet and performs visual fusion and AI analysis and calculation. Wireless self-organizing network equipment, used to realize the rapid self-organizing network connection between the information fusion server and the enhanced display helmet for data sharing and transmission; At least one augmented reality helmet is used to collect real environment information and location information around the user in all-weather complex environments and forward it back to the information fusion server for integrated visual fusion and three-dimensional virtual scene reconstruction.
2. The augmented reality network combat device according to claim 1, characterized in that: The information fusion server adopts the Loongson CPU3C5000L architecture, and the information fusion server includes a geographic information device and a virtual environment construction device. The geographic information device is used to receive satellite remote sensing image data and unmanned aerial vehicle mapping data and forward them to the virtual environment construction device. The virtual environment construction device automatically constructs a three-dimensional virtual battlefield scene based on the satellite remote sensing image data and the unmanned aerial vehicle mapping data.
3. The augmented reality network combat device according to claim 1, characterized in that: The physical layer of the wireless ad hoc network device adopts OFDM waveform, the large bandwidth data channel of the wireless ad hoc network device adopts turbo coding, and the small bandwidth control channel adopts RM coding.
4. The augmented reality network combat device according to claim 3, characterized in that: The data encryption method of the wireless ad hoc network device adopts one or more combinations of DES56, AES128 or AES256 standards.
5. The augmented reality network combat device according to claim 1, characterized in that: The augmented reality helmet includes an integrated sensor array, a self-organizing network communication terminal, a microcomputer PC and a power supply component, wherein the integrated sensor array is used to collect real environment information and positioning information of objects around the user; the self-organizing network communication terminal is used to maintain real-time data connection between the wireless self-organizing network device and the augmented reality helmet; the microcomputer PC is used to process data from the integrated sensor array and the information fusion server and identify the target; the power supply component is used to provide power to the internal devices of the augmented reality helmet.
6. The augmented reality network combat device according to claim 5, characterized in that: The integrated sensor array includes an image sensor, a sound sensor, a ranging sensor, a vital sign sensor and a positioning sensor. The image sensor is used to collect environmental image data around the user; the sound sensor is used to collect sound data around the user; the ranging sensor is used to obtain distance data of surrounding objects; the vital sign sensor is used to obtain real-time vital sign data of the user; and the positioning sensor is used to locate the user's current location information.
7. The augmented reality network combat device according to claim 6, characterized in that: The image sensor includes one or more combinations of a fixed focus lens, a telephoto lens, a night vision lens, a multi-spectral lens or a wide-angle lens.
8. The augmented reality network combat device according to claim 6, characterized in that: The sound sensor includes a wired headset or a wireless headset.
9. The augmented reality network combat device according to claim 6, characterized in that: The positioning sensor includes a GPS positioning module, a Beidou positioning module or a UWB positioning module.
10. The augmented reality network combat device according to claim 5, characterized in that: The augmented reality helmet also includes a head-up display, which is fixed to the front of the augmented reality helmet, and the head-up display receives data transmitted by the microcomputer PC and displays it dynamically.
Citation Information
Patent Citations
An unmanned aerial vehicle AR field observation method based on BIM technology
CN109325478A
Intelligent emergency rescue helmet
CN110150784A
Soldier and team combat-oriented combat cooperation system and soldier and team combat-oriented combat cooperation method
CN112099620A
Systems and methods for virtual and augmented reality
CN113632030A
Individual soldier rescue wearable system for fire fighting and use method thereof
CN117240839A
Cited By
Target guidance system and method based on augmented reality and high-precision positioning technology
CN120121016A
