Multimodal information generation method and device for digital force intelligent construction platform

Abstract

The present invention provides a multimodal information generation method and device for a digital force intelligent construction platform, which relates to the field of data processing technology, and includes: obtaining electronic information data and visible light data of a target area according to a configuration input of a target area; generating infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input; obtaining radar data and SAR radar data of the target area according to data processing of a radar echo signal of the target area; and synthesizing the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a multimodal information generation method and device for a digital force intelligent construction platform. Background Art

[0002] In the field of modern military training and simulation, live simulation, constructive simulation and virtual simulation are the three main simulation technologies. Live simulation involves real personnel and equipment operating in an actual or near-actual environment, and is mainly used for actual combat exercises and skill training. Constructive simulation focuses on exercises with simulated personnel and systems in a computer-generated environment, and is often used for tactical analysis and decision-making. Virtual simulation refers to confrontation exercises with simulated systems and personnel in a completely virtual environment. This simulation technology can be infinitely close to actual combat, but lacks the realism of physical interaction.

[0003] The data used to realize simulation is also very important. Only with more complete data can simulation be better realized. Therefore, how to effectively obtain data used to realize simulation has become a problem that needs to be solved urgently in the industry. Summary of the invention

[0004] The present invention provides a multimodal information generation method and device for a digital force intelligent construction platform, which are used to solve the problem of how to effectively obtain data for realizing simulation in the prior art.

[0005] The present invention provides a multimodal information generation method for a digital force intelligent construction platform, comprising:

[0006] According to the configuration input of the target area, electronic information data and visible light data of the target area are obtained;

[0007] Generate infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input;

[0008] According to data processing of the radar echo signal of the target area, radar data and SAR radar data of the target area are obtained;

[0009] The electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area are synthesized to obtain multimodal data of the target area.

[0010] According to a multimodal information generation method for a digital force intelligent construction platform provided by the present invention, the electronic information data acquisition method specifically includes:

[0011] Generate a target digital signal according to the FPGA data input in the configuration input;

[0012] According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

[0013] According to a multimodal information generation method for a digital force intelligent construction platform provided by the present invention, the method for acquiring visible light data includes:

[0014] According to the color mode setting input in the configuration input, adjusting the color mode of the original image of the target area to obtain a first visible light image;

[0015] According to the image parameter setting input in the configuration input, image parameters of the original image of the target area are adjusted to obtain a visible light image of the target area.

[0016] According to a multimodal information generation method for a digital force intelligent construction platform provided by the present invention, infrared image data of the target area is generated according to thermal balance model calculation, thermal conduction model calculation and display mode input, including:

[0017] Preprocess and analyze the infrared image of the target area to extract the temperature information of the target area;

[0018] The pixel values ​​in the infrared image are converted into the temperature values ​​of the object surface, and the heat conduction model is established based on the object geometry information and the temperature data calculated from the infrared image;

[0019] The established heat conduction model is numerically solved to calculate the temperature distribution inside the object in the target area for thermal balance analysis.

[0020] According to a multimodal information generation method for a digital force intelligent construction platform provided by the present invention, the radar data acquisition method includes:

[0021] Receiving a radar echo signal of the target area;

[0022] Amplifying and filtering the received radar echo signal, and estimating radar parameter information of the target area by processing and analyzing the echo signal;

[0023] The radar parameter information is visualized to obtain the radar data.

[0024] According to a multimodal information generation method for a digital force intelligent construction platform provided by the present invention, the SAR radar data acquisition method includes:

[0025] Performing platform motion compensation on the received SAR radar echo signal to obtain a compensated SAR radar echo signal;

[0026] The compensated SAR radar echo signal is processed by synthetic aperture processing algorithm to form a synthetic aperture image;

[0027] The synthetic aperture image is reconstructed and filtered, and then image visualization processing is performed to obtain SAR radar data.

[0028] The present invention also provides a multimodal information generation device for a digital force intelligent construction platform, comprising:

[0029] A first generating module, for obtaining electronic information data and visible light data of the target area according to the configuration input of the target area;

[0030] A second generating module, used for generating infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input;

[0031] A third generating module is used to obtain radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area;

[0032] The synthesis module is used to synthesize the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area.

[0033] According to a multimodal information generation device for a digital force intelligent construction platform provided by an embodiment of the present invention, the method for acquiring the electronic information data specifically includes:

[0034] Generate a target digital signal according to the FPGA data input in the configuration input;

[0035] According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

[0036] The method for acquiring the visible light data includes:

[0037] According to the color mode setting input in the configuration input, adjusting the color mode of the original image of the target area to obtain a first visible light image;

[0038] According to the image parameter setting input in the configuration input, image parameters of the original image of the target area are adjusted to obtain a visible light image of the target area.

[0039] Generate infrared image data of the target area according to the heat balance model calculation, the heat conduction model calculation and the display mode input, including:

[0040] Preprocess and analyze the infrared image of the target area to extract the temperature information of the target area;

[0041] The pixel values ​​in the infrared image are converted into the temperature values ​​of the object surface, and the heat conduction model is established based on the object geometry information and the temperature data calculated from the infrared image;

[0042] The established heat conduction model is numerically solved to calculate the temperature distribution inside the object in the target area for thermal balance analysis.

[0043] The radar data acquisition method comprises:

[0044] Receiving a radar echo signal of the target area;

[0045] Amplifying and filtering the received radar echo signal, and estimating radar parameter information of the target area by processing and analyzing the echo signal;

[0046] The radar parameter information is visualized to obtain the radar data.

[0047] The method for acquiring SAR radar data comprises:

[0048] Performing platform motion compensation on the received SAR radar echo signal to obtain a compensated SAR radar echo signal;

[0049] The compensated SAR radar echo signal is processed by synthetic aperture processing algorithm to form a synthetic aperture image;

[0050] The synthetic aperture image is reconstructed and filtered, and then image visualization processing is performed to obtain SAR radar data.

[0051] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a multimodal information generation method for a digital force intelligent construction platform as described in any one of the above-mentioned methods is implemented.

[0052] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method for generating multimodal information for a digital force intelligent construction platform as described in any one of the above is implemented.

[0053] The present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements any of the multimodal information generation methods for a digital force intelligent construction platform as described above.

[0054] The present invention provides a multimodal information generation method and device for a digital force intelligent construction platform, which generates different modal information such as electronic information data, visible light data, infrared image data, radar data and SAR radar data through various sensor data information generation algorithms, and realizes information data synthesis through an information synthesis method, thereby providing comprehensive and accurate data support for the digital force intelligent construction platform, thereby improving the effect and quality of simulation training. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0056] Figure 1 A schematic flow chart of a multimodal information generation method for a digital force intelligent construction platform described in an embodiment of the present application;

[0057] Figure 2 A schematic diagram of generating multimodal information provided in an embodiment of the present application;

[0058] Figure 3 A schematic diagram of the structure of a multimodal information generation device for a digital force intelligent construction platform provided in an embodiment of the present application;

[0059] Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0060] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0061] Figure 1 This is a flow chart of a multimodal information generation method for a digital force intelligent construction platform described in an embodiment of the present application. Figure 1 As shown, including:

[0062] Step 110, obtaining electronic information data and visible light data for the target area according to the configuration input of the target area;

[0063] In the embodiment of the present application, the target area needs to be configured and input first, which may include the geographical information, environmental characteristics, expected electronic activities, etc. of the target area. Based on this input information, the electronic information data generation module will use FPGA or other digital signal processing technology to generate simulated electronic signals and data patterns.

[0064] At the same time, the visible light data generation module will simulate the image data of the target area within the visible spectrum according to the configuration input. This may involve the simulation of parameters such as lighting conditions, color distribution, and image clarity.

[0065] Optionally, the method for acquiring the electronic information data specifically includes:

[0066] Generate a target digital signal according to the FPGA data input in the configuration input;

[0067] According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

[0068] In the embodiment of the present application, the FPGA data input in the configuration input refers to the input of specific parameters and settings into the FPGA data generation module. These inputs may include the type, frequency, amplitude, phase and duration of the signal. FPGA (Field-Programmable Gate Array) is a semiconductor device that can be programmed to implement specific functions. It consists of programmable logic units and programmable interconnects.

[0069] Using codes written in hardware description languages ​​(such as VHDL or Verilog), FPGA data generation modules are able to generate complex digital signal patterns. These signal patterns can simulate signals that may be generated by actual electronic devices or communication systems, such as radio communication signals, radar pulses, or working signals of other electronic devices. Through the flexibility and reconfigurability of FPGA, it can quickly adapt to different test scenarios and requirements and generate the required target digital signals.

[0070] More specifically, the signal processing function input in the configuration input refers to the requirements and parameters for further processing of the target digital signal. These processes may include filtering, modulation, demodulation, encoding and decoding, signal enhancement or signal simulation, etc. The custom signal style module processes the target digital signal generated by the FPGA using a software-defined method based on these inputs.

[0071] For example, if the electronic information data of the target area needs to simulate enemy communication interference, the signal processing function will include specific modulation and coding of the signal to generate a signal with jamming characteristics. Alternatively, if it is necessary to simulate electronic jamming or noise, the signal processing function can introduce specific noise patterns or jamming signals.

[0072] The processed target digital signal is the electronic information data of the target area. This data can be used to simulate the actual electronic battlefield environment and provide trainers with a realistic electronic warfare simulation experience. In this way, the digital force intelligent construction platform can provide high-quality electronic information data to support complex simulation training and analysis tasks.

[0073] Optionally, the method for acquiring the visible light data includes:

[0074] According to the color mode setting input in the configuration input, adjusting the color mode of the original image of the target area to obtain a first visible light image;

[0075] According to the image parameter setting input in the configuration input, image parameters of the original image of the target area are adjusted to obtain a visible light image of the target area.

[0076] In an embodiment of the present application, the color mode of the original image of the target area is adjusted according to the color mode setting input in the configuration input. The color mode setting may include color, black and white (grayscale), or a specific color filter effect. The purpose of this step is to ensure that the generated image data can meet the specific requirements for color representation in the simulation training.

[0077] Color mode: In color mode, all color channels (such as red, green, and blue) in the original image will be retained, so that the image retains rich color information.

[0078] Black and white mode: In black and white mode, the color information of the original image will be converted into grayscale values, retaining only the brightness information. It is suitable for scenes that do not require color distinction.

[0079] Specific color filter effects: Based on specific simulation requirements, specific color filter effects may be applied, such as infrared filters, night vision filters, etc., to simulate the visual experience in a specific environment.

[0080] More specifically, in the embodiment of the present application, according to the image parameter setting input in the configuration input, the image parameters of the original image of the target area are adjusted. The image parameter settings may include brightness, contrast, saturation, sharpness, noise intensity, etc. These adjustments can optimize the visual effect of the image to make it closer to the actual observation conditions or specific training goals.

[0081] Brightness adjustment: Change the overall brightness level of the image to adapt it to different lighting conditions, such as simulating nighttime or dusk environments.

[0082] Contrast adjustment: Increase or decrease the contrast between light and dark areas in an image to improve image clarity and visual impact.

[0083] Saturation adjustment: Change the saturation of colors in an image to make it more vivid or softer to suit different visual requirements.

[0084] Sharpness Adjustment: Improves image clarity and resolution by enhancing image edges and details.

[0085] Noise intensity adjustment: Introduce or reduce noise in the image to simulate the image quality of different sensors or observation conditions.

[0086] In the embodiment of the present application, a visible light image of the target area after color mode adjustment and image parameter adjustment can be obtained. These image data can be used for tasks such as visual effect evaluation, target recognition and image analysis in simulation training, providing trainers with realistic visual experience and effective training support.

[0087] Step 120, generating infrared image data of the target area according to the thermal balance model calculation, the heat conduction model calculation and the display mode input;

[0088] Optionally, generating infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input includes:

[0089] Preprocess and analyze the infrared image of the target area to extract the temperature information of the target area;

[0090] The pixel values ​​in the infrared image are converted into the temperature values ​​of the object surface, and the heat conduction model is established based on the object geometry information and the temperature data calculated from the infrared image;

[0091] The established heat conduction model is numerically solved to calculate the temperature distribution inside the object in the target area for thermal balance analysis.

[0092] In the embodiment of the present application, the infrared image of the target area is preprocessed and analyzed to extract the temperature information of the target area. The preprocessing may include operations such as denoising, contrast enhancement, and image smoothing to improve image quality and reduce errors. The analysis step may involve techniques such as image segmentation, feature extraction, and target recognition to accurately identify and extract objects and areas of interest from the infrared image.

[0093] More specifically, the pixel values ​​in the infrared image are converted to the actual temperature values ​​of the object surface. This process usually requires calibration of the output of the infrared sensor to ensure an accurate correspondence between the pixel value and the temperature. In addition, factors such as the resolution of the infrared image, the field of view, and the characteristics of the sensor need to be considered.

[0094] After the conversion is completed, a heat conduction model can be established based on the geometric information of the object and the temperature data obtained from the infrared image. The heat conduction model is a mathematical model used to describe the propagation and distribution of heat inside an object. This model is usually based on the heat conduction equation, such as the three-dimensional heat conduction equation, which takes into account the thermal conductivity, specific heat capacity, density and other physical parameters of the material.

[0095] Optionally, the established heat conduction model can also be numerically solved to calculate the internal temperature distribution of the object in the target area. The numerical solution usually adopts the finite element method (FEM), the finite difference method (FDM) or other numerical analysis techniques to obtain the temperature value of each grid node through iterative calculation. The temperature distribution data obtained by the solution is used for thermal balance analysis, that is, to determine whether the object has reached a thermal equilibrium state. Thermal balance analysis can help understand the thermal stability and thermal characteristics of an object under specific conditions, which is crucial for evaluating the temperature environment of the target area and performing thermal imaging analysis. Finally, infrared image data describing the temperature characteristics of the target area is generated.

[0096] Step 130, obtaining radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area;

[0097] Optionally, the method for acquiring radar data includes:

[0098] Receiving a radar echo signal of the target area;

[0099] Amplifying and filtering the received radar echo signal, and estimating radar parameter information of the target area by processing and analyzing the echo signal;

[0100] The radar parameter information is visualized to obtain the radar data.

[0101] In the embodiment of the present application, the radar system transmits electromagnetic waves, usually radio waves, and receives radar echo signals reflected from the target area. These echo signals contain information such as the position, speed, size, etc. of the target object. The received radar echo signals are the basis for subsequent processing and analysis.

[0102] More specifically, necessary preprocessing is performed on the received radar echo signal, such as amplification and filtering, to improve the quality and usability of the signal. Amplification can enhance the strength of the signal, making it easier to detect and analyze. Filtering is used to remove noise and interference and improve the signal-to-noise ratio.

[0103] Next, the radar parameter information of the target area is estimated through detailed processing and analysis of the echo signal. This may include measuring the time delay of the echo signal to estimate the distance of the target, analyzing the Doppler frequency shift to estimate the speed of the target, and estimating the size and shape of the target based on the intensity and distribution of the echo signal.

[0104] The estimated radar parameter information is visualized for easy observation and understanding. Visualization can take many forms, such as radar charts, scatter plots, 3D images, etc., which can intuitively display the position, speed and other characteristics of the target.

[0105] For example, radar charts can show the distribution of targets at different distances and azimuths, scatter plots can show the relationship between the speed and distance of targets, and 3D images can provide a stereoscopic view of targets. Through these visualization methods, users can understand radar data more intuitively, thereby making more accurate judgments and decisions in simulation training and actual applications.

[0106] In the embodiment of the present application, the radar data acquisition method can provide the digital force intelligent construction platform with detailed radar information about the target area. This information is of great value for target detection, tracking, identification and evaluation, and can significantly improve the authenticity and effectiveness of simulation training.

[0107] Optionally, the method for acquiring SAR radar data includes:

[0108] Performing platform motion compensation on the received SAR radar echo signal to obtain a compensated SAR radar echo signal;

[0109] The compensated SAR radar echo signal is processed by synthetic aperture processing algorithm to form a synthetic aperture image;

[0110] The synthetic aperture image is reconstructed and filtered, and then image visualization processing is performed to obtain SAR radar data.

[0111] In the embodiment of the present application, since the SAR radar system is usually mounted on a moving platform (such as an aircraft or a satellite), it is necessary to perform platform motion compensation on the received SAR radar echo signal. This step is to eliminate or reduce the impact of platform motion on radar data and ensure that the radar echo signal can accurately reflect the information of the target area.

[0112] Platform motion compensation typically involves correcting for the time delay of radar echo signals to ensure that echo signals received from different locations are combined in the correct position. This may require the use of precise positioning and navigation data, such as that provided by the Global Positioning System (GPS) and Inertial Navigation System (INS), to calculate and apply the necessary corrections.

[0113] In the embodiment of the present application, the compensated SAR radar echo signal is processed by a synthetic aperture processing algorithm to form a synthetic aperture image. Synthetic aperture processing is a technology that uses the movement of the radar platform to increase the time that the radar beam illuminates the target, thereby improving the spatial resolution of the image.

[0114] The synthetic aperture processing algorithm includes steps such as phase encoding and phase modulation, which superimpose echo signals from different positions to form a high-resolution image. This process requires complex mathematical processing of radar echo signals to ensure the quality and accuracy of the image.

[0115] In the embodiment of the present application, the synthetic aperture image is reconstructed and filtered. Image reconstruction is to generate a two-dimensional or three-dimensional image of the target area based on the processed radar data, while filtering is to remove noise and irrelevant features in the image to improve the clarity of the image and the recognizability of the target.

[0116] Image reconstruction may involve de-skew correction, multi-view fusion, Doppler frequency correction and other techniques to ensure the correctness and consistency of the image. Filtering may use various filters, such as low-pass filters, high-pass filters or band-pass filters, to remove or enhance specific frequency components in the image as needed.

[0117] Finally, the reconstructed and filtered synthetic aperture image is visualized to obtain the final SAR radar data. Visualization processing may include image enhancement, pseudo color processing, target highlighting, etc., to facilitate user analysis and interpretation of the image.

[0118] In an embodiment of the present application, the method for acquiring SAR radar data can provide high-resolution radar images for the digital force intelligent construction platform, and these images are of great value for target detection, recognition, terrain analysis and other application scenarios.

[0119] Step 140 , synthesizing the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area.

[0120] Figure 2 A schematic diagram of generating multimodal information provided in an embodiment of the present application is shown in FIG. Figure 2As shown, it includes 6 parts: electronic information data generation, visible light data generation, infrared data generation, radar data generation, SAR radar data generation, and information synthesis

[0121] The specific processes of electronic information data generation, visible light data generation, infrared data generation, radar data generation, and SAR radar data generation can refer to the above embodiments and will not be repeated here.

[0122] More specifically, information synthesis can be:

[0123] Base map area calculation: Calculate the satellite position based on the number of satellite orbital elements, integrate the satellite and payload attitude information, obtain the visible area of ​​infrared, visible light, SAR and other payloads, and obtain the relevant payload base map data based on the visible area.

[0124] Regional target data acquisition: Based on the visible area information, query the target information in the area, such as target name, target location, target quantity, target physical model data, etc.

[0125] Information data synthesis: map data and target data are integrated to finally obtain multimodal information. Based on the multimodal information of the target area, some characteristic information that users are concerned about can be obtained, such as some digital information, such as the number distribution of red and blue sides.

[0126] The multimodal information generation device for the digital force intelligent construction platform provided by the present invention is described below. The multimodal information generation device for the digital force intelligent construction platform described below and the multimodal information generation method for the digital force intelligent construction platform described above can be referenced to each other.

[0127] Figure 3 A schematic diagram of the structure of a multimodal information generation device for a digital force intelligent construction platform provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, including:

[0128] The first generating module 310 is used to obtain electronic information data and visible light data of the target area according to the configuration input of the target area;

[0129] The second generating module 320 is used to generate infrared image data of the target area according to the thermal balance model calculation, the heat conduction model calculation and the display mode input;

[0130] The third generating module 330 is used to obtain radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area;

[0131] The synthesis module 340 is used to synthesize the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area.

[0132] According to a multimodal information generation device for a digital force intelligent construction platform provided by an embodiment of the present invention, the method for acquiring the electronic information data specifically includes:

[0133] Generate a target digital signal according to the FPGA data input in the configuration input;

[0134] According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

[0135] The method for acquiring the visible light data includes:

[0136] According to the color mode setting input in the configuration input, adjusting the color mode of the original image of the target area to obtain a first visible light image;

[0137] According to the image parameter setting input in the configuration input, image parameters of the original image of the target area are adjusted to obtain a visible light image of the target area.

[0138] Generate infrared image data of the target area according to the heat balance model calculation, the heat conduction model calculation and the display mode input, including:

[0139] Preprocess and analyze the infrared image of the target area to extract the temperature information of the target area;

[0140] The pixel values ​​in the infrared image are converted into the temperature values ​​of the object surface, and the heat conduction model is established based on the object geometry information and the temperature data calculated from the infrared image;

[0141] The established heat conduction model is numerically solved to calculate the temperature distribution inside the object in the target area for thermal balance analysis.

[0142] The radar data acquisition method comprises:

[0143] Receiving a radar echo signal of the target area;

[0144] Amplifying and filtering the received radar echo signal, and estimating radar parameter information of the target area by processing and analyzing the echo signal;

[0145] The radar parameter information is visualized to obtain the radar data.

[0146] The method for acquiring SAR radar data comprises:

[0147] Performing platform motion compensation on the received SAR radar echo signal to obtain a compensated SAR radar echo signal;

[0148] The compensated SAR radar echo signal is processed by synthetic aperture processing algorithm to form a synthetic aperture image;

[0149] The synthetic aperture image is reconstructed and filtered, and then image visualization processing is performed to obtain SAR radar data.

[0150] In the embodiments of the present application, electronic information data, visible light data, infrared image data, radar data, SAR radar data and other different modal information are generated through various sensor data information generation algorithms, and information data synthesis is achieved through information synthesis methods, providing comprehensive and accurate data support for the digital force intelligent construction platform, thereby improving the effect and quality of simulation training.

[0151] Figure 4 is a schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 4 As shown, the electronic device may include: a processor 410, a communications interface 420, a memory 430 and a communication bus 440, wherein the processor 410, the communications interface 420 and the memory 430 communicate with each other through the communication bus 440. The processor 410 may call the logic instructions in the memory 430 to execute a multimodal information generation method for a digital force intelligent construction platform, the method comprising: obtaining electronic information data and visible light data for the target area according to the configuration input of the target area;

[0152] Generate infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input;

[0153] According to data processing of the radar echo signal of the target area, radar data and SAR radar data of the target area are obtained;

[0154] The electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area are synthesized to obtain multimodal data of the target area.

[0155] In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0156] On the other hand, the present invention further provides a computer program product, the computer program product includes a computer program, the computer program can be stored on a non-transitory computer-readable storage medium, when the computer program is executed by a processor, the computer can execute the multimodal information generation method for the digital force intelligent construction platform provided by the above methods, the method includes: according to the configuration input of the target area, obtaining electronic information data and visible light data for the target area;

[0157] Generate infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input;

[0158] Obtaining radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area;

[0159] The electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area are synthesized to obtain multimodal data of the target area.

[0160] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to execute the multimodal information generation method for a digital force intelligent construction platform provided by the above methods, the method comprising: obtaining electronic information data and visible light data for a target area according to a configuration input of the target area;

[0161] Generate infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input;

[0162] Obtaining radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area;

[0163] The electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area are synthesized to obtain multimodal data of the target area.

[0164] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0165] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0166] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A multimodal information generation method for a digital force intelligent construction platform, characterized in that: include: According to the configuration input of the target area, electronic information data and visible light data of the target area are obtained; Generate infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input; According to data processing of the radar echo signal of the target area, radar data and SAR radar data of the target area are obtained; Synthesizing the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area; The method for acquiring the multimodal data of the target area specifically includes: Calculate the satellite position according to the satellite orbit elements, integrate the satellite and payload attitude information, obtain the target area, and obtain the payload base map data of the target area according to the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area; Querying target data in the target area, the target data including at least one of the following: target name, target location, target quantity, and target physical model data; According to the fusion of the load base map data and the target data, multimodal data of the target area is obtained; The electronic information data acquisition method specifically includes: Generate a target digital signal according to the FPGA data input in the configuration input; According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

2. The multimodal information generation method for the digital force intelligent construction platform according to claim 1 is characterized in that: The method for acquiring the visible light data includes: According to the color mode setting input in the configuration input, adjusting the color mode of the original image of the target area to obtain a first visible light image; According to the image parameter setting input in the configuration input, image parameters of the original image of the target area are adjusted to obtain a visible light image of the target area.

3. The multimodal information generation method for the digital force intelligent construction platform according to claim 1 is characterized in that: Generate infrared image data of the target area according to the heat balance model calculation, the heat conduction model calculation and the display mode input, including: Preprocess and analyze the infrared image of the target area to extract the temperature information of the target area; The pixel values ​​in the infrared image are converted into the temperature values ​​of the object surface, and the heat conduction model is established based on the object geometry information and the temperature data calculated from the infrared image; The established heat conduction model is numerically solved to calculate the temperature distribution inside the object in the target area for thermal balance analysis.

4. The multimodal information generation method for a digital force intelligent construction platform according to claim 1 is characterized in that: The radar data acquisition method comprises: Receiving a radar echo signal of the target area; Amplifying and filtering the received radar echo signal, and estimating radar parameter information of the target area by processing and analyzing the echo signal; The radar parameter information is visualized to obtain the radar data.

5. The multimodal information generation method for the digital force intelligent construction platform according to claim 1 is characterized in that: The method for acquiring SAR radar data comprises: Performing platform motion compensation on the received SAR radar echo signal to obtain a compensated SAR radar echo signal; The compensated SAR radar echo signal is processed by synthetic aperture processing algorithm to form a synthetic aperture image; The synthetic aperture image is reconstructed and filtered, and then image visualization processing is performed to obtain SAR radar data.

6. A multimodal information generation device for a digital force intelligent construction platform, characterized in that: include: A first generating module, for obtaining electronic information data and visible light data of the target area according to the configuration input of the target area; A second generating module, used for generating infrared image data of the target area according to heat balance model calculation, heat conduction model calculation and display mode input; A third generating module is used to obtain radar data and SAR radar data of the target area according to data processing of the radar echo signal of the target area; A synthesis module, used for synthesizing the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area to obtain multimodal data of the target area; The method for acquiring the multimodal data of the target area specifically includes: Calculate the satellite position according to the satellite orbit elements, integrate the satellite and payload attitude information, obtain the target area, and obtain the payload base map data of the target area according to the electronic information data, visible light data, infrared image data, radar data and SAR radar data of the target area; Querying target data in the target area, the target data including at least one of the following: target name, target location, target quantity, and target physical model data; According to the fusion of the load base map data and the target data, multimodal data of the target area is obtained; Wherein, the device is also used for: Generate a target digital signal according to the FPGA data input in the configuration input; According to the input of the signal processing function in the configuration input, the target digital signal is processed to obtain the electronic information data of the target area.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, it implements the multimodal information generation method for the digital force intelligent construction platform as described in any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, a multimodal information generation method for a digital force intelligent construction platform is implemented as described in any one of claims 1 to 5.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, a multimodal information generation method for a digital force intelligent construction platform is implemented as described in any one of claims 1 to 5.

Images