Airborne measurement system and method

Abstract

The invention discloses an airborne measurement system and method, and belongs to the technical field of airborne measurement. According to the airborne measurement system, the photoelectric measurement equipment is used for optical measurement, and the electromagnetic measurement equipment is used for electromagnetic measurement; the display control panel is used for collecting measurement data of the photoelectric measurement equipment and the electromagnetic measurement equipment and displaying the measurement data in real time, receiving parameter information of the photoelectric measurement equipment and the electromagnetic measurement equipment and displaying the parameter information in real time, the photoelectric measurement equipment and the electromagnetic measurement equipment are controlled, and the rocker is used for controlling the photoelectric measurement equipment and the electromagnetic measurement equipment. According to the invention, display and real-time control of a plurality of measuring devices can be realized, and the problem of photoelectric fusion measurement is solved; multiple measuring devices use one set of display and control device, the size and weight are small, the time error is stable, power supply and heat dissipation are facilitated, the device can be applied to complex scenes, the target finding probability is higher, and the device has good application prospects.

Description

Technical Field

[0001] The present invention relates to the technical field of airborne measurement, and in particular to an airborne measurement system and method. Background Art

[0002] Airborne measurement technology is a new type of measurement method proposed with the development of aerospace vehicles and low-altitude weapon systems. It uses airborne measurement equipment to track and measure targets.

[0003] In related technologies, airborne measurement systems are often based on optical payloads such as visible light and infrared, or electromagnetic measurement payloads are mounted separately. There are problems such as large size and weight of airborne display and control measurement equipment, unstable time error, lack of simultaneous display control of multiple devices, and low probability of detecting targets in complex scenarios. Summary of the invention

[0004] The present invention provides an airborne measurement system and method, which can solve the problems of large volume and weight of display and control measurement equipment in related technologies, unstable time error, lack of simultaneous display control of multiple devices, and low probability of finding targets in complex scenes. The technical solution is as follows:

[0005] In one aspect, an airborne measurement system is provided, the system comprising:

[0006] At least one optoelectronic measuring device for optical measurements;

[0007] Electromagnetic measuring equipment, used for electromagnetic measurements;

[0008] A display control panel, connected to the photoelectric measuring device and the electromagnetic measuring device through a bus, for collecting measurement data of the photoelectric measuring device and the electromagnetic measuring device and displaying them in real time, receiving parameter information of the photoelectric measuring device and the electromagnetic measuring device and displaying them in real time, and controlling the photoelectric measuring device and the electromagnetic measuring device;

[0009] A joystick, connected to the display control panel, the photoelectric measuring device and the electromagnetic measuring device through a bus, and used to control the photoelectric measuring device and the electromagnetic measuring device;

[0010] A target characteristic adapter box is used to connect the display control panel, the joystick, the photoelectric measuring device and the electromagnetic measuring device.

[0011] Optionally, the system includes two of the photoelectric measuring devices, and the photoelectric measuring devices are also used to search for distant targets. When any of the photoelectric measuring devices finds a distant target, it switches to tracking mode and sends angle information to the other photoelectric measuring device and the electromagnetic measuring device; the photoelectric measuring device is also used to perform target search and target tracking based on the target latitude and longitude information obtained by solving the external guidance information.

[0012] Optionally, the joystick includes a thumb joystick, a confirmation button, a cancel button, a plus button, a minus button and a switch button; wherein the thumb joystick, the confirmation button, the cancel button, the plus button, the minus button and the switch button are used to implement user operation command input.

[0013] Optionally, a bus interface is provided at the back of the display and control panel, and a power-on button, a power-off button, a video switching button, a tracking mode switching button, a working mode switching button, a focus button, a zoom button and a switch button are provided at the bottom of the display and control panel; wherein,

[0014] The power-on button, the power-off button, the video switching button, the tracking mode switching button, the working mode switching button, the focus button, the zoom button and the switch button are used to implement user operation command input.

[0015] Optionally, the display control panel has a display control module, a screenshot playback module, a video playback module and a system information module; wherein,

[0016] The display control module includes a display layout processing module, a brightness adjustment module, a target discovery reminder module, a screenshot module, a picture saving module, a screen recording module and a video saving module; the display layout processing module is used to receive and display in real time the measurement data, status information and virtual menu of the photoelectric measuring device and the electromagnetic measuring device; the brightness adjustment module is used to continuously adjust the screen brightness of the display control panel; the target discovery reminder module is used to provide a timely warning function for discovering a target or a fault; the screen recording module is used to record the screen image of the display control panel; the video saving module is used to store the measurement data and screen image of the photoelectric measuring device and the electromagnetic measuring device as a local video file; the screenshot module is used to capture the key frames of the display control panel as images; the image saving module is used to store the captured images;

[0017] The display and control module has an electromagnetic measurement working mode, an optical measurement working mode and a multi-measurement working mode; the display and control module is used to display the target track, radar beam and echo curve in the electromagnetic measurement working mode; the display and control module is used to display the measurement data and status information of the two photoelectric measurement devices on the left and right halves at the same time in the optical measurement working mode, and to display virtual buttons at the bottom. When the two photoelectric measurement devices detect a target, after the photoelectric measurement device identifies the target, each target is corresponded to a virtual button and the virtual button is changed from unselectable to selectable; the display and control module is used to display the measurement data and status information of the currently selected measurement device in the left half in the multi-measurement working mode, and to display the selection and notification interface in the right half, as well as the measurement data and status information of the other two measurement devices and a target discovery reminder;

[0018] The screenshot playback module is used to select the captured pictures for playback and provide a quick switching browsing option by frame;

[0019] The video playback module is used to select local video files for playback and provide playback process pause, fast forward, and fast rewind options;

[0020] The system information module includes a parameter setting module, a device self-test module, a timing module, an external boot setting module and a log module; the parameter setting module is used for screen sleep and wake-up settings, storage settings, and for setting the measurement data, status information and virtual keys of the photoelectric measuring device and the electromagnetic measuring device; the device self-test module is used to perform status self-test and display on each measuring device; the timing module is used to perform timing on the photoelectric measuring device and the electromagnetic measuring device; the external boot setting module is used to receive and send input external boot information; the log module is used to manage log records and log files.

[0021] On the other hand, an airborne measurement method is provided, which is applied to an airborne measurement system of the present invention, and the method comprises:

[0022] After the airborne measurement system is powered on, in response to the user's power-on operation on the display control panel, the photoelectric measurement device and the electromagnetic measurement device are powered on, the photoelectric measurement device performs a self-check to adjust the focus, brightness, and contrast, and enters the collection mode after parameter binding, the electromagnetic measurement device performs a self-check to set detailed parameters, working mode and working frequency band, and turns off the power amplifier to enter the measurement stop state;

[0023] During operation, in response to the user's operation instructions on the display control panel or the joystick, the photoelectric measuring device is controlled to enter the measurement mode, the electromagnetic measuring device turns on the power amplifier to start measurement, the measurement data of the photoelectric measuring device and the electromagnetic measuring device are received, and the measurement data is processed and displayed on the display control panel;

[0024] After the task is completed, in response to the user's stop operation on the display and control panel, the photoelectric measuring device is controlled to enter the collection mode, and the electromagnetic measuring device is controlled to turn off the power amplifier and enter the measurement stop state.

[0025] Optionally, after the airborne measurement system is powered on, the method further includes:

[0026] Perform video decoding initialization, bus decoding initialization and interface initialization on the airborne measurement system, obtain the self-test result of the airborne measurement system after successful initialization, issue a fault alarm when initialization is unsuccessful, and obtain the self-test result of the airborne measurement system after fault handling.

[0027] Optionally, the measurement data includes electromagnetic data and video data; and receiving the measurement data of the photoelectric measurement device and the electromagnetic measurement device, processing the measurement data and displaying it on the display control panel, comprises:

[0028] Receiving electromagnetic data measured by the electromagnetic measuring device, and displaying the electromagnetic data on the display control panel after performing graphical processing on the electromagnetic data;

[0029] The video data measured by the photoelectric measuring device is received, and a fault alarm is issued if the video stream is abnormal; if the video stream is normal, target detection and feature extraction are performed after image processing on the video data, and the data is displayed on the display control panel.

[0030] Optionally, the method further comprises:

[0031] In response to the user's long-distance target search operation on the display and control panel, the photoelectric measuring device is controlled by the display and control panel to perform a search. When any of the photoelectric measuring devices finds a target, it switches to a tracking mode, and sends the angle information of the long-distance target to the other photoelectric measuring device and the electromagnetic measuring device, and then enters a follow-up mode; in response to the external guidance information input by the user on the display and control panel, the external guidance information is solved to obtain the target longitude and latitude information, and the photoelectric measuring device and the electromagnetic measuring device are controlled to search and track according to the target longitude and latitude information.

[0032] Optionally, the method further comprises:

[0033] In response to the user's setting operation on the display control panel, adjusting the screen sleep and wake-up settings, storage settings, the measurement data and status information settings of the photoelectric measurement device and the electromagnetic measurement device, virtual key settings, and screen brightness of the display control panel;

[0034] In response to a recording operation of the user on the display and control panel, recording a screen image of the display and control panel;

[0035] In response to a saving operation of the user on the display control panel, storing the electromagnetic data and / or the video data displayed on the display control panel as a local video file;

[0036] In response to a capture operation of the user on the display control panel, capturing a key frame of the display control panel as a picture;

[0037] In response to a storage operation of the user on the display control panel, storing the captured picture;

[0038] When the optical measurement working mode is running, in response to the user's selection operation on the display control panel or the joystick, the photoelectric measurement device is controlled to select and track a target;

[0039] When the multi-measurement working mode is running, in response to the user's switching operation on the display control panel or the joystick, the measuring device displayed on the left half of the display control module is switched.

[0040] On the other hand, a computer device is provided, the computer device comprising a memory and a processor, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory to implement the steps of the above-mentioned airborne measurement method.

[0041] On the other hand, a computer-readable storage medium is provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned airborne measurement method are implemented.

[0042] On the other hand, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the steps of the above-mentioned airborne measurement method are implemented.

[0043] The technical solution provided by the present invention can at least bring the following beneficial effects:

[0044] It realizes the display and real-time control of multiple measuring devices, and solves the problem of optoelectronic fusion measurement; multiple measuring devices use a set of display and control equipment, which is small in size and weight, has stable time error, is conducive to power supply and heat dissipation, can be applied in complex scenarios and has a higher probability of detecting targets, and has good application prospects; the operating steps of each measuring device are simplified to improve human-machine efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 is a structural diagram of an airborne measurement system provided by an embodiment of the present invention;

[0047] Figure 2a It is a front structural diagram of a display and control panel of an airborne measurement system provided by an embodiment of the present invention;

[0048] Figure 2b It is a back structure diagram of a display and control panel of an airborne measurement system provided by an embodiment of the present invention;

[0049] Figure 3 is a structural diagram of a rocker of an airborne measurement system provided by an embodiment of the present invention;

[0050] Figure 4 This is a schematic diagram of a main interface of a display control panel for reference provided by an embodiment of the present invention;

[0051] Figure 5 It is a flowchart of a reference airborne measurement method provided by an embodiment of the present invention;

[0052] Figure 6 It is a schematic diagram of a procedure of an airborne measurement method for reference provided by an embodiment of the present invention;

[0053] Figure 7 It is a hardware architecture diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0055] As mentioned above, the embodiment of the present invention adopts a separate design of the display and control panel, the target characteristic adapter box and the joystick, optimizes the control operation level, and reasonably designs the joystick buttons and the display and control panel buttons. At the same time, it receives and displays the system clock, longitude, latitude, altitude, servo platform rotation angle and other parameter information of the airborne measuring equipment, and sends follow-up, ranging and other control instructions to control the airborne equipment, realizing the real-time display control function of multiple devices and solving the problem of optoelectronic fusion measurement and other problems.

[0056] Through the target characteristic adapter box, display and control panel, joystick and other devices, the interaction with the photoelectric measuring equipment and the electromagnetic measuring equipment is realized, and the measurement data and status information are received and displayed on the display and control panel. Through the virtual buttons of the display and control panel, the power on / off, measurement data switching, tracking mode switching, working mode switching, focusing, zooming and other functions of each measuring device can be controlled. At the same time, it supports equipment self-test, playback of video files and pictures, system information viewing, file export and other functions.

[0057] The specific implementation of the above concept is described below.

[0058] Please refer to Figure 1 An airborne measurement system according to an embodiment of the present invention includes: at least one photoelectric measurement device 101, an electromagnetic measurement device 103, a display control panel 105, a joystick 102 and a target characteristic adapter box 104.

[0059] The photoelectric measurement device 101 is used for optical measurement, including searching and tracking targets, etc. For example, the photoelectric measurement device can search and track targets according to the target latitude and longitude information obtained by solving the external guidance information. As a preferred embodiment, the airborne measurement system includes two photoelectric measurement devices 101. When the two photoelectric measurement devices 101 search for distant targets at the same time, when any photoelectric measurement device 101 finds a distant target, it switches to the tracking mode and sends the angle information to the other photoelectric measurement device 101 and the electromagnetic measurement device 103.

[0060] The electromagnetic measurement device 103 is used for electromagnetic measurement, such as measuring target tracks, radar beams, echo curves, etc.

[0061] Furthermore, the photoelectric measuring device 101 and the electromagnetic measuring device 103 may be refrigeration type devices.

[0062] The display control panel 105 is connected to the photoelectric measuring device 101 and the electromagnetic measuring device 103 through a bus (not marked in the figure), and is mainly used to collect the measurement data of the photoelectric measuring device 101 and the electromagnetic measuring device 103 and display them in real time, receive the parameter information of the photoelectric measuring device 101 and the electromagnetic measuring device 103 and display them in real time, and control the photoelectric measuring device 101 and the electromagnetic measuring device 103. Figure 2a and Figure 2b As shown, the back of the display control panel 105 is provided with a bus interface 201, and the lower part of the display control panel 105 is provided with physical buttons such as a power-on button 202, a power-off button 203, a video switching button 204, a tracking mode switching button 205, a working mode switching button 206, a focus button 207, a zoom button 208 and a switch button 209, etc. These physical buttons are used to implement the user's operation command input, thereby controlling the photoelectric measurement device 101 and the electromagnetic measurement device 103. As a preferred embodiment, the bus is a control bus, which transmits the signal of the microprocessor control unit to the peripheral device, and the common ones are USB Bus and 1394Bus.

[0063] like Figure 4 As shown, the display control panel 105 in the embodiment of the present invention is provided with a display control module 401, a screenshot playback module 402, a video playback module 403 and a system information module 404. In addition, the display control module 401 has the following three working modes: electromagnetic measurement working mode, optical measurement working mode and multi-measurement working mode.

[0064] Specifically, the input of the display and control module 401 mainly includes the measurement data of each measuring device and the user operation information, and the output mainly includes the interface display of the display and control panel, and the video files, images and log files saved locally. The display and control module 401 includes a display layout processing module, a brightness adjustment module, a target discovery reminder module, a screenshot module, a picture saving module, a screen recording module and a video saving module. Among them, the display layout processing module is used to receive and display the measurement data, status information and virtual menu of the photoelectric measurement device 101 and the electromagnetic measurement device 103 in real time; the brightness adjustment module is used to continuously adjust the screen brightness of the display and control panel 105; the target discovery reminder module is used to issue a target discovery reminder or a fault warning; the screen recording module is used to record the screen of the display and control panel; the video saving module is used to store the measurement data and screen of the photoelectric measurement device 101 and the electromagnetic measurement device 103 as a video file; the screenshot module is used to intercept the key frames of the display and control panel as pictures; and the picture saving module is used to store the intercepted pictures.

[0065] The display and control module 401 can display the target track, radar beam, and measurement echo curve in the electromagnetic measurement working mode; the display and control module 401 can simultaneously display the measurement data and status information of the two photoelectric measurement devices 101 on the left and right halves in the optical measurement working mode, and display the virtual keys corresponding to the physical keys at the bottom. When the two photoelectric measurement devices 101 detect the target, the display and control module 401 displays the virtual keys, which are initially unselectable. When the photoelectric measurement device 101 recognizes the target, the virtual keys corresponding to the target are changed from unselectable to selectable. At this time, the target represented by the corresponding virtual key can be selected through the physical key, so that the virtual key can be used to achieve target selection and tracking. It should be noted here that the target represented by the corresponding virtual key can also be selected through the joystick, especially when the number of targets exceeds the number of physical keys, the joystick can still be used for selection; in the multi-measurement working mode, the display and control module 401 can display the measurement data and status information of the currently selected measurement device on the left half, and display the selection and notification interface on the right half, as well as the measurement data and status information of the other two measurement devices and the target discovery reminder.

[0066] The screenshot playback module 402 is used to select the captured pictures for playback and provide a quick switching browsing option by frame.

[0067] The video playback module 403 is used to select a video file for playback and provide playback process pause, fast forward, and fast rewind options.

[0068] In addition, the input of the system information module 404 mainly includes the status information of each measuring device, user operation information, etc., and the output mainly includes the interface display of the display control panel, the log file saved to the local, etc. The system information module 404 includes a parameter setting module, a device self-test module, a timing module, an external boot setting module and a log module. Among them, the parameter setting module is used for screen sleep wake-up settings, storage settings, and for setting the measurement data, status information and virtual buttons of the photoelectric measuring device 101 and the electromagnetic measuring device 103; the device self-test module is used to perform status self-test and display on each measuring device; the timing module is used to perform timing on the photoelectric measuring device 101 and the electromagnetic measuring device 103; the external boot setting module is used to receive and send input external boot information; the log module is used to manage log records and log files.

[0069] The joystick 102 is connected to the display control panel 105 , the photoelectric measuring device 101 and the electromagnetic measuring device 103 through a bus, and is used to control the photoelectric measuring device 101 and the electromagnetic measuring device 103 .

[0070] like Figure 3As shown, the joystick 102 includes a thumb joystick 301, a confirmation button 302, a cancel button 303, a plus button 304, a minus button 305, and a switch button 306. The thumb joystick 301, the confirmation button 302, the cancel button 303, the plus button 304, and the minus button 305 are arranged on the front of the joystick 102, and the switch button 306 is arranged on the back of the joystick 102. The thumb joystick 301 can be freely shaken in the plane where it is located, and is used to adjust the selected item of the display control panel 105; the confirmation button 302, the cancel button 303, the plus button 304, and the minus button 305 surround the lower half of the thumb joystick 301. The thumb joystick 301, the confirmation button 302, the cancel button 303, the plus button 304, the minus button 305 and the switch button 306 are used to implement the user's operation command input. For example, the switch button 306 is used to switch the information displayed on the display control panel 105 in the electromagnetic mode, the plus button 304 and the minus button 305 are used to adjust the measurement distance of the electromagnetic measurement device 103, and the confirmation button 302 and the cancel button 303 are used to select the measurement target of the electromagnetic measurement device 103.

[0071] The target characteristic adapter box 104 is connected to the display control panel 105 , the joystick 102 , the photoelectric measuring device 101 and the electromagnetic measuring device 103 .

[0072] The target characteristic adapter box 104 is a special aerospace test equipment, which is a medium for testing and monitoring the normal signal transmission during the signal conversion process. It can convert a common signal point into another special signal point output, and realize online real-time testing and verification of various signal transmission of aerospace products. The target characteristic adapter box can complete the interface inspection between the large-scale test system (comprehensive supporting equipment) and the aerospace model product through its matching cable, detect all the signals of the aerospace model product, and track the online signal transmission during the test. It is used in large-scale field tests, ground tests, and model flight tests.

[0073] An embodiment of the present invention provides an airborne measurement method, the method comprising:

[0074] After the onboard measurement system is powered on, in response to the user's power-on operation on the display and control panel, the photoelectric measurement equipment and the electromagnetic measurement equipment are powered on, the photoelectric measurement equipment performs a self-check to adjust the focus, brightness, and contrast, and enters the collection mode after parameter binding, the electromagnetic measurement equipment performs a self-check to set detailed parameters, working mode and working frequency band, and turns off the power amplifier to enter the measurement stop state.

[0075] After the airborne measurement system is powered on, it enters the main interface, and the working mode can be selected according to the use requirements. As a preferred embodiment, after the airborne measurement system is powered on, the airborne measurement system is initialized for video decoding, bus decoding and interface initialization, and the self-test result of the airborne measurement system is obtained after the initialization is successful. When the initialization is unsuccessful, a fault alarm is issued, and the self-test result of the airborne measurement system is obtained after the fault is handled. Video decoding initialization is to set the parameters required for video decoding to initial values, such as brightness, contrast and color settings. Bus decoding initialization includes turning on the clock, setting the GPIO mode, setting the parameters to initial values, and enabling bus functions. Interface initialization is to initialize the physical interface and logical data transmission protocol between the joystick, display control panel, optoelectronic measurement equipment and electromagnetic measurement equipment, so that the bus interface of these devices can work normally. It should be noted that whether the initialization is successful can be judged by existing technical solutions or tools, which will not be repeated here.

[0076] During operation, in response to the user's operating instructions on the display control panel or the joystick, the photoelectric measuring device is controlled to enter the measurement mode, the electromagnetic measuring device turns on the power amplifier to start measurement, and the measurement data of the photoelectric measuring device and the electromagnetic measuring device are received, and the measurement data is processed and displayed on the display control panel. It should be noted that how the photoelectric measuring device and the electromagnetic measuring device implement measurement can refer to the existing technical solutions, which will not be repeated here.

[0077] The measurement data mainly includes electromagnetic data and video data. For the electromagnetic data measured by the electromagnetic measurement equipment, it can be displayed to the user after being processed graphically. For the video data measured by the photoelectric measurement equipment, if the reception is normal (that is, the video stream is normal), target detection and feature extraction are performed after image processing, otherwise a fault alarm needs to be issued. In an embodiment of the present invention, the measurement data of the photoelectric measurement equipment and the electromagnetic measurement equipment are received, and the measurement data are processed and displayed on the display control panel. The steps can be implemented in the following ways: receiving the electromagnetic data measured by the electromagnetic measurement equipment, and displaying the electromagnetic data on the display control panel after graphical processing; receiving the video data measured by the photoelectric measurement equipment, and issuing a fault alarm if the video stream is abnormal, and performing image processing on the video data if the video stream is normal, and performing target detection and feature extraction, and displaying it on the display control panel. It should be noted that graphical processing, image processing, and target detection and feature extraction in video data can be implemented using existing technical solutions or tools, which are not limited in the embodiments of the present invention.

[0078] As a preferred implementation, user instructions are received through the display and control panel. Specifically, in response to the user's long-distance target search operation on the display and control panel, the display and control panel controls the photoelectric measurement device to search, and when any photoelectric measurement device finds the target, it switches to the tracking mode, and sends the angle information of the long-distance target to another photoelectric measurement device and the electromagnetic measurement device, and then enters the follow-up mode; in response to the external guidance information input by the user on the display and control panel, the external guidance information is solved to obtain the target latitude and longitude information, and the photoelectric measurement device and the electromagnetic measurement device are controlled to search and track according to the target latitude and longitude information.

[0079] As a preferred implementation, in order to adapt to the user's operating habits and improve the user experience, the user can set the airborne measurement system through the display and control panel. Specifically, in response to the user's setting operation on the display and control panel, the screen sleep and wake-up settings, storage settings, measurement data and status information settings of the photoelectric measurement equipment and electromagnetic measurement equipment, virtual button settings, and screen brightness of the display and control panel are adjusted; in response to the user's recording operation on the display and control panel, the screen image of the display and control panel is recorded; in response to the user's saving operation on the display and control panel, the electromagnetic data and / or video data displayed by the display and control panel are stored as local video files; in response to the user's interception operation on the display and control panel, the key frames of the display and control panel are intercepted as pictures; in response to the user's storage operation on the display and control panel, the intercepted pictures are stored.

[0080] As a preferred embodiment, user instructions can also be received through the joystick, that is, the physical buttons of the display control panel and the joystick are reused, thereby simplifying the operation steps and improving the human-machine efficiency. Specifically, when the optical measurement working mode is running, in response to the user's selection operation on the display control panel or the joystick, the photoelectric measurement device is controlled to select and track the target; when the multi-measurement working mode is running, in response to the user's switching operation on the display control panel or the joystick, the measurement device displayed on the left half of the display control module 401 is switched.

[0081] After the task is completed, in response to the user's stop operation on the display and control panel, the photoelectric measuring device is controlled to enter the collection mode, and the electromagnetic measuring device is controlled to turn off the power amplifier and enter the measurement stop state.

[0082] The following describes the module design of the display control panel, such as Figure 4 As shown, it is a schematic diagram of the main interface of a display control panel for reference. The display control panel is provided with a display control module 401 , a screenshot playback module 402 , a video playback module 403 and a system information module 404 .

[0083] The display control module 401 mainly includes a display layout processing module, a brightness adjustment module, a target detection reminder module, a screenshot module, a picture saving module, a screen recording module and a video saving module. It is mainly responsible for receiving the status information of the photoelectric measuring device and the electromagnetic measuring device and displaying it in real time, and timely warning when a target is found or a fault occurs; realizing the display of screen sleep, wake-up settings, storage settings and software version information, device information, etc.; adapting to the display requirements of each measuring device, optimizing the display mode, and adaptively displaying the measurement data, status information and virtual menu of the photoelectric measuring device and the electromagnetic measuring device; continuously adjusting the screen brightness of the display control panel; storing the measurement data and screen recording information of the photoelectric measuring device and the electromagnetic measuring device; capturing the key frames of the display control panel as pictures and storing them; managing log records and log files, etc.

[0084] The screenshot playback module 402 is mainly responsible for completing the selection of local pictures for playback and the quick switching browsing function by picture.

[0085] The video playback module 403 is mainly responsible for completing the selection of local video files for playback, pausing, fast forwarding, and rewinding the playback process.

[0086] The system information module 404 mainly includes a parameter setting module, a device self-check module, a timing module, an external boot setting module and a log module. The above modules are mainly used to complete system operation status monitoring, software version information display, automatic display screen shutdown management, status self-check and display of each measuring device, timing of photoelectric measuring equipment and electromagnetic measuring equipment, receiving and sending input external boot information, managing log records and log files, etc.

[0087] The following describes the interface layout design of the display and control panel, which is a schematic diagram of the main interface design of the display and control panel of the airborne measurement system that can be used as a reference. The display and control module of the display and control panel has the following three working modes: electromagnetic measurement working mode, optical measurement working mode and multi-measurement working mode. After power-on, enter the main interface and select the working mode according to the use requirements. In this specific embodiment, the two photoelectric measurement devices are named photoelectric measurement device A and photoelectric measurement device B respectively.

[0088] In the electromagnetic measurement working mode, the display and control module displays electromagnetic data such as the target track, radar beam, echo curve, etc. measured by the electromagnetic measurement equipment. In this mode, the switch button of the joystick can switch the information displayed on the display and control panel, the plus button and minus button can adjust the measurement distance of the electromagnetic measurement equipment, and the confirmation button and cancel button can select the measurement target of the electromagnetic measurement equipment.

[0089] The optical measurement working mode interface is designed into three parts (i.e., the left and right halves and the bottom). The left and right halves display the video data and status information measured by the photoelectric measuring device A and the photoelectric measuring device B respectively. The left half is the display interface of the photoelectric measuring device A, and the right half is the display interface of the photoelectric measuring device B. Both sides display the video data and status information at the same time. The bottom is a control command menu composed of virtual buttons, and the virtual buttons correspond one-to-one to the physical buttons of the display and control panel, thereby realizing the control function of the photoelectric measuring device A and the photoelectric measuring device B. It should be noted that when the photoelectric measuring device A and the photoelectric measuring device B detect targets, the video interface displays a virtual button menu for target selection and tracking. When there is no target, the virtual button can be set to gray display and cannot be selected. After the target is identified, the corresponding number of virtual buttons can be turned black and can be selected according to the number of targets, while the others remain gray and cannot be selected, and the targets are displayed with serial numbers 1, 2, 3... If the number of targets is equal to or greater than 7, 7 targets will be displayed each time, and the virtual buttons will become black and can be operated, and will be displayed with serial numbers 1 to 7. Other targets will be matched with virtual buttons and numbered after switching. Click a virtual button or a corresponding physical button (except the switch button) to select a corresponding target, and the photoelectric measuring device A and the photoelectric measuring device B will track the target.

[0090] The multi-measurement working mode interface is designed as two parts (i.e., the left and right halves), which respectively display the measurement data and status information of photoelectric measuring device A, photoelectric measuring device B and electromagnetic measuring device. The left half is the main display interface, which is used to display the measurement data and status information of the currently selected measuring device. The right half is the selection and notification interface, which is used to display the measurement data and status information of the other two measuring devices and to display the target discovery reminder. In this mode, the measuring device displayed on the main display interface can be selected and switched.

[0091] As a reference implementation method, the airborne measurement system is designed to use a process based on the application scenario, which consists of two parts: the preparation phase and the use phase. In this specific embodiment, the two photoelectric measurement devices are named photoelectric measurement device A and photoelectric measurement device B. Figure 5 As shown, an airborne measurement system according to an embodiment of the present invention can be used with reference to the following process:

[0092] Step 501, power on;

[0093] The preparation stage is carried out on the ground. After the equipment is powered on, the display and control panel is turned on, and the photoelectric measuring device A, the photoelectric measuring device B and the electromagnetic measuring device are powered on.

[0094] Step 502, measuring equipment cooling;

[0095] The photoelectric measuring device A, the photoelectric measuring device B and the electromagnetic measuring device are refrigeration type devices, and the measuring devices are cooled before starting the measurement.

[0096] Step 503: System initialization;

[0097] After the airborne measurement system is powered on, video decoding initialization, bus decoding initialization and interface initialization are performed on the airborne measurement system.

[0098] Step 504: Obtain self-test results;

[0099] After successful initialization, a self-test result of the airborne measurement system is obtained, a fault alarm is issued when the initialization is unsuccessful, and a self-test result of the airborne measurement system is obtained after the fault is handled.

[0100] Step 505, binding parameters;

[0101] After the self-check of the photoelectric measuring device A and the photoelectric measuring device B is completed, the focus, brightness, contrast, and parameters are adjusted, and the preparation is completed to enter the collection mode. After the electromagnetic measuring device completes the system self-check, the detailed parameters, working mode, working frequency band, etc. are set, and the power amplifier is turned off and the measurement is stopped.

[0102] The above is the process of the preparation stage, and the next is the process of the use stage.

[0103] Step 506: image processing;

[0104] After completing the above preparations, the photoelectric measuring device A and the photoelectric measuring device B enter the measuring mode, and the electromagnetic measuring device turns on the power amplifier to start measuring. In addition, when encountering a long-distance target, the photoelectric measuring device A and the photoelectric measuring device B search manually or automatically. When any measuring device finds the target, it switches to the tracking mode and sends the angle information to the other measuring device before entering the follow-up mode. In order to obtain target information through external channels, the display and control panel can receive the external guidance information input by the user, and automatically search and track after solving the external guidance information to obtain the target latitude and longitude information.

[0105] The electromagnetic data measured by the electromagnetic measuring equipment can be displayed after graphical processing, while the video data measured by the photoelectric measuring equipment needs to be image processed before display.

[0106] Step 507: feature extraction;

[0107] Feature extraction is performed on the video data processed in step 506, so as to identify the target in the video data.

[0108] Step 508: confirm the target;

[0109] After the target is identified, the corresponding number of virtual buttons will be displayed in black and can be selected according to the number of targets, and the others will remain gray and cannot be selected, and the targets will be superimposed with serial numbers 1, 2, 3, etc. If the number of targets is equal to or greater than 7, all virtual buttons will be displayed in black and can be operated, and the identified targets will be superimposed with serial numbers 1 to 7. At this time, the user can select a corresponding target by clicking a virtual button or a corresponding physical button (except the switch button), and the photoelectric measurement device A and the photoelectric measurement device B will track the target.

[0110] Please refer to Figure 6 As a reference implementation method, in this specific embodiment, the two photoelectric measurement devices are named photoelectric measurement device A and photoelectric measurement device B respectively. An airborne measurement method of the embodiment of the present invention may include the following process:

[0111] Step 601, start;

[0112] After the airborne measurement system is powered on, the optoelectronic measurement device A, the optoelectronic measurement device B and the electromagnetic measurement device are powered on.

[0113] Step 602: Video decoding is initialized;

[0114] Step 603, bus decoding initialization;

[0115] Step 604: Interface initialization;

[0116] Execute steps 602 to 604 simultaneously. If the initialization is successful, execute step 607. If the initialization is unsuccessful, execute step 605.

[0117] Step 605: Fault alarm;

[0118] Step 606: Fault handling;

[0119] Step 607, self-check;

[0120] After the self-test is completed, the onboard measurement system can start measuring work;

[0121] Step 608, operation instruction;

[0122] Allow users to input operation instructions through the display control panel or joystick;

[0123] Step 609: interactive response;

[0124] In response to the user's operating instructions on the display control panel or the joystick, the photoelectric measuring device is controlled to enter the measurement mode and the electromagnetic measuring device turns on the power amplifier to start measurement;

[0125] Step 610, device status information;

[0126] Regardless of whether the photoelectric measuring device and the electromagnetic measuring device start measuring, the status information of the photoelectric measuring device and the electromagnetic measuring device is obtained;

[0127] Step 611, receiving electromagnetic data from an electromagnetic measurement device;

[0128] Step 612: Graphic processing;

[0129] After the electromagnetic data is processed graphically, it can be displayed on the display control panel;

[0130] Step 613, receiving video data from the photoelectric measuring device A;

[0131] If the video stream is normal, continue to step 614, otherwise a fault alarm is issued;

[0132] Step 614: image processing;

[0133] Step 615: target detection;

[0134] Step 616: feature extraction;

[0135] Step 617, receiving video data from the photoelectric measuring device B;

[0136] If the video stream is normal, continue to step 618, otherwise a fault alarm is issued;

[0137] Step 618: image processing;

[0138] Step 619: target detection;

[0139] Step 620: feature extraction;

[0140] Step 621, status information;

[0141] Step 622: data analysis;

[0142] The status information can be used to analyze the operating status, functional status, abnormality, software version information, device information, etc. of the photoelectric measuring equipment and electromagnetic measuring equipment;

[0143] Step 623: display;

[0144] The display and control module of the display and control panel can display corresponding information according to the working mode;

[0145] Step 624: store;

[0146] The electromagnetic data and / or video data displayed by the display and control module of the display and control panel are stored as local video files; the screen image of the display and control panel can also be recorded and stored; the key frames of the display and control panel can also be captured as pictures and stored;

[0147] Step 625, check;

[0148] The data stored in step 624 can be viewed through the screenshot playback module and the video playback module of the display control panel;

[0149] Step 626, export;

[0150] The data stored in step 624 may be further exported.

[0151] It should be noted that the implementation of the above steps 601 to 626 can refer to the previous embodiment and will not be repeated here.

[0152] It should be noted that: the airborne measurement system provided in the above embodiment is only illustrated by the division of the above functional modules. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the airborne measurement system provided in the above embodiment and the airborne measurement method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0153] The embodiment of the present application also provides a computer device, please refer to Figure 7 The computer device includes a processor and a memory, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, at least one program, a code set or an instruction set is loaded and executed by the processor to implement an airborne measurement method provided by the above-mentioned method embodiments.

[0154] An embodiment of the present application also provides a computer-readable storage medium, on which is stored at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement an airborne measurement method provided by the above-mentioned method embodiments.

[0155] An embodiment of the present application further provides a computer program product, which includes a computer program. A processor of a computer device reads the computer program from a computer-readable storage medium, and the processor executes the computer program, so that the computer device executes an airborne measurement method described in any one of the above embodiments.

[0156] For the convenience of description, the above system or device is described by dividing it into various modules or units according to its functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0157] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0158] Finally, it should be noted that, in this article, relational terms such as first, second, third and fourth are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0159] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. An airborne measurement system, characterized in that: The system comprises: at least one optoelectronic measuring device (101) for optical measurement; Electromagnetic measurement equipment (103), used for electromagnetic measurement; A display control panel (105) is connected to the photoelectric measuring device (101) and the electromagnetic measuring device (103) via a bus, and is used to collect measurement data of the photoelectric measuring device (101) and the electromagnetic measuring device (103) and display it in real time, receive parameter information of the photoelectric measuring device (101) and the electromagnetic measuring device (103) and display it in real time, and control the photoelectric measuring device (101) and the electromagnetic measuring device (103); A joystick (102) connected to the display control panel (105), the photoelectric measuring device (101) and the electromagnetic measuring device (103) via a bus, and used for controlling the photoelectric measuring device (101) and the electromagnetic measuring device (103); The target characteristic adapter box (104) is connected to the display control panel (105), the joystick (102), the photoelectric measurement device (101) and the electromagnetic measurement device (103).

2. The system according to claim 1, characterized in that The system comprises two photoelectric measuring devices (101), wherein the photoelectric measuring devices (101) are further used to search for a long-distance target. When any of the photoelectric measuring devices (101) finds a long-distance target, it switches to a tracking mode and sends angle information to the other photoelectric measuring device (101) and the electromagnetic measuring device (103); the photoelectric measuring device (101) is further used to search for and track the target based on target latitude and longitude information obtained by solving external guidance information; The joystick (102) comprises a thumb joystick (301), a confirmation button (302), a cancel button (303), a plus button (304), a minus button (305) and a switch button (306); wherein the thumb joystick (301), the confirmation button (302), the cancel button (303), the plus button (304), the minus button (305) and the switch button (306) are used to implement user operation instruction input.

3. The system according to claim 2, characterized in that The back of the display and control panel (105) is provided with a bus interface (201); the lower part of the display and control panel (105) is provided with a power-on button (202), a power-off button (203), a video switching button (204), a tracking mode switching button (205), a working mode switching button (206), a focus button (207), a zoom button (208) and a switch button (209); the display and control panel (105) has a display and control module (401), a screenshot playback module (402), a video playback module (403) and a system information module (404); wherein, The power-on button (202), the power-off button (203), the video switching button (204), the tracking mode switching button (205), the working mode switching button (206), the focus button (207), the zoom button (208) and the switch button (209) are used to implement user operation command input; The display control module (401) comprises a display layout processing module, a brightness adjustment module, a target discovery reminder module, a screenshot module, a picture saving module, a screen recording module and a video saving module; the display layout processing module is used to receive and display in real time the measurement data, status information and virtual menu of the photoelectric measurement device (101) and the electromagnetic measurement device (103); the brightness adjustment module is used to continuously adjust the screen brightness of the display control panel (105); the target discovery reminder module is used to provide a timely warning function when a target is discovered or a fault occurs; the screen recording module is used to record the screen image of the display control panel (105); the video saving module is used to store the measurement data and screen image of the photoelectric measurement device (101) and the electromagnetic measurement device (103) as a local video file; the screenshot module is used to capture the key frame of the display control panel (105) as a picture; and the picture saving module is used to store the captured picture; The display and control module (401) has an electromagnetic measurement working mode, an optical measurement working mode and a multi-measurement working mode; the display and control module (401) is used to display the target track, radar beam and echo curve in the electromagnetic measurement working mode; the display and control module (401) is used to simultaneously display the measurement data and status information of the two photoelectric measurement devices (101) in the left and right halves in the optical measurement working mode, and to display virtual buttons at the bottom; when the two photoelectric measurement devices (101) detect a target, after the photoelectric measurement device (101) identifies the target, each target is associated with a virtual button and the virtual button is changed from unselectable to selectable; in the multi-measurement working mode, the display and control module (401) is used to display the measurement data and status information of the currently selected measurement device in the left half, and to display the selection and notification interface in the right half, as well as the measurement data and status information of the other two measurement devices and a target discovery reminder; The screenshot playback module (402) is used to select the captured pictures for playback and provide a quick switching browsing option by frame; The video playback module (403) is used to select a local video file for playback and provide playback process pause, fast forward, and fast rewind options; The system information module (404) comprises a parameter setting module, a device self-check module, a timing module, an external guidance setting module and a log module; the parameter setting module is used for screen sleep and wake-up settings, storage settings, and for setting measurement data, status information and virtual keys of the photoelectric measurement device (101) and the electromagnetic measurement device (103); the device self-check module is used for self-checking and displaying the status of each measurement device; the timing module is used for timing the photoelectric measurement device (101) and the electromagnetic measurement device (103); the external guidance setting module is used for receiving and sending input external guidance information; and the log module is used for managing log records and log files.

4. An airborne measurement method, applied to the system according to any one of claims 1 to 3, characterized in that: The method comprises: After the airborne measurement system is powered on, in response to the user's power-on operation on the display control panel, the photoelectric measurement device and the electromagnetic measurement device are powered on, the photoelectric measurement device performs a self-check to adjust the focus, brightness, and contrast, and enters the collection mode after parameter binding, the electromagnetic measurement device performs a self-check to set detailed parameters, working mode and working frequency band, and turns off the power amplifier to enter the measurement stop state; During operation, in response to the user's operation instructions on the display control panel or the joystick, the photoelectric measuring device is controlled to enter the measurement mode, the electromagnetic measuring device turns on the power amplifier to start measurement, the measurement data of the photoelectric measuring device and the electromagnetic measuring device are received, and the measurement data is processed and displayed on the display control panel; After the task is completed, in response to the user's stop operation on the display and control panel, the photoelectric measuring device is controlled to enter the collection mode, and the electromagnetic measuring device is controlled to turn off the power amplifier and enter the measurement stop state.

5. The method according to claim 4, characterized in that After the onboard measurement system is powered on, the method further includes: Perform video decoding initialization, bus decoding initialization and interface initialization on the airborne measurement system, obtain the self-test result of the airborne measurement system after successful initialization, issue a fault alarm if initialization is unsuccessful, and obtain the self-test result of the airborne measurement system after fault handling; The measurement data includes electromagnetic data and video data; and receiving the measurement data of the photoelectric measurement device and the electromagnetic measurement device, processing the measurement data and displaying it on the display control panel, including: Receiving electromagnetic data measured by the electromagnetic measuring device, and displaying the electromagnetic data on the display control panel after performing graphical processing on the electromagnetic data; The video data measured by the photoelectric measuring device is received, and a fault alarm is issued if the video stream is abnormal; if the video stream is normal, target detection and feature extraction are performed after image processing on the video data, and the data is displayed on the display control panel.

6. The method according to claim 4, characterized in that The method further comprises: In response to the user's long-distance target search operation on the display and control panel, the photoelectric measuring device is controlled by the display and control panel to perform a search. When any of the photoelectric measuring devices finds a target, it switches to a tracking mode, and sends the angle information of the long-distance target to the other photoelectric measuring device and the electromagnetic measuring device, and then enters a follow-up mode; in response to the external guidance information input by the user on the display and control panel, the external guidance information is solved to obtain the target longitude and latitude information, and the photoelectric measuring device and the electromagnetic measuring device are controlled to search and track according to the target longitude and latitude information.

7. The method according to claim 5, characterized in that The method further comprises: In response to the user's setting operation on the display control panel, adjusting the screen sleep and wake-up settings, storage settings, the measurement data and status information settings of the photoelectric measurement device and the electromagnetic measurement device, virtual key settings, and screen brightness of the display control panel; In response to a recording operation of the user on the display and control panel, recording a screen image of the display and control panel; In response to a saving operation of the user on the display control panel, storing the electromagnetic data and / or the video data displayed on the display control panel as a local video file; In response to a capture operation of the user on the display control panel, capturing a key frame of the display control panel as a picture; In response to a storage operation of the user on the display control panel, storing the captured picture; When the optical measurement working mode is running, in response to the user's selection operation on the display control panel or the joystick, the photoelectric measurement device is controlled to select and track a target; When the multi-measurement working mode is running, in response to the user's switching operation on the display control panel or the joystick, the measuring device displayed on the left half of the display control module is switched.

8. A computer device, characterized in that: The computer device includes a memory and a processor, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory to implement the steps of any of the methods described in claims 4-7.

9. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described in any one of claims 4 to 7 are implemented.

10. A computer program product, characterized in that The method comprises a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 4 to 7.

Images