An image processing online debugging system

Abstract

The invention discloses an image processing online debugging system, which can realize online visual display of monitoring content, facilitate rapid positioning of problems arising in the image processing debugging process, and shorten the project development cycle.

Description

Technical Field

[0001] The invention relates to the field of optical technology, in particular to an image processing online debugging system. Background Art

[0002] Infrared thermal imaging technology uses photoelectric technology to passively receive infrared radiation from various parts of the scene itself for detection. With the help of infrared thermal imaging technology, humans can break through visual barriers and detect objects in a completely dark environment. Detection can be achieved even in the presence of smoke and dust, and no light source is required, so it can be used all day long.

[0003] Due to the advantages of infrared thermal imaging such as good concealment, strong anti-interference and strong target recognition ability, it plays an increasingly important role in related fields. Target detection, tracking and recognition systems based on thermal imaging technology have been widely used. With the continuous development of technology and the continuous increase in user needs, the complexity of infrared image processing systems continues to increase, which brings huge challenges to the research and development of related infrared image processing systems, which must not only meet the user's functional performance index requirements, but also take into account the project's research and development cycle.

[0004] Existing infrared image processing systems generally adopt FPGA+DSP architecture. In the development process of such systems, the cross-compiled bitstream files / executable files are generally loaded into FPGA / DSP by connecting to the downloader / emulator, and the relevant programs are debugged with the help of the development environment. Early FPGAs were limited by logic resources and often only implemented data communication functions. With the continuous development of FPGA technology, its logic resources have become quite rich, and it is equipped with various DSP resources, storage resources, etc. Therefore, some processing algorithms suitable for parallel computing have gradually been transferred to FPGA for implementation. For image processing systems, FPGAs do not have effective debugging and observation methods. Key signals need to be added to the logic analyzer provided by the development environment for monitoring, but there is a lack of data visualization debugging methods, which makes debugging very inconvenient and unintuitive. Summary of the invention

[0005] The invention provides an image processing online debugging system, which solves the problem that the existing image processing online debugging system is inconvenient to debug.

[0006] The present invention provides an image processing online debugging system, which comprises: a debugging image processor, an information conversion memory, a monitor and a human-computer interaction device;

[0007] The debugging image processor is used to process the image data to be processed, pre-process the processing results of the image data to be monitored in the image processing process according to the control instructions sent by the human-computer interaction device, and send the pre-processed processing results and status information to the information conversion memory;

[0008] The information conversion memory is used to parse and store the processing results and status information sent by the debugging image processor according to the processing instructions sent by the human-computer interaction device;

[0009] The monitor receives the processing result and status information of the image data to be monitored after being analyzed by the information conversion memory, and displays the same;

[0010] The human-computer interaction device is used to control the debugging image processor, the information conversion memory and the monitor according to the processing results and status information of the image data to be displayed and monitored during the debugging process.

[0011] Preferably, the information conversion memory is further provided with a field programmable gate array FPGA and an ARM processor;

[0012] The ARM processor is used to parse and superimpose the image data and status information sent by the debugging image processor;

[0013] The FPGA is used for interface communication, data preprocessing and information interaction among the debugging image processor, the information conversion memory and the human-computer interaction device.

[0014] Preferably, the FPGA is also used to send the control instruction sent by the human-computer interaction device to the debugging image processor.

[0015] Preferably, the FPGA is also used to send the parsed processing results and status information of the image data to be monitored to the monitor for display, and to process image data other than the image data to be monitored.

[0016] Preferably, the information conversion memory also includes a memory;

[0017] The memory is used to store the image data parsed by the ARM processor and / or the image data processed by the FPGA.

[0018] Preferably, the human-computer interaction device is further used to generate the preset key information based on a user instruction, and send the preset key information to the memory of the information conversion memory through the monitor;

[0019] The memory is also used to store the preset key information.

[0020] Preferably, the information conversion memory is also used to determine the image data to be monitored according to the preset key information.

[0021] The beneficial effects of the present invention are as follows:

[0022] The present invention can realize online visual display of monitoring content, facilitate rapid positioning of problems arising during image processing and debugging, and shorten the project development cycle. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a structural diagram of an image processing online debugging system according to an embodiment of the present invention;

[0024] Figure 2 It is a schematic diagram of the information collection and transmission information form of an embodiment of the present invention;

[0025] Figure 3 It is a schematic diagram of the content parsed by the monitor according to the embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to solve the problem of inconvenient debugging of the existing image processing online debugging system, the present invention provides an image processing online debugging system, which realizes online visual display of monitoring content by debugging image processor, information conversion memory, monitor and human-computer interaction equipment, so as to facilitate the rapid location of problems arising in the image processing debugging process and shorten the project development cycle. The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and do not limit the present invention.

[0027] The embodiment of the present invention provides an image processing online debugging system, such as Figure 1 As shown, the system includes: a debugging image processor, an information conversion memory, a monitor and a human-computer interaction device;

[0028] The debugging image processor is used to process the image data to be processed, pre-process the processing results of the image data to be monitored in the image processing process according to the control instructions sent by the human-computer interaction device, and send the pre-processed processing results and status information to the information conversion memory;

[0029] The information conversion memory is used to parse and store the processing results and status information sent by the debugging image processor according to the processing instructions sent by the human-computer interaction device;

[0030] The monitor receives the processing result and status information of the image data to be monitored after being analyzed by the information conversion memory, and displays the same;

[0031] For ease of use, the monitor in the embodiment of the present invention can select a conventional display that supports HDMI / SDI / PAL interface. The human-computer interaction device can be a keyboard or a user command interaction terminal implemented by means of serial port / network interface, which provides a human-computer interaction software and hardware interface to facilitate the selection and control of the information that needs to be monitored during the debugging process.

[0032] The human-computer interaction device is used to control the debugging image processor, the information conversion memory and the monitor according to the processing results and status information of the image data to be displayed and monitored during the debugging process.

[0033] The embodiment of the present invention realizes online visual display of monitoring content by debugging an image processor, an information conversion memory, a monitor and a human-computer interaction device, which facilitates rapid location of problems arising in the image processing debugging process and shortens the project development cycle.

[0034] In specific implementation, in the embodiment of the present invention, the information conversion memory is further provided with a field programmable gate array FPGA and an ARM processor;

[0035] The ARM processor is used to parse and superimpose the image data and status information sent by the debugging image processor;

[0036] The FPGA is used for interface communication, data preprocessing and information interaction among the debugging image processor, the information conversion memory and the human-computer interaction device.

[0037] The FPGA is also used to send the control instructions sent by the human-computer interaction device to the debugging image processor, and send the parsed processing results and status information of the image data to be monitored to the monitor for display, and process image data other than the image data to be monitored.

[0038] That is to say, the information conversion memory of the embodiment of the present invention adopts the form of FPGA+ARM, FPGA is responsible for the interface processing of data signals, ARM realizes data analysis and human-computer interaction interface, and the function of the information conversion memory is, on the one hand, to receive data information from the image processing system to be debugged, and send corresponding human-computer interaction instructions to the image processing debugging system to be debugged; on the other hand, it is necessary to convert the received data (image, status information, etc.) into (HDMI / SDI / PAL) image timing, and display the status information, and output it through the corresponding image interface; on the other hand, some key information can be stored under the control of instructions, so as to facilitate further analysis through data analysis software (such as MATLAB) later;

[0039] In specific implementation, in an embodiment of the present invention, the information conversion memory further includes a memory;

[0040] The memory is used to store the image data parsed by the ARM processor and / or the image data processed by the FPGA.

[0041] The human-computer interaction device is also used to generate the preset key information based on the user instruction, and send the preset key information to the memory of the information conversion memory through the monitor;

[0042] The memory is also used to store the preset key information.

[0043] The information conversion memory is also used to determine the image data to be monitored according to the preset key information.

[0044] The following will be combined Figure 1-Figure 3 The system of the present invention is explained and described in detail:

[0045] An image processing online debugging system according to an embodiment of the present invention comprises a debugging image processor, an information conversion memory, a monitor and a human-computer interaction device.

[0046] The signal processor to be debugged of the present invention is a customized image information processing device that supports common video interface input (Cameralink, SDI, etc.) / output (such as HDMI / SDI / PAL, etc.);

[0047] The human-computer interaction device may be a keyboard, a user command interaction terminal implemented by means of a serial port / network interface, etc.;

[0048] The monitor is a display with common video interface (such as HDMI / SDI / PAL, etc.);

[0049] The debugging image processor is a functional module that packages and sends the specified data according to the communication protocol, and runs on the signal processor to be debugged;

[0050] The monitor mainly receives the packaged data transmitted from the information conversion memory and displays it;

[0051] The information conversion memory, under the control of the human-computer interaction device, stores some key information in a non-volatile storage device such as (SD card, solid state drive, etc.) according to a certain protocol format;

[0052] The present invention adopts the above technical solution, which has the following advantages compared with the existing image processing development and debugging technology:

[0053] With the help of this image processing online debugging system, online visual display of key information can be realized, which is convenient for quickly locating problems that arise during the image processing debugging process and shortening the project development cycle.

[0054] The debugging image processor runs the image processing system to be debugged, coexists with the actual image processing software, resides in the business logic software, and interacts with the image processing business logic through a certain open interface to obtain the data information to be monitored. Image processing has two main functions: one is to package the image data and status information to be transmitted to the monitor according to the instructions, and the other is to receive instructions and select the monitoring data source; in order to reduce the data transmission path and simplify the communication protocol design, the starting line data of the image is used as the status information data transmission during transmission, such as Figure 2 As shown. For FPGA debugging, the data to be monitored in the business logic can be directly transferred to the debugging image processor through the logic interface. For DSP debugging, the DSP software needs to first transfer the data to be monitored to the debugging image processor in the FPGA through a certain interface (SRIO, EMIF, UART, etc.) according to a certain protocol, and then the debugging image processor will perform data superposition and packaging, and transfer all the data to be monitored to the post-stage monitor.

[0055] The information conversion memory is jointly composed of software on both the FPGA and ARM sides. The FPGA receives the data transmitted from the debugging side, and then transmits the data to the ARM processor. The Linux operating system runs on the ARM processor, and the human-computer interface is implemented based on Qt. After the ARM side receives the data transmitted from the debugging side, it generates a display image (including the display area of ​​the image to be observed and the display area of ​​the first line of data content of the image) for display on the monitor according to a timer at a certain frame rate. The display image uses a fixed resolution. For the display area of ​​the image to be observed and the display area of ​​the first line of data content that exceeds the resolution, the image to be observed is downsampled and displayed by scaling. On the one hand, the ARM-side program extracts the first line of status information according to the human-computer interaction device. For some key variables (such as frame rate, resolution, etc.), the numerical values ​​are directly extracted and superimposed on the image to be output to the display. For some general data, they are superimposed on the image to be output to the display in the form of a memory observation window, such as Figure 3 shown.

[0056] Under the control of the human-computer interaction device, the information conversion memory is responsible for storing the status information transmitted from the debugging end in a non-volatile storage device (such as an SD card, solid-state hard drive, etc.), which can be subsequently transmitted to the PC system through a serial port, network, etc. The PC side can restore the monitoring signal according to the application protocol by programming, which is convenient for related problem analysis and positioning. For example, for the detection of the miss amount of the target tracking system, the miss amount information for a period of time can be stored. The curve of the miss amount changing with time can be plotted through the back-end MATLAB to analyze the accuracy of the target tracking system.

[0057] Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, and thus, the scope of the present invention should not be limited to the above embodiments.

Claims

1. An image processing online debugging system, characterized in that: include: Debug image processors, information conversion memories, monitors, and human-computer interaction devices; The debugging image processor is used to process the image data to be processed, pre-process the processing results of the image data to be monitored in the image processing process according to the control instructions sent by the human-computer interaction device, and send the pre-processed processing results and status information to the information conversion memory, wherein the debugging image processor runs the image processing system to be debugged, coexists with the actual image processing software, resides in the business logic software, interacts with the image processing business logic through a certain open interface, and obtains the data information to be monitored; The information conversion memory is used to parse and store the processing results and status information sent by the debugging image processor according to the processing instructions sent by the human-computer interaction device, wherein the information conversion memory is jointly composed of software on both sides of the FPGA and ARM. The FPGA receives the data transmitted from the debugging end, and then transmits the data to the ARM processor, and the ARM processor runs the Linux operating system; after receiving the data transmitted from the debugging end, the ARM side generates a display image for display on the monitor according to a timer at a certain frame rate, and the display image adopts a fixed resolution. For the display area of ​​the image to be observed and the display area of ​​the first line of data content that exceed the resolution, the image to be observed is downsampled and displayed by scaling; the ARM side program extracts the first line of status information according to the human-computer interaction device, directly extracts the value of the key variable and superimposes it on the image to be output to the display, and superimposes the general data on the image to be output to the display in the form of a memory observation window; The monitor receives the processing result and status information of the image data to be monitored after being analyzed by the information conversion memory, and displays the same; The human-computer interaction device is used to control the debugging image processor, the information conversion memory and the monitor according to the processing results and status information of the image data to be displayed and monitored during the debugging process.

2. The system according to claim 1, characterized in that The FPGA is used to send the control instruction sent by the human-computer interaction device to the debugging image processor.

3. The system according to claim 2, characterized in that The FPGA is also used to send the analyzed processing results and status information of the image data to be monitored to the monitor for display, and to process image data other than the image data to be monitored.

4. The system according to claim 1, characterized in that The information conversion memory also includes a memory; The memory is used to store the image data parsed by the ARM processor and / or the image data processed by the FPGA.

5. The system according to any one of claims 1 to 4, characterized in that: The human-computer interaction device is also used to generate preset key information based on user instructions, and send the preset key information to the memory of the information conversion memory through the monitor; The memory is also used to store the preset key information.

6. The system according to claim 5, characterized in that The information conversion memory is also used to determine the image data to be monitored according to the preset key information.

Images