Main control processor monitoring method and device, equipment, storage medium and program product

Abstract

The invention discloses a main control processor monitoring method and device, equipment, a storage medium and a program product, and relates to the technical field of image processing, and the method comprises the steps: generating an image request instruction through a triggering action, and transmitting the image request instruction to a first main control processor, the main control processor monitoring equipment is in communication connection with a first main control processor of to-be-monitored equipment, and the first main control processor forwards an image request instruction to a second main control processor of the to-be-monitored equipment; receiving image data of the second main control processor returned by the to-be-monitored equipment; and displaying an image obtained by rendering the image data on a preview interface. According to the invention, the monitoring cost of the multiple main control processors can be reduced, and the monitoring efficiency of the multiple main control devices can be improved.

Description

Technical Field

[0001] This application relates to the field of image processing technologies, and in particular, to a master control processor monitoring method, a master control processor monitoring device, a master control processor monitoring equipment, a storage medium, and a computer program product. Background Art

[0002] With the improvement of the intelligence and functional complexity of electronic devices, devices adopting a multi-level master control architecture are increasingly widely used in the fields of video processing and data acquisition. In such an architecture, it is necessary to ensure the normal operation of each master control processor (such as MCU1, Microcontroller Unit, microcontroller unit, MCU2), and to monitor its output image in real time to verify the functional integrity. However, the traditional design of multiple master control processors has significant defects in realizing multi-master control monitoring. For example, to monitor the target master control processor, when switching from the current master control processor to the target master control processor, it is necessary to physically disconnect the USB connection of the current master control processor and manually fly the wire to the target master control processor, or rely on an external switching circuit to reconstruct the communication path. This not only increases the complexity of the hardware design, but also easily causes connection failures due to poor contact or signal interference. Another example is that after switching from the current master control processor to the target master control processor, it is necessary to reload the USB driver program corresponding to the master control processor to complete the identification and initialization of the USB device. Developers need to develop and maintain USB driver programs separately for different master control processors, and the driver adaptation is complex.

[0003] It can be seen from this that when monitoring the target master control processor, the frequent physical switching and driver reloading make the master control processor monitoring process time-consuming and seriously restrict the production efficiency of multiple master control processors. Summary of the Invention

[0004] The main purpose of this application is to provide a master control processor monitoring method, a master control processor monitoring device, a master control processor monitoring equipment, a storage medium, and a computer program product, aiming to solve the technical problem that the traditional design of multiple master control processors results in high monitoring costs for multiple master control processors.

[0005] To achieve the above purpose, this application proposes a master control processor monitoring method, and the method includes:

[0006] Generating an image request instruction through a trigger action, and sending the image request instruction to a first master control processor, where the master control processor monitoring equipment is communicatively connected to the first master control processor of the device to be monitored, and the first master control processor forwards the image request instruction to the second master control processor of the device to be monitored;

[0007] Receiving the image data of the second master control processor returned by the device to be monitored;

[0008] On the preview interface, display the image rendered from the image data.

[0009] In one embodiment, the image request instruction carries a target main control processor identifier, and the target main control processor identifier is used to determine the main control processor to be monitored among multiple main control processors of the device to be monitored.

[0010] In one embodiment, the second main control processor converts the format of the original image data to obtain compressed image data, where the original image data is collected by a camera module connected to the second main control processor.

[0011] In one embodiment, after the step of receiving the image data of the second main control processor returned by the device to be monitored, it includes:

[0012] Perform integrity verification on the image data;

[0013] If the integrity verification of the image data passes, then on the preview interface, display the image rendered from the image data with passed integrity verification;

[0014] If the integrity verification of the image data fails, then send a retransmission request instruction to the second main control processor; record the number of times of failed verification, and if the consecutive number of failed times exceeds a preset number threshold, then display the exception information of the second main control processor on the preview interface.

[0015] In one embodiment, after the step of, on the preview interface, display the image rendered from the image data, it includes:

[0016] Based on a pre-trained defect detection model, perform quality analysis on the rendered image to identify abnormal regions in the image, where the abnormal regions include at least one of mosaic, blur, noise, or color distortion;

[0017] Mark the position and type of the abnormal region in the preview interface to obtain an analysis result.

[0018] In one embodiment, after the step of generating an image request instruction by a trigger action and sending the image request instruction to the first main control processor, it includes:

[0019] If no image data in response to the image request instruction is received from the first main control processor or the second main control processor within a preset time, then display a timeout error message.

[0020] In addition, to achieve the above object, the present application also provides a master processor monitoring device, which includes: a sending module, configured to generate an image request instruction through a triggering action and send the image request instruction to a first master processor, where the master processor monitoring device is communicatively connected to the first master processor of the device to be monitored, and the first master processor forwards the image request instruction to a second master processor of the device to be monitored;

[0021] a receiving module, configured to receive the image data of the second master processor returned by the device to be monitored;

[0022] a display module, configured to display an image rendered from the image data on a preview interface.

[0023] In addition, to achieve the above object, the present application also provides a master processor monitoring device, which includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is configured to implement the steps of the master processor monitoring method as described above.

[0024] In addition, to achieve the above object, the present application also provides a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium, where the computer program, when executed by a processor, implements the steps of the master processor monitoring method as described above.

[0025] In addition, to achieve the above object, the present application also provides a computer program product, which includes a computer program, where the computer program, when executed by a processor, implements the steps of the master processor monitoring method as described above.

[0026] One or more technical solutions provided by the present application have at least the following technical effects:

[0027] In the prior art, to monitor each master processor, when switching from the current master processor to the target master processor, it is necessary to physically switch the USB connection cable or rely on an external switching circuit to reconstruct the communication path, which makes the hardware design complex and there is a risk of connection failure; it is also necessary to reload the USB driver program corresponding to the master processor, which makes the driver program loading time-consuming and there are driver adaptation problems; as a result, when monitoring multiple master processors, it takes a long time, seriously restricting the production efficiency of multiple master processors.

[0028] After the present application generates an image request instruction through a trigger action and sends it to the first main control processor, the first main control processor then forwards the image request instruction to the second main control processor of the device to be monitored. It only needs to maintain a unified communication protocol and driver program with the first main control processor, and there is no need to develop an independent driver for the second main control processor. This can not only achieve logical switching between main control processors, avoid physical disconnection of USB cables, flying wires or external circuit reconstruction operations in traditional solutions, significantly reduce the hardware complexity and the risk of connection failures, but also solve the problems of driver reloading and driver adaptation during the switching of multiple main control processors. In addition, by receiving the image data of the second main control processor returned by the device to be monitored and displaying the image rendered from the image data on the preview interface, it is possible to achieve instant preview of multi-main control image output, avoid the production efficiency bottleneck caused by the long time-consuming monitoring process of the main control processor due to frequent physical switching and driver reloading in traditional solutions, and improve the efficiency of monitoring multiple main control processors. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present application and, together with the specification, are used to explain the principles of the present application.

[0030] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0031] Figure 1 It is a schematic flowchart provided for an embodiment of the main control processor monitoring method of the present application;

[0032] Figure 2 It is a schematic flowchart provided for another embodiment of the main control processor monitoring method of the present application;

[0033] Figure 3 It is a schematic brief flowchart provided for the main control processor monitoring method of the present application;

[0034] Figure 4 It is a schematic brief flowchart provided for another embodiment of the main control processor monitoring method of the present application;

[0035] Figure 5 It is a schematic PC-side flowchart provided for the main control processor monitoring method of the present application;

[0036] Figure 6 It is a schematic module structure diagram of the main control processor monitoring device of the present application;

[0037] Figure 7This is a schematic diagram of the device structure of the hardware operating environment involved in the monitoring method of the main control processor of this application.

[0038] The implementation, functional characteristics and advantages of the purpose of this application will be further described with reference to the accompanying drawings in combination with the embodiments. Specific embodiments

[0039] It should be understood that the specific embodiments described herein are used to explain the technical solutions of this application and are not used to limit this application.

[0040] In order to better understand the technical solutions of this application, the following will be described in detail in combination with the accompanying drawings of the specification and specific embodiments.

[0041] The model diagram of traditional multi-master devices such as multi-master cameras is as Figure 1 shown. The multi-master device includes at least two main control processors (Master 1 and Master 2), and the multi-master device is connected to a PC (i.e., a computer) through a USB cable. When switching between Master 1 (MCU1, Microcontroller Unit) and Master 2 (MCU2), it is switched through a physical button or a control signal, and is connected to the USB ports of the two masters through a USB cable.

[0042] Exemplarily, in a multi-master camera, if it is necessary to monitor Master 1 and preview the image processed by Master 1, the image collected by the camera module connected to the first main control processor is sent to Master 1. After Master 1 performs image processing, the processed image is sent to the PC end through the USB cable, and the PC end displays the image processed by Master 1.

[0043] When it is necessary to monitor Master 2 (i.e., check the output of Master 2), first switch the USB selection switch (physical button) to Master 2, then connect the USB cable to Master 2, perform re-identification and initialization of the USB device, and then send the image collected by the camera module connected to the second main control processor to Master 2. After Master 2 performs image processing, the processed image is sent to the PC end through the USB cable, and the PC end displays the image processed by Master 2.

[0044] It can be seen from this that in the prior art, when performing master control switching, it is necessary to complete it through hardware switching or additional means such as using jump wires. This not only increases the complexity of hardware design, but also may introduce unnecessary connection failures and signal interference, affecting the switching process. In addition, after switching to the second master control, it is also necessary to implement the re-identification and initialization of the USB device, and corresponding driver programs need to be written to ensure that the second master control can correctly identify the connected USB device. For developers, this is a complex and time-consuming task. The complexity of this operation further increases the development and maintenance costs, and in a multi-master control environment, the adaptability of the driver also brings additional challenges.

[0045] To address the above challenges, the present application proposes a solution that can achieve real-time monitoring of the image outputs of multiple master controls without relying on complex hardware switching, realizing efficient video preview. At the same time, this solution can also reduce the complex driver development work in the USB device identification process, reduce the monitoring costs of multi-master control processors, where the monitoring costs include hardware costs, software costs, development time costs, and labor costs, and improve the monitoring efficiency of multi-master control devices.

[0046] It should be noted that the execution subject of this embodiment can be a master control processor monitoring device such as a computer or a host computer that can issue control commands, or a computing service device with data processing, network communication, and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device, a processor, etc. that can implement the above functions. Hereinafter, a computer (also referred to as a PC) will be used as an example to illustrate this embodiment and the following embodiments.

[0047] Based on this, an embodiment of the present application provides a master control processor monitoring method, referring to Figure 2 , Figure 2 which is a schematic flowchart of an embodiment of the master control processor monitoring method of the present application.

[0048] In this embodiment, the master control processor monitoring method includes steps S10 to S30:

[0049] Step S10, generating an image request instruction through a trigger action, and sending the image request instruction to the first master control processor. Among them, the master control processor monitoring device is communicatively connected to the first master control processor of the device to be monitored, and the first master control processor forwards the image request instruction to the second master control processor of the device to be monitored;

[0050] It should be noted that in a computer (i.e., the main control processor monitoring device), an image request instruction is generated through a triggering action, where the triggering action includes clicking, voice, touch, etc. The image request instruction is sent to the first main control processor through a USB cable, and the first main control processor forwards the image request instruction to the second main control processor of the device to be monitored, where the device to be monitored includes a first main control processor and a second main control processor.

[0051] Exemplarily, when the user clicks the request original image button of the upper computer software in the computer, an image request instruction can be generated.

[0052] It can be understood that for step S10, the computer can achieve directional triggering of image requests without directly connecting to the second main control processor, while avoiding the physical link reconstruction problem caused by USB hardware switching in the traditional solution, reducing the hardware complexity and signal risk.

[0053] In a feasible implementation manner, after step S10, it includes:

[0054] If the response data of the image request instruction from the first main control processor or the second main control processor is not received within the preset time, an overtime error message is displayed.

[0055] It should be noted that after the computer sends the image request instruction to the first main control processor, an overtime monitoring mechanism is started. Exemplarily, the computer can start a timer and set a response time threshold (such as 500 ms); if the response data from any main control processor is not received within the preset time due to a forwarding link failure (such as a serial port communication interruption), data processing overload (such as a camera module initialization failure), or communication protocol parsing error, the computer terminates the waiting state and displays an overtime error message.

[0056] It can be understood that through this implementation manner, deadlocks caused by unresponsive main control processors can be avoided, real-time feedback of the human-computer interaction interface can be ensured, and the fault tolerance ability can be improved.

[0057] Step S20, receiving the image data of the second main control processor returned by the device to be monitored;

[0058] It should be noted that after the second main control processor responds according to the image request instruction to obtain the image data, then the image data is transmitted back to the computer via the first main control processor. The device to be monitored includes multiple main control processors, and the second main control processor can be any main control processor other than the first main control processor.

[0059] In a feasible implementation manner, after step S20, it includes steps A10 to A30:

[0060] Step A10, performing integrity verification on the image data;

[0061] It should be noted that in order to ensure that the received image data is not lost or damaged, integrity verification of the image data is required.

[0062] Step A20, if the integrity verification of the image data passes, then in the preview interface, display the image rendered from the image data for which the integrity verification has passed;

[0063] It should be noted that if the verification passes, it indicates that no errors or losses occurred during the transmission or storage of the image data, and the data is complete. At this time, the image displayed in the preview interface is the image rendered from the image data that has passed the integrity verification.

[0064] Step A30, if the integrity verification of the image data fails, then send a retransmission request instruction to the second main control processor; record the number of times the verification fails. If the consecutive number of failures exceeds the preset number threshold, then display the exception information of the second main control processor in the preview interface.

[0065] It should be noted that if the integrity verification of the image data fails, it indicates that errors, losses, or damages may have occurred during the transmission or storage of the image data, resulting in incomplete data. In this case, the computer sends a retransmission request instruction to the second main control processor to request retransmission of the image data in order to obtain complete and correct image data.

[0066] Record the number of times the integrity verification of the image data fails each time. When the consecutive number of failures exceeds the preset number threshold, it indicates that problems such as a malfunction of the second main control processor or continuous interference in the transmission link may occur at this time. Display the exception information of the second main control processor in the preview interface to remind the operator so that timely measures can be taken for troubleshooting and repair.

[0067] In this embodiment, when the integrity verification of the image data passes, it can ensure that the image rendered from it and displayed in the preview interface is complete and accurate, and reliable image information can be obtained. If the integrity verification of the image data fails, trigger the sending of a retransmission request instruction to the second main control processor. This process can avoid subsequent operation failures caused by data errors, help improve stability and reliability, and ensure the normal operation of the entire image data processing flow.

[0068] Step S30, in the preview interface, display the image rendered from the image data.

[0069] It should be noted that the preview interface is a user-friendly interface that allows for interaction and can simplify the operation process. Display the image that can be directly viewed by the user on the preview interface. The image is obtained after the image data is rendered according to the preset algorithms and rules.

[0070] Exemplarily, the rendering method may be: through the Qt image processing framework, rendering and displaying BRG format data on a QLabel.

[0071] It can be understood that by performing step S30, efficient real-time image preview can be achieved, overcoming the technical problem that the prior art cannot perform real-time image preview.

[0072] Exemplarily, as Figure 3 shown, after opening the host computer software program in the PC and clicking the "Request Original Image" button, the PC side (the main control processor monitoring device) will generate an image request instruction according to the button trigger and send it to the device to be monitored (the multi-main control device) through the USB cable.

[0073] After the MCU1 (i.e., the first main control processor) of the device to be monitored receives the image request instruction, it parses the target main control processor identifier carried in the image request instruction and determines whether it matches its own identifier; if it matches, the image request instruction is not forwarded; if it does not match, the image request instruction is forwarded to the MCU2 (i.e., the second main control processor) through the serial port.

[0074] After the MCU2 of the device to be monitored receives the image request instruction, it processes the original image data collected by the camera module, and then forwards the processed image data to the MCU1 through the serial port first, and then the MCU1 sends it to the PC side through the USB cable.

[0075] When the PC side receives the image data returned by the device to be monitored, it will display the reception progress on the interface. When the reception progress reaches 100%, the image obtained by rendering the image data will be displayed on the preview interface.

[0076] In summary, in the whole process, the user only needs to click the button to complete the whole data request process, and the operation process is simple, enhancing the applicability.

[0077] In this embodiment, after generating an image request instruction through a triggering action and sending it to the first main control processor, the first main control processor then forwards the image request instruction to the second main control processor of the device to be monitored. It only needs to maintain a unified communication protocol and driver program with the first main control processor, and there is no need to develop an independent driver for the second main control processor. This can not only achieve logical switching between main control processors, avoid physical disconnection of USB cables, wire flying or external circuit reconstruction operations in traditional solutions, and significantly reduce the hardware complexity and connection failure risk, but also solve the problems of driver reloading and driver adaptation during the switching of multiple main control processors. In addition, by receiving the image data of the second main control processor returned by the device to be monitored and displaying the image rendered from the image data on the preview interface, instant preview of multi-main control image output can be realized, avoiding the production efficiency bottleneck caused by the long monitoring process of the main control processor due to frequent physical switching and driver reloading in the traditional solution, and improving the efficiency of monitoring multiple main control processors.

[0078] In a feasible implementation manner, a target main control processor identifier is carried in the image request instruction, and the target main control processor identifier is used to determine the main control processor to be monitored among multiple main control processors of the device to be monitored.

[0079] It should be noted that in the image request instruction, the target main control processor identifier is used to clearly specify the specific main control processor that needs to be monitored. In a multi-main control processor architecture, there are multiple main control processors, and each main control processor has different functions. By carrying the target main control processor identifier, the target main control processor can be accurately identified and located, ensuring that the image request instruction is only sent to the target main control processor. At the same time, the target main control processor identifier can also be used to monitor the task execution situation of the target main control processor. For example, in a multi-main control device, MCU1 is responsible for image acquisition and MCU2 is responsible for image processing. Then when requesting image processing, the image request instruction will carry the identifier of MCU2, monitor the image processing function of MCU2, and preview the image processed by MCU2.

[0080] Exemplarily, such as Figure 4As shown, the PC sends an image request instruction to the first master processor through a private communication protocol carrying the identifier of the target master processor. The first master processor parses the identifier of the target master processor and determines whether the identifier of the target master processor matches its own identifier. If the identifier of the first master processor does not match the identifier of the target master processor, the image request instruction is forwarded to the second master processor; if the identifier of the first master processor matches the identifier of the target master processor, the image request instruction is not forwarded. After the first master processor or the second master processor processes the data according to the image request instruction, the processed image data is sent to the PC through the private communication protocol. In one embodiment, the processed image data can be sent to the PC through a private communication protocol carrying the PC identifier.

[0081] In this embodiment, carrying the identifier of the target master processor when sending the image request instruction helps to accurately locate the master processor to be monitored, realizes the accurate distribution of the image request instruction, improves the accuracy of monitoring, and avoids misoperations on irrelevant master processors.

[0082] In another feasible embodiment, the second master processor converts the format of the original image data to obtain compressed image data, where the original image data is collected by a camera module connected to the second master processor.

[0083] It should be noted that after the first master processor forwards the image request instruction to the second master processor through the serial port, the received image request instruction is parsed through the pre-set logic inside the second master processor to obtain the target image data type in the image request instruction. Among them, the image data type can be image data with different resolutions, or image data in different color modes, or image data in different coding formats (such as JPEG, PNG), etc.

[0084] After the second master processor determines the image data type in the image request instruction through internal logic, it converts the format of the original image data collected by the camera module. Among them, it can be converted into an image format with fewer bytes through a preset conversion rule to obtain compressed image data, so as to reduce the data volume and thus optimize the transmission efficiency.

[0085] In this embodiment, since the amount of data of the original image data collected by the camera module is large and the data format is relatively complex, which is not conducive to storage, transmission or processing, the second main control processor converts the format of the original image data to obtain compressed image data. The storage space occupied by the compressed image data is greatly reduced, and more image data can be stored in a limited storage device, improving the utilization rate of storage resources. In terms of transmission, the smaller amount of data can speed up the transmission speed of the image data, reduce the network bandwidth occupancy during the transmission process, and reduce the transmission delay in the scenario where real-time transmission of image data and preview of the image are required, improving the real-time performance and stability of data transmission and realizing instant preview of the image.

[0086] Based on the above embodiments of the present application, in another embodiment of the present application, for the same or similar content as the above embodiments, reference may be made to the above introduction and will not be repeated hereinafter. After step S30, steps D10 to D20 are included:

[0087] Step D10, perform quality analysis on the rendered image based on a pre-trained defect detection model to identify abnormal regions in the image, and the abnormal regions include at least one of mosaic, blur, noise or color distortion;

[0088] It should be noted that the pre-trained defect detection model can perform quality analysis on the rendered image by using the data features it has learned, and identify the abnormal regions existing in the image through algorithms. The abnormal regions have at least one problem among mosaic (local pixelation of the image), blur (unclear details), noise (random particle interference) or color distortion (color deviation).

[0089] It can be understood that through step D10, the image features of the rendered image are automatically extracted and compared by the pre-trained defect detection model to quickly locate potential defects.

[0090] Step D20, mark the position and type of the abnormal region in the preview interface to obtain the analysis result.

[0091] It should be noted that after the abnormal regions are identified, the positions and specific types of these regions are marked in a visual manner in the preview interface. Through these marks, it is possible to intuitively understand what quality problems the image has, and then specifically repair the main control processor.

[0092] In this embodiment, based on the pre-trained defect detection model, the quality of the rendered image is analyzed, which can efficiently identify the abnormal areas in the image and ensure the accurate positioning of image quality problems. The defect detection model can effectively distinguish normal areas from abnormal areas through the feature extraction and pattern matching capabilities obtained by pre-training, reducing the errors and time consumption of manual screening. Mark the positions and types of abnormal areas in the preview interface, making the analysis results visually presented. Users can quickly understand the defect distribution and specific types, providing a clear basis for subsequent correction and optimization of the main control processor. This process can not only improve the automation level of image quality assessment but also ensure the output quality and reliability of the image.

[0093] Exemplarily, to understand the main control processor monitoring method, the process on the PC side is as Figure 5 shown. After clicking the "Request Original Image" button in the host computer software, an image request instruction is generated and sent through the private communication protocol. After sending the image request instruction, start the timeout monitoring mechanism and wait for the main control processor to respond with the image data of the image request instruction. If the image data is not received within the preset time, an error message will be displayed on the interface.

[0094] If the image data in response to the image request instruction from the main control processor is received, perform an integrity check on the image data. If the integrity check fails, an error message will be displayed on the interface; if the integrity check passes, convert the data format of the image data into the BRG format (a color format), and finally, through the Qt image processing framework, render and display the BRG format data on the QLabel to show the rendered image on the preview interface.

[0095] Exemplarily, in an application scenario, the main control processor monitoring method includes:

[0096] Step 1: The user clicks the "Request Original Image" button in the PC host computer software to generate an image request instruction.

[0097] Step 2: The image request instruction is transmitted through the USB cable to the MCU1 at the multi-main control device end.

[0098] Step 3: After receiving the image request instruction, MCU1 forwards the image request instruction to MCU2 through the serial port.

[0099] Step 4: MCU2 parses the received image request instruction: determines the target image data type through internal logic.

[0100] Step 5: After MCU2 collects the image data, perform format conversion: convert it into compressed image data with fewer bytes to significantly reduce the data volume and thus optimize the transmission efficiency.

[0101] Step 6: The image data after format conversion is returned to MCU1 through the serial port.

[0102] Step 7: MCU1 uses a private communication protocol to transmit the image data after format conversion to the host computer software on the PC side.

[0103] Step 8: After the host computer software on the PC side receives the image data after format conversion, it performs data integrity verification to ensure that the received data is not lost or damaged.

[0104] Step 9: After the verification is correct, the image obtained by rendering the image data after format conversion is displayed on the image preview interface so that the user can view the monitored image data in real time for further analysis.

[0105] It should be noted that the above examples are only for understanding the present application and do not constitute a limitation on the monitoring method of the main control processor of the present application. Based on this technical concept, more simple transformations in various forms, such as the interaction and combination of various embodiments, are within the protection scope of the present application.

[0106] The present application also provides a main control processor monitoring device. Please refer to Figure 6 , the main control processor monitoring device includes:

[0107] A sending module 10, configured to generate an image request instruction through a trigger action and send the image request instruction to the first main control processor. The main control processor monitoring device is communicatively connected to the first main control processor of the device to be monitored, and the first main control processor forwards the image request instruction to the second main control processor of the device to be monitored;

[0108] A receiving module 20, configured to receive the image data of the second main control processor returned by the device to be monitored;

[0109] A display module 30, configured to display the image obtained by rendering the image data on the preview interface.

[0110] Optionally, the receiving module 20 is further configured to perform integrity verification on the image data;

[0111] If the integrity verification of the image data passes, the image obtained by rendering the image data with passed integrity verification is displayed on the preview interface;

[0112] If the integrity verification of the image data fails, a retransmission request instruction is sent to the second main control processor; the number of times of failed verification is recorded. If the number of consecutive failed times exceeds a preset number threshold, the abnormal information of the second main control processor is displayed on the preview interface.

[0113] Optionally, the display module 30 is further configured to perform quality analysis on the rendered image based on a pre-trained defect detection model, and identify abnormal areas in the image, where the abnormal areas include at least one of mosaic, blur, noise, or color distortion;

[0114] Mark the position and type of the abnormal area in the preview interface to obtain an analysis result.

[0115] Optionally, the sending module 10 is further configured to display a timeout error message if image data in response to the image request instruction is not received from the first main control processor or the second main control processor within a preset time.

[0116] In one embodiment, the image request instruction carries a target main control processor identifier, and the target main control processor identifier is used to determine the main control processor to be monitored among multiple main control processors of the device to be monitored.

[0117] In one embodiment, the second main control processor converts the format of the original image data to obtain compressed image data, where the original image data is collected by a camera module connected to the second main control processor.

[0118] The main control processor monitoring device provided in this application adopts the main control processor monitoring method in the above embodiment, and can solve the technical problem that the monitoring cost of multiple main control processors is high in the traditional multi-main control processor design. Compared with the prior art, the beneficial effects of the main control processor monitoring device provided in this application are the same as those of the main control processor monitoring method provided in the above embodiment, and other technical features in the main control processor monitoring device are the same as those disclosed in the above embodiment method, and will not be elaborated here.

[0119] This application provides a main control processor monitoring device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the main control processor monitoring method in the above first embodiment.

[0120] Next, refer to Figure 7, which shows a schematic structural diagram of a main control processor monitoring device suitable for implementing the embodiments of the present application. The main control processor monitoring device in the embodiments of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistant), PADs (Portable Application Description: tablet computers), PMPs (Portable Media Player), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The shown main control processor monitoring device is an example and should not impose any limitations on the functions and usage scope of the embodiments of the present application.

[0121] As Figure 7 shown, the main control processor monitoring device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to the program stored in the read-only memory 1002 or the program loaded from the storage device 1003 into the random access memory 1004. In the random access memory 1004, various programs and data required for the operation of the main control processor monitoring device are also stored. The processing device 1001, the read-only memory 1002, and the random access memory 1004 are connected to each other through a bus 1005. An input / output interface 1006 is also connected to the bus. Generally, the following systems may be connected to the input / output interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the main control processor monitoring device to communicate with other devices wirelessly or wiredly to exchange data. Although the figure shows a main control processor monitoring device with various systems, it should be understood that it is not required to implement or have all the shown systems. Instead, more or fewer systems may be implemented or had.

[0122] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product that includes a computer program carried on a computer-readable medium, and the computer program contains program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a read-only memory 1002. When the computer program is executed by a processing device 1001, the above-mentioned functions defined in the methods of the embodiments disclosed in the present application are executed.

[0123] The master processor monitoring device provided by the present application adopts the master processor monitoring method in the above-mentioned embodiments, and can solve the technical problem that the traditional multi-master processor design makes the monitoring cost of multi-master processors high. Compared with the prior art, the beneficial effects of the master processor monitoring device provided by the present application are the same as those of the master processor monitoring method provided by the above-mentioned embodiments, and other technical features in the master processor monitoring device are the same as the features disclosed in the method of the previous embodiment, and will not be elaborated here.

[0124] It should be understood that each part disclosed in the present application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in a suitable manner in any one or more embodiments or examples.

[0125] As described above, only the specific embodiments of the present application are provided, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, and all of them should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0126] The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the master processor monitoring method in the above-mentioned embodiments.

[0127] The computer-readable storage medium provided by this application can, for example, be a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system or device. The program code contained on the computer-readable storage medium can be transmitted by any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0128] The above computer-readable storage medium can be included in the main control processor monitoring device; it can also exist independently and not be assembled into the main control processor monitoring device.

[0129] The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed by the main control processor monitoring device, the main control processor monitoring device is caused to: generate an image request instruction by triggering an action, send the image request instruction to the first main control processor, where the main control processor monitoring device is communicatively connected to the first main control processor of the device to be monitored, and the first main control processor forwards the image request instruction to the second main control processor of the device to be monitored; receive the image data of the second main control processor returned by the device to be monitored; and display, on a preview interface, the image rendered from the image data.

[0130] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, by connecting through the Internet using an Internet service provider).

[0131] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of the code, and this module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0132] The modules described in the embodiments of this application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation to the unit itself in some cases.

[0133] The readable storage medium provided by this application is a computer-readable storage medium. The computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for performing the above-mentioned main control processor monitoring method, and can solve the technical problem that the traditional multi-main control processor design makes the monitoring cost of multi-main control processors high. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the main control processor monitoring method provided in the above embodiments, and will not be elaborated here.

[0134] The present application also provides a computer program product, including a computer program, which implements the steps of the main control processor monitoring method as described above when executed by a processor.

[0135] The computer program product provided by the present application can solve the technical problem that the traditional multi-main control processor design results in high monitoring costs for multi-main control processors. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as those of the main control processor monitoring method provided by the above embodiments, and will not be elaborated herein.

[0136] The above are only partial embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structural transformation made under the technical concept of the present application by using the content of the specification and drawings of the present application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. A method for monitoring a main control processor, characterized in that, The method includes: Generating an image request instruction through a trigger action, and sending the image request instruction to a first main control processor. The main control processor monitoring device is communicatively connected to the first main control processor of the device to be monitored, and the first main control processor forwards the image request instruction to a second main control processor of the device to be monitored; Receiving the image data of the second main control processor returned by the device to be monitored; Displaying, on a preview interface, an image rendered from the image data.

2. The method according to claim 1, wherein The image request instruction carries a target main control processor identifier, which is used to determine the main control processor to be monitored among multiple main control processors of the device to be monitored.

3. The method according to claim 1, wherein The second main control processor converts the format of the original image data to obtain compressed image data, where the original image data is collected by a camera module connected to the second main control processor.

4. The method according to claim 1, wherein After the step of receiving the image data of the second main control processor returned by the device to be monitored, it includes: Performing integrity verification on the image data; If the integrity verification of the image data passes, then on the preview interface, displaying an image rendered from the image data with passed integrity verification; If the integrity verification of the image data fails, then sending a retransmission request instruction to the second main control processor; recording the number of times of failed verification, and if the consecutive number of times of failure exceeds a preset number threshold, then displaying the abnormal information of the second main control processor on the preview interface.

5. The method according to claim 1, characterized in that, After the step of displaying, on the preview interface, an image rendered from the image data, it includes: Performing quality analysis on the rendered image based on a pre-trained defect detection model to identify abnormal regions in the image, where the abnormal regions include at least one of mosaic, blur, noise, or color distortion; Marking the position and type of the abnormal regions in the preview interface to obtain an analysis result.

6. The method according to claim 1, characterized in that, After the step of generating an image request instruction through a trigger action and sending the image request instruction to the first main control processor, it includes: If no image data in response to the image request instruction is received from the first main control processor or the second main control processor within a preset time, then displaying a timeout error message.

7. A main control processor monitoring device, characterized in that The main control processor monitoring device includes: A sending module, configured to generate an image request instruction through a trigger action and send the image request instruction to the first main control processor. The main control processor monitoring device is communicatively connected to the first main control processor of the device to be monitored, and the first main control processor forwards the image request instruction to the second main control processor of the device to be monitored; A receiving module, configured to receive the image data of the second main control processor returned by the device to be monitored; A display module, configured to display, on a preview interface, an image rendered from the image data.

8. A main control processor monitoring device, characterized in that, The device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, where the computer program is configured to implement the steps of the main control processor monitoring method according to any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the main control processor monitoring method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that, The computer program product includes a computer program. When the computer program is executed by a processor, the steps of the main control processor monitoring method according to any one of claims 1 to 6 are implemented.

Images