Method and apparatus for controlling a multi-path image signal processing unit

CN115311121BActive Publication Date: 2026-09-22VERISILICON MICROELECTRONICS (SHANGHAI) CO LTD +3
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210945875.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-08
Publication Date
2026-09-22
Estimated Expiration
2042-08-08

AI Technical Summary

Technical Problem

若出现挂死的图像信号处理单元,即无法进行中断上报的图像信号处理单元,加速处理单元便会一直等待,导致其他的图像信号处理单元也崩溃

Benefits of technology

[0007]在本申请实施例中,无需一直等待各路图像信号处理单元上报中断信息,而是配置预设时长;针对某个图像信号处理单元来说,如果在预设时长内仍然没有上报中断信息,说明该路图像信号处理单元可能是挂死的图像信号处理单元,则直接对该路图像信号处理单元进行重启,避免该路图像信号处理单元对其他图像信号处理单元的中断事件的处理带来影响,进而避免其他路图像信号处理单元崩溃,提高控制稳定性。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115311121B_ABST
    Figure CN115311121B_ABST
Patent Text Reader

Abstract

The application provides a control method and device of a multi-path image signal processing unit. The control method of the multi-path image signal processing unit is applied to an acceleration processing unit connected with the multi-path image signal processing unit. The method comprises the following steps: configuring parameters of the multi-path image signal processing unit and starting the multi-path image signal processing unit; starting timing when receiving interrupt information reported by a first-path image signal processing unit; judging whether interrupt information of each-path image signal processing unit is received within a preset time length since the timing is started; if the interrupt information of the each-path image signal processing unit is not received within the preset time length, determining an image signal processing unit without sending the interrupt information as a target image signal processing unit; reconfiguring parameters of the target image signal processing unit and restarting the target image signal processing unit. The control method is used to improve the control stability of the image signal processing unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of signal processing technology, and more specifically, to a control method and apparatus for a multi-channel image signal processing unit. Background Technology

[0002] The image signal processing unit (ISR) is a key component of a digital camera, converting sensor signals into image signals. Digital cameras typically employ multiple ISRs, each processing its corresponding image signal. While the ISRs are processing signals, an accelerator unit (ACU) is needed to handle these multiple ISRs. In this case, the ACU performs interrupt synchronization based on interrupt information reported by the ISRs.

[0003] Currently, during interrupt synchronization, the acceleration processing unit needs to wait for all image signal processing units to complete their interrupt reporting before processing the interrupt event. If an image signal processing unit is stuck (i.e., unable to report an interrupt), the acceleration processing unit will wait indefinitely, causing other image signal processing units to crash as well.

[0004] Therefore, the current control method for image signal processing units is prone to causing the image signal processing unit to crash, resulting in poor control stability. Summary of the Invention

[0005] The purpose of this application is to provide a control method and apparatus for a multi-channel image signal processing unit, so as to improve the control stability of the multi-channel image signal processing unit.

[0006] In a first aspect, embodiments of this application provide a control method for a multi-channel image signal processing unit, applied to an accelerated processing unit (APU), the APU being connected to a multi-channel image signal processing unit (ISP). The method includes: configuring parameters of the multi-channel image signal processing unit and starting the multi-channel image signal processing unit; starting a timer upon receiving interrupt information reported by a first-channel image signal processing unit; determining whether interrupt information from each image signal processing unit is received within a preset time period from the start of the timer; if no interrupt information from each image signal processing unit is received within the preset time period, identifying the image signal processing unit that did not send interrupt information as the target image signal processing unit; reconfiguring the parameters of the target image signal processing unit and restarting the target image signal processing unit.

[0007] In this embodiment, instead of waiting for each image signal processing unit to report interruption information, a preset time is configured. If no interruption information is reported within the preset time for a certain image signal processing unit, it indicates that the image signal processing unit may be a suspended image signal processing unit. In this case, the image signal processing unit is restarted directly to avoid affecting the processing of interruption events of other image signal processing units, thereby preventing other image signal processing units from crashing and improving control stability.

[0008] As one possible implementation, the step of starting timing upon receiving interrupt information reported by the first image signal processing unit includes: starting timing through a preset timing thread upon receiving interrupt information reported by the first image signal processing unit.

[0009] In this embodiment, timing can be achieved through a preset timing thread, thereby improving the accuracy and stability of timing and enabling accurate determination of the presence of a target image signal processing unit.

[0010] As one possible implementation, after restarting the target image signal processing unit, the method further includes: if interrupt information of the restarted target image signal processing unit and other image signal processing units is received within a preset time period, the interruption event of each image signal processing unit is processed according to the interruption information of the restarted target image signal processing unit and other image signal processing units.

[0011] In this embodiment, after the target image signal processing unit is restarted, the acceleration processing unit receives interrupt information from each image signal processing unit, thereby processing the interrupt event of each image signal processing unit. Each image signal processing unit includes the target image signal processing unit and other image signal processing units.

[0012] As one possible implementation, the method further includes: if an interruption message from each image signal processing unit is received within a preset time period, processing the interruption event of each image signal processing unit according to the interruption message of each image signal processing unit.

[0013] In this embodiment of the application, the acceleration processing unit receives interrupt information from each image signal processing unit within a preset time period, indicating that each image signal processing unit has reported interrupt information and there is no suspended image signal processing unit. The unit then processes the interrupt event of each image signal processing unit.

[0014] As one possible implementation, the reconfiguration of the parameters of the target image signal processing unit includes: reading pre-stored configuration parameters from memory, and reconfiguring the parameters of the target image signal processing unit based on the pre-stored configuration parameters.

[0015] In this embodiment of the application, when restarting the target image signal processing unit, the parameters are configured by pre-stored configuration parameters in memory, thereby improving the efficiency of parameter configuration; and the control time of the image signal processing unit is reduced, thereby improving control stability.

[0016] As one possible implementation, the pre-stored configuration parameters are the initial parameters of any one of the multi-channel image signal processing units, and the initial parameters are parameters common to the multi-channel image signal processing units.

[0017] In this embodiment, the parameters common to multiple image signal processing units are stored in memory. Therefore, when reading parameters, only the parameters of any one image signal processing unit need to be read, which improves the efficiency of parameter reading and storage.

[0018] As one possible implementation, the accelerated processing unit includes a first bus and a second bus. The data read / write speed of the first bus is lower than that of the second bus. A DMA (Direct Memory Access) module is configured between the first bus and the multi-channel image signal processing unit. The first bus reads and writes data to the corresponding image signal processing unit through the DMA module.

[0019] In this embodiment, the accelerated processing unit is configured with two buses for data reading and writing. For the bus with slower data reading and writing, data reading and writing is achieved through a DMA module, which can improve its data reading and writing efficiency and thus ensure the overall data reading and writing efficiency.

[0020] Secondly, embodiments of this application provide a control device for a multi-channel image signal processing unit, comprising: various functional modules for implementing the control method for the multi-channel image signal processing unit described in the first aspect and any possible implementation thereof.

[0021] Thirdly, embodiments of this application provide an electronic device, including: a processor; a memory communicatively connected to the processor; wherein the memory stores instructions executable by the processor, the instructions being executed by the processor to enable the processor to perform the control method for the multi-channel image signal processing unit described in the first aspect and any possible implementation thereof.

[0022] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a computer, performs the control method for the multi-channel image signal processing unit described in the first aspect and any possible implementation thereof. Attached Figure Description

[0023] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 A flowchart illustrating the control method for a multi-channel image signal processing unit provided in an embodiment of this application;

[0025] Figure 2 This is a control flowchart of the image signal processing unit provided in an embodiment of this application;

[0026] Figure 3 This application provides a schematic diagram of data reading and writing for an embodiment of the present application.

[0027] Figure 4 This is a schematic diagram of the control device for the multi-channel image signal processing unit provided in the embodiments of this application;

[0028] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0029] Icons: 400 - Control device for multi-channel image signal processing unit; 410 - Initialization module; 420 - Control module; 500 - Electronic device; 510 - Processor; 520 - Memory. Detailed Implementation

[0030] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0031] The technical solutions provided in this application can be applied to various application scenarios involving the control of image signal processing units, such as the control of image signal processing units in digital cameras. Image signal processing units can convert sensor signals into receivable images. For image signal processing units, a single acceleration processing unit is needed to control multiple image signal processing units; that is, a single acceleration processing unit controls multiple image signal processing units. In this application scenario, since a single acceleration processing unit needs to control multiple image signal processing units, the stability of the control must be ensured to prevent system crashes.

[0032] Based on the above application scenarios, please refer to the following... Figure 1 The flowchart below shows a control method for a multi-channel image signal processing unit provided in an embodiment of this application. The control method includes:

[0033] Step 110: Configure the parameters of the multi-channel image signal processing unit and start the multi-channel image signal processing unit.

[0034] The parameters of the multi-channel image signal processing unit include general parameters and parameters specific to each image signal processing unit.

[0035] Whether it is a general parameter or a parameter specific to each image signal processing unit, in step 110, configuration parameters are read from an external file, and the parameters of the multi-channel image signal processing units are configured based on the read configuration parameters.

[0036] As an optional implementation, the general parameters of any image signal processing unit can be stored in memory as pre-stored configuration parameters, which can be applied in subsequent processes.

[0037] In some embodiments, the memory described above may be DDR (Double Data Rate) or other memory, which is not limited herein.

[0038] When configuring parameters, the configuration parameters corresponding to each image signal processing unit are written into the register in the image signal processing unit to complete the configuration.

[0039] After completing the parameter configuration, the multi-channel image signal processing unit can be started, and the multi-channel image signal processing unit will begin signal processing accordingly.

[0040] In some embodiments, the acceleration processing unit needs to be initialized before step 110 can begin executing step 110.

[0041] Step 120: Start timing when the interrupt information reported by the first image signal processing unit is received.

[0042] Step 130: Determine whether an interrupt message has been received from each image signal processing unit within the preset time period from the start of timing.

[0043] Step 140: If no interrupt information is received from each image signal processing unit within a preset time period, the image signal processing unit that did not send interrupt information is identified as the target image signal processing unit.

[0044] The target image signal processing unit is an image signal processing unit that has not reported interruption information within a preset time period.

[0045] It is understandable that after each image signal processing unit is started, if each image signal processing unit is running normally, it will report the corresponding interrupt information; however, if any image signal processing unit hangs, it will not report the interrupt information.

[0046] Under normal circumstances, the accelerated processing unit will usually wait until all image signal processing units have reported interrupt information before processing the interrupt event. This will result in the interrupt event not being processed effectively, leading to system crash.

[0047] Therefore, in this embodiment of the application, after starting the multi-channel image signal processing unit, while receiving the interruption information reported by each image signal processing unit, it monitors whether there are any image signal processing units that have not reported interruption information within a preset time period. If so, they need to be processed.

[0048] In this embodiment, the preset duration can be understood as the longest allowed reporting time for interruption information. Different configurations can be made in different application scenarios, and no specific duration value is limited here.

[0049] When the first image signal processing unit reports an interruption, timing can begin to compare it with a preset duration. The "first image signal processing unit" is understood as the first image signal processing unit to report an interruption; it could be any image signal processing unit, and there is no distinction in order between multiple image signal processing units.

[0050] Furthermore, after the timing begins, a judgment can be made based on the real-time timing information and the preset duration. For example, if the preset duration is 1 hour and the current timing information is 50 minutes, it is possible to detect whether each image signal processing unit reports an interruption. If there is an image signal processing unit that has not reported an interruption, the timing continues until 1 hour has been reached. If there is still an image signal processing unit that has not reported an interruption, then that image signal processing unit is the target image signal processing unit.

[0051] In some embodiments, if the real-time timing information has not yet reached the preset duration, but all image signal processing units have reported interruption information, the real-time timing information can be cleared to 0, and new interruption information reporting monitoring of image signal processing units can be performed.

[0052] In this embodiment of the application, when the interrupt information reported by the first image signal processing unit is received, a timer is started, and it is determined whether the interrupt information of each image signal processing unit is received within a preset time period from the start of the timer. If the interrupt information of each image signal processing unit is not received within the preset time period, the image signal processing unit that did not send interrupt information is determined as the target image signal processing unit, thereby realizing the effective determination of whether the target image signal processing unit exists.

[0053] As an optional implementation, timing is started when an interrupt message is received from the first image signal processing unit, including: starting timing through a preset timing thread when an interrupt message is received from the first image signal processing unit.

[0054] In this implementation, timing is achieved through a timing thread. In some embodiments, the timing thread can be started after each image signal processing unit is powered on. In other embodiments, the timing thread can be started after the acceleration processing unit is initialized. The timing thread will begin timing when the conditions for starting timing are met.

[0055] In this embodiment, timing can be achieved through a preset timing thread, thereby improving the accuracy and stability of timing and enabling accurate determination of the presence of a target image signal processing unit.

[0056] Step 150: Reconfigure the parameters of the target image signal processing unit and restart the target image signal processing unit.

[0057] If the determination result is that no interrupt information is received from each image signal processing unit within a preset time period, the image signal processing unit that did not send interrupt information is identified as the target image signal processing unit, and the target image signal processing unit is processed.

[0058] During processing, the parameters of the target image signal processing unit are first reconfigured, and then it is restarted.

[0059] Based on the foregoing embodiments, each image signal processing unit includes general parameters and non-general parameters. The general parameters can be stored in memory in advance.

[0060] Therefore, as an optional implementation, reconfiguring the parameters of the target image signal processing unit includes: reading pre-stored configuration parameters from memory, and reconfiguring the parameters of the target image signal processing unit based on the pre-stored configuration parameters.

[0061] In this implementation, general parameters can be read directly from memory and then configured.

[0062] For the other part of the non-general parameters, they are still read from external files and configured.

[0063] In this embodiment of the application, when restarting the target image signal processing unit, the parameters are configured by pre-stored configuration parameters in memory, thereby improving the efficiency of parameter configuration; and the control time of the image signal processing unit is reduced, thereby improving control stability.

[0064] In some embodiments, the pre-stored configuration parameters are the initial parameters of any one of the multiple image signal processing units, and the initial parameters are parameters common to multiple image signal processing units.

[0065] In this embodiment, the parameters common to multiple image signal processing units are stored in memory. Therefore, when reading parameters, only the parameters of any one image signal processing unit need to be read, which improves the efficiency of parameter reading and storage.

[0066] Furthermore, after restarting the target image signal processing unit in step 150, the control method for the multi-channel image signal processing unit provided in this application embodiment further includes:

[0067] If interruption information of the target image signal processing unit and other image signal processing units after restart is received within a preset time period, the interruption event of each image signal processing unit is processed according to the interruption information of the target image signal processing unit and other image signal processing units after restart.

[0068] In this embodiment of the application, if the accelerated processing unit receives interruption information sent to the accelerated processing unit by the restarted target image signal processing unit and other image signal processing units within a preset time period, the interruption time of each image signal processing unit will be processed accordingly.

[0069] Furthermore, the control method for the multi-channel image signal processing unit provided in this application embodiment also includes:

[0070] If an interrupt message is received from each image signal processing unit within a preset time period, the interrupt event of each image signal processing unit is processed according to the interrupt message of each image signal processing unit.

[0071] In this embodiment of the application, if an interruption message is received from each image signal processing unit within a preset time period, it indicates that there is no target image signal processing unit among the multiple image signal processing units, and each image signal processing unit has reported an interruption message within the preset time period. In this case, the interruption events of each image signal processing unit are processed directly.

[0072] For easier understanding, please refer to Figure 2 This is a complete flowchart of the control method provided in the embodiments of this application. Figure 2 As shown, the acceleration processing unit is performed first (in Figure 2 The image signal processing unit (represented as APU) is initialized, and then each image signal processing unit (in...) is initialized. Figure 2 The diagram illustrates the process of writing initial parameters (general parameters) of the image signal processing unit (ISP) to the DDR, and writing parameters (including general and non-general parameters) to the image signal processing unit. Then, all image signal processing units are started and operate normally.

[0073] During the operation of the image signal processing unit, if an interrupt is reported by one image signal processing unit, a timer begins. For image signal processing units that have not reported an interrupt within a preset time period, parameters are configured based on the parameters stored in DDR, and the unit is restarted; this continues until the accelerated processing unit receives interrupts reported by each image signal processing unit, processes the interrupts, and provides feedback.

[0074] As mentioned in the above embodiments, the configuration of the image signal processing unit requires data reading and writing, such as writing data into a register.

[0075] The accelerated processing unit performs data reading and writing via a bus. As an optional implementation method, please refer to... Figure 3 The diagram below illustrates data read / write operations in an embodiment of this application. The accelerated processing unit includes a first bus and a second bus. The data read / write speed of the first bus is lower than that of the second bus. A DMA module is configured between the first bus and the multi-channel image signal processing unit. The first bus reads and writes data to the corresponding image signal processing unit through the DMA module.

[0076] In some embodiments, the first bus may be an AXI (Advanced eXtensible Interface) bus, and the second bus may be an AHB (Advanced High Performance Bus) bus.

[0077] In this implementation, the AHB master-slave control mode can be changed to the AXI DMA control mode in software, so that the image signal processing unit can be read and written to registers through the AXI bus and DMA.

[0078] That is, after the DMA module is added, the DMA module is responsible for the data read and write operations of the first bus and the second bus. This read and write operation is controlled by the DMA module instead of by the acceleration processing unit, which can improve the data read and write efficiency.

[0079] In this embodiment, the accelerated processing unit is configured with two buses for data reading and writing. For the bus with slower data reading and writing, data reading and writing is achieved through a DMA module, which can improve its data reading and writing efficiency and thus ensure the overall data reading and writing efficiency.

[0080] In different application scenarios, the first bus and the second bus may also adopt other implementation methods, which are not limited here.

[0081] As can be seen from the description of the embodiments of this application, the control method of the image signal processing unit adopted in the embodiments of this application adopts a single-thread servo mode, performs timing during interrupt synchronization, and restarts the image signal processing unit that has not reported the interrupt after a timeout. This does not affect the normally operating image signal processing unit, achieves a good isolation effect, and enhances the stability of the image signal processing unit control.

[0082] By restarting the unreported image signal processing unit through a single thread and configuring the parameters of the image signal processing unit directly from memory, the suspended image signal processing unit can be quickly restarted, thus enhancing the stability of the image signal processing unit control.

[0083] By changing the control method of the image signal processing unit from a single bus mode to a dual bus + DMA module approach for writing to the registers of the image signal processing unit, the control time for writing to the registers is reduced by a factor of two.

[0084] Based on the same inventive concept, please refer to Figure 4 This application also provides a control device 400 for a multi-channel image signal processing unit, including an initialization module 410 and a control module 420.

[0085] An initialization module 410 is used to configure the parameters of the multi-channel image signal processing unit and start the multi-channel image signal processing unit; a control module 420 is used to: start timing when receiving interrupt information reported by the first image signal processing unit; determine whether interrupt information from each image signal processing unit is received within a preset time period from the start of timing; if interrupt information from each image signal processing unit is not received within the preset time period, determine the image signal processing unit that did not send interrupt information as the target image signal processing unit; reconfigure the parameters of the target image signal processing unit and restart the target image signal processing unit.

[0086] In this embodiment of the application, the control module 420 is further configured to: start timing through a preset timing thread when receiving interrupt information reported by the first signal processing unit image signal processing unit.

[0087] In this embodiment of the application, the control module 420 is further configured to: if interrupt information of the target image signal processing unit and other image signal processing units after receiving a restart is received within a preset time period, process the interruption event of each image signal processing unit according to the interruption information of the target image signal processing unit and other image signal processing units after the restart.

[0088] In this embodiment of the application, the control module 420 is further configured to: if an interruption message of each image signal processing unit is received within a preset time period, process the interruption event of each image signal processing unit according to the interruption message of each image signal processing unit.

[0089] In this embodiment of the application, the control module 420 is further configured to: read pre-stored configuration parameters from memory, and reconfigure the parameters of the target signal processing unit based on the pre-stored configuration parameters.

[0090] In this embodiment of the application, the pre-stored configuration parameters are the initial parameters of any one of the multiple signal processing units, and the initial parameters are parameters common to the multiple signal processing units.

[0091] In this embodiment, the accelerated processing unit includes a first bus and a second bus. The data read / write speed of the first bus is less than that of the second bus. A DMA module is configured between the first bus and the multi-channel image signal processing unit. The first bus reads and writes data to the corresponding image signal processing unit through the DMA module.

[0092] The control device 400 of the multi-channel image signal processing unit corresponds to the aforementioned control method of the multi-channel image signal processing unit. Each functional module corresponds to each step of the aforementioned control method. Therefore, the implementation of each functional module refers to the implementation of the control method in the aforementioned embodiments, and will not be repeated here.

[0093] Please refer to Figure 5 This application also provides an electronic device 500, which can serve as the execution subject of the aforementioned control method for the multi-channel image signal processing unit, including: a processor 510 and a memory 520 communicatively connected to the processor 510.

[0094] The memory 520 stores instructions that can be executed by the processor 510. The instructions are executed by the processor 510 so that the processor 510 can execute the control method of the multi-channel image signal processing unit in the foregoing embodiment.

[0095] The processor 510 and memory 520 can be connected via a communication bus, or via some communication modules, such as: wireless communication module, Bluetooth communication module, Wi-Fi (wireless network communication technology) communication module, 2G (second generation mobile communication technology), 3G (third generation mobile communication technology), 4G (fourth generation mobile communication technology) and 5G communication modules, etc.

[0096] Processor 510 can be an integrated circuit chip with signal processing capabilities. Processor 510 can be a general-purpose processor, including a CPU (Central Processing Unit), NP (Network Processor), etc.; it can also be a digital signal processor, application-specific integrated circuit, off-the-shelf programmable gate array or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor.

[0097] The memory 520 may include, but is not limited to, RAM (Random Access Memory), ROM (Read Only Memory), PROM (Programmable Read-Only Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electric Erasable Programmable Read-Only Memory), etc.

[0098] It is understood that the electronic device 500 may also include more general modules required by itself, which will not be described one by one in the embodiments of this application.

[0099] This application also provides a computer-readable medium on which a computer program is stored. When the computer program is run by a computer, it executes the control method of the multi-channel image signal processing unit described in the foregoing embodiments.

[0100] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some communication interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0101] Furthermore, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0102] Furthermore, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0103] In this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any such actual relationship or order between these entities or operations.

[0104] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A control method for a multi-channel image signal processing unit, characterized in that, The method is applied to an accelerated processing unit connected to a multi-channel image signal processing unit. The accelerated processing unit includes a first bus and a second bus. The data read / write speed of the first bus is lower than that of the second bus. A DMA module is configured between the first bus and the multi-channel image signal processing unit. The first bus reads and writes data to the corresponding image signal processing unit through the DMA module. The method includes: Configure the parameters of the multi-channel image signal processing unit and start the multi-channel image signal processing unit; The timing begins upon receiving an interrupt message reported by the first image signal processing unit; Determine whether an interrupt message has been received from each image signal processing unit within the preset time period from the start of timing; If no interruption information is received from each of the image signal processing units within a preset time period, the image signal processing unit that did not send interruption information is identified as the target image signal processing unit. The pre-stored configuration parameters are read from memory and written into the register of the target image signal processing unit via the first bus and the second bus to reconfigure the parameters of the target image signal processing unit and restart the target image signal processing unit. The restarting of the target image signal processing unit has no effect on other normally operating image signal processing units.

2. The control method for the multi-channel image signal processing unit according to claim 1, characterized in that, The step of starting a timer upon receiving an interruption message reported by the first image signal processing unit includes: Upon receiving the interrupt information reported by the first image signal processing unit, timing begins through a preset timing thread.

3. The control method for the multi-channel image signal processing unit according to claim 1 or 2, characterized in that, After restarting the target image signal processing unit, the method further includes: If interruption information of the restarted target image signal processing unit and other image signal processing units is received within a preset time period, the interruption event of each image signal processing unit is processed according to the interruption information of the restarted target image signal processing unit and other image signal processing units.

4. The control method for the multi-channel image signal processing unit according to claim 1, characterized in that, The method further includes: If an interruption message from each image signal processing unit is received within a preset time period, the interruption event of each image signal processing unit is processed according to the interruption message of each image signal processing unit.

5. The control method for the multi-channel image signal processing unit according to claim 1, characterized in that, The pre-stored configuration parameters are the initial parameters of any one of the multi-channel image signal processing units, and the initial parameters are parameters common to the multi-channel image signal processing units.

6. A control device for a multi-channel image signal processing unit, characterized in that, The device is configured in an acceleration processing unit, which is connected to a multi-channel image signal processing unit. The acceleration processing unit includes a first bus and a second bus. The data read / write speed of the first bus is lower than that of the second bus. A DMA module is configured between the first bus and the multi-channel image signal processing unit. The first bus reads and writes data to the corresponding image signal processing unit through the DMA module. The device includes: An initialization module is used to configure the parameters of the multi-channel image signal processing unit and start the multi-channel image signal processing unit; The control module is configured to: start timing upon receiving interrupt information reported by the first image signal processing unit; determine whether interrupt information from each image signal processing unit has been received within a preset time period from the start of timing; if no interrupt information from each image signal processing unit has been received within the preset time period, identify the image signal processing unit that did not send interrupt information as the target image signal processing unit; read pre-stored configuration parameters from memory, and write the pre-stored configuration parameters into the register of the target image signal processing unit through the first bus and the second bus to reconfigure the parameters of the target image signal processing unit, and restart the target image signal processing unit, wherein restarting the target image signal processing unit has no effect on other normally operating image signal processing units.

7. An electronic device, characterized in that, include: processor; The memory is communicatively connected to the processor; The memory stores instructions that can be executed by the processor, which are executed by the processor to enable the processor to perform the control method of the multi-channel image signal processing unit as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a computer, performs the control method of the multi-channel image signal processing unit as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Processor monitoring method, watchdog, processor and processor monitoring system

    CN114564328A

  • Image processing apparatus, image signal processor, image processing method, and medium

    CN114727082A