Method and device for debugging ISP image effect

Through efficient data interaction between image processing and data interaction, the problem of low debugging of ISP image effects is solved, efficient transmission and online debugging of image data are realized, and the intelligence and efficiency of image processing are improved.

CN118945480APending Publication Date: 2024-11-12ALLWINNER TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410993731.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

During the current image processing process, the debugging efficiency of ISP image effects is low, and traditional FPGA platforms are difficult to meet the needs of efficient debugging.

Method used

By collecting the images to be processed and transmitting them to the predetermined image processing end for processing, combining the communication parameters of the image storage end and the data interaction end, efficient interaction and online debugging of image data are achieved, and image effect debugging results are generated.

Benefits of technology

It improves the debugging efficiency and intelligence of ISP image effects, ensures the security and reliability of image data during transmission, meets the image quality requirements under different scenarios and requirements, and realizes efficient online debugging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945480A_ABST
    Figure CN118945480A_ABST
Patent Text Reader

Abstract

The invention discloses an ISP image effect debugging method and device, and relates to the technical field of image processing, and the method comprises the steps: collecting a to-be-processed image, transmitting the to-be-processed image to a predetermined image processing end, carrying out the image processing operation of the to-be-processed image through the image processing end, and obtaining a target processing image; and transmitting the target processing image to a predetermined image storage end, and transmitting the target processing image to a predetermined data interaction end through the image storage end and predetermined communication parameters, so as to execute image data interaction operation on the target processing image through the data interaction end. And obtaining an image effect debugging result corresponding to the to-be-processed image. Therefore, by implementing the method and the device, the efficiency of debugging the ISP image effect can be improved, and the intelligence of debugging the ISP image effect can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a method and device for debugging ISP image effects. Background Art

[0002] With the continuous application of multimedia technology, modern digital image technology has also been continuously developed, and image acquisition and processing technology has been more and more widely used in various fields of people's lives. Due to the increasing demand for image processing quality, the amount of data and difficulty of operations required for image acquisition, processing and transmission are also gradually increasing. At present, the method for debugging image effects is usually to debug and verify ISP image effects through traditional FPGA platforms, which has the technical problem of low image debugging efficiency. It can be seen that it is particularly important to provide a new image effect debugging method to improve the debugging efficiency of ISP image effects. Summary of the invention

[0003] The present invention provides a method and device for debugging ISP image effects, which can help improve the efficiency of debugging ISP image effects and help improve the intelligence of debugging ISP image effects.

[0004] In order to solve the above technical problems, the first aspect of the present invention discloses a method for debugging ISP image effects, the method comprising:

[0005] Acquiring an image to be processed, and transmitting the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image;

[0006] The target processed image is transmitted to a predetermined image storage terminal, and through the image storage terminal and predetermined communication parameters, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain image effect debugging results corresponding to the image to be processed.

[0007] As an optional implementation, in the first aspect of the present invention, after the image to be processed is transmitted to a predetermined image processing end so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image, the method further includes:

[0008] Determining a target image format corresponding to the target processed image, and judging whether the target image format matches a predetermined reference image format;

[0009] When it is determined that the target image format does not match the predetermined reference image format, a format conversion operation is performed on the target processed image to obtain a format conversion result, and the target processed image is updated based on the format conversion result.

[0010] As an optional implementation, in the first aspect of the present invention, before the image to be processed is transmitted to a predetermined image processing end so as to perform an image processing operation on the image to be processed by the image processing end to obtain a target processed image, the method further includes:

[0011] Determining a first communication parameter of an image processing end and a second communication parameter of an image acquisition end corresponding to the image to be processed, and generating communication requirement information based on the first communication parameter and the second communication parameter;

[0012] Based on the communication requirement information, determine target communication parameters between the image processing end and the image acquisition end, wherein the target communication parameters include one or more of interface communication parameters, serial port communication parameters, and communication protocol parameters;

[0013] According to the target communication parameters, a data communication channel is established between the image processing end and the image acquisition end, and the operation of transmitting the image to be processed to a predetermined image processing end is triggered so that the image processing operation is performed on the image to be processed through the image processing end to obtain a target processed image.

[0014] As an optional implementation, in the first aspect of the present invention, the target processing image is transmitted to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform an image data interaction operation on the target processing image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed, including:

[0015] The image transmission method is determined through the image storage end and the predetermined communication parameters, and the target processed image is transmitted to the predetermined data interaction end based on the image transmission method, so as to perform online debugging operations on the target processed image through the data interaction end to obtain the image effect debugging result corresponding to the image to be processed.

[0016] As an optional implementation, in the first aspect of the present invention, before the image to be processed is transmitted to a predetermined image processing end so as to perform an image processing operation on the image to be processed by the image processing end to obtain a target processed image, the method further includes:

[0017] Acquire current scene information corresponding to the image to be processed, and determine image processing requirements of the image to be processed based on the current scene information;

[0018] Based on the image processing requirement, determining processing requirement parameters corresponding to the image to be processed, and generating image processing parameters of the image to be processed based on the processing requirement parameters, wherein the image processing parameters include one or more of image exposure processing parameters, image saturation processing parameters, and image sharpening processing parameters;

[0019] The step of transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image includes:

[0020] The image to be processed is transmitted to a predetermined image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain a target processed image.

[0021] As an optional implementation, in the first aspect of the present invention, before determining the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, the method further includes:

[0022] Obtain a configuration file corresponding to the FPGA platform, and generate a target image file based on the configuration file and a predetermined development tool;

[0023] Based on the target image file, performing a target configuration operation on the predetermined image storage end;

[0024] The target image file includes at least one or more of I2C configuration parameters, clock configuration parameters, and interface configuration parameters.

[0025] As an optional implementation, in the first aspect of the present invention, the target processed image is transmitted to a predetermined data interaction terminal based on the image transmission mode, so as to perform an online debugging operation on the target processed image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed, including:

[0026] Based on the image transmission mode, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform an image data interaction operation on the target processed image through an image interaction debugging model included in the data interaction terminal, and obtain interactive debugging image data;

[0027] Determining whether the interactive debugging image data meets a preset image debugging condition;

[0028] When it is determined that the interactive debugging image data meets the preset image debugging condition, generating an image effect debugging result corresponding to the image to be processed based on the interactive debugging image data;

[0029] When it is determined that the interactive debugging image data does not satisfy the preset image debugging conditions, the operation of transmitting the target processed image to a predetermined data interaction terminal is re-triggered to perform image data interaction operations on the target processed image through the image interactive debugging model included in the data interaction terminal, to obtain interactive debugging image data and to determine whether the interactive debugging image data satisfies the preset image debugging conditions.

[0030] A second aspect of the present invention discloses a device for debugging ISP image effects, the device comprising:

[0031] An acquisition module, used for acquiring images to be processed;

[0032] A processing module, used for transmitting the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image;

[0033] A transmission module, used for transmitting the target processed image to a predetermined image storage terminal;

[0034] The debugging module is used to transmit the target processed image to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain the image effect debugging result corresponding to the image to be processed.

[0035] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0036] A determination module, configured to determine a target image format corresponding to the target processed image after the processing module transmits the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end and obtain a target processed image;

[0037] A determination module, used to determine whether the target image format matches a predetermined reference image format;

[0038] The conversion module is used to perform a format conversion operation on the target processed image to obtain a format conversion result when the judgment module determines that the target image format does not match the predetermined reference image format, and update the target processed image based on the format conversion result.

[0039] As an optional implementation, in the second aspect of the present invention, the determination module is further used to determine a first communication parameter of the image processing end and a second communication parameter of the image acquisition end corresponding to the image to be processed before the processing module transmits the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image, and to generate communication requirement information based on the first communication parameter and the second communication parameter.

[0040] The determination module is further used to determine target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, wherein the target communication parameters include one or more of interface communication parameters, serial port communication parameters, and communication protocol parameters;

[0041] A construction module is used to construct a data communication channel between the image processing end and the image acquisition end according to the target communication parameters, and trigger the processing module to execute the operation of transmitting the image to be processed to a predetermined image processing end, so as to perform image processing operations on the image to be processed through the image processing end to obtain a target processed image.

[0042] As an optional implementation, in the second aspect of the present invention, the debugging module transmits the target processed image to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform image data interaction operations on the target processed image through the data interaction terminal, and the specific manner of obtaining the image effect debugging result corresponding to the image to be processed includes:

[0043] The image transmission method is determined through the image storage end and the predetermined communication parameters, and the target processed image is transmitted to the predetermined data interaction end based on the image transmission method, so as to perform online debugging operations on the target processed image through the data interaction end to obtain the image effect debugging result corresponding to the image to be processed.

[0044] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0045] an acquisition module, configured to acquire current scene information corresponding to the image to be processed before the processing module transmits the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image;

[0046] The determination module is further used to determine, based on the image processing requirement, processing requirement parameters corresponding to the image to be processed, and generate image processing parameters of the image to be processed based on the processing requirement parameters, wherein the image processing parameters include one or more of image exposure processing parameters, image saturation processing parameters, and image sharpening processing parameters;

[0047] The specific method in which the processing module transmits the image to be processed to a predetermined image processing end so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image includes:

[0048] The image to be processed is transmitted to a predetermined image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain a target processed image.

[0049] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0050] A generating module, configured to obtain a configuration file corresponding to the FPGA platform before the determining module determines the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, and to generate a target image file based on the configuration file and a predetermined development tool;

[0051] The processing module is further used to perform a target configuration operation on the predetermined image storage end based on the target image file;

[0052] The target image file includes at least one or more of I2C configuration parameters, clock configuration parameters, and interface configuration parameters.

[0053] As an optional implementation, in the second aspect of the present invention, the debugging module transmits the target processed image to a predetermined data interaction terminal based on the image transmission mode, so as to perform an online debugging operation on the target processed image through the data interaction terminal, and the specific method of obtaining the image effect debugging result corresponding to the image to be processed includes:

[0054] Based on the image transmission mode, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform an image data interaction operation on the target processed image through an image interaction debugging model included in the data interaction terminal, and obtain interactive debugging image data;

[0055] Determining whether the interactive debugging image data meets a preset image debugging condition;

[0056] When it is determined that the interactive debugging image data meets the preset image debugging condition, generating an image effect debugging result corresponding to the image to be processed based on the interactive debugging image data;

[0057] When it is determined that the interactive debugging image data does not satisfy the preset image debugging conditions, the operation of transmitting the target processed image to a predetermined data interaction terminal is re-triggered to perform image data interaction operations on the target processed image through the image interactive debugging model included in the data interaction terminal, to obtain interactive debugging image data and to determine whether the interactive debugging image data satisfies the preset image debugging conditions.

[0058] A third aspect of the present invention discloses another ISP image effect debugging device, the device comprising:

[0059] A memory storing executable program code;

[0060] a processor coupled to the memory;

[0061] The processor calls the executable program code stored in the memory to execute the debugging method of ISP image effects disclosed in the first aspect of the present invention.

[0062] A fourth aspect of the present invention discloses a computer storage medium, wherein the computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the debugging method of the ISP image effect disclosed in the first aspect of the present invention.

[0063] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0064] In the embodiment of the present invention, an image to be processed is collected, and the image to be processed is transmitted to a predetermined image processing terminal, so that an image processing operation is performed on the image to be processed through the image processing terminal to obtain a target processed image; the target processed image is transmitted to a predetermined image storage terminal, and through the image storage terminal and predetermined communication parameters, the target processed image is transmitted to a predetermined data interaction terminal, so that an image data interaction operation is performed on the target processed image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed. It can be seen that the implementation of the present invention can be beneficial to improving the efficiency of debugging the ISP image effect, and is beneficial to improving the intelligence of debugging the ISP image effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0066] Figure 1 It is a flowchart of a method for debugging ISP image effects disclosed in an embodiment of the present invention;

[0067] Figure 2 It is a flowchart of another ISP image effect debugging method disclosed in an embodiment of the present invention;

[0068] Figure 3 It is a structural schematic diagram of a debugging device for ISP image effects disclosed in an embodiment of the present invention;

[0069] Figure 4 It is a structural schematic diagram of another ISP image effect debugging device disclosed in an embodiment of the present invention;

[0070] Figure 5 It is a structural schematic diagram of another ISP image effect debugging device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0071] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0072] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0073] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0074] The present invention discloses a method and device for debugging ISP image effects, which can be helpful to improve the efficiency of debugging ISP image effects and improve the intelligence of debugging ISP image effects. Detailed descriptions are given below.

[0075] Embodiment 1

[0076] See also Figure 1 , Figure 1 1 is a flow chart of a method for debugging ISP image effects disclosed in an embodiment of the present invention. Figure 1 The described debugging method of ISP image effect can be applied to the debugging device of ISP image effect, and can also be applied to the MPSoc FPGA platform, which is not limited in the embodiment of the present invention. Figure 1 As shown, the debugging method of the ISP image effect may include the following operations:

[0077] 101. Collect an image to be processed, and transmit the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image.

[0078] In the embodiment of the present invention, the image to be processed may be an ISP image, wherein the ISP image refers to an image processed by an image signal processor (ISP). An ISP is an electronic device used to process an image signal output by an image sensor and convert it into an image format that can be viewed on a display or saved.

[0079] In the embodiment of the present invention, optionally, the image to be processed may be collected by a MIPI CMOS camera; wherein, the number of images to be processed may be one or more, which is not specifically limited in the embodiment of the present invention. Furthermore, the MIPI CMOS camera is a CMOS (Complementary Metal-Oxide-Semiconductor) camera module that adopts the MIPI (Mobile Industry Processor Interface) standard.

[0080] In an embodiment of the present invention, optionally, the predetermined image processing end may include a PL end, wherein the ISP processing module can be placed at the PL end. Further, the PL end, in the context of a system-on-chip (SoC), generally refers to the programmable logic (Programmable Logic) part, especially in an SoC using FPGA (Field Programmable Gate Array) technology. Further, in an SoC, the PL end generally works in conjunction with the PS end (Processing System). The PS end is responsible for general computing tasks and system management, while the PL end is responsible for implementing specific hardware logic. The collaborative work between the two is achieved through a series of interfaces and protocols, such as the HP (High-Performance) interface, the ACP (Accelerator Coherency Port) interface, and the GP (General-Purpose) interface. These interfaces provide efficient data transmission and communication mechanisms, ensuring seamless collaboration between the PS and PL ends; the ISP (Image Signal Processor) processing module is a key component in digital cameras, smart phones and other devices. It is responsible for processing the raw image data captured from image sensors (such as CMOS or CCD) to output the final high-quality image; among them, the ISP module can perform one or more of noise reduction, white balance adjustment, color correction, sharpening and edge enhancement, dynamic range compression, automatic exposure control, autofocus, format conversion, etc. on the image data.

[0081] 102. The target processed image is transmitted to a predetermined image storage terminal, and through the image storage terminal and predetermined communication parameters, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain image effect debugging results corresponding to the image to be processed.

[0082] In an embodiment of the present invention, optionally, the predetermined image storage end may include a PS end, wherein the PS end includes DDR4; wherein DDR4 (Double Data Rate 4th Generation Synchronous Dynamic RandomAccess Memory) is a fourth generation synchronous dynamic random access memory, and is a high-performance memory standard widely used in current computer systems.

[0083] In the embodiment of the present invention, optionally, the above-mentioned transmission of the target processed image to the predetermined image storage terminal can be to transmit the target processed image to the image storage terminal through an AXI interface. Among them, the AXI (Advanced Extensible Interface) interface is a high-performance, high-bandwidth bus interface protocol developed by ARM and widely used in various SoC (System-on-Chip) designs; the AXI interface supports multiple transmission modes, including single transmission, burst transmission and stream transmission, and provides a flexible interface to support high-performance and low-power system design. In Zynq FPGA, the AXI interface is usually used to connect PS (processing system, including ARM processor) and PL (programmable logic).

[0084] In the embodiment of the present invention, optionally, the predetermined communication parameters may include Ethernet communication parameters.

[0085] In the embodiment of the present invention, optionally, the data interaction terminal may include a PC terminal.

[0086] In the embodiment of the present invention, optionally, the image effect debugging result may include the image effect corresponding to the image to be processed. Further, the image effect corresponding to the image to be processed may include one or more of the exposure debugging result, the saturation debugging result, and the sharpening debugging result.

[0087] In the embodiment of the present invention, optionally, for example, the MIPI CMOS camera daughter board is connected to the MPSOC motherboard through the FMC high-speed interface, and the MPSoC platform PS end integrates the camera video data acquisition physical interface DPHY, as well as the clock, GPIO, I2C and other basic modules required for the data path, and the PS end is based on the Linux operating system. The self-developed CSI data receiving and ISP processing modules are placed on the PL end, and the image data is converted to the AXI interface through the MBUS2AXI module to communicate with the PS end. The image data is stored in the DDR4 of the PS end through the AXI interface, and then the data is exchanged with the PC through Ethernet, so as to efficiently realize the online debugging of the ISP image effect.

[0088] It can be seen that implementation Figure 1The described ISP image effect debugging method can collect the image to be processed and transmit it to a predetermined image processing end to perform image processing operations on the image to be processed to obtain a target processed image, transmit the target processed image to the image storage end and transmit it to the data interaction end through predetermined communication parameters to perform data interaction operations on the target processed image, and obtain the image effect debugging result corresponding to the image to be processed, which can ensure that the image data can flow efficiently between various system components, improve the overall data processing efficiency, and effectively ensure the security and reliability of image data during transmission by pre-determined and configured image processing ends, image storage ends and data interaction ends, and use specific communication parameters for data transmission, so as to prevent data leakage or loss, and perform image data interaction operations on the target processed image through the data interaction end, so as to flexibly debug and modify the image effect, meet the image quality requirements under different scenarios and requirements, and can perform image data interaction operations on the target processed image through the data interaction end, so as to realize efficient online ISP image effect debugging to obtain the corresponding image effect debugging result, which can be beneficial to improve the debugging efficiency and debugging intelligence of ISP image effect.

[0089] Embodiment 2

[0090] See also Figure 2 , Figure 2 FIG. 1 is a flow chart of another method for debugging ISP image effects disclosed in an embodiment of the present invention. Figure 2 The described debugging method of ISP image effect can be applied to the debugging device of ISP image effect, and can also be applied to the MPSoc FPGA platform, which is not limited in the embodiment of the present invention. Figure 2 As shown, the debugging method of the ISP image effect may include the following operations:

[0091] 201. Collect an image to be processed, and transmit the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image.

[0092] 202. Determine a target image format corresponding to the target processed image, and judge whether the target image format matches a predetermined reference image format.

[0093] In the embodiment of the present invention, optionally, the predetermined reference image format may be a yuv format image. Optionally, for example, the target image format corresponding to the target processed image may be a raw format. When the target image format is a raw format and the reference image format is a yuv format, the target image format does not match the reference image format.

[0094] In the embodiment of the present invention, optionally, the determining whether the target image format matches the predetermined reference image format may include:

[0095] Determining whether the target image format is the same as a predetermined reference image format;

[0096] When it is determined that the target image format is the same as the predetermined reference image format, it is determined that the target image format matches the predetermined reference image format; when it is determined that the target image format is not the same as the predetermined reference image format, it is determined that the target image format does not match the predetermined reference image format.

[0097] 203. When it is determined that the target image format does not match the predetermined reference image format, a format conversion operation is performed on the target processed image to obtain a format conversion result, and the target processed image is updated based on the format conversion result.

[0098] In the embodiment of the present invention, further optionally, when it is determined that the target image format matches the predetermined reference image format, step 204 is directly triggered to be executed.

[0099] In an embodiment of the present invention, further optionally, the format conversion operation performed on the target processed image can be performed by one or more of the CSI processing module and the ISP processing module; wherein the CSI (Channel State Information) processing module plays an important role in fields such as wireless communications and embedded systems.

[0100] In the embodiment of the present invention, optionally, a target image format corresponding to the target processed image updated based on the format conversion result matches a predetermined reference image format.

[0101] 204. The target processed image is transmitted to a predetermined image storage terminal, and the target processed image is transmitted to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain image effect debugging results corresponding to the image to be processed.

[0102] In the embodiment of the present invention, for the detailed description of step 201 and step 204, please refer to the other descriptions of step 101-step 102 in the first embodiment, and the embodiment of the present invention will not be repeated.

[0103] It can be seen that the implementation Figure 2The described ISP image effect debugging method can determine the target image format corresponding to the target processed image and judge whether the target image format matches the reference image format. If not, a format conversion operation is performed on the target processed image to obtain a format conversion result and the target processed image is updated based on the format conversion result. By ensuring that the target processed image conforms to a predetermined reference image format, the process enhances the compatibility of image data. In subsequent stages of the image processing chain, such as image storage, transmission, display or further analysis, a unified image format can simplify the processing process, reduce the error rate, and improve the overall processing efficiency. In some cases, mismatched image formats may cause data to be lost or damaged during conversion or processing. By performing format matching and conversion in advance, such problems can be effectively avoided, and the integrity and accuracy of the image data can be guaranteed. Through a preset reference image format and an automated format conversion mechanism, the system can automatically complete the format matching and conversion work, thereby improving processing efficiency and accuracy, and can achieve efficient online ISP image effect debugging to obtain corresponding image effect debugging results, which can be beneficial to improving the debugging efficiency and debugging intelligence of ISP image effects.

[0104] In an optional embodiment, before transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image, the method further includes:

[0105] Determine a first communication parameter of the image processing end, and determine a second communication parameter of the image acquisition end corresponding to the image to be processed, and generate communication requirement information based on the first communication parameter and the second communication parameter;

[0106] Based on the communication requirement information, determine the target communication parameters between the image processing end and the image acquisition end, wherein the target communication parameters include one or more of interface communication parameters, serial port communication parameters, and communication protocol parameters;

[0107] According to the target communication parameters, a data communication channel is established between the image processing end and the image acquisition end, and the operation of transmitting the image to be processed to a predetermined image processing end is triggered so that the image processing end performs image processing operations on the image to be processed to obtain the target processed image.

[0108] In this optional embodiment, optionally, the communication requirement information includes at least communication requirement information corresponding to the first communication parameter and communication requirement information corresponding to the second communication parameter; that is, the communication requirement information can meet the communication requirement corresponding to the image processing end and the communication requirement corresponding to the image acquisition end.

[0109] In this optional embodiment, optionally, the image acquisition end includes a MIPI CMOS camera, wherein the MIPI CMOS camera subboard is connected to the MPSOC motherboard via the FMC high-speed interface, and the MPSoC platform PS end in the image processing end integrates the camera video data acquisition physical interface DPHY, as well as basic modules such as clock, GPIO, I2C required for the data path; that is, the image acquisition end and the image processing end can be connected to the MPSOC motherboard via the FMC high-speed interface and communicate through the physical interface DPHY.

[0110] In this optional embodiment, optionally, FMC (FPGA Mezzanine Card) high-speed interface is a technology for connecting between FPGA (field programmable gate array) IO and communication components. It allows FPGA pins with reconfigurable IO capabilities to connect with other FMC daughter card IOs, and has a signal communication capability of up to several G / bps; DPHY (D-PHY) is a physical layer specification of MIPI (Mobile Industry Processor Interface), which is mainly used for high-speed data transmission in mobile applications. DPHY is one of the physical layers of the MIPI interface, and its protocol layer includes CSI (Camera Serial Interface) and DSI (Display Serial Interface).

[0111] It can be seen that the implementation of this optional embodiment can determine the first communication parameter of the image processing end and the second communication parameter of the image acquisition end and then generate communication requirement information, determine the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, build a data communication channel between the image processing end and the image acquisition end according to the target communication parameters and trigger the execution of an operation of transmitting the image to be processed to the image processing end so as to obtain the target processed image by performing an image processing operation on the image to be processed by the image processing end. By predetermining the first and second communication parameters of the image processing end and the image acquisition end and generating the communication requirement information based on these parameters, the compatibility and efficiency of the communication between the two parties can be ensured, which is also conducive to improving the efficiency and Stability, and by defining the target communication parameters in detail, including interface communication parameters, serial port communication parameters, communication protocol parameters, etc., the accuracy and consistency of the data transmission process can be ensured, which helps to reduce the risk of data loss, damage or misunderstanding, thereby enhancing the reliability of the entire system. By accurately matching the communication parameters of the image processing end and the image acquisition end, it can ensure that the resources in the data transmission process are fully utilized, which helps to reduce unnecessary resource consumption and waste, and improves the resource utilization and energy efficiency of the entire system, which in turn helps to improve the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, as well as the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0112] In another optional embodiment, the target processed image is transmitted to a predetermined data interaction terminal through an image storage terminal and predetermined communication parameters, so as to perform an image data interaction operation on the target processed image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed, including:

[0113] The image transmission method is determined through the image storage end and the predetermined communication parameters, and the target processed image is transmitted to the predetermined data interaction end based on the image transmission method, so as to perform online debugging operations on the target processed image through the data interaction end to obtain the image effect debugging result corresponding to the image to be processed.

[0114] In this optional embodiment, the predetermined data interaction terminal may be a PC terminal.

[0115] In this optional embodiment, optionally, the predetermined data interaction terminal may include PC software and Linux application layer software; further, the target processed image may include image data in yuv format, that is, the Linux application layer software transmits the yuv image data to the host computer PC based on Ethernet, and debugs the ISP image effect online through the PC software.

[0116] It can be seen that the implementation of this optional embodiment can determine the image transmission mode through the image storage end and the communication parameters, and based on the image transmission mode, transmit the target processed image to the data interaction end so as to perform online debugging operations on the target processed image through the data interaction end to obtain the corresponding image effect debugging results. The processed image can be directly transmitted to the data interaction end in an online manner, thereby realizing instant image effect debugging. Compared with the traditional offline processing or manual transmission method, the efficiency of image processing and debugging can be significantly improved, and the developer or user can be allowed to quickly adjust the image processing parameters according to real-time feedback through online debugging until a satisfactory image effect is achieved. The automated transmission and debugging reduces manual participation, especially reduces the workload of manual transmission and inspection of images between different devices or systems. Through efficient communication protocols and parameter optimization, the bandwidth and storage resource consumption in the data transmission process can be reduced, further reducing costs, and can be conducive to further improving the intelligence and efficiency of image processing and image effect debugging, thereby also being conducive to improving the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, and being conducive to improving the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0117] In yet another optional embodiment, before transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image, the method further includes:

[0118] Acquire current scene information corresponding to the image to be processed, and determine image processing requirements of the image to be processed based on the current scene information;

[0119] Based on the image processing requirements, determining the processing requirement parameters corresponding to the image to be processed, and generating the image processing parameters of the image to be processed based on the processing requirement parameters, wherein the image processing parameters include one or more of image exposure processing parameters, image saturation processing parameters, and image sharpening processing parameters;

[0120] The image to be processed is transmitted to a predetermined image processing end so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image, including:

[0121] The image to be processed is transmitted to a predetermined image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain a target processed image.

[0122] In this optional embodiment, optionally, the current scene information corresponding to the image to be processed may include one or more of scene brightness information, scene color information, scene saturation information, and scene contrast information corresponding to the image to be processed.

[0123] In this optional embodiment, optionally, the image processing requirements may include one or more of exposure processing requirements, saturation processing requirements, and sharpening processing requirements; further optionally, the image processing requirements may also include one or more of color processing requirements and contrast processing requirements.

[0124] In this optional embodiment, optionally, the above-mentioned determining the processing requirement parameters corresponding to the image to be processed based on the image processing requirement, and generating the image processing parameters of the image to be processed based on the processing requirement parameters may include:

[0125] Extracting processing keywords from the image processing requirements, and determining processing requirement parameters corresponding to the image to be processed based on the processing keywords;

[0126] Based on the processing requirement parameters, at least one target processing parameter matching the processing requirement parameters is determined in a predetermined image processing parameter set, and image processing parameters of the image to be processed are generated based on all the target processing parameters.

[0127] In this optional embodiment, further optionally, the image processing end can include an MPSoC FPGA platform. Furthermore, based on the actual LUTs resources and verification requirements of the MPSoC FPGA platform, CSI and ISP digital logic circuits can be designed to achieve format conversion and image effect adjustment of the original raw data of the image emitted by the CMOS Sensor daughter board, wherein the image effect adjustment may include image effect parameters such as exposure, saturation, and sharpening.

[0128] It can be seen that implementing this optional embodiment can obtain the current scene information corresponding to the image to be processed, determine the image processing requirements based on the current scene information, determine the processing requirement parameters corresponding to the image to be processed based on the image processing requirements, and then generate the image processing parameters of the image to be processed, and transmit the image to be processed to the image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain the target processed image. By obtaining the current scene information of the image to be processed, the characteristics of the image and the areas that need to be improved can be more accurately identified, so as to determine the image processing requirements in a targeted manner, so that the image processing is more accurate and the image processing is more matched with the requirements of the current scene, and the image quality requirements in various scenarios can be met. According to the determined image processing requirements, corresponding image processing parameters (such as exposure, saturation, sharpening, etc.) can be generated, and the image quality can be adjusted more finely. By automatically generating and applying image processing parameters, the links of manual intervention are reduced, and the processing efficiency is improved, which is conducive to significantly improving the pertinence and effect of image processing, while improving the processing efficiency and enhancing the user experience.

[0129] In yet another optional embodiment, before determining the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, the method further includes:

[0130] Obtain a configuration file corresponding to the FPGA platform, and generate a target image file based on the configuration file and a predetermined development tool;

[0131] Based on the target image file, perform target configuration operations on the predetermined image storage end;

[0132] The target image file includes at least one or more of I2C configuration parameters, clock configuration parameters, and interface configuration parameters.

[0133] In this optional embodiment, the FPGA platform is mainly used to accelerate calculations, process complex algorithms, and implement specific hardware functions; FPGA (Field-Programmable Gate Array) is a semi-custom integrated circuit that allows users to define its internal logic functions through programming after manufacturing. The FPGA platform refers to the development, deployment, and operation and maintenance environment based on FPGA technology, which provides rich hardware resources and software tools to support users in efficient algorithm development, hardware acceleration, and system integration.

[0134] In this optional embodiment, optionally, the configuration file corresponding to the FPGA platform may include a bitfile file; the predetermined development tool may include Petalinux SDK; wherein the bitfile file is the final file of the FPGA (Field-Programmable Gate Array) design, which is used to configure the configuration bit stream of the FPGA; the bitfile file is a binary file finally generated after synthesis, layout and routing and other steps in the FPGA development process, which contains the configuration information of all logic resources inside the FPGA and is used to download to the FPGA chip to realize specific hardware functions. The bitfile file is a necessary file for the operation of the FPGA. When the bitfile is downloaded to the FPGA chip, the FPGA will set the connection mode and function of the internal logic resources according to the configuration information, so as to realize the hardware circuit designed by the user; further, Petalinux SDK (Software Development Kit) is a set of development tools designed for Xilinx FPGA (field programmable gate array) and SoC (system-on-chip) platforms, aiming to simplify the development and deployment process of Linux systems. Petalinux SDK provides developers with a complete development environment, including compilers, debuggers, library files, sample codes, and necessary tools and scripts to support the construction, deployment and debugging of Linux systems. With Petalinux SDK, developers can easily create, compile and debug Linux applications and systems for Xilinx FPGA and SoC.

[0135] In this optional embodiment, the target image file can be a system image file required for MPSoC FPGA platform startup. Further, the target image file can perform board-level configuration of various peripherals on the ARM side based on the DTS file of the Linux5.4 kernel, such as I2C configuration, clock configuration, etc. Among them, on the MPSoC (multi-processor system-on-chip) FPGA platform, the system image file required for startup includes several parts, and several files work together to ensure that the system can successfully start and run Linux or other operating systems. Among them, the system image file can include one or more of FSBL (first stage boot loader), PMU (power management unit) configuration file, ARM Trusted Firmware (encrypted firmware), PL bitstream (FPGA-side bitstream file), and U-Boot (uboot file).

[0136] In this optional embodiment, optionally, for example, the bitfile file provided by the FPGA platform is combined with the Petalinux SDK to generate the system image file required for starting the MPSoC FPGA platform, and the board-level configuration of various peripherals on the ARM side (PS side), such as I2C, clock, etc., is performed based on the DTS file of the Linux5.4 kernel.

[0137] It can be seen that the implementation of this optional embodiment can obtain the configuration file corresponding to the FPGA platform, generate the target image file based on the configuration file and the development tool, and perform the target configuration operation on the image storage end based on the target image file. The configuration file can flexibly define various parameters of the FPGA platform, such as I2C configuration parameters, clock configuration parameters, interface configuration parameters, etc. When it is necessary to adapt to different image processing requirements or hardware environments, it is only necessary to modify the corresponding parameters in the configuration file and regenerate the target image file to achieve rapid configuration and adjustment of the system without large-scale changes to the hardware. Using a predetermined development tool, the parameters in the configuration file can be automatically converted into a format recognizable by the FPGA, and a target image file can be generated, which greatly simplifies the complexity and error rate of manual configuration of the FPGA. The target image file generated by the configuration file and the development tool can ensure that the various parameters of the FPGA are accurately configured, avoiding system errors or instability caused by improper manual configuration. The I2C configuration parameters contained in the target image file enable the FPGA to support multiple communication protocols and interfaces, such as I2C, SPI, UART, etc. This helps to achieve efficient communication and data transmission between the FPGA and the image acquisition end, image processing end and image storage end, and can help to further improve the intelligence and efficiency of image processing and image effect debugging, and thus help to improve the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, and help to improve the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0138] In another optional embodiment, the target processed image is transmitted to a predetermined data interaction terminal based on an image transmission mode, so as to perform an online debugging operation on the target processed image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed, including:

[0139] Based on the image transmission mode, the target processing image is transmitted to a predetermined data interaction terminal, so as to perform an image data interaction operation on the target processing image through an image interaction debugging model included in the data interaction terminal, and obtain interactive debugging image data;

[0140] Determine whether the interactive debugging image data meets the preset image debugging conditions;

[0141] When it is determined that the interactive debugging image data meets the preset image debugging condition, an image effect debugging result corresponding to the image to be processed is generated based on the interactive debugging image data;

[0142] When it is determined that the interactive debugging image data does not satisfy the preset image debugging conditions, the execution is re-triggered to transmit the target processed image to a predetermined data interaction terminal, so as to perform image data interaction operations on the target processed image through the image interactive debugging model included in the data interaction terminal, obtain the interactive debugging image data, and determine whether the interactive debugging image data satisfies the preset image debugging conditions.

[0143] In this optional embodiment, optionally, the image interaction debugging model included in the data interaction terminal is an image interaction debugging model pre-trained to convergence. Further optionally, the data interaction terminal performing the image data interaction operation on the target processing image may be performing an online interaction debugging processing operation on the target processing image.

[0144] In this optional embodiment, optionally, the above-mentioned determination of whether the interactive debugging image data meets the preset image debugging condition may include:

[0145] Determine the image debugging quality based on the interactive debugging image data, determine the benchmark debugging quality based on the preset image debugging conditions, and judge whether the image debugging quality matches the benchmark debugging quality;

[0146] When it is determined that the image debugging quality matches the benchmark debugging quality, it is determined that the interactive debugging image data meets the preset image debugging condition; when it is determined that the image debugging quality does not match the benchmark debugging quality, it is determined that the interactive debugging image data does not meet the preset image debugging condition.

[0147] In this optional embodiment, optionally, the image effect debugging result may at least include interactive debugging image data.

[0148] It can be seen that the implementation of this optional embodiment can transmit the target processed image to the data interaction end based on the image transmission method so as to perform image data interaction operations on the target processed image through the image interaction debugging model to obtain interactive debugging image data, and judge whether the interactive debugging image data meets the preset image debugging conditions. If so, the image effect debugging result of the image to be processed is generated based on the interactive debugging image data. If not, the operation of transmitting the target processed image to the data interaction end so as to perform image data interaction operations on the target processed image through the image interaction debugging model and judge whether the interactive debugging image data meets the image debugging conditions is re-executed. The target processed image can be subjected to detailed data interaction operations through the image interaction debugging model, and various parameters of the image, such as brightness, contrast, color, etc., can be analyzed and adjusted more accurately. In order to achieve the expected visual effect, and when the interactive debugging image data does not meet the preset conditions, the image transmission and debugging process is automatically re-triggered without manual intervention, thus realizing the automation of the debugging process. By continuously iterating the execution of image transmission, debugging and judgment operations, the image effect can be gradually optimized until the preset conditions are met, ensuring the continuous improvement of image quality. Through precise image debugging and iterative optimization, it can be ensured that the final output image quality meets or exceeds user expectations, enhances the user's visual experience and satisfaction, and can be conducive to further improving the intelligence and efficiency of image processing and image effect debugging, and thus is also conducive to improving the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, as well as the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0149] Embodiment 3

[0150] See also Figure 3 , Figure 3 FIG. 1 is a schematic diagram of the structure of another ISP image effect debugging device disclosed in an embodiment of the present invention. Figure 3 As shown, the debugging device for the ISP image effect may include:

[0151] The acquisition module 301 is used to acquire the image to be processed;

[0152] The processing module 302 is used to transmit the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image;

[0153] The transmission module 303 is used to transmit the target processed image to a predetermined image storage terminal;

[0154] The debugging module 304 is used to transmit the target processed image to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain the image effect debugging result corresponding to the image to be processed.

[0155] It can be seen that implementation Figure 3 The described device can collect the image to be processed and transmit it to a predetermined image processing end to perform image processing operations on the image to be processed to obtain a target processed image, transmit the target processed image to the image storage end and transmit it to the data interaction end through predetermined communication parameters to perform data interaction operations on the target processed image, and obtain the image effect debugging result corresponding to the image to be processed, which can ensure that the image data can flow efficiently between various system components, improve the overall data processing efficiency, and effectively ensure the security and reliability of image data during transmission by pre-determined and configured image processing ends, image storage ends and data interaction ends, and use specific communication parameters for data transmission, so as to prevent data leakage or loss. By performing image data interaction operations on the target processed image through the data interaction end, the image effect can be flexibly debugged and modified to meet the image quality requirements under different scenarios and needs, and the image data interaction operations can be performed on the target processed image through the data interaction end, so as to realize efficient online ISP image effect debugging to obtain the corresponding image effect debugging result, which can be beneficial to improve the debugging efficiency and debugging intelligence of ISP image effects.

[0156] In an optional embodiment, if Figure 4 As shown, the device also includes:

[0157] The determination module 305 is used for transmitting the image to be processed to a predetermined image processing end in the processing module 302, so that the image processing end performs an image processing operation on the image to be processed, and after obtaining a target processed image, determining a target image format corresponding to the target processed image;

[0158] A determination module 306, used to determine whether the target image format matches a predetermined reference image format;

[0159] The conversion module 307 is used to perform a format conversion operation on the target processed image to obtain a format conversion result, and update the target processed image based on the format conversion result when the determination module 306 determines that the target image format does not match the predetermined reference image format.

[0160] It can be seen that implementation Figure 4The described device can determine the target image format corresponding to the target processed image and judge whether the target image format matches the reference image format. If not, a format conversion operation is performed on the target processed image to obtain a format conversion result and the target processed image is updated based on the format conversion result. By ensuring that the target processed image conforms to a predetermined reference image format, the process enhances the compatibility of image data. In subsequent stages of the image processing chain, such as image storage, transmission, display or further analysis, a unified image format can simplify the processing process, reduce the error rate, and improve the overall processing efficiency. In some cases, mismatched image formats may cause data to be lost or damaged during conversion or processing. By performing format matching and conversion in advance, such problems can be effectively avoided, and the integrity and accuracy of the image data can be ensured. Through a preset reference image format and an automated format conversion mechanism, the system can automatically complete the format matching and conversion work, thereby improving processing efficiency and accuracy, and can achieve efficient online ISP image effect debugging to obtain corresponding image effect debugging results, which can be beneficial to improving the debugging efficiency and debugging intelligence of ISP image effects.

[0161] In another optional embodiment, Figure 4 As shown, the determination module 305 is further used to determine the first communication parameter of the image processing end and the second communication parameter of the image acquisition end corresponding to the image to be processed before the processing module 302 transmits the image to be processed to the predetermined image processing end so as to perform the image processing operation on the image to be processed through the image processing end to obtain the target processed image, and to generate the communication requirement information based on the first communication parameter and the second communication parameter;

[0162] The determination module 305 is further used to determine target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, wherein the target communication parameters include one or more of interface communication parameters, serial port communication parameters, and communication protocol parameters;

[0163] The construction module 308 is used to construct a data communication channel between the image processing end and the image acquisition end according to the target communication parameters, and trigger the processing module 302 to transmit the image to be processed to a predetermined image processing end, so as to perform image processing operations on the image to be processed through the image processing end to obtain the target processed image.

[0164] It can be seen that implementation Figure 4The described device is capable of determining a first communication parameter of an image processing end and a second communication parameter of an image acquisition end and thereby generating communication requirement information, determining target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, constructing a data communication channel between the image processing end and the image acquisition end according to the target communication parameters and triggering an operation of transmitting an image to be processed to the image processing end so as to obtain a target processed image by performing an image processing operation on the image to be processed through the image processing end, and by predetermining the first and second communication parameters of the image processing end and the image acquisition end and generating communication requirement information based on these parameters, the compatibility and efficiency of communication between the two parties can be ensured, and it is also beneficial to improve the efficiency and stability of data transmission. , and by defining the target communication parameters in detail, including interface communication parameters, serial port communication parameters, communication protocol parameters, etc., the accuracy and consistency of the data transmission process can be ensured, which helps to reduce the risk of data loss, damage or misunderstanding, thereby enhancing the reliability of the entire system. By accurately matching the communication parameters of the image processing end and the image acquisition end, it can ensure that the resources in the data transmission process are fully utilized, which helps to reduce unnecessary resource consumption and waste, and improves the resource utilization and energy efficiency of the entire system, which in turn is beneficial to improving the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, as well as improving the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0165] In yet another optional embodiment, Figure 4 As shown, the debugging module 304 transmits the target processed image to the predetermined data interaction terminal through the image storage terminal and the predetermined communication parameters, so as to perform the image data interaction operation on the target processed image through the data interaction terminal, and the specific method of obtaining the image effect debugging result corresponding to the image to be processed includes:

[0166] The image transmission method is determined through the image storage end and the predetermined communication parameters, and the target processed image is transmitted to the predetermined data interaction end based on the image transmission method, so as to perform online debugging operations on the target processed image through the data interaction end to obtain the image effect debugging result corresponding to the image to be processed.

[0167] It can be seen that implementation Figure 4The described device can determine the image transmission mode through the image storage end and the communication parameters, and transmit the target processed image to the data interaction end based on the image transmission mode so as to perform online debugging operations on the target processed image through the data interaction end to obtain the corresponding image effect debugging results. The processed image can be directly transmitted to the data interaction end in an online manner, thereby realizing instant image effect debugging. Compared with the traditional offline processing or manual transmission mode, the efficiency of image processing and debugging can be significantly improved. In addition, the online debugging allows the developer or user to quickly adjust the image processing parameters according to the real-time feedback until a satisfactory image effect is achieved. The automated transmission and debugging reduces manual participation, especially reduces the workload of manual transmission and inspection of images between different devices or systems. Through efficient communication protocols and parameter optimization, the bandwidth and storage resource consumption in the data transmission process can be reduced, further reducing costs, and can be conducive to further improving the intelligence and efficiency of image processing and image effect debugging, thereby also being conducive to improving the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, and being conducive to improving the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0168] In yet another optional embodiment, Figure 4 As shown, the device also includes:

[0169] The acquisition module 309 is used to acquire the current scene information corresponding to the image to be processed before the processing module 302 transmits the image to be processed to the predetermined image processing end so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image;

[0170] The determination module 305 is further used to determine the processing requirement parameters corresponding to the image to be processed based on the image processing requirement, and generate image processing parameters of the image to be processed based on the processing requirement parameters, wherein the image processing parameters include one or more of image exposure processing parameters, image saturation processing parameters, and image sharpening processing parameters;

[0171] The processing module 302 transmits the image to be processed to a predetermined image processing end so that the image processing end performs image processing operations on the image to be processed. The specific method of obtaining the target processed image includes:

[0172] The image to be processed is transmitted to a predetermined image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain a target processed image.

[0173] It can be seen that implementation Figure 4The described device can obtain current scene information corresponding to the image to be processed, determine image processing requirements based on the current scene information, determine processing requirement parameters corresponding to the image to be processed based on the image processing requirements, and then generate image processing parameters for the image to be processed, and transmit the image to be processed to the image processing end, so that the image processing end performs image processing operations matching the image processing parameters on the image to be processed to obtain the target processed image. By obtaining the current scene information of the image to be processed, the characteristics of the image and the areas that need to be improved can be more accurately identified, so as to determine the image processing requirements in a targeted manner, so that the image processing is more accurate and the image processing is more matched with the requirements of the current scene, and the image quality requirements in various scenarios can be met. According to the determined image processing requirements, corresponding image processing parameters (such as exposure, saturation, sharpening, etc.) can be generated, and the image quality can be adjusted more finely. By automatically generating and applying image processing parameters, the links of manual intervention are reduced, and the processing efficiency is improved, which is conducive to significantly improving the pertinence and effect of image processing, while improving the processing efficiency and enhancing the user experience.

[0174] In yet another optional embodiment, Figure 4 As shown, the device also includes:

[0175] The generating module 310 is used to obtain a configuration file corresponding to the FPGA platform and generate a target image file based on the configuration file and a predetermined development tool before the determining module 305 determines the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information;

[0176] The processing module 302 is further used to perform a target configuration operation on a predetermined image storage terminal based on the target image file;

[0177] The target image file includes at least one or more of I2C configuration parameters, clock configuration parameters, and interface configuration parameters.

[0178] It can be seen that implementation Figure 4The described device can obtain the configuration file corresponding to the FPGA platform, generate the target image file based on the configuration file and the development tool, and perform the target configuration operation on the image storage end based on the target image file. The configuration file can flexibly define various parameters of the FPGA platform, such as I2C configuration parameters, clock configuration parameters, interface configuration parameters, etc. When it is necessary to adapt to different image processing requirements or hardware environments, it is only necessary to modify the corresponding parameters in the configuration file and regenerate the target image file to achieve rapid configuration and adjustment of the system without large-scale changes to the hardware. Using a predetermined development tool, the parameters in the configuration file can be automatically converted into a format recognizable by the FPGA, and a target image file can be generated, which greatly simplifies the complexity and error rate of manual configuration of the FPGA. The target image file generated by the configuration file and the development tool can ensure that various parameters of the FPGA are accurately configured, avoiding system errors or instability caused by improper manual configuration. The I2C configuration parameters contained in the target image file enable the FPGA to support multiple communication protocols and interfaces, such as I2C, SPI, UART, etc. This helps to achieve efficient communication and data transmission between the FPGA and the image acquisition end, image processing end and image storage end, and can help to further improve the intelligence and efficiency of image processing and image effect debugging, and thus help to improve the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, and help to improve the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0179] In yet another optional embodiment, Figure 4 As shown, the debugging module 304 transmits the target processed image to a predetermined data interaction terminal based on the image transmission mode, so as to perform an online debugging operation on the target processed image through the data interaction terminal, and the specific method of obtaining the image effect debugging result corresponding to the image to be processed includes:

[0180] Based on the image transmission mode, the target processing image is transmitted to a predetermined data interaction terminal, so as to perform an image data interaction operation on the target processing image through an image interaction debugging model included in the data interaction terminal, and obtain interactive debugging image data;

[0181] Determine whether the interactive debugging image data meets the preset image debugging conditions;

[0182] When it is determined that the interactive debugging image data meets the preset image debugging condition, an image effect debugging result corresponding to the image to be processed is generated based on the interactive debugging image data;

[0183] When it is determined that the interactive debugging image data does not satisfy the preset image debugging conditions, the execution is re-triggered to transmit the target processed image to a predetermined data interaction terminal, so as to perform image data interaction operations on the target processed image through the image interactive debugging model included in the data interaction terminal, obtain the interactive debugging image data, and determine whether the interactive debugging image data satisfies the preset image debugging conditions.

[0184] It can be seen that implementation Figure 4 The described device can transmit the target processed image to the data interaction end based on the image transmission method so as to perform image data interaction operation on the target processed image through the image interaction debugging model to obtain interaction debugging image data, and judge whether the interaction debugging image data meets the preset image debugging conditions. If so, the image effect debugging result of the image to be processed is generated based on the interaction debugging image data. If not, the operation of transmitting the target processed image to the data interaction end so as to perform image data interaction operation on the target processed image through the image interaction debugging model and judge whether the interaction debugging image data meets the image debugging conditions is re-executed. The target processed image can be subjected to detailed data interaction operation through the image interaction debugging model, and various parameters of the image can be analyzed and adjusted more accurately. , such as brightness, contrast, color, etc., to achieve the expected visual effect, and when the interactive debugging image data does not meet the preset conditions, the image transmission and debugging process is automatically re-triggered without manual intervention, thus realizing the automation of the debugging process. By continuously iterating the execution of image transmission, debugging and judgment operations, the image effect can be gradually optimized until the preset conditions are met, thus ensuring the continuous improvement of image quality. Through precise image debugging and iterative optimization, it can be ensured that the final output image quality meets or exceeds user expectations, thus improving the user's visual experience and satisfaction, which in turn is beneficial to improving the accuracy and reliability of the image effect debugging results of the subsequent generation of ISP images, as well as the intelligence and efficiency of the image effect debugging results of the subsequent generation of ISP images.

[0185] Embodiment 4

[0186] See also Figure 5 , Figure 5 FIG. 1 is a schematic diagram of the structure of another ISP image effect debugging device disclosed in an embodiment of the present invention. Figure 5 As shown, the debugging device for the ISP image effect may include:

[0187] A memory 401 storing executable program codes;

[0188] a processor 402 coupled to the memory 401;

[0189] The processor 402 calls the executable program code stored in the memory 401 to execute the steps in the debugging method of the ISP image effect described in the first embodiment of the present invention or the second embodiment of the present invention.

[0190] Embodiment 5

[0191] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the steps in the debugging method of ISP image effects described in Embodiment 1 or Embodiment 2 of the present invention.

[0192] Embodiment 6

[0193] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps in the debugging method of the ISP image effect described in Embodiment 1 or Embodiment 2.

[0194] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0195] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0196] Finally, it should be noted that the debugging method and device for ISP image effects disclosed in the embodiments of the present invention disclose only the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for debugging ISP image effects, characterized in that: The method comprises: Acquiring an image to be processed, and transmitting the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image; The target processed image is transmitted to a predetermined image storage terminal, and through the image storage terminal and predetermined communication parameters, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain image effect debugging results corresponding to the image to be processed.

2. The debugging method of ISP image effect according to claim 1, characterized in that: After transmitting the image to be processed to a predetermined image processing end so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image, the method further includes: Determining a target image format corresponding to the target processed image, and judging whether the target image format matches a predetermined reference image format; When it is determined that the target image format does not match the predetermined reference image format, a format conversion operation is performed on the target processed image to obtain a format conversion result, and the target processed image is updated based on the format conversion result.

3. The debugging method of ISP image effect according to claim 2, characterized in that: Before transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed by the image processing end to obtain a target processed image, the method further includes: Determining a first communication parameter of an image processing end and a second communication parameter of an image acquisition end corresponding to the image to be processed, and generating communication requirement information based on the first communication parameter and the second communication parameter; Based on the communication requirement information, determine target communication parameters between the image processing end and the image acquisition end, wherein the target communication parameters include one or more of interface communication parameters, serial port communication parameters, and communication protocol parameters; According to the target communication parameters, a data communication channel is established between the image processing end and the image acquisition end, and the operation of transmitting the image to be processed to a predetermined image processing end is triggered so that the image processing operation is performed on the image to be processed through the image processing end to obtain a target processed image.

4. The debugging method of ISP image effect according to claim 1, characterized in that: The target processed image is transmitted to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform an image data interaction operation on the target processed image through the data interaction terminal to obtain an image effect debugging result corresponding to the image to be processed, including: The image transmission method is determined through the image storage end and the predetermined communication parameters, and the target processed image is transmitted to the predetermined data interaction end based on the image transmission method, so as to perform online debugging operations on the target processed image through the data interaction end to obtain the image effect debugging result corresponding to the image to be processed.

5. The debugging method of ISP image effect according to claim 2, characterized in that: Before transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed by the image processing end to obtain a target processed image, the method further includes: Acquire current scene information corresponding to the image to be processed, and determine image processing requirements of the image to be processed based on the current scene information; Based on the image processing requirement, determining processing requirement parameters corresponding to the image to be processed, and generating image processing parameters of the image to be processed based on the processing requirement parameters, wherein the image processing parameters include one or more of image exposure processing parameters, image saturation processing parameters, and image sharpening processing parameters; The step of transmitting the image to be processed to a predetermined image processing end so as to perform an image processing operation on the image to be processed through the image processing end to obtain a target processed image includes: The image to be processed is transmitted to a predetermined image processing end, so that the image processing end performs an image processing operation matching the image processing parameters on the image to be processed to obtain a target processed image.

6. The debugging method of ISP image effect according to claim 3, characterized in that: Before determining the target communication parameters between the image processing end and the image acquisition end based on the communication requirement information, the method further includes: Obtain a configuration file corresponding to the FPGA platform, and generate a target image file based on the configuration file and a predetermined development tool; Based on the target image file, performing a target configuration operation on the predetermined image storage end; The target image file includes at least one or more of I2C configuration parameters, clock configuration parameters, and interface configuration parameters.

7. The debugging method of ISP image effect according to claim 4, characterized in that: The step of transmitting the target processed image to a predetermined data interaction terminal based on the image transmission mode, so as to perform an online debugging operation on the target processed image through the data interaction terminal, and obtaining an image effect debugging result corresponding to the image to be processed, includes: Based on the image transmission mode, the target processed image is transmitted to a predetermined data interaction terminal, so as to perform an image data interaction operation on the target processed image through an image interaction debugging model included in the data interaction terminal, and obtain interactive debugging image data; Determining whether the interactive debugging image data meets a preset image debugging condition; When it is determined that the interactive debugging image data meets the preset image debugging condition, generating an image effect debugging result corresponding to the image to be processed based on the interactive debugging image data; When it is determined that the interactive debugging image data does not satisfy the preset image debugging conditions, the operation of transmitting the target processed image to a predetermined data interaction terminal is re-triggered to perform image data interaction operations on the target processed image through the image interactive debugging model included in the data interaction terminal, to obtain interactive debugging image data and to determine whether the interactive debugging image data satisfies the preset image debugging conditions.

8. A debugging device for ISP image effect, characterized in that: The device comprises: An acquisition module, used for acquiring images to be processed; A processing module, used for transmitting the image to be processed to a predetermined image processing end, so that the image processing end performs an image processing operation on the image to be processed to obtain a target processed image; A transmission module, used for transmitting the target processed image to a predetermined image storage terminal; The debugging module is used to transmit the target processed image to a predetermined data interaction terminal through the image storage terminal and predetermined communication parameters, so as to perform image data interaction operations on the target processed image through the data interaction terminal to obtain the image effect debugging result corresponding to the image to be processed.

9. A debugging device for ISP image effect, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the debugging method for ISP image effects as described in any one of claims 1-7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the debugging method of the ISP image effect as described in any one of claims 1-7.