MIPI camera image signal processing system and method based on OpenHarmony standard system

Abstract

The invention relates to an MIPI camera image signal processing system and method based on an OpenHarmony standard system, the OpenHarmony standard system comprises an ISP processing unit, an IQ configuration, an image acquisition unit and a display control unit, and the system also comprises an ISP server remotely connected with the OpenHarmony standard system, the ISP server side is used for acquiring Sensor information of an MIPI camera on the OpenHarmony system and corresponding raw image data to complete a basic calibration module calibration process of IQ configuration so as to obtain a calibration data set of the IQ configuration, and transmitting the calibration data set back to the OpenHarmony standard system to automatically update the IQ configuration so as to output the optimal image quality in real time.

Description

Technical Field

[0001] The present invention relates to the technical field of MIPI camera image signal processing, and in particular to a MIPI camera image signal processing system and method based on an OpenHarmony standard system. Background Art

[0002] The OpenHarmony open source Hongmeng system is an operating system for all-scenario, fully connected smart terminal devices. The camera driver framework it provides can forward the data stream and process the image signal of the camera raw image, realizing the construction of a path from image data acquisition to display. Embedded devices equipped with the OpenHarmony standard system can more conveniently collect and display image data. Taking the OV4689 MIPI camera as an example, the output raw data image presents a dark green picture by default, which is far from the actual picture effect. Because the sensor inside the camera usually uses a Bayer color filter to capture color information, the number of green filters accounts for the majority, and the image often presents a dark green hue. In order to flexibly adjust and optimize the image processing effect and meet the hardware characteristics of different cameras such as sensitivity, color response and noise level, the OpenHarmony system is required to process the image signal of the raw data of the MIPI camera and convert it into a higher quality and more natural color image.

[0003] The existing OpenHarmony standard system's ISP (Image Signal Processor) image signal processing program requires an IQ (Image Quality) image quality parameter configuration file, where the IQ file contains parameters and settings for ISP processing, which are used to adjust the image sensor's parameters, image processing algorithms, white balance, exposure, etc., to optimize image quality and hardware processing performance, so as to obtain the best image quality for the camera. However, the system will not automatically update the IQ file. The generation of the IQ file requires the host computer to obtain the camera's raw image information and manually perform calibration, debugging, and other parameter adjustment work on the ISP module. The system cannot dynamically adjust the IQ configuration file according to the scene or external environment changes, resulting in the camera being difficult to adapt to possible color temperature changes under different light conditions, resulting in image color cast, and fixed exposure settings may cause overexposure or underexposure, affecting the clarity and details of the image. These fixed configurations result in the hardware performance not being fully utilized, the camera image visual quality is poor, and the system is difficult to adapt to diverse scene requirements. Summary of the invention

[0004] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a MIPI camera image signal processing system and method based on the OpenHarmony standard system, the system comprising a MIPI camera and an OpenHarmony standard system, the OpenHarmony standard system comprising an ISP processing unit, an IQ configuration, an image acquisition unit and a display control unit, the system further comprising an ISP server remotely connected to the OpenHarmony standard system, the ISP server being used to obtain the Sensor information and corresponding raw image data of the MIPI camera on the OpenHarmony system to complete the calibration process of the basic calibration module of the IQ configuration, so as to obtain a calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system, automatically updating the IQ configuration, so as to output the best image quality in real time.

[0005] Preferably, the OpenHarmony standard system also includes a data flow control unit, which is connected to the IQ configuration and image acquisition unit respectively; the ISP server includes a server flow control unit, a camera Senor configuration unit and a basic calibration module calibration unit; the server flow control unit is used for remote data interaction with the data flow control unit; the camera Senor configuration unit is used for matching camera information; the basic calibration module calibration unit is used for a basic calibration module calibration process based on the IQ configuration of raw image data to obtain a calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system through the server flow control unit.

[0006] Preferably, the calibration process of the basic calibration module includes BLC calibration for black level correction, LSC calibration for lens shading correction, AWB calibration for automatic white balance, CCM calibration for color correction matrix, and NR calibration for noise reduction processing.

[0007] Preferably, an ISP parameter debugging module is also included, and the ISP parameter debugging module is respectively connected to the basic calibration module and the server-side flow control unit, for further parameter debugging of the calibration data set of the basic calibration module, and transmitting the calibration data set after parameter debugging back to the OpenHarmony standard system through the server-side flow control unit.

[0008] Preferably, data is transmitted between the data flow control unit and the server flow control unit via the TCP transmission control protocol, wherein the transmitted data is encapsulated into a data packet of a fixed byte size, and the data is transmitted in the format of a packet header plus a packet body with a specified string as the end mark of the packet, wherein the packet header stores the camera Sensor information and the packet body stores the camera raw image data.

[0009] Preferably, the IQ configuration unit is provided with an automatic update mechanism, and the automatic update mechanism is used to cyclically detect whether the parameters of the IQ configuration file data set are modified, and if modification is detected, the IQ configuration file is automatically updated.

[0010] The present invention also provides a MIPI camera image signal processing method based on the OpenHarmony standard system. The method is based on the above system and comprises the following steps:

[0011] Step 1: The image information captured by the camera is input to the ISP processing unit through its MIPI interface;

[0012] Step 2: The ISP processing unit processes the raw image data of the MIPI camera and sends the raw image to the image acquisition unit;

[0013] Step 3: The image acquisition unit collects the raw image data processed by the ISP unit and the camera sensor information;

[0014] Step 4: The data flow control unit encapsulates the sensor information of the MIPI camera collected from the image acquisition unit and the corresponding raw image data into a data packet, and transmits it to the server flow control unit through TCP;

[0015] Step 5: The server-side flow control unit unpacks the data packet to obtain the sensor information and corresponding raw image data of the MIPI camera, wherein the obtained camera sensor information is given to the sensor configuration unit, and the obtained raw image data is sent to the basic calibration module;

[0016] Step 6: The camera sensor configuration unit matches the camera information, and sends the matched camera information to the basic calibration module;

[0017] Step 7: The basic calibration module uses the raw image data and camera information to perform a calibration process to obtain a calibration data set for the IQ configuration;

[0018] Step 8: The server-side flow control unit encapsulates the calibration data set configured by IQ into a data packet and transmits it to the data flow control unit of OpenHarmony via TCP;

[0019] Step 9: The data flow control unit decapsulates the data packet and sends the decapsulated IQ configured calibration data set data to the ISP processing unit;

[0020] Step 10: The ISP processing unit will detect in real time whether the IQ profile is updated. The detection method is to cyclically detect whether the data of the IQ profile is modified. If modified, the internal ISP program will automatically trigger to re-read the IQ profile and adjust the parameters including image sensor parameters, image processing algorithm, white balance, and exposure.

[0021] Step 11: The image acquisition unit acquires the image data processed by the ISP unit, outputs the image data to the system, and the display control unit displays it to the upper-level application.

[0022] Preferably, the method further includes an ISP parameter debugging step, which is arranged after step 7 and before step 8. The ISP parameter debugging step matches the camera information of the corresponding model, refers to the calibration data set of the IQ configuration completed in step 7, and compares it with the data set parameters of scene_isp2 in the current IQ configuration. If the error of each calibration threshold is not within the range, the corresponding calibration data is replaced.

[0023] The present invention has the following beneficial effects:

[0024] The system provided by the present invention includes a MIPI camera, an OpenHarmony standard system and an ISP server remotely connected to the OpenHarmony standard system, wherein the ISP server is used to obtain the sensor information and corresponding raw image data of the MIPI camera on the OpenHarmony system to complete the calibration process of the basic calibration module of the IQ configuration, so as to obtain the calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system, automatically update the IQ configuration, and output the best image quality in real time.

[0025] The input interface of the IQ configuration of the ISP processing unit is adjusted on the OpenHarmony standard system to detect whether the IQ configuration file is updated. The detection method is to cyclically detect whether the parameters of the IQ configuration file data set are modified. If modified, it automatically triggers the re-reading of the IQ configuration file, so that the ISP processing unit can adjust the image processing algorithm in real time without interruption. In this way, even if the IQ configuration is updated midway, the ISP processing unit can adjust the image quality of the MIPI camera according to the system's optimal processing algorithm, optimize the camera acquisition and display framework, and enhance the system's ability to process image frames.

[0026] The method provided by the present invention realizes the interconnection between the ISP server program and the multi-terminal devices under the OpenHarmony standard system, and the IQ file can be updated online in real time without the need to perform ISP parameter adjustment work in a local environment. This feedback adjustment image processing algorithm realizes the real-time output of the best image quality for the MIPI camera in a complex environment, thereby improving the visual quality of the system output image. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 A block diagram of a MIPI camera image signal processing system based on the OpenHarmony standard system provided by the present invention;

[0028] Figure 2 A flowchart of a MIPI camera image signal processing method based on the OpenHarmony standard system provided by the present invention; DETAILED DESCRIPTION

[0029] The technical solution in one embodiment of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0030] See also Figure 1-2 :

[0031] A MIPI camera image signal processing system based on an OpenHarmony standard system, the system comprises a MIPI camera and an OpenHarmony standard system, the OpenHarmony standard system comprises an ISP processing unit, an IQ configuration, an image acquisition unit, a data flow control unit and a display control unit, the data flow control unit being connected to the IQ configuration and the image acquisition unit respectively; the system also comprises an ISP server remotely connected to the OpenHarmony standard system,

[0032] The ISP server includes a server flow control unit, a camera Senor configuration unit and a basic calibration module calibration unit; the server flow control unit is used for remote data interaction with the data flow control unit; the camera Senor configuration unit is used for matching camera information; the basic calibration module calibration unit is used for the basic calibration module calibration process based on the IQ configuration of the raw image data to obtain the calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system through the server flow control unit.

[0033] The calibration process of the basic calibration module includes BLC calibration for black level correction, LSC calibration for lens shading correction, AWB calibration for automatic white balance, CCM calibration for color correction matrix, and NR calibration for noise reduction processing.

[0034] The system also includes an ISP parameter debugging module, which is respectively connected to the basic calibration module and the server-side flow control unit for further parameter debugging of the calibration data set of the basic calibration module, and transmitting the calibration data set after parameter debugging back to the OpenHarmony standard system through the server-side flow control unit.

[0035] The data flow control unit and the server flow control unit transmit data via the TCP transmission control protocol, wherein the transmitted data is encapsulated into a data packet of fixed byte size, and the data is transmitted in the format of a header plus a body and a string is specified as the end mark of the packet, wherein the header stores the camera sensor information, and the body stores the camera raw image data. The data flow control unit and the server flow control unit transmit data via the TCP (Transmission Control Protocol) transmission control protocol and the OpenHarmony standard system, and in order to prevent the TCP transmission from sticking, the data transmitted each time is encapsulated into a data packet of fixed byte size, and the data is transmitted in the format of a header plus a body and a string is specified as the end mark of the packet, wherein the header stores the camera sensor information, such as the resolution size of the current camera output, the image output format information, the output frame rate, and the label description whether it is used as the image information of the calibration process; the body stores the camera raw image data, such as the original BGGR pixel data, which is the image used normally or the image required for the calibration process. The ISP server program will unpack the encapsulated data packets transmitted by TCP, thereby obtaining the sensor information and corresponding raw image data of the MIPI camera on the OpenHarmony system to complete the basic module calibration process.

[0036] To realize automatic update of the IQ configuration file of the IQ configuration unit, the IQ configuration unit is provided with an automatic update mechanism, which is used to cyclically detect whether the parameters of the IQ configuration file data set are modified. If a modification is detected, the IQ configuration file is automatically updated.

[0037] The present invention also provides a MIPI camera image signal processing method based on the OpenHarmony standard system. The method is based on the above system and comprises the following steps:

[0038] Step 1: The image information captured by the camera is input to the ISP processing unit through its MIPI interface;

[0039] Step 2: The ISP processing unit processes the raw image data of the MIPI camera and sends the raw image to the image acquisition unit;

[0040] Step 3: The image acquisition unit collects the raw image data processed by the ISP unit and the camera sensor information;

[0041] Step 4: The data flow control unit encapsulates the sensor information of the MIPI camera collected from the image acquisition unit and the corresponding raw image data into a data packet, and transmits it to the server flow control unit through TCP;

[0042] Step 5: The server-side flow control unit unpacks the data packet and obtains the sensor information and corresponding raw image data of the MIPI camera. The obtained camera sensor information is given to the sensor configuration unit, and the obtained raw image data is sent to the basic calibration module.

[0043] Step 6: The camera sensor configuration unit matches the camera information, and sends the matched camera information to the basic calibration module;

[0044] Step 7: The basic calibration module uses the raw image data and camera information to perform the calibration process and obtain the calibration data set of the IQ configuration;

[0045] Step 8: The server-side flow control unit encapsulates the calibration data set configured by IQ into a data packet and transmits it to the data flow control unit of OpenHarmony via TCP;

[0046] Step 9: The data flow control unit decapsulates the data packet and sends the decapsulated IQ configured calibration data set data to the ISP processing unit;

[0047] Step 10: The ISP processing unit will detect in real time whether the IQ profile is updated. The detection method is to cyclically detect whether the data of the IQ profile is modified. If modified, the internal ISP program will automatically trigger to re-read the IQ profile and adjust the parameters including image sensor parameters, image processing algorithm, white balance, and exposure.

[0048] Step 11: The image acquisition unit acquires the image data processed by the ISP unit, outputs the image data to the system, and the display control unit displays it to the upper-level application.

[0049] Since there are more or less parameter data errors in each calibration link, it is necessary to debug the calibration result, that is, the parameters of the data set of the IQ configuration, to further improve the visual quality of the system output image. The method also includes an ISP parameter debugging step. The ISP parameter debugging step is arranged after step 7 and before step 8. The ISP parameter debugging step matches the camera information of the corresponding model, and refers to the calibration data set of the IQ configuration completed in step 7, and compares it with the data set parameters of scene_isp2 in the current IQ configuration. If the error of each calibration threshold is not within the range, the corresponding calibration data is replaced, wherein the current IQ configuration refers to the IQ configuration data set that has been calibrated by the ISP server.

[0050] The following is a specific example to illustrate how to calibrate the basic module and debug the ISP parameters for the original image:

[0051] If the original image is as follows:

[0052] BLC (Black Level Correction) The black area appears uneven gray or color.

[0053] LSC (Lens Shading Correction) is a problem where the brightness or color of the edge area of ​​the image is inconsistent with the center area.

[0054] The G green pixel channel accounts for a large proportion of the original BGGR pixel data of the AWB (Auto White Balance) camera, resulting in image color deviation

[0055] CCM (Color Correction Matrix) camera sensor color spectrum distribution is difficult to completely match the human eye visual color distribution, correcting the color deviation in the image.

[0056] NR (Noise Reduce) Image Noise

[0057] FEC / LDC (Fish Eye Correction / Lens Distortion Correction) Fisheye and lens distortion cause geometric distortion of the image.

[0058] Calibrate the original image with the basic module:

[0059] BLC (Black Level Correction) calibration, that is, black level correction. The program defaults to setting Gain to 1x, ExpTime = 0.01, that is, the exposure time is set to 10ms, and the Gain value is automatically incremented to 1x, 2x, 4x, 8x...32x, so that the gray value of the BLC calibration sampling image is calibrated to 0, that is, a completely black screen, and the BLC calibration is completed.

[0060] LSC (Lens Shading Correction) calibration, that is, lens shading correction. Adjust the brightness value of the image periphery, and perform brightness value correction on the four channel data of Bayer, that is, the BGGR image data pixels, so that the brightness difference at the dark edge of the LSC calibration sampling image is not less than 70%, set the maximum brightness configuration to 200±10%, and switch the standard light sources HZ, A, CWF, TL84, D50, D65, and D75 in sequence. During this period, the appropriate exposure will be automatically selected until the preset maximum brightness value range is met, and the LSC calibration is completed.

[0061] AWB (Auto White Balance) calibration, that is, automatic white balance. Since the G green pixel channel accounts for a large proportion of the camera's original BGGR pixel data, it is necessary to compensate the R and B pixel channels to correct the deviation in image color. Match the camera information during calibration, import the built-in 1-frame X-rite24 color card image, and import the light source configuration A, CWF, D50, D65, D75, HZ, TL84 in sequence according to the light conditions of the object being photographed, adjust the color temperature of the image, and increase the proportion of BG channel and B pixel channel data to 50% ± 5% based on the warm yellow-red color in low color temperature occasions, so that the RGB three channel data arrangement of the AWB calibration sampling image is balanced, and the AWB calibration is completed.

[0062] CCM (Color Correction Matrix) calibration, that is, color correction matrix. Because the color spectrum distribution of the camera sensor is difficult to completely match the color distribution of human vision, the color deviation in the image is corrected. Based on the AWB calibration, the overall saturation of the raw image is set to 100%, and the R Gain and B Gain gain values ​​are adjusted to 1. After comparing the image brightness and saturation in the LAB space area with the standard color card image, the overall saturation of the raw image is gradually adjusted to 76% based on the color card image, and the CCM calibration is completed.

[0063] NR (Noise Reduce) calibration. It is a noise reduction process. The noise generated by the image sensor under different lighting conditions needs to be reduced to improve the quality and clarity of the image. When performing NR calibration, the BGGR raw pixel data is divided into 4 channels for separate processing. According to the noise distribution of the sampled image data, the bayernr denoising algorithm is internally executed to perform corresponding filtering on the raw image. For edge problems in the image, spatial filtering is performed to remove high-frequency or low-frequency components, so that the image grayscale value changes are not so large to reduce marginalization or increase the contrast of the image grayscale value in certain areas to improve marginalization, so that the total number of noise distribution in the sampled image data is reduced. When the calibration process reaches the threshold, the NR calibration is completed.

[0064] FEC / LDC (Fish Eye Correction / Lens Distortion Correction) calibration, namely fisheye correction and lens distortion correction. It is used to correct and optimize image quality, eliminate non-uniformity in sensors and optics, and correct geometric distortion of lenses. When performing FEC / LDCH calibration, match the camera information, import the built-in 1-frame black and white chessboard image, configure the fec_correct_direction_t type variable to 0x1 to enable correction only in the X direction, calculate the number of inner corner points in the vertical direction of the chessboard superimposed on the raw image, then locate the inner corner image pixel area, adjust the inner corner angle in the vertical direction, and sequentially set the ldch correction level from 0 to 255, so that the vertical inner corner of the black and white chessboard image pixel superimposed on the raw image is 90 degrees vertical, and then the FEC / LDC calibration is completed.

[0065] The ISP server program finally debugs the ISP parameters. Since there are more or less parameter data errors in each calibration link, it is necessary to debug the calibration results, that is, the data set parameters of the IQ configuration. The program will match the camera information of the corresponding model, refer to the IQ file that has completed the standard calibration process, and compare it with the data set parameters of scene_isp2 in the current IQ configuration. If the error of each calibration threshold is not within the range, the corresponding calibration data will be replaced and the IQ file will be generated:

[0066] If there is an error in the grayscale calibration of the BLC calibration sampling image, the BLC calibration parameter debugging compares the values ​​of the R_Channel, Gr_Channel, Gb_Channel, and B_Channel arrays of BLC_Data in the ablc_calib->BlcTuningPara node. If the comparison value difference is within the range of ±5, the node data of BLC_Data is replaced.

[0067] If the LSC calibration sampling image does not meet the preset maximum brightness value range, the LSC calibration parameter debugging will compare the values ​​of the lsc_v2->common node and the lsc_v2->alscCoef node. The lsc_v2->common node replaces the XY domain values ​​of lsc_sect_size_x and lsc_sect_size_y. The lsc_v2->alscCoef node replaces the gains brightness gain value of the standard light source HZ, A, CWF, TL84, D50, D65, and D75 configuration information.

[0068] If the data arrangement of the three RGB channels of the AWB calibration sampled image is not balanced, the AWB calibration parameter debugging compares the values ​​of the wb_v21->autoPara node and the wb_v21->autoExtPara node. The wb_v21->autoPara node adjusts the xyRegion node in lightSources and replaces the normal and big child node data sets, that is, replaces the values ​​of the middle frame white point interval and the big frame white point interval; the wb_v21->autoExtPara node replaces the partition strategy value of the WBGain category.

[0069] If the CCM calibration does not adjust the overall saturation of the raw image to 76%, the CCM calibration parameter debugging will compare the values ​​of the ccm_calib->TuningPara->aCcmCo node and ccm_calib->TuningPara->matrixAll node. The ccm_calib->TuningPara->aCcmCof node automatically selects the parameters of the corresponding light source based on the white balance gain. Different exposure gains can be configured for different saturations under each standard light source, replacing the awbGain value of the corresponding light source configuration; replace the ccMatrix color correction matrix value with the ccm_calib->TuningPara->matrixAll node.

[0070] If the total number of noise points in the NR calibration sampled image data does not reach the actual processing threshold, the NR calibration parameter debugging compares the values ​​of the bayernr_v2->CalibPara node and the bayernr_v2->Bayernr2D node. The bayernr_v2->CalibPara node replaces the values ​​of lumapoint and sigma, which are used in the bayernr denoising algorithm to describe the different noise sigma curve points corresponding to different pixel brightness; the bayernr_v2->Bayernr2D node replaces the filter_strength denoising strength parameter and the ratio soft threshold weight.

[0071] If the FEC / LDCH calibration sampling image does not meet 90 degrees verticality in the vertical direction, the FEC / LDCH calibration parameter debugging sets the correctLevel calibration level of the aldch node to 255, and directly replaces the coefficient value of the aldch->light_center node ldch->coefficient node.

[0072] The above are only embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A MIPI camera image signal processing system and method based on the OpenHarmony standard system, the system comprising a MIPI camera and an OpenHarmony standard system, the OpenHarmony standard system comprising an ISP processing unit, an IQ configuration, an image acquisition unit and a display control unit, characterized in that: The system also includes an ISP server remotely connected to the OpenHarmony standard system. The ISP server is used to obtain the sensor information and corresponding raw image data of the MIPI camera on the OpenHarmony system to complete the calibration process of the basic calibration module of the IQ configuration, so as to obtain the calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system, automatically update the IQ configuration, and output the best image quality in real time.

2. The MIPI camera image signal processing system based on the OpenHarmony standard system according to claim 1, characterized in that: The OpenHarmony standard system also includes a data flow control unit, which is connected to the IQ configuration and image acquisition unit respectively; the ISP server includes a server flow control unit, a camera Senor configuration unit and a basic calibration module calibration unit; The server flow control unit is used to perform remote data interaction with the data flow control unit; The camera Senor configuration unit is used for matching camera information; the basic calibration module calibration unit is used for the basic calibration module calibration process based on the IQ configuration of the raw image data to obtain the calibration data set of the IQ configuration, and transmit the calibration data set back to the OpenHarmony standard system through the server flow control unit.

3. The MIPI camera image signal processing system based on the OpenHarmony standard system according to claim 1, characterized in that: The calibration process of the basic calibration module includes BLC calibration for black level correction, LSC calibration for lens shading correction, AWB calibration for automatic white balance, CCM calibration for color correction matrix, and NR calibration for noise reduction processing.

4. The MIPI camera image signal processing system based on the OpenHarmony standard system according to claim 1, characterized in that: The ISP server also includes an ISP parameter debugging module, which is respectively connected to the basic calibration module and the server flow control unit to further debug the parameters of the calibration data set of the basic calibration module, and transmit the calibration data set after parameter debugging back to the OpenHarmony standard system through the server flow control unit.

5. The MIPI camera image signal processing system based on the OpenHarmony standard system according to claim 1, characterized in that: The data flow control unit and the server flow control unit transmit data via the TCP transmission control protocol, wherein the transmitted data is encapsulated into a data packet of a fixed byte size, and the data is transmitted in the format of a packet header plus a packet body with a specified string as the end mark of the packet, wherein the packet header stores the camera sensor information and the packet body stores the camera raw image data.

6. The MIPI camera image signal processing system based on the OpenHarmony standard system according to claim 1, characterized in that: The IQ configuration unit is provided with an automatic update mechanism, which is used to cyclically detect whether the parameters of the IQ configuration file data set are modified. If a modification is detected, the IQ configuration file is automatically updated.

7. A MIPI camera image signal processing method based on the OpenHarmony standard system, the method being based on the MIPI camera image signal processing system based on the OpenHarmony standard system according to any one of claims 1 to 6, the method comprising: Follow these steps: Step 1: The image information captured by the camera is input to the ISP processing unit through its MIPI interface; Step 2: The ISP processing unit processes the raw image data of the MIPI camera and sends the raw image to the image acquisition unit; Step 3: The image acquisition unit collects the raw image data processed by the ISP unit and the camera sensor information; Step 4: The data flow control unit transmits the sensor information of the MIPI camera and the corresponding raw image data collected from the image acquisition unit to the server flow control unit; Step 5: The server-side flow control unit obtains the sensor information and corresponding raw image data of the MIPI camera, wherein the obtained camera sensor information is sent to the sensor configuration unit, and the obtained raw image data is sent to the basic calibration module; Step 6: The camera sensor configuration unit matches the camera information, and sends the matched camera information to the basic calibration module; Step 7: The basic calibration module uses the raw image data and camera information to perform a basic calibration process to obtain a calibration data set for the IQ configuration; Step 8: The server-side flow control unit transmits the calibration data set configured by IQ to the data flow control unit of OpenHarmony; Step 9: The data flow control unit sends the calibration data set data configured by IQ to the ISP processing unit; Step 10: The ISP processing unit will detect in real time whether the IQ profile is updated. The detection method is to cyclically detect whether the data of the IQ profile is modified. If modified, the internal ISP program will automatically trigger to re-read the IQ profile and adjust the parameters including image sensor parameters, image processing algorithm, white balance, and exposure. Step 11: The image acquisition unit acquires the image data processed by the ISP unit, outputs the image data to the system, and the display control unit displays it to the upper-level application.

8. The MIPI camera image signal processing method based on the OpenHarmony standard system according to claim 7, characterized in that: The method also includes an ISP parameter debugging step, which is arranged after step 7 and before step 8. The ISP parameter debugging step matches the camera information of the corresponding model, refers to the calibration data set of the IQ configuration completed in step 7, and compares it with the data set parameters of scene_isp2 in the current IQ configuration. If the error of each calibration threshold is not within the range, the corresponding calibration data is replaced.

Images