Image processing chip detection method and device and electronic equipment

Abstract

The invention discloses a detection method and device of an image processing chip and electronic equipment. The method is applied to an image processing chip, the image processing chip comprises a first processing unit and a second processing unit, the first processing unit is used for processing and / or transmitting mobile industry processor interface MIPI data of a preview image, and the second processing unit is used for processing the preview image; the method comprises the following steps: detecting the first processing unit and / or the second processing unit to obtain a detection result; and recovering the abnormal first processing unit and / or the abnormal second processing unit according to the detection result.

Description

Technical Field

[0001] The present application belongs to the field of image processing, and specifically relates to a detection method, device and electronic equipment for an image processing chip. Background Art

[0002] Mobile phone imaging has been one of the important research directions for major manufacturers in recent years as a means of technological innovation and improving user experience. Usually, the chip is equipped with a neural-network processing unit (NPU) to process image data to accelerate photo taking or previewing. When implementing chips equipped with NPU in engineering, the preview pipeline is usually set in the preview mobile industry processor interface (MIPI) transmission channel, which makes it difficult to find a time to recover when the preview channel or MIPI transmission channel is abnormal, thus affecting the processing of preview images. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a method, device and electronic device for detecting an image processing chip, so as to solve the problem that it is difficult to recover when an abnormality occurs in a preview channel or a MIPI transmission channel.

[0004] In order to solve the above technical problems, this application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a detection method for an image processing chip, which is applied to an image processing chip, wherein the image processing chip comprises: a first processing unit and a second processing unit, wherein the first processing unit is used to process and / or transmit mobile industry processor interface MIPI data of a preview image, and the second processing unit is used to process the preview image;

[0006] The method comprises:

[0007] Performing a test on the first processing unit and / or the second processing unit to obtain a test result;

[0008] The abnormal first processing unit and / or the abnormal second processing unit is restored according to the detection result.

[0009] In a second aspect, an embodiment of the present application provides a detection device for an image processing chip, which is applied to an image processing chip, wherein the image processing chip includes: a first processing unit and a second processing unit, wherein the first processing unit is used to process and / or transmit MIPI data of a preview image, and the second processing unit is used to process the preview image;

[0010] The device comprises:

[0011] A detection module, used to detect the first processing unit and / or the second processing unit to obtain a detection result;

[0012] A recovery processing module is used to recover the abnormal first processing unit and / or the second processing unit according to the detection result.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0014] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0015] In a fifth aspect, an embodiment of the present application further provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0016] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0017] In the embodiments of the present application, the unit for processing and / or transmitting MIPI data and the unit for processing preview images in the image processing chip are independently arranged, and the two do not interfere with each other. When an abnormality is detected in a certain unit, the abnormal unit can be restored in a targeted manner without restoring the entire algorithm of the image processing chip, thereby ensuring that when one unit is abnormal, another unit can process data normally, avoiding waste of resources and improving image processing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 is a flow chart of a detection method of an image processing chip according to an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of a processing channel inside an image processing chip according to an embodiment of the present application;

[0020] Figure 3 is a schematic structural diagram of a detection device for an image processing chip according to an embodiment of the present application;

[0021] Figure 4 It is one of the structural schematic diagrams of the electronic device according to the embodiment of the present application;

[0022] Figure 5 This is the second structural schematic diagram of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0024] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0025] The following, in conjunction with the accompanying drawings, describes in detail the detection method, device and electronic device of the image processing chip provided in the embodiments of the present application through specific embodiments and their application scenarios.

[0026] like Figure 1 As shown, an embodiment of the present application provides a detection method for an image processing chip, which is applied to an image processing chip, wherein the image processing chip includes: a first processing unit and a second processing unit, wherein the first processing unit is used to process and / or transmit mobile industry processor interface MIPI data of a preview image, and the second processing unit is used to process the preview image;

[0027] The method comprises:

[0028] Step 101: Detect the first processing unit and / or the second processing unit to obtain a detection result;

[0029] Step 102: Restore the abnormal first processing unit and / or the abnormal second processing unit according to the detection result.

[0030] In this embodiment, the electronic device may include an application processor (AP) and an image processing chip. The AP is the main chip of the electronic device, which can handle data tasks of the device, control the user interface, process graphics and audio, and manage network communications. The image processing chip can be an external chip, and it can also be understood that the image processing chip is a newly added chip on the electronic device for image processing. The AP and the image processing chip are connected to perform data transmission.

[0031] Optionally, the image processing chip may be an external chip equipped with a neural network processor (Neural-network Processing Unit, NPU). For example, if the NPU is set in the image processing chip, the NPU may perform image processing.

[0032] The photosensitive sensor (sensor) obtains image data and transmits the image data to the image processing chip. The image processing chip includes a first processing unit and a second processing unit. The first processing unit and the second processing unit are two independent image processing units for processing different image data. Among them, the first processing unit can be used to process and / or transmit MIPI data, and it can also be understood that the first processing unit is used to process data that needs to be sent to the AP through the MIPI protocol. Optionally, the processing is physical layer processing, such as data encoding, modulation, and signal conversion (such as converting data into a signal form). It should be noted that the first processing unit may also only transmit data without processing the data, for example, sending the data transmitted by the sensor to the AP through an analog channel (Analog bypass). The image processing chip transmits the image data sent by the photosensitive sensor to the AP, and the user can see the preview image.

[0033] The second processing unit is used to process and cache the preview image. The processing can be understood as processing of image parameters, such as adjusting image parameters (such as size, color, resolution, etc.) according to parameters set by the user, built-in parameters of the camera, etc.

[0034] For example Figure 2As shown: the photosensitive sensor (sensor) represents the camera of the electronic device. After the photosensitive sensor of the camera collects data, it transmits the image data to the image processing chip line by line. The image processing chip completes the reception of the data through the receiving interface (receive, RX). At this time, the data can be processed or transmitted by the first processing unit. The first processing unit includes a digital channel (Digital bypass) and an analog channel (Analog bypass). Among them, the image processing chip can choose to process through the MIPI port physical layer (Physical, PHY) (referring to Figure 2 digital channels in the MIPIPHY), or without MIPIPHY processing (that is, after Figure 2 analog channels in ).

[0035] If MIPIPHY is selected for processing, the image data is bypassed by Digital and then transmitted to the AP through the output interface (Transmit, TX) using the MIPI protocol. In addition, the image processing chip can also selectively use the second processing unit to process the preview image and cache the processing results. The second processing unit may include Figure 2 The preview pipeline in . Figure 2 As shown in the figure, the channel for processing MIPI data (Digital bypass, Analog bypass) and the preview pipeline are independent channels and do not interfere with each other.

[0036] The image processing chip can monitor the first processing unit and / or the second processing unit respectively, and recover the abnormal processing unit. For example, the image processing chip performs self-checks on the digital bypass and preview pipeline respectively, determines whether each channel is abnormal, and recovers the abnormal channel.

[0037] Optionally, in the embodiments of the present application, restoring the processing unit can be understood as restoring the channel, such as restoring the Digital bypass or preview pipeline. The recovery refers to determining the cause of the channel abnormality according to the detection results, and processing the abnormality to restore it to a normal state. For example, if the preview pipeline is abnormal, it is determined according to the detection results that the cause of the abnormality is a processing abnormality of a certain processing node, and the processing node is adjusted; another example: if the preview pipeline is abnormal, it is determined according to the detection results that the cause of the abnormality is interference, and the interference is processed; another example: if the preview pipeline is abnormal, it is determined according to the detection results that a certain algorithm parameter of the image processing chip for image processing is wrong, and the parameter is corrected. In the embodiments of the present application, the specific abnormal conditions and recovery methods are not limited.

[0038] In the embodiments of the present application, the unit for processing and / or transmitting MIPI data and the unit for processing preview images in the image processing chip are independently arranged, and the two do not interfere with each other. When an abnormality is detected in a certain unit, the abnormal unit can be restored in a targeted manner without restoring the entire algorithm of the image processing chip, thereby ensuring that when one unit is abnormal, another unit can process data normally, avoiding waste of resources and improving image processing efficiency.

[0039] As an optional embodiment, detecting the first processing unit and / or the second processing unit to obtain a detection result includes:

[0040] When the first processing unit processes any frame of image, determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit;

[0041] and / or,

[0042] When the second processing unit processes any frame of image, the detection result of the second processing unit is determined according to the processing result of the processing node of the second processing unit on the image.

[0043] In this embodiment, when the processing unit is detected, it can be determined whether the processing unit is abnormal based on the image input to the processing unit and the image output by the processing unit. For example, the image processing chip receives image data sent by the photosensitive sensor, and sends it to the AP after being processed by the first processing unit (or transmitted without processing). The image data input to the first processing unit is called the first image, and the data output by the first processing unit is called the second image. Whether the first processing unit is abnormal can be determined based on the first image and the second image.

[0044] Alternatively, when the processing unit is detected, it can be determined whether the processing unit is abnormal based on the image processing results of the internal nodes of the processing unit. For example, the second processing unit includes multiple processing nodes, and the processing nodes can be various algorithm nodes when processing images.

[0045] Optionally, the detecting the first processing unit and / or the second processing unit to obtain a detection result further includes:

[0046] When the detection results corresponding to N consecutive frames of images processed by the first processing unit and / or the second processing unit are all abnormal, it is determined that the first processing unit and / or the second processing unit is abnormal.

[0047] In this embodiment, when the first processing unit and / or the second processing unit are tested and the test results are obtained, it can be determined whether the processing unit is abnormal based on the test results of the processing unit processing N consecutive frames of images. For example, if the test results of the first processing unit processing N consecutive frames of images are all abnormal, then the first processing unit is determined to be abnormal; if the test results of the second processing unit processing M consecutive frames of images are all abnormal, then the second processing unit is determined to be abnormal.

[0048] As an optional embodiment, determining the detection result of the first processing unit according to the first image input to the first processing unit and the second image output by the first processing unit includes:

[0049] A detection result of the first processing unit is determined according to the number of rows of the first image and the number of rows of the second image.

[0050] In this embodiment, the first image is the image transmitted by the photosensitive sensor to the first processing unit, and the second image is the image output by the first processing unit to the AP. A fixed number of rows are preset for both the first image and the second image. If it is detected that the number of rows of the first image is different from the preset number of rows, it is considered that the timing of the photosensitive sensor outputting the image is abnormal and the photosensitive sensor is abnormal. If it is detected that the number of rows of the second image is different from the preset number of rows, it is considered that the timing of the first processing unit outputting the image is abnormal and the first processing unit is abnormal.

[0051] Optionally, the method further includes:

[0052] Sending the detection result of the first processing unit to the AP;

[0053] The detection result of the first processing unit includes one of the following:

[0054] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is normal;

[0055] The image output timing of the first processing unit is normal, and the image output timing of the sensor is abnormal;

[0056] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is abnormal;

[0057] The image output timing of the first processing unit is normal, and the image output timing of the sensor is normal.

[0058] In this embodiment, the image processing chip can send the detection result to the AP, and the AP determines how to restore the processing unit based on the detection result. For example, if the AP determines based on the detection result that the image output timing of the first processing unit is abnormal, then it is determined that the first processing unit needs to be restored. If the AP determines based on the detection result that the image output timing of the photosensor is abnormal, then it is determined that the photosensor needs to be restored.

[0059] Optionally, according to the detection result, restoring the abnormal first processing unit includes:

[0060] receiving first control information sent by the AP, where the first control information is used to instruct: restoring a first channel in the first processing unit, or switching the first channel in the first processing unit to a second channel, where the first channel is a channel indicated as abnormal by the detection result;

[0061] The first processing unit is restored according to the first control information.

[0062] In this embodiment, when the AP core determines that the first processing unit is abnormal, it can send first control information to the image sensor to instruct the image processor to restore the abnormal channel in the first processing unit, or instruct the image processor to switch the abnormal channel in the first processing unit.

[0063] As an optional embodiment, determining the detection result of the second processing unit according to the processing result of the processing node of the second processing unit on the image includes:

[0064] Obtaining a processing result of the image by each processing node in the second processing unit;

[0065] If there is at least one processing node in the second processing unit whose processing result does not meet the first condition, determining that the second processing unit is abnormal;

[0066] The first condition includes at least one of the following:

[0067] The processing result is incomplete;

[0068] The value of the processing result is not within the preset range.

[0069] In this embodiment, when the second processing unit is detected, it can be determined whether the second processing unit is abnormal based on the processing results of the image by the internal processing nodes of the second processing unit. For example, for the preview pipeline, each node in the preview pipeline will generate an intermediate result, and the intermediate result of each node is detected. If an abnormality is found, such as an incomplete output of the intermediate result of a node, or the value of the intermediate result exceeds the expected range, it means that the preview pipeline is abnormal.

[0070] The following example illustrates the implementation process of the detection method using an image processing chip.

[0071] Example 1: Performing self-test on the second processing unit, where the second processing unit is a preview pipeline in an image processing chip. The method for performing self-test on the image processing chip includes:

[0072] Step 21: The user opens the camera and enters the preview interface. This step is a prerequisite for taking photos.

[0073] Step 22: The preview pipeline performs normal processing, processes the preview image and caches it.

[0074] In this step, in the normal preview state, the preview pipeline processes the preview image and generates an intermediate result.

[0075] Step 23: The preview pipeline performs self-check on each frame of the image to obtain the self-check result.

[0076] During the preview pipeline process, each node in the pipeline will generate intermediate results. The intermediate results of each node will be checked. If an exception is found, such as incomplete output of the intermediate result of a node, or the value of the intermediate result exceeds the expected range, it means that the self-check is abnormal.

[0077] Step 24: Read the self-test result for each frame of image.

[0078] A self-test result is generated for each frame of image self-test, and the self-test result is read for determination in step 25 .

[0079] Step 25: Determine whether multiple consecutive self-test frames are abnormal.

[0080] If the self-test results for N consecutive frames of images are all abnormal, it means that the preview pipeline cannot recover on its own and recovery needs to be triggered.

[0081] Step 26: Trigger the preview pipeline to resume.

[0082] This step will not affect the processing flow in the first processing unit, that is, it will not affect the Digital bypass or Analog bypass processing flow. The preview pipeline is an independent pipeline and will not affect the first processing unit. After the recovery is triggered, the preview processing will return to normal.

[0083] Step 27: The image processing chip restarts the self-check of each frame of image.

[0084] After the preview pipeline is reset, the self-check status is also reset and the self-check starts again.

[0085] In this example, for Figure 2 The preview pipeline in the image processing unit performs a self-check. If the preview pipeline self-check is abnormal, the preview pipeline is automatically reset and restored. This embodiment can perform a self-check on the preview pipeline relatively independently and perform effective recovery without affecting the normal preview image.

[0086] Example 2: A method for performing self-test on a digital bypass in a first processing unit, wherein the image processing chip performs the test includes:

[0087] Step 31: Open the camera and enter the preview. This step is a prerequisite for taking photos.

[0088] Step 32: The digital bypass in the image processing chip transmits the image sent by the sensor to the AP.

[0089] Step 33: The image processing chip self-checks for digital bypass. For example, by checking the number of lines in each frame of the image transmitted by the sensor and the number of lines of the image sent by the image processing chip to the AP, we can know whether the timing of the sensor output is abnormal and whether the image output of the image processing chip is abnormal.

[0090] Step 34: Send the self-test result of each frame of image to the AP.

[0091] Step 35: The AP determines whether the self-test of multiple consecutive image frames is abnormal.

[0092] Step 36: The AP determines the type of self-test anomaly and triggers recovery.

[0093] Among them, if the sensor image output timing is normal, and the image processing chip image output timing is abnormal, the AP actively initiates the recovery of the digital bypass of the image processing chip, or triggers the image processing chip to switch to the analog bypass path.

[0094] If the image output of the sensor is abnormal and the image processing chip output timing is normal, the AP will actively initiate the recovery of the sensor.

[0095] Step 37: The image processing chip restarts the self-test for each frame. After the recovery is executed, the self-test status is also reset and the self-test is restarted.

[0096] This embodiment performs a self-check on Digital bypass, so that in the event of an abnormality in the image preview, timely recovery can be performed. For example, when the preview is stuck, the image processing chip checks the number of lines of the image transmitted by the sensor and the number of lines of the image sent out, so that the AP can obtain the source of the abnormality and determine whether the sensor output is abnormal or the image processing chip digital bypass is abnormal, thereby executing an efficient recovery mechanism.

[0097] In the embodiments of the present application, the unit for processing and / or transmitting MIPI data and the unit for processing preview images in the image processing chip are independently arranged, and the two do not interfere with each other. When an abnormality is detected in a certain unit, the abnormal unit can be restored in a targeted manner without restoring the entire algorithm of the image processing chip, thereby ensuring that when one unit is abnormal, another unit can process data normally, avoiding waste of resources and improving image processing efficiency.

[0098] The embodiment of the present application further provides a detection method of an image processing chip, which is applied to an AP, and the method includes:

[0099] Receiving a detection result of a first processing unit sent by an image processing chip, where the first processing unit is used to process and / or transmit MIPI data of a preview image;

[0100] Sending first control information to the image processing chip and / or sending second control information to the sensor according to the detection result of the first processing unit;

[0101] The first control information is used to instruct: to restore the first channel in the first processing unit, or to switch the first channel in the first processing unit to a second channel, the first channel being the channel indicated as abnormal by the detection result;

[0102] The second control information is used to instruct: restoring the sensor.

[0103] Optionally, the method further includes:

[0104] generating first control information and / or second control information according to the detection result of the first processing unit;

[0105] Optionally, the detection result of the first processing unit includes one of the following:

[0106] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is normal;

[0107] The image output timing of the first processing unit is normal, and the image output timing of the sensor is abnormal;

[0108] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is abnormal;

[0109] The image output timing of the first processing unit is normal, and the image output timing of the sensor is normal.

[0110] In this embodiment, the image processing chip performs a self-test and can send the test result to the AP. The AP determines how to restore the processing unit based on the test result. For example, the AP determines that the image output timing of the first processing unit is abnormal based on the test result, and determines that the first processing unit needs to be restored. If the AP chip determines that the image output timing of the photosensor is abnormal based on the test result, it determines that the photosensor needs to be restored.

[0111] When the AP determines that the first processing unit is abnormal, it can send first control information to the image sensor to instruct the image processor to restore the abnormal channel in the first processing unit, or instruct the image processor to switch the abnormal channel in the first processing unit.

[0112] like Figure 3 As shown, the embodiment of the present application further provides a detection device 300 for an image processing chip, which is applied to an image processing chip, wherein the image processing chip comprises: a first processing unit and a second processing unit, wherein the first processing unit is used to process and / or transmit MIPI data of a preview image, and the second processing unit is used to process the preview image;

[0113] The device comprises:

[0114] A detection module 310, configured to detect the first processing unit and / or the second processing unit to obtain a detection result;

[0115] The recovery processing module 320 is used to recover the abnormal first processing unit and / or the second processing unit according to the detection result.

[0116] Optionally, the detection module is specifically used for:

[0117] When the first processing unit processes any frame of image, determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit;

[0118] and / or,

[0119] When the second processing unit processes any frame of image, the detection result of the second processing unit is determined according to the processing result of the processing node of the second processing unit on the image.

[0120] Optionally, the detection module is specifically used for:

[0121] A detection result of the first processing unit is determined according to the number of rows of the first image and the number of rows of the second image.

[0122] Optionally, the device further comprises:

[0123] A first sending module, used to send the detection result of the first processing unit to the AP;

[0124] The detection result of the first processing unit includes one of the following:

[0125] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is normal;

[0126] The image output timing of the first processing unit is normal, and the image output timing of the sensor is abnormal;

[0127] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is abnormal;

[0128] The image output timing of the first processing unit is normal, and the image output timing of the sensor is normal.

[0129] Optionally, the recovery processing module is specifically used for:

[0130] receiving first control information sent by the AP, where the first control information is used to instruct: restoring a first channel in the first processing unit, or switching the first channel in the first processing unit to a second channel, where the first channel is a channel indicated as abnormal by the detection result;

[0131] The first processing unit is restored according to the first control information.

[0132] Optionally, the detection module is specifically used for:

[0133] Obtaining a processing result of the image by each processing node in the second processing unit;

[0134] If there is at least one processing node in the second processing unit whose processing result does not meet the first condition, determining that the second processing unit is abnormal;

[0135] The first condition includes at least one of the following:

[0136] The processing result is incomplete;

[0137] The value of the processing result is not within the preset range.

[0138] Optionally, the detection module is further used for:

[0139] When the detection results corresponding to N consecutive frames of images processed by the first processing unit and / or the second processing unit are all abnormal, it is determined that the first processing unit and / or the second processing unit is abnormal.

[0140] In the embodiments of the present application, the unit for processing and / or transmitting MIPI data and the unit for processing preview images in the image processing chip are independently arranged, and the two do not interfere with each other. When an abnormality is detected in a certain unit, the abnormal unit can be restored in a targeted manner without restoring the entire algorithm of the image processing chip, thereby ensuring that when one unit is abnormal, another unit can process data normally, avoiding waste of resources and improving image processing efficiency.

[0141] The detection device of the image processing chip in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than the terminal. Exemplary, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) equipment, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobilepersonal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application is not specifically limited.

[0142] The detection device of the image processing chip in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0143] The detection device of the image processing chip provided in the embodiment of the present application can realize Figure 1 to Figure 2To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0144] Optional, such as Figure 4 As shown, an embodiment of the present application also provides an electronic device 400, which may include an AP chip and / or an image processing chip. The electronic device includes a processor 401, a memory 402, and a program or instruction stored in the memory 402 and executable on the processor 401. When the program or instruction is executed by the processor 401, each process of the detection method embodiment of the above-mentioned image processing chip is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0145] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0146] Figure 5 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0147] The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510.

[0148] Those skilled in the art will appreciate that the electronic device 500 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 510 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 5 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0149] Wherein, in the case where the electronic device is an image processing chip, the processor 510 is used to: detect the first processing unit and / or the second processing unit to obtain a detection result;

[0150] The abnormal first processing unit and / or the abnormal second processing unit is restored according to the detection result.

[0151] Optionally, the detection module is specifically used for:

[0152] When the first processing unit processes any frame of image, determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit;

[0153] and / or,

[0154] When the second processing unit processes any frame of image, the detection result of the second processing unit is determined according to the processing result of the processing node of the second processing unit on the image.

[0155] Optionally, the detection module is specifically used for:

[0156] A detection result of the first processing unit is determined according to the number of rows of the first image and the number of rows of the second image.

[0157] Optionally, the device further comprises:

[0158] A second sending module, used to send the detection result of the first processing unit to the AP;

[0159] The detection result of the first processing unit includes one of the following:

[0160] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is normal;

[0161] The image output timing of the first processing unit is normal, and the image output timing of the sensor is abnormal;

[0162] The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is abnormal;

[0163] The image output timing of the first processing unit is normal, and the image output timing of the sensor is normal.

[0164] Optionally, the recovery processing module is specifically used for:

[0165] receiving first control information sent by the AP, where the first control information is used to instruct: restoring a first channel in the first processing unit, or switching the first channel in the first processing unit to a second channel, where the first channel is a channel indicated as abnormal by the detection result;

[0166] The first processing unit is restored according to the first control information.

[0167] Optionally, the detection module is specifically used for:

[0168] Obtaining a processing result of the image by each processing node in the second processing unit;

[0169] If there is at least one processing node in the second processing unit whose processing result does not meet the first condition, determining that the second processing unit is abnormal;

[0170] The first condition includes at least one of the following:

[0171] The processing result is incomplete;

[0172] The value of the processing result is not within the preset range.

[0173] Optionally, the detection module is specifically used for:

[0174] When the detection results corresponding to N consecutive frames of images processed by the first processing unit and / or the second processing unit are all abnormal, it is determined that the first processing unit and / or the second processing unit is abnormal.

[0175] It should be understood that in the embodiment of the present application, the input unit 504 may include a graphics processor (GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 507 includes a touch panel 5071 and at least one of other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include two parts: a touch detection device and a touch controller. Other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0176] The memory 509 can be used to store software programs and various data. The memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 509 may include a volatile memory or a non-volatile memory, or the memory 509 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0177] The processor 510 may include one or more processing units; optionally, the processor 510 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 510.

[0178] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the detection method embodiment of the above-mentioned image processing chip is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0179] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0180] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the detection method embodiment of the above-mentioned image processing chip, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0181] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0182] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the detection method embodiment of the image processing chip as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0183] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0184] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

Claims

1. A method for detecting an image processing chip, characterized in that: Applied to an image processing chip, the image processing chip comprises: a first processing unit and a second processing unit, the first processing unit is used to process and / or transmit the mobile industry processor interface MIPI data of the preview image, and the second processing unit is used to process the preview image; The method comprises: Detecting the first processing unit and / or the second processing unit to obtain a detection result; The abnormal first processing unit and / or the abnormal second processing unit is restored according to the detection result.

2. The method according to claim 1, characterized in that Detecting the first processing unit and / or the second processing unit to obtain a detection result includes: When the first processing unit processes any frame of image, determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit; and / or, When the second processing unit processes any frame of image, the detection result of the second processing unit is determined according to the processing result of the processing node of the second processing unit on the image.

3. The method according to claim 2, characterized in that Determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit includes: A detection result of the first processing unit is determined according to the number of rows of the first image and the number of rows of the second image.

4. The method according to claim 1 or 3, characterized in that: The method further comprises: Sending the detection result of the first processing unit to the application processor AP; The detection result of the first processing unit includes one of the following: The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is normal; The image output timing of the first processing unit is normal, and the image output timing of the sensor is abnormal; The image output timing of the first processing unit is abnormal, and the image output timing of the sensor is abnormal; The image output timing of the first processing unit is normal, and the image output timing of the sensor is normal.

5. The method according to claim 1 or 4, characterized in that: Restoring the abnormal first processing unit according to the detection result includes: receiving first control information sent by the AP, where the first control information is used to instruct: restoring a first channel in the first processing unit, or switching the first channel in the first processing unit to a second channel, where the first channel is a channel indicated as abnormal by the detection result; The first processing unit is restored according to the first control information.

6. The method according to claim 2, characterized in that Determining the detection result of the second processing unit according to the processing result of the processing node of the second processing unit on the image includes: Obtaining a processing result of the image by each processing node in the second processing unit; If there is at least one processing node in the second processing unit whose processing result does not meet the first condition, determining that the second processing unit is abnormal; The first condition includes at least one of the following: The processing result is incomplete; The value of the processing result is not within the preset range.

7. The method according to claim 1 or 2, characterized in that: Detecting the first processing unit and / or the second processing unit to obtain a detection result further includes: When the detection results corresponding to N consecutive frames of images processed by the first processing unit and / or the second processing unit are all abnormal, it is determined that the first processing unit and / or the second processing unit is abnormal.

8. A detection device for an image processing chip, characterized in that: Applied to an image processing chip, the image processing chip comprises: a first processing unit and a second processing unit, the first processing unit is used to process and / or transmit MIPI data of a preview image, and the second processing unit is used to process the preview image; The device comprises: A detection module, used to detect the first processing unit and / or the second processing unit to obtain a detection result; A recovery processing module is used to recover the abnormal first processing unit and / or the second processing unit according to the detection result.

9. The device according to claim 8, characterized in that The detection module is specifically used for: When the first processing unit processes any frame of image, determining a detection result of the first processing unit according to a first image input to the first processing unit and a second image output by the first processing unit; and / or, When the second processing unit processes any frame of image, the detection result of the second processing unit is determined according to the processing result of the processing node of the second processing unit on the image.

10. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the detection method of the image processing chip as described in any one of claims 1 to 7 are implemented.

Images