Shooting exception processing method and device, electronic equipment and medium

Abstract

The invention discloses a shooting exception processing method and device, electronic equipment and a medium, and belongs to the technical field of communication. The method comprises the following steps: detecting the state of an image processing chip; and under the condition that the state of the image processing chip is abnormal, the image sensor is communicated with the unvarnished transmission path by controlling the switch module, so that image data acquired by the image sensor is unvarnished transmitted to the application processor for processing through the unvarnished transmission path.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a method, device, electronic equipment and medium for handling abnormal shooting. Background Art

[0002] At present, the shooting functions of electronic devices such as mobile phones are becoming increasingly powerful. In some application scenarios, in order to improve the shooting processing efficiency and shooting image effect, an external chip can be used in the electronic device, that is, an additional image processing chip is added to process the captured image data, and the processed image data is then transmitted to the application processor (AP) for subsequent processing. However, in actual applications, it is easy to be restricted by the interface and physical conditions of the external chip, and there is a certain probability that the user's shooting function cannot work normally as expected. At this time, the user often needs to restart the camera or even restart the electronic device to solve the problem, which easily leads to low shooting efficiency. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a method, device, electronic device and medium for handling shooting abnormalities, which can solve the problem of low shooting efficiency caused by the need to restart the camera or even restart the electronic device when a shooting abnormality occurs in an electronic device equipped with an external chip.

[0004] In a first aspect, an embodiment of the present application provides an electronic device, including: an image sensor, an image processing chip, and an application processor, wherein the image processing chip is provided with a switch module, an image signal processing path, and a transparent transmission path; a signal output end of the image sensor is respectively connected to a signal input end of the image signal processing path and a signal input end of the transparent transmission path through the switch module, the signal output end of the image signal processing path is connected to a first signal input end of the application processor, and the signal output end of the transparent transmission path is connected to a second signal input end of the application processor; the switch module is used to connect the image sensor to the image signal processing path, or to connect the image sensor to the transparent transmission path;

[0005] The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or is transparently transmitted to the application processor through the transparent transmission path.

[0006] In a second aspect, an embodiment of the present application provides a method for handling shooting abnormalities, which is performed by the electronic device described in the first aspect, and the method includes:

[0007] The application processor detects the state of the image processing chip;

[0008] When the state of the image processing chip is abnormal, the application processor controls the switch module to connect the image sensor to the transparent transmission path, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

[0009] In a third aspect, an embodiment of the present application provides a shooting exception processing device, which is provided with the electronic device described in the first aspect, and the shooting exception processing device includes:

[0010] A detection module, used to detect the state of the image processing chip;

[0011] The control module is used to control the switch module to connect the image sensor with the transparent transmission path when the state of the image processing chip is abnormal, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

[0012] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the shooting exception handling method described in the first aspect are implemented.

[0013] In a fifth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the shooting exception handling method described in the first aspect are implemented.

[0014] In a sixth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the shooting exception handling method as described in the first aspect.

[0015] In a seventh aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the shooting exception handling method as described in the first aspect.

[0016] In an embodiment of the present application, an electronic device includes: an image sensor, an image processing chip and an application processor, wherein the image processing chip is provided with a switch module, an image signal processing path and a transparent transmission path; a signal output end of the image sensor is respectively connected to a signal input end of the image signal processing path and a signal input end of the transparent transmission path through the switch module, the signal output end of the image signal processing path is connected to a first signal input end of the application processor, and the signal output end of the transparent transmission path is connected to a second signal input end of the application processor; the switch module is used to connect the image sensor with the image signal processing path, or to connect the image sensor with the transparent transmission path; image data output by the image sensor is transmitted to the application processor after being processed by the image signal processing path, or is transparently transmitted to the application processor through the transparent transmission path.

[0017] The shooting abnormality processing method includes: the application processor detects the state of the image processing chip; when the state of the image processing chip is abnormal, the application processor controls the switch module to connect the image sensor with the transparent transmission path, so as to transmit the image data collected by the image sensor to the application processor through the transparent transmission path for processing.

[0018] In this way, by adding a transparent transmission path in the external chip of the electronic device, that is, the image processing chip, it is possible to switch to the transparent transmission path when the external chip is in an abnormal state, and transmit the captured image data to the application processor for processing, thereby ensuring the normal operation of the shooting function. Since this process does not require restarting the camera or restarting the electronic device, it can improve the efficiency of abnormal recovery and the shooting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0020] Figure 2 This is one of the flow charts of the method for handling abnormal shooting provided in the embodiment of the present application;

[0021] Figure 3 It is a schematic diagram of an electronic device provided by an embodiment of the present application using a single channel in an external chip;

[0022] Figure 4 This is the second flowchart of the method for handling abnormal shooting provided in the embodiment of the present application;

[0023] Figure 5 is a structural diagram of a shooting abnormality processing device provided in an embodiment of the present application;

[0024] Figure 6 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0025] Figure 7 It is a schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0027] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0028] In order to make the embodiments of the present application clearer, the following first further describes in detail the background technical defects on which the embodiments of the present application are based, and briefly introduces the purpose and improvement points of the embodiments of the present application, as follows:

[0029] There are shortcomings in the scheme of restarting the camera and restarting the electronic device when shooting abnormally. For the first scheme of restarting the camera, although the user can use the camera photo function immediately through the guidance instructions, it will make the user doubt the quality of the camera software, that is, the user will feel that although there is an image processing chip, the software quality is poor. Therefore, this scheme is likely to cause a very bad experience for the user and affect the user's trust in the product.

[0030] The second method of restarting the electronic device will make users worry about the product quality. Powering off and restarting the device will fix all abnormal problems, but it will give users an extremely poor experience.

[0031] Therefore, the existing solutions of restarting the camera software or restarting the electronic device have defects that seriously affect the user experience. On the other hand, the solutions of restarting the camera software or restarting the electronic device require the user to wait for a long time, that is, the abnormal recovery is slow, which seriously affects the shooting efficiency.

[0032] To this end, the purpose of the embodiments of the present application is to provide a method for handling shooting exceptions of a plug-in chip that is not noticeable to the user. Starting from the user experience, while ensuring the reliability of the external chip exception handling, the shooting function can be made stable and reliable in various scenarios, and the recovery efficiency of shooting exceptions can be improved.

[0033] The embodiments of the present application can achieve the following points: according to the specific limitations of the shooting chip, in abnormal situations, the shooting function can be carried out normally without the user noticing; in the event of a recoverable abnormality in the external chip, the abnormality recovery efficiency is improved.

[0034] The electronic device, shooting abnormality processing method and device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0035] See also Figure 1 , Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application, such as Figure 1 As shown, including:

[0036] An image sensor 11, an image processing chip 12 and an application processor 13, wherein the image processing chip 12 is provided with a switch module 121, an image signal processing path 122 and a transparent transmission path 123; the signal output end of the image sensor 11 is respectively connected to the signal input end of the image signal processing path 122 and the signal input end of the transparent transmission path 123 through the switch module 121, the signal output end of the image signal processing path 122 is connected to the first signal input end of the application processor 13, and the signal output end of the transparent transmission path 123 is connected to the second signal input end of the application processor 13; the switch module 121 is used to connect the image sensor 11 with the image signal processing path 122, or connect the image sensor 11 with the transparent transmission path 123;

[0037] The image data output by the image sensor 11 is processed by the image signal processing path 122 and then transmitted to the application processor 13 , or is transparently transmitted to the application processor 13 through the transparent transmission path 123 .

[0038] like Figure 1As shown, in the embodiment of the present application, in order to improve the shooting processing efficiency and the shooting image effect, an additional image processing chip is arranged after the image sensor (sensor) 11 of the electronic device, that is, the camera, and before the application processor 13, that is, the AP end. Specifically, it can be called an image signal processor (Image Signal Processor, ISP) 12. This chip can carry different AI image processing algorithms with the application processor 13 to improve the overall image processing performance and effect. The image processing chip 13 can be understood as an external chip for image processing.

[0039] In the embodiment of the present application, the image signal processing path 122 can be understood as the normal processing path in the above-mentioned external chip. The path can be provided with corresponding circuit units according to the specific image processing functions that need to be implemented. If the noise reduction function of the image signal needs to be implemented through the external chip, the image signal processing path 122 can be provided with a noise reduction circuit unit. Of course, the image signal processing path 122 can also be provided with circuit units that implement other functions.

[0040] The transparent transmission path 123 is an additional path set in the external chip that can directly transparently transmit signals without any additional processing of the signal. Specifically, the original image data collected by the image sensor 11 can be directly transparently transmitted to the AP end through the transparent transmission path 123 without being processed by the image signal processing path 122. In this way, when the normal processing path of the external chip is abnormal, the processing can be skipped and the original image data can be transparently transmitted to the AP end for subsequent image processing.

[0041] In specific implementation, the switch module 121 is combined with the abnormal situation of the external chip to control the selection and switching of the path of the external chip, and the image sensor 11 and the image signal processing path 122 or the transparent transmission path 123 are controlled according to the switch module 121, so as to select the corresponding path.

[0042] Exemplarily, the switch module 121 may include switches respectively arranged on the image signal processing path 122 and the transparent transmission path 123, so as to realize whether to cut through the path through the switches on the corresponding path, so as to transmit or process the image data through the cut-through path. Figure 1 As shown, a switching switch is shown, wherein the fixed end is connected to the image sensor 11, and the two movable ends are respectively connected to the image signal processing path 122 and the transparent transmission path 123, so that the corresponding path can be selected by switching on the corresponding path.

[0043] It should be noted that, in some embodiments, the switch module 121 may be controlled by the AP end, that is, the corresponding path may be switched on by a switch control signal sent by the AP end.

[0044] Optionally, an image processing unit is provided in the image signal processing path 122, an input end of the image processing unit is connected to a signal input end of the image signal processing path 122, and an output end of the image processing unit is connected to a signal output end of the image signal processing path 122;

[0045] The signal input end of the transparent transmission path 123 is connected to the signal output end of the transparent transmission path 123 , and the output signal of the transparent transmission path is the same as the input signal of the transparent transmission path.

[0046] Specifically, an image processing unit is provided in the image signal processing path 122. In some embodiments, a plurality of image processing units with different processing functions may be provided in the image signal processing path 122, such as image processing units corresponding to different functions such as noise reduction, dynamic range enhancement, and de-mosaicing. In this way, the image processing unit in the image signal processing path 122 may perform various image processing functions on the original image data collected by the camera.

[0047] The transparent transmission path 123 is a direct path without any circuit unit. For example, the transparent transmission path 123 is only a transmission cable, and the signal input end of the transparent transmission path 123 is directly connected to the signal output end of the transparent transmission path 123 through a wire. The output signal of the transparent transmission path 123 is the same as the input signal of the transparent transmission path, that is, the transparent transmission path 123 does not perform any processing on the original image data collected by the camera. In this way, the original image data collected by the camera can be directly transparently transmitted to the AP end for processing through the transparent transmission path 123, which effectively avoids the problem of abnormality in the normal processing path of the external chip.

[0048] Optionally, the image signal processing path 122 and the transparent transmission path 123 are powered independently.

[0049] That is, in some embodiments, the image signal processing path 122 and the transparent transmission path 123 can be powered independently without interfering with each other, that is, they are powered by independent power supplies, so that in actual applications, the corresponding path can be flexibly enabled according to the usage scenario, and only the power supply of the path can be enabled. In addition, when each path needs to be reset, the image signal processing path 122 and the transparent transmission path 123 can be reset independently to ensure that the working state of one path will not be affected when the other path is reset.

[0050] The electronic device in the embodiment of the present application includes: an image sensor, an image processing chip and an application processor, wherein the image processing chip is provided with a switch module, an image signal processing path and a transparent transmission path; the signal output end of the image sensor is respectively connected to the signal input end of the image signal processing path and the signal input end of the transparent transmission path through the switch module, the signal output end of the image signal processing path is connected to the first signal input end of the application processor, and the signal output end of the transparent transmission path is connected to the second signal input end of the application processor; the switch module is used to connect the image sensor with the image signal processing path, or to connect the image sensor with the transparent transmission path; the image data output by the image sensor is transmitted to the application processor after being processed by the image signal processing path, or is transparently transmitted to the application processor through the transparent transmission path. In this way, by adding a transparent transmission path in the external chip of the electronic device, that is, the image processing chip, it can be realized that when the external chip is in an abnormal state, it can be switched to the transparent transmission path, and the captured image data can be transparently transmitted to the application processor for processing, so as to ensure the normal operation of the shooting function. Since this process does not require restarting the camera or restarting the electronic device, it can improve the abnormal recovery efficiency and the shooting efficiency.

[0051] The embodiment of the present application provides a method for implementing abnormal recovery processing of external chips by using an independent hardware data transparent transmission path and combining it with a system software solution, such as Figure 1 As shown, the chip is designed with an independent transparent transmission path. Figure 2 , explaining the specific steps included in the system software solution.

[0052] See also Figure 2 , Figure 2 A flowchart of a method for handling abnormal shooting provided in an embodiment of the present application, comprising Figure 1 The electronic device in the embodiment shown performs, for example Figure 2 As shown, the method comprises the following steps:

[0053] Step 201: The application processor detects the status of the image processing chip.

[0054] Specifically, the status of the external chip, i.e., the image processing chip, can be detected during the use of the shooting function of the electronic device, or the status of the external chip can be periodically detected when the electronic device is powered on, specifically to detect whether the status of the external chip is abnormal.

[0055] In some embodiments, the external chip can mark whether the chip status is abnormal through the status bit on the register, such as the status bit marked as 1 indicates that the chip is abnormal, and the status bit marked as 0 indicates that the chip is normal. Therefore, the above detection of the status of the image processing chip can be to determine whether the chip status is abnormal by the application processor reading the status bit in the register.

[0056] It should be noted that in the embodiment of the present application, the external chip refers to the image processing chip.

[0057] Optionally, step 201 includes:

[0058] When the electronic device is powered on or a camera of the electronic device is enabled, the application processor detects a state of the image processing chip.

[0059] In some embodiments, the application processor can detect the state of the external chip when the electronic device is turned on or the camera of the electronic device is turned on, that is, the state of the external chip can be checked when the external chip is powered on. In this way, it can ensure that the abnormal state of the external chip is detected in time, and then measures can be taken in time to deal with the abnormal situation, so as to avoid the user waiting too long when using the camera shooting function, resulting in a bad shooting experience.

[0060] Step 202: When the image processing chip is in an abnormal state, the application processor controls the switch module to connect the image sensor to the transparent transmission path, so as to transparently transmit the image data collected by the image sensor to the application processor AP through the transparent transmission path for processing.

[0061] The abnormal status of the above-mentioned image processing chip includes, but is not limited to: abnormal chip status caused by cosmic rays, partial functional defects of the chip caused by chip production, functional abnormality caused by chip aging, functional abnormality caused by abnormal software operation, and hardware abnormality caused by software misconfiguration.

[0062] In an embodiment of the present application, when it is detected that the state of the image processing chip is abnormal, the external chip may not be used to process the image data collected during shooting. Therefore, the image sensor and the transparent transmission path can be connected by the application processor to control the switch module, that is, switch to the transparent transmission path, and the image data collected by the image sensor is directly transmitted to the application processor, i.e., the AP side, through the transparent transmission path for processing, thereby avoiding the inability to process the captured image data in time due to the abnormal state of the external chip, and also avoiding the unusable shooting function due to the abnormal state of the external chip.

[0063] Optionally, after the application processor controls the switch module to connect the image sensor to the transparent transmission path, the method further includes:

[0064] Transparently transmitting the image data acquired by the image sensor to the application processor through the transparent transmission path;

[0065] The application processor uses a software algorithm to replace the image signal processing path to process the image data.

[0066] That is, in some embodiments, the image data is transparently transmitted to the AP end for processing. Specifically, the AP end may use an AP software algorithm solution to replace the image signal processing path processing solution through an external chip, that is, data flow and image processing are all implemented using AP system software to ensure the continuity of user usage scenarios.

[0067] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0068] That is, in some embodiments, the external chip can be configured to select an independent data transparent transmission channel by default when powered on, that is, the switch module can be set to connect the image sensor and the transparent transmission path by default when the external chip is powered on, that is, the transparent transmission path is initially selected by default, and the image data collected by the image sensor is directly transmitted to the application processor, i.e., the AP, through the transparent transmission path for processing, so as to avoid the inability to process the captured image data in the first time due to anomalies when the external chip is powered on, and also avoid the shooting function being unavailable when the camera is turned on.

[0069] Optionally, when the state of the image processing chip is abnormal, the method further includes:

[0070] The application processor performs a reset process on the software code running on the image processing chip to restore the image processing chip to a normal state.

[0071] In some embodiments, when an abnormal state of the external chip is detected, certain measures can be taken to try to repair the abnormal state. Specifically, the software of the external chip can be reset first, that is, the software code running on the image processing chip can be reset, such as erasing and rewriting the code on the external chip and then running it to try to repair the software running error. In specific implementation, the software of the external chip can be reset through AP control.

[0072] It should be noted that after resetting the software of the plug-in chip, you can wait for a certain period of time, such as waiting for 10 to 20 ms, and read the status of the plug-in chip again. If the status of the plug-in chip is read to be restored to normal, it can be determined that the abnormality is caused by the software abnormality. If the status of the plug-in chip is still abnormal, the software abnormality can be eliminated and the subsequent hardware reset process can be performed. Alternatively, you can first perform repeated reset processes on the software of the plug-in chip to repair the software abnormality through multiple software resets as much as possible, to avoid the situation where one reset cannot repair the software abnormality. If the status of the plug-in chip cannot be restored to normal after multiple software reset processes, you can perform subsequent hardware reset processes, that is, reconfigure the hardware power supply.

[0073] In this implementation, the abnormal situation of the plug-in chip caused by the software abnormality can be repaired by timely performing software reset processing on the plug-in chip.

[0074] Optionally, the method further comprises:

[0075] The application processor detects the state of the image processing chip again after resetting the software code;

[0076] When the state of the image processing chip is still abnormal, the application processor reconfigures the power supply of the image processing chip to restore the image processing chip to a normal state.

[0077] In some embodiments, after the software of the external chip is reset, the state of the external chip can be detected again, such as reading the status bit of the register again to determine whether the state of the external chip has returned to normal after the software reset. By way of example, if the state of the external chip has returned to normal after the software reset, the status bit of the register is marked as 0 to indicate a "normal" state; otherwise, it remains at 1 to indicate an "abnormal" state.

[0078] In this embodiment, when it is read that the status of the external chip is still abnormal, that is, the software abnormality is ruled out, the external chip can be further reset in hardware, such as reconfiguring the power supply of the external chip. For example, the hardware power supply of the external chip and the related initialization configuration on the hardware can be reset to try to repair the chip status abnormality caused by the hardware configuration abnormality.

[0079] It should be noted that after reconfiguring the hardware power supply of the external chip, you can wait for a certain period of time, such as waiting for 30 to 40ms, and read the status of the external chip again. If the status of the external chip is found to have returned to normal, it can be determined that the abnormality is caused by the abnormal hardware configuration and the chip status is abnormal. If the status of the external chip is still abnormal, it can be determined that the external chip has an irreparable fault and cannot be used any further. The chip abnormality can be reported and the external chip will no longer be used to process the captured image data.

[0080] In this implementation, when the software reset of the plug-in chip cannot restore it to normal, the hardware power reconfiguration processing of the plug-in chip can be further performed in time to repair the abnormal situation caused by the abnormal hardware configuration of the plug-in chip, that is, a multi-layer recovery mechanism is used to restore the chip to normal.

[0081] Optionally, the method further comprises:

[0082] The application processor detects the state of the image processing chip again after reconfiguring the power supply of the image processing chip;

[0083] When the state of the image processing chip is still abnormal, the application processor marks the image processing chip as a transparent transmission mode and keeps the image sensor connected to the transparent transmission path.

[0084] In some embodiments, after the hardware power supply of the external chip is reconfigured, the status of the external chip can be detected again, such as reading the status bit of the register again to determine whether the status of the external chip has returned to normal after the hardware power supply is reconfigured. By way of example, if the status of the external chip has returned to normal after the hardware power supply is reconfigured, the status bit of the register is marked as 0 to indicate a "normal" status; otherwise, it remains at 1 to indicate an "abnormal" status.

[0085] In this embodiment, when the state of the external chip is still abnormal, it indicates that the external chip may have a serious fault or is damaged. At this time, the application processor can permanently mark the state of the external chip as the transparent transmission mode, that is, the image sensor is always connected to the transparent transmission path, so that the transparent transmission path is used in subsequent shooting, and the captured image data is directly transparently transmitted to the AP end for processing.

[0086] Furthermore, the hardware failure anomaly of the external chip may be reported, such as reporting the chip failure anomaly to the manufacturer, and the failed external chip will never be used afterwards.

[0087] Through this implementation, when the external chip fails, it can be marked that the chip will no longer be used to process the captured image data, thereby avoiding unnecessary waiting for shooting exceptions and avoiding checking the chip status every subsequent time the chip is powered on.

[0088] Optionally, the method further comprises:

[0089] When the image processing chip is in a normal state, the application processor controls the switch module to connect the image sensor to the image signal processing path, so as to process the image data collected by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

[0090] In some embodiments, when it is first detected that the external chip is in a normal state, or when the external chip returns to normal state after software reset and hardware power reconfiguration, the external chip can be used normally to process the captured image data to improve the shooting effect. Therefore, the application processor can control the switch module to connect the image sensor and the image signal processing path, that is, switch to the image signal processing path, and process the image data collected by the image sensor through the image signal processing path.

[0091] Exemplarily, the image data may be pre-processed by the image signal processing pathway such as frame selection and registration, and may be further subjected to image effect enhancement processing such as noise reduction, dynamic range enhancement, and image synthesis after the pre-processing.

[0092] Finally, the image data processed by the image signal processing path can be transmitted to the application processor for further processing, such as image quality enhancement.

[0093] This implementation can ensure that when the external chip is functioning normally, the normal processing path of the chip is used to process the captured image data, thereby ensuring image processing effects and shooting effects.

[0094] See also Figure 3 According to the state of the external chip, namely the image signal processing path 122, the image signal processing path 122 or the transparent transmission path 123 can be selected to process or transparently transmit the image data collected by the image sensor 11, that is, one of the paths is used for each processing.

[0095] Based on the above implementation mode, Figure 4 The embodiment process shown is used to illustrate the implementation method of the embodiment of the present application:

[0096] like Figure 4 As shown, the specific steps include:

[0097] Step 101, after the device is turned on or the camera is turned on, the external chip will default to using an independent data transparent transmission channel when it is powered on, and the status of the external chip needs to be checked.

[0098] Step 102: If the external chip is in a normal state, it will switch to the normal external chip data processing path, and the AP side will use the data processed by the image signal processing path accordingly. If the external chip is in an abnormal state, the external chip will use the transparent transmission path. The chip state abnormality includes but is not limited to: chip state abnormality caused by cosmic rays, chip partial functional defects caused by chip production, functional abnormality caused by chip aging, functional abnormality caused by software operation abnormality, and hardware abnormality caused by software misconfiguration.

[0099] Step 103, the AP obtains the data of the external chip transparent transmission path, and adopts the AP software algorithm solution to replace the solution processed by the external chip. The data flow and image processing are all implemented by the system software to ensure the continuity of the user's usage scenario.

[0100] Step 104: The AP resets the software of the external chip to eliminate software abnormalities.

[0101] Step 105, after waiting for the software to reset, read the status of the external chip again after a certain period of time (after repeating a certain number of times); if the status of the external chip is normal, end the exception processing and display it back to normal, and return to step 102, otherwise go to the next step.

[0102] Step 106: Reset the hardware power and initialization configuration of the plug-in chip.

[0103] Step 107, after waiting for a period of time, read and determine the status of the external chip again; if the status is normal, end the exception processing and display it back to normal, and return to step 102, otherwise go to the next step.

[0104] Step 108: On the AP side, the external chip status is permanently marked as transparent transmission mode, that is, the transparent transmission path is fixedly selected in the future, and the external chip hardware failure exception can be reported, and the external chip will never be used.

[0105] The embodiments of the present application can realize the user-unaware exception handling of the plug-in chip, increase the fault tolerance of product components, improve the stability and quality of the overall product at the system engineering level, and effectively improve the stability of the plug-in chip.

[0106] In the shooting abnormality processing method in the embodiment of the present application, the application processor detects the state of the image processing chip; when the state of the image processing chip is abnormal, the application processor controls the switch module to connect the image sensor with the transparent transmission path, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path. In this way, by adding a transparent transmission path in the external chip of the electronic device, that is, the image processing chip, it is possible to switch to the transparent transmission path when the state of the external chip is abnormal, and transparently transmit the captured image data to the application processor for processing, so as to ensure the normal operation of the shooting function. Since this process does not require restarting the camera or restarting the electronic device, it can improve the abnormal recovery efficiency and the shooting efficiency.

[0107] The shooting exception processing method provided in the embodiment of the present application can be executed by a shooting exception processing device. In the embodiment of the present application, the shooting exception processing device executing the shooting exception processing method is taken as an example to illustrate the shooting exception processing device provided in the embodiment of the present application.

[0108] See also Figure 5 , Figure 5 This is a structural diagram of a shooting abnormality processing device provided in an embodiment of the present application, which is arranged in an electronic device provided in an embodiment of the present application, such as Figure 5 As shown, the shooting abnormality processing device 500 includes:

[0109] A detection module 501, used to detect the state of the image processing chip;

[0110] The control module 502 is used to control the switch module to connect the image sensor with the transparent transmission path when the state of the image processing chip is abnormal, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

[0111] Optionally, the shooting abnormality processing device 500 further includes:

[0112] The reset module is used to reset the software code running on the image processing chip when the state of the image processing chip is abnormal, so as to restore the image processing chip to a normal state.

[0113] Optionally, the detection module 501 is further used to detect the state of the image processing chip again after resetting the software code;

[0114] The shooting abnormality processing device 500 further includes:

[0115] The reconfiguration module is used to reconfigure the power supply of the image processing chip when the state of the image processing chip is still abnormal, so as to restore the image processing chip to a normal state.

[0116] Optionally, the shooting abnormality processing device 500 is further used to detect the state of the image processing chip again after reconfiguring the power supply of the image processing chip;

[0117] The shooting abnormality processing device 500 further includes:

[0118] The marking module is used to mark the image processing chip as a transparent transmission mode when the state of the image processing chip is still abnormal, and to keep the image sensor connected to the transparent transmission path.

[0119] Optionally, the control module 502 is further used to control the switch module to connect the image sensor with the image signal processing path when the image processing chip is in a normal state, so as to process the image data collected by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

[0120] Optionally, the detection module 501 is further configured to detect the state of the image processing chip when the electronic device is turned on or a camera of the electronic device is enabled.

[0121] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0122] The shooting abnormality processing device 500 in the embodiment of the present application detects the state of the image processing chip; when the state of the image processing chip is abnormal, the image sensor is connected to the transparent transmission path by controlling the switch module, so that the image data collected by the image sensor is transparently transmitted to the application processor for processing through the transparent transmission path. In this way, by adding a transparent transmission path in the external chip of the electronic device, that is, the image processing chip, it is possible to switch to the transparent transmission path when the state of the external chip is abnormal, and transparently transmit the captured image data to the application processor for processing, so as to ensure the normal operation of the shooting function. Since this process does not require restarting the camera or restarting the electronic device, it can improve the abnormal recovery efficiency and improve the shooting efficiency.

[0123] The shooting exception processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than the terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0124] The shooting exception processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0125] The shooting abnormality processing device provided in the embodiment of the present application can achieve Figure 2 or Figure 4 The various processes implemented by the method embodiment can achieve the same technical effect, and to avoid repetition, they will not be described here.

[0126] Alternatively, if Figure 6 As shown, an embodiment of the present application also provides an electronic device 600, including a processor 601 and a memory 602, wherein the memory 602 stores programs or instructions that can be executed on the processor 601, and when the program or instructions are executed by the processor 601, the various steps of the above-mentioned shooting exception processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

[0127] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0128] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0129] The electronic device 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.

[0130] Those skilled in the art will appreciate that the electronic device 700 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 710 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0131] The processor 710 is used for:

[0132] Detecting the state of the image processing chip;

[0133] When the state of the image processing chip is abnormal, the switch module is controlled to connect the image sensor to the transparent transmission path, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

[0134] Optionally, the processor 710 is further configured to, when the state of the image processing chip is abnormal, reset the software code running on the image processing chip to restore the image processing chip to a normal state.

[0135] Optionally, the processor 710 is further configured to:

[0136] After resetting the software code, detecting the state of the image processing chip again;

[0137] When the state of the image processing chip is still abnormal, the power supply of the image processing chip is reconfigured to restore the image processing chip to a normal state.

[0138] Optionally, the processor 710 is further configured to:

[0139] After reconfiguring the power supply of the image processing chip, detecting the state of the image processing chip again;

[0140] When the state of the image processing chip is still abnormal, the image processing chip is marked as a transparent transmission mode, and the image sensor is kept connected to the transparent transmission path.

[0141] Optionally, the processor 710 is further configured to:

[0142] When the image processing chip is in a normal state, the switch module is controlled to connect the image sensor to the image signal processing path, so as to process the image data collected by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

[0143] Optionally, the processor 710 is further configured to:

[0144] When the electronic device is turned on or a camera of the electronic device is enabled, the state of the image processing chip is detected.

[0145] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0146] The electronic device in the embodiment of the present application can achieve the same technical effect as the aforementioned embodiment, and will not be described again here to avoid repetition.

[0147] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes a touch panel 7071 and at least one of other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0148] The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 709 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0149] The processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 710.

[0150] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned shooting exception handling method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0151] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0152] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting exception handling method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0153] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0154] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned shooting exception handling method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0155] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0156] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0157] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An electronic device, It is characterized in that include: An image sensor, an image processing chip and an application processor, wherein the image processing chip is provided with a switch module, an image signal processing path and a transparent transmission path; the signal output end of the image sensor is respectively connected to the signal input end of the image signal processing path and the signal input end of the transparent transmission path through the switch module, the signal output end of the image signal processing path is connected to the first signal input end of the application processor, and the signal output end of the transparent transmission path is connected to the second signal input end of the application processor; the switch module is used to connect the image sensor with the image signal processing path, or connect the image sensor with the transparent transmission path; The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or is transparently transmitted to the application processor through the transparent transmission path.

2. The electronic device according to claim 1, It is characterized in that An image processing unit is provided in the image signal processing path, an input end of the image processing unit is connected to a signal input end of the image signal processing path, and an output end of the image processing unit is connected to a signal output end of the image signal processing path; The signal input end of the transparent transmission path is connected to the signal output end of the transparent transmission path, and the output signal of the transparent transmission path is the same as the input signal of the transparent transmission path.

3. The electronic device according to claim 1, It is characterized in that The image signal processing path and the transparent transmission path are powered independently.

4. A method for handling abnormal shooting. It is characterized in that The method is performed by the electronic device according to any one of claims 1 to 3, comprising: The application processor detects the state of the image processing chip; When the state of the image processing chip is abnormal, the application processor controls the switch module to connect the image sensor to the transparent transmission path, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

5. The method according to claim 4, It is characterized in that When the state of the image processing chip is abnormal, the method further includes: The application processor performs a reset process on the software code running on the image processing chip to restore the image processing chip to a normal state.

6. The method according to claim 5, It is characterized in that The method further comprises: The application processor detects the state of the image processing chip again after resetting the software code; When the state of the image processing chip is still abnormal, the application processor reconfigures the power supply of the image processing chip to restore the image processing chip to a normal state.

7. The method according to claim 6, It is characterized in that The method further comprises: The application processor detects the state of the image processing chip again after reconfiguring the power supply of the image processing chip; When the state of the image processing chip is still abnormal, the application processor marks the image processing chip as a transparent transmission mode and keeps the image sensor connected to the transparent transmission path.

8. The method according to any one of claims 4 to 7, It is characterized in that The method further comprises: When the image processing chip is in a normal state, the application processor controls the switch module to connect the image sensor to the image signal processing path, so as to process the image data collected by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

9. The method according to claim 4, It is characterized in that The application processor detects the state of the image processing chip, including: When the electronic device is powered on or a camera of the electronic device is enabled, the application processor detects a state of the image processing chip.

10. The method according to claim 4, It is characterized in that When the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

11. The method according to claim 4, It is characterized in that After the application processor controls the switch module to connect the image sensor to the transparent transmission path, the method further includes: Transparently transmitting the image data acquired by the image sensor to the application processor through the transparent transmission path; The application processor uses a software algorithm to replace the image signal processing path to process the image data.

12. A device for handling abnormal shooting, It is characterized in that The electronic device provided in any one of claims 1 to 3, wherein the abnormal shooting processing device comprises: A detection module, used to detect the state of the image processing chip; The control module is used to control the switch module to connect the image sensor with the transparent transmission path when the state of the image processing chip is abnormal, so as to transparently transmit the image data collected by the image sensor to the application processor for processing through the transparent transmission path.

13. An electronic device, It is characterized in that The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the shooting abnormality processing method as described in any one of claims 4 to 11 are implemented.

14. A readable storage medium, It is characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the shooting abnormality processing method according to any one of claims 4 to 11 are implemented.

Images