Abnormal shooting processing method and device, electronic equipment and medium

Abstract

The application discloses a photographing exception processing method and device, electronic equipment and medium, and belongs to the technical field of communication. The method comprises the following steps: detecting the state of an image processing chip; in the case that the state of the image processing chip is abnormal, making the image sensor communicate with a transparent transmission channel through a control switch module, so as to transmit the image data collected by the image sensor to an application processor through the transparent transmission channel for processing.

Description

Technical Field

[0001] This application belongs to the field of communication technology, and specifically relates to a method, device, electronic device and medium for handling shooting anomalies. Background Technology

[0002] Currently, the camera functions of mobile phones and other electronic devices are becoming increasingly powerful. In some application scenarios, to improve shooting processing efficiency and image quality, external chips—that is, additional image processing chips—can be used to process the captured image data. The processed image data is then transmitted to the application processor (AP) for further processing. However, in practical applications, limitations imposed by the interface and physical conditions of the external chip can lead to situations where the user's shooting function fails to work as expected. In such cases, the user often needs to restart the camera or even the entire electronic device to resolve the issue, which can result in low shooting efficiency. Summary of the Invention

[0003] The purpose of this application is to provide a method, apparatus, electronic device, and medium for handling shooting anomalies, which can solve the problem of low shooting efficiency caused by the need to restart the camera or even the electronic device when shooting anomalies occur in electronic devices equipped with external chips.

[0004] In a first aspect, embodiments of this application provide an electronic device, including: an image sensor, an image processing chip, and an application processor. The image processing chip includes a switching module, an image signal processing path, and a pass-through path. The signal output terminal of the image sensor is connected to the signal input terminal of the image signal processing path and the signal input terminal of the pass-through path via the switching module. The signal output terminal of the image signal processing path is connected to a first signal input terminal of the application processor, and the signal output terminal of the pass-through path is connected to a second signal input terminal of the application processor. The switching module is used to connect the image sensor to the image signal processing path or to the pass-through path.

[0005] The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or is transmitted to the application processor through the pass-through path.

[0006] Secondly, embodiments of this application provide a method for handling shooting anomalies, executed by the electronic device described in the first aspect, the method comprising:

[0007] The application processor detects the status of the image processing chip;

[0008] In the event of an abnormal state of the image processing chip, the application processor controls the switching module to connect the image sensor to the transparent transmission path, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transparent transmission path.

[0009] Thirdly, embodiments of this application provide a camera capture anomaly processing device, which incorporates the electronic device described in the first aspect. The camera capture anomaly processing device includes:

[0010] The detection module is used to detect the status of the image processing chip;

[0011] The control module is used to control the switch module to connect the image sensor to the transparent transmission path when the image processing chip is in an abnormal state, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transparent transmission path.

[0012] Fourthly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the shooting anomaly handling method as described in the first aspect.

[0013] Fifthly, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the shooting anomaly handling method described in the first aspect.

[0014] In a sixth aspect, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the shooting anomaly handling method as described in the first aspect.

[0015] In a seventh aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the shooting anomaly handling method as described in the first aspect.

[0016] In this embodiment, the electronic device includes an image sensor, an image processing chip, and an application processor. The image processing chip includes a switching module, an image signal processing path, and a pass-through path. The signal output terminal of the image sensor is connected to the signal input terminal of the image signal processing path and the signal input terminal of the pass-through path via the switching module. The signal output terminal of the image signal processing path is connected to a first signal input terminal of the application processor, and the signal output terminal of the pass-through path is connected to a second signal input terminal of the application processor. The switching module is used to connect the image sensor to the image signal processing path or to the pass-through path. The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or transmitted to the application processor via the pass-through path.

[0017] The method for handling abnormal shooting includes: the application processor detecting the status of the image processing chip; in the event of an abnormal status of the image processing chip, the application processor controlling the switching module to connect the image sensor to the transmission path, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transmission path.

[0018] In this way, by adding a pass-through path to the external chip, i.e. the image processing chip, of the electronic device, it is possible to switch to the pass-through path when the external chip is in an abnormal state, and pass the captured image data to the application processor for processing, thereby ensuring that the shooting function can be carried out normally. Since this process does not require restarting the camera or the electronic device, it can improve the efficiency of abnormal recovery and the shooting efficiency. Attached Figure Description

[0019] Figure 1 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0020] Figure 2 This is one of the flowcharts of the shooting anomaly handling method provided in the embodiments of this application;

[0021] Figure 3 This is a schematic diagram of a single-path external chip used in the electronic device provided in the embodiments of this application;

[0022] Figure 4 This is the second flowchart of the shooting anomaly handling method provided in the embodiments of this application;

[0023] Figure 5 This is a structural diagram of the imaging anomaly handling device provided in the embodiments of this application;

[0024] Figure 6 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0025] Figure 7 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0026] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0027] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0028] To make the embodiments of this application clearer, the background technical deficiencies on which the embodiments of this application are based will be described in further detail below, and the purpose and improvement points of the embodiments of this application will be briefly introduced, as follows:

[0029] The solutions for restarting the camera and other electronic devices in case of shooting abnormalities have shortcomings. While the first solution—restarting the camera—can be guided to allow users to immediately use the camera's shooting function, it can lead users to doubt the quality of the camera software, giving them the impression that although it has an image processing chip, the software is of poor quality. Therefore, this solution can easily create a very poor user experience and affect user trust in the product.

[0030] The second option, restarting the electronic device, would raise concerns about product quality. While a power outage and restart would fix all the malfunctions, it would provide an extremely poor user experience.

[0031] Therefore, existing solutions for restarting camera software or electronic devices have serious drawbacks that negatively impact user experience. Furthermore, these solutions require users to wait a considerable amount of time, meaning recovery from anomalies is slow, which severely affects shooting efficiency.

[0032] Therefore, the purpose of this application is to provide a user-unobtrusive method for handling external chip shooting anomalies. From the perspective of user experience, this method ensures the reliability of external chip anomaly handling while achieving stable and reliable shooting function in various scenarios and improving the recovery efficiency of shooting anomalies.

[0033] The embodiments of this application can achieve the following: based on the specific limitations of the shooting chip, the shooting function can be performed normally without the user's notice in abnormal situations; and the abnormal recovery efficiency is improved in the event of a recoverable abnormality in the external chip.

[0034] The electronic device, shooting anomaly handling method, and apparatus provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0035] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application, such as... Figure 1 As shown, it includes:

[0036] The system comprises an image sensor 11, an image processing chip 12, and an application processor 13. The image processing chip 12 includes a switch module 121, an image signal processing path 122, and a transmission path 123. The signal output terminal of the image sensor 11 is connected to the signal input terminals of the image signal processing path 122 and the transmission path 123 via the switch module 121. The signal output terminal of the image signal processing path 122 is connected to the first signal input terminal of the application processor 13, and the signal output terminal of the transmission path 123 is connected to the second signal input terminal of the application processor 13. The switch module 121 is used to connect the image sensor 11 to the image signal processing path 122 or to the transmission path 123.

[0037] The image data output by the image sensor 11 is processed by the image signal processing path 122 and then transmitted to the application processor 13, or transmitted to the application processor 13 through the transparent transmission path 123.

[0038] like Figure 1As shown in this embodiment, to improve image processing efficiency and image quality, an additional image processing chip, specifically an image signal processor (ISP) 12, is deployed after the image sensor 11 (camera) and before the application processor 13 (AP). This chip can carry different AI image processing algorithms, respectively, to improve overall image processing performance and quality. The image processing chip 13 can be understood as an external chip for image processing.

[0039] In this embodiment, the image signal processing path 122 can be understood as the normal processing path in the external chip. The path can be equipped with corresponding circuit units for specific image processing functions that need to be implemented. For example, if the external chip is required to implement the noise reduction function of the image signal, a noise reduction circuit unit can be provided on the image signal processing path 122. Of course, the image signal processing path 122 can also be equipped with circuit units that implement other functions.

[0040] The pass-through path 123 is an additional path in the external chip that can directly transmit signals without any additional processing. Specifically, the raw image data acquired by the image sensor 11 can be directly transmitted to the AP through this pass-through path 123 without going through the image signal processing path 122. In this way, if the normal processing path of the external chip malfunctions, the processing can be skipped, and the raw image data can be transmitted to the AP for subsequent image processing.

[0041] In specific implementation, the switching module 121 controls the selection and switching of the external chip's path in conjunction with the abnormal situation of the external chip. That is, the switching module 121 controls the image sensor 11 to be connected to the image signal processing path 122 or the transparent transmission path 123, thereby selecting the corresponding path.

[0042] For example, the switch module 121 may include switches respectively disposed on the image signal processing path 122 and the transmission path 123, so as to realize whether the path is turned on or off by the switch on the corresponding path, so as to transmit or process image data through the turned-on path. The switch module 121 may also be as follows: Figure 1 As shown, there is a switch with its stationary end connected to the image sensor 11 and its two moving ends connected to the image signal processing path 122 and the transmission path 123, respectively. In this way, the corresponding path can be selected by switching on the corresponding path.

[0043] It should be noted that in some embodiments, the switch module 121 can be controlled by the AP, that is, the corresponding path can be selected by the switch control signal sent by the AP.

[0044] Optionally, the image signal processing path 122 is provided with an image processing unit, the input end of the image processing unit is connected to the signal input end of the image signal processing path 122, and the output end of the image processing unit is connected to the signal output end of the image signal processing path 122.

[0045] The signal input terminal of the transparent transmission path 123 is connected to the signal output terminal of the transparent transmission path 123, and the output signal of the transparent transmission path is the same as the input signal of the transparent transmission path.

[0046] Specifically, the image signal processing path 122 is provided with an image processing unit. In some embodiments, the image signal processing path 122 may be provided with multiple image processing units with different processing functions, such as image processing units corresponding to different functions such as noise reduction, dynamic range enhancement, and de-mosaic. In this way, the image processing units in the image signal processing path 122 can perform various image processing functions on the raw image data acquired by the camera.

[0047] The pass-through path 123 is a direct path without any circuit units. It is essentially a transmission cable, with the signal input and output terminals directly connected via a wire. The output signal of the pass-through path 123 is the same as its input signal; that is, the pass-through path 123 does not process the raw image data captured by the camera. This allows the raw image data to be directly transmitted to the AP for processing via the pass-through path 123, effectively avoiding problems caused by abnormalities in the normal processing path of the external chip.

[0048] Optionally, the image signal processing path 122 and the transparent transmission path 123 are powered independently.

[0049] In some embodiments, the image signal processing path 122 and the transmission path 123 can be powered independently without interference. That is, they are powered by their own independent power supplies, allowing for flexible activation of the appropriate path based on the application scenario, and enabling only the power supply of that path to be used. Furthermore, when a reset of each path is required, the image signal processing path 122 and the transmission path 123 can be reset independently, ensuring that resetting one path does not affect the working state of the other.

[0050] The electronic device in this embodiment includes an image sensor, an image processing chip, and an application processor. The image processing chip includes a switch module, an image signal processing path, and a pass-through path. The signal output terminal of the image sensor is connected to the signal input terminals of the image signal processing path and the pass-through path via the switch module. The signal output terminal of the image signal processing path is connected to a first signal input terminal of the application processor, and the signal output terminal of the pass-through path is connected to a second signal input terminal of the application processor. The switch module is used to connect the image sensor to the image signal processing path or to the pass-through path. The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or transmitted to the application processor via the pass-through path. Thus, by adding a pass-through path to the external chip (image processing chip) of the electronic device, it is possible to switch to the pass-through path when the external chip is malfunctioning, and transmit the captured image data to the application processor for processing, thereby ensuring normal shooting function. Since this process does not require restarting the camera or the electronic device, it improves the efficiency of fault recovery and shooting efficiency.

[0051] This application provides a method for handling external chip anomaly recovery by employing an independent hardware data pass-through path and combining it with a system software solution, such as... Figure 1 As shown, the chip is designed with an independent transparent transmission path. The following section further combines... Figure 2 This describes the specific steps included in the system software solution.

[0052] Please see Figure 2 , Figure 2 This is a flowchart of the shooting anomaly handling method provided in the embodiments of this application, by... Figure 1 The electronic device in the illustrated embodiment performs, as follows: Figure 2 As shown, the method includes the following steps:

[0053] Step 201: The application processor detects the status of the image processing chip.

[0054] Specifically, the status of the external chip, i.e. the image processing chip, can be detected during the use of the electronic device's shooting function, or the status of the external chip can be periodically detected when the electronic device is powered on, specifically to detect whether the external chip's status is abnormal.

[0055] In some embodiments, the external chip can use status bits in a register to indicate whether the chip status is abnormal; for example, a status bit marked as 1 indicates a chip malfunction, and a status bit marked as 0 indicates a normal chip. Therefore, the above-mentioned detection of the image processing chip status can be achieved by the application processor reading the status bits in the register to determine whether the chip status is abnormal.

[0056] It should be noted that, in the embodiments of this application, the external chip refers to the image processing chip.

[0057] Optionally, step 201 includes:

[0058] When the electronic device is powered on or the camera of the electronic device is activated, the application processor detects the status of the image processing chip.

[0059] In some embodiments, the application processor can detect the status of the external chip when the electronic device is powered on or when the camera of the electronic device is turned on. This means that the status of the external chip can be checked before it is powered on. This ensures that abnormal states of the external chip are detected promptly, allowing for timely intervention and preventing users from waiting too long while using the camera, thus avoiding a poor shooting experience.

[0060] Step 202: In the event of an abnormal state of the image processing chip, the application processor controls the switching module to connect the image sensor to the pass-through path, so as to pass-through the image data acquired by the image sensor to the application processor AP for processing through the pass-through path.

[0061] The aforementioned abnormalities in the image processing chip include, but are not limited to: abnormalities caused by cosmic rays, partial functional defects caused by chip manufacturing, functional abnormalities caused by chip aging, functional abnormalities caused by abnormal software operation, and hardware abnormalities caused by software misconfiguration.

[0062] In this embodiment, when an abnormality is detected in the image processing chip, the external chip can be used to process the image data acquired during shooting without the external chip. Therefore, the application processor can control the switching module to switch the image sensor and the transmission path, i.e., switch to the transmission path, and directly transmit the image data acquired by the image sensor to the application processor (AP) for processing through the transmission path. This avoids the inability to process the captured image data in a timely manner due to the abnormality of the external chip, and also avoids the inability to use the shooting function due to the abnormality of the external chip.

[0063] Optionally, after the application processor controls the switching module to connect the image sensor to the transparent transmission path, the method further includes:

[0064] The image data acquired by the image sensor is transmitted to the application processor through the transmission path.

[0065] The application processor uses a software algorithm to replace the image signal processing path to process the image data.

[0066] In some embodiments, the image data is transmitted to the AP for processing. Specifically, the AP software algorithm is used at the AP to replace the image signal processing path through an external chip. That is, the data stream and image processing are all implemented by the AP system software to ensure the continuity of the user's usage scenario.

[0067] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0068] In some embodiments, the external chip can be configured to default to using an independent data pass-through channel when powered on. That is, the switching module can be set to automatically switch the image sensor and the pass-through path when the external chip is powered on, initially selecting the pass-through path. The image data acquired by the image sensor is directly passed through the pass-through path to the application processor (AP) for processing. This avoids the inability to process the captured image data immediately due to anomalies when the external chip is powered on, and also prevents the shooting function from being unusable when the camera is turned on.

[0069] Optionally, in the event of an abnormal state of the image processing chip, the method further includes:

[0070] The application processor resets the software code running on the image processing chip to restore the image processing chip to its normal state.

[0071] In some embodiments, when an abnormal state of the external chip is detected, certain measures can be taken to attempt to repair the abnormal state. Specifically, the software of the external chip can be reset first, that is, the software code running on the image processing chip can be reset, such as erasing and rewriting the code on the external chip before running it, in order to attempt to repair the software malfunction. In specific implementation, the software reset of the external chip can be controlled through the AP terminal.

[0072] It should be noted that after resetting the software of the external chip, a certain period of time can be waited, such as 10-20ms, before rereading the status of the external chip. If the status of the external chip returns to normal, it can be determined that the abnormality was caused by a software malfunction. If the status of the external chip remains abnormal, the software malfunction can be ruled out, and a subsequent hardware reset can be performed. Alternatively, the software of the external chip can be repeatedly reset multiple times to try to repair the software malfunction through multiple software resets, avoiding situations where a single reset cannot fix the software malfunction. If the external chip's status still cannot be restored to normal after multiple software resets, a subsequent hardware reset can be performed, i.e., reconfiguring the hardware power supply.

[0073] In this implementation, abnormal situations caused by software malfunctions in the external chip can be repaired by promptly performing a software reset on the external chip.

[0074] Optionally, the method further includes:

[0075] After resetting the software code, the application processor checks the state of the image processing chip again.

[0076] If the image processing chip is still in an abnormal state, the application processor reconfigures the power supply to the image processing chip to restore it to a normal state.

[0077] In some embodiments, after the software of the external chip is reset, the status of the external chip can be detected again, such as by reading the status bit of the register again, to determine whether the status of the external chip has returned to normal after the software reset. For example, if the status of the external chip returns to normal after the software reset, the status bit of the register is marked as 0 to indicate that the status is "normal", otherwise it remains 1 to indicate that the status is "abnormal".

[0078] In this embodiment, if the status of the external chip is still abnormal, that is, if the software abnormality is ruled out, the external chip can be further reset in hardware, such as reconfiguring the power supply of the external chip. For example, the hardware power supply and related hardware initialization configuration of the external chip can be reset to try to repair the abnormal chip status caused by the abnormal hardware configuration.

[0079] It should be noted that after reconfiguring the hardware power supply of the external chip, you can wait for a certain period of time, such as 30-40ms, and then read the status of the external chip again. If the status of the external chip returns to normal, it can be determined that the abnormality was caused by a hardware configuration error. If the status of the external chip is still abnormal, it can be determined that the external chip has an unrepairable fault and cannot be used anymore. In this case, the chip fault can be reported and the external chip should no longer be used to process the captured image data.

[0080] In this implementation, if software reset of the external chip fails to restore normal operation, the abnormal situation caused by the abnormal hardware configuration of the external chip can be repaired by timely hardware power reconfiguration of the external chip. That is, a multi-layer recovery mechanism is used to restore the chip to normal operation.

[0081] Optionally, the method further includes:

[0082] The application processor reconfigures the power supply to the image processing chip and then checks the status of the image processing chip again.

[0083] If the image processing chip is still in an abnormal state, the application processor marks the image processing chip as pass-through mode and keeps the image sensor connected to the pass-through path.

[0084] In some embodiments, after the hardware power supply of the external chip is reconfigured, the status of the external chip can be detected again, such as by reading the status bit of the register again, to determine whether the status of the external chip has returned to normal after the hardware power supply is reconfigured. For example, if the status of the external chip returns to normal after the hardware power supply is reconfigured, the status bit of the register is marked as 0 to indicate that the status is "normal", otherwise it remains 1 to indicate that the status is "abnormal".

[0085] In this embodiment, if the status of the external chip is still abnormal, it indicates that the external chip may have a serious fault or be damaged. At this time, the application processor can permanently mark the status of the external chip as pass-through mode, that is, keep the image sensor connected to the pass-through path, so that the pass-through path is used in subsequent shooting and the captured image data is directly passed through to the AP for processing.

[0086] Furthermore, the external chip hardware failure can also be reported, such as reporting the failure to the manufacturer and never using the failed external chip again.

[0087] This implementation method allows for marking the chip as no longer needed to process captured image data in the event of an external chip failure, thus avoiding unnecessary waiting during abnormal shooting and eliminating the need to check the chip status every time the chip is powered on.

[0088] Optionally, the method further includes:

[0089] When the image processing chip is in normal condition, the application processor controls the switching module to connect the image sensor to the image signal processing path, so as to process the image data acquired by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

[0090] In some embodiments, when the external chip is detected to be in normal condition for the first time, or when the external chip is restored to normal condition after a software reset or hardware power reconfiguration, the external chip can be used normally to process the captured image data to improve the shooting effect. Therefore, the application processor can control the switching module to switch the image sensor and the image signal processing path, that is, switch to the image signal processing path and process the image data acquired by the image sensor through the image signal processing path.

[0091] For example, the image data can be preprocessed through the image signal processing path, such as frame selection and registration. Further image enhancement processing, such as noise reduction, dynamic range enhancement, and image synthesis, can be performed after preprocessing.

[0092] Finally, the image data processed by the image signal processing path can be transmitted to the application processor for further processing, such as image quality enhancement.

[0093] This implementation method ensures that when the external chip is functioning normally, the chip's normal processing path is used to process the captured image data, thus ensuring image processing and shooting effects.

[0094] See Figure 3 The image signal processing path 122 or the pass-through path 123 can be selected to process or pass through the image data collected by the image sensor 11 according to the state of the external chip, i.e., the image signal processing path 122. That is, one path is used each time processing.

[0095] In summary, the following describes the implementation methods. Figure 4 The flowchart shown in this embodiment illustrates the implementation of the embodiments of this application:

[0096] like Figure 4 As shown, the specific steps include:

[0097] Step 101: After the device is powered on or the camera is turned on, the external chip will default to using an independent data pass-through channel, and the status of the external chip needs to be checked.

[0098] Step 102: If the external chip is functioning normally, the system will switch to the normal external chip data processing path, and the AP will use the data processed by the image signal processing path accordingly. If the external chip is malfunctioning, it will use the pass-through path. Malfunctions include, but are not limited to: malfunctions caused by cosmic rays, chip manufacturing defects, chip aging, software malfunctions, and hardware malfunctions caused by software misconfiguration.

[0099] Step 103: The AP obtains the data from the external chip's transparent transmission path and uses the AP software algorithm to replace the external chip's processing solution. The data flow and image processing are all implemented by the system software to ensure the continuity of the user's usage scenario.

[0100] Step 104: Simultaneously reset the software of the external chip on the AP side to eliminate software malfunctions.

[0101] Step 105: After the software reset is complete, wait for a certain period of time and then read the status of the external chip again (repeated a certain number of times); if the status of the external chip is normal, end the exception handling and display that it has returned to normal, and return to step 102; otherwise, proceed to the next step.

[0102] Step 106: Reset the external chip hardware power supply and initialize the configuration.

[0103] Step 107: After waiting for a period of time, read and judge the status of the external chip again; if the status is normal, end the exception handling and display that it has returned to normal, and return to step 102; otherwise, proceed to the next step.

[0104] Step 108: On the AP side, permanently mark the status of the external chip as transparent transmission mode, that is, the transparent transmission path will be fixed in the future, and the external chip hardware failure will be reported, and the external chip will never be used.

[0105] The embodiments of this application enable user-insensitive anomaly handling for external chips, increasing the fault tolerance of product components and improving the overall stability and quality of the product at the system engineering level. Furthermore, it effectively enhances the stability of external chips.

[0106] In the shooting anomaly handling method of this application embodiment, the application processor detects the state of the image processing chip; when the image processing chip is in an abnormal state, the application processor controls the switching module to connect the image sensor to the pass-through path, so that the image data acquired by the image sensor is passed through the pass-through path to the application processor for processing. Thus, by adding a pass-through path to the external chip (i.e., the image processing chip) of the electronic device, it is possible to switch to the pass-through path when the external chip is in an abnormal state, and pass the captured image data to the application processor for processing, thereby ensuring normal shooting function. Since this process does not require restarting the camera or the electronic device, it improves the efficiency of anomaly recovery and shooting efficiency.

[0107] The shooting anomaly handling method provided in this application can be executed by a shooting anomaly handling device. This application uses the shooting anomaly handling device executing the shooting anomaly handling method as an example to illustrate the shooting anomaly handling device provided in this application.

[0108] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of the imaging anomaly handling device provided in the embodiments of this application, which is installed in the electronic equipment provided in the embodiments of this application, such as... Figure 5 As shown, the imaging anomaly processing device 500 includes:

[0109] Detection module 501 is used to detect the status of the image processing chip;

[0110] The control module 502 is used to control the switch module to connect the image sensor to the transparent transmission path when the image processing chip is in an abnormal state, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transparent transmission path.

[0111] Optionally, the imaging anomaly processing device 500 also includes:

[0112] The reset module is used to reset the software code running on the image processing chip in the event of an abnormal state of the image processing chip, so as to restore the image processing chip to a normal state.

[0113] Optionally, the detection module 501 is further configured to detect the state of the image processing chip again after the software code has been reset;

[0114] The camera anomaly handling device 500 also includes:

[0115] The reconfiguration module is used to reconfigure the power supply of the image processing chip to restore the image processing chip to a normal state if the image processing chip is still in an abnormal state.

[0116] Optionally, the image processing device 500 is also used to detect the state of the image processing chip again after the power supply of the image processing chip has been reconfigured;

[0117] The camera anomaly handling device 500 also includes:

[0118] The marking module is used to mark the image processing chip as pass-through mode and maintain the connection between the image sensor and the pass-through path when the image processing chip is still in an abnormal state.

[0119] Optionally, the control module 502 is further configured to, when the image processing chip is in normal condition, control the switch module to connect the image sensor to the image signal processing path, so as to process the image data acquired by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

[0120] Optionally, the detection module 501 is also used to detect the state of the image processing chip when the electronic device is powered on or the camera of the electronic device is enabled.

[0121] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0122] The shooting anomaly handling device 500 in this embodiment detects the state of the image processing chip. If the image processing chip is in an abnormal state, it controls the switching module to connect the image sensor to the pass-through path, so that the image data acquired by the image sensor is transmitted to the application processor for processing via the pass-through path. Thus, by adding a pass-through path to the external chip (image processing chip) of the electronic device, it is possible to switch to the pass-through path when the external chip is in an abnormal state, and transmit the captured image data to the application processor for processing, thereby ensuring normal shooting function. Since this process does not require restarting the camera or the electronic device, it improves anomaly recovery efficiency and shooting efficiency.

[0123] The camera anomaly processing device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific device.

[0124] The camera error handling device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0125] The shooting anomaly handling device provided in this application embodiment can achieve... Figure 2 or Figure 4 The various processes implemented in the method embodiments can achieve the same technical effect, and will not be described again here to avoid repetition.

[0126] Optionally, such as Figure 6 As shown, this application embodiment also provides an electronic device 600, including a processor 601 and a memory 602. The memory 602 stores a program or instructions that can run on the processor 601. When the program or instructions are executed by the processor 601, they implement the various steps of the above-described shooting anomaly handling method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0127] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0128] Figure 7 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0129] The electronic device 700 includes, but is not limited to, components such as: radio frequency unit 701, network module 702, audio output unit 703, input unit 704, sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, and processor 710.

[0130] Those skilled in the art will understand that the electronic device 700 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 710 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 7 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0131] The processor 710 is used for:

[0132] Detect the status of the image processing chip;

[0133] In the event of an abnormal state of the image processing chip, the switching module is controlled to connect the image sensor to the transmission path, so that the image data acquired by the image sensor can be transmitted to the application processor for processing through the transmission path.

[0134] Optionally, the processor 710 is further configured to reset the software code running on the image processing chip in the event of an abnormal state of the image processing chip, so as to restore the image processing chip to a normal state.

[0135] Optionally, the processor 710 is also used for:

[0136] The state of the image processing chip is checked again after the software code is reset.

[0137] If the image processing chip is still in an abnormal state, the power supply to the image processing chip is reconfigured to restore the image processing chip to a normal state.

[0138] Optionally, the processor 710 is also used for:

[0139] The status of the image processing chip is checked again after the power supply of the image processing chip is reconfigured;

[0140] If the image processing chip is still in an abnormal state, mark the image processing chip in pass-through mode and keep the image sensor connected to the pass-through path.

[0141] Optionally, the processor 710 is also used for:

[0142] When the image processing chip is in normal condition, the switch module is controlled to connect the image sensor to the image signal processing path, so that the image data acquired by the image sensor is processed by the image signal processing path, and then the image data processed by the image signal processing path is transmitted to the application processor for processing.

[0143] Optionally, the processor 710 is also used for:

[0144] When the electronic device is powered on or the camera of the electronic device is activated, the status of the image processing chip is detected.

[0145] Optionally, when the image processing chip is powered on, the switch module is set by default to connect the image sensor and the transparent transmission path.

[0146] The electronic device in this application embodiment can achieve the same technical effects as the foregoing embodiments, and will not be described again here to avoid repetition.

[0147] It should be understood that, in this embodiment, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042. The GPU 7041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 706 may include a display panel 7061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include a touch detection device and a touch controller. Other input devices 7072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0148] The memory 709 can be used to store software programs and various data. The memory 709 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 709 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 709 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0149] The processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 710.

[0150] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described methods for handling abnormal shooting conditions and achieve the same technical effect. To avoid repetition, these will not be described again here.

[0151] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0152] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described embodiments of the shooting anomaly handling method, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0153] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0154] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-described method for handling abnormal shooting conditions, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0155] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0156] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0157] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An electronic device, characterized in that, include: The system comprises an image sensor, an image processing chip, and an application processor. The image processing chip is positioned after the image sensor and before the application processor. The image processing chip includes a switching module, an image signal processing path, and a pass-through path. The signal output terminal of the image sensor is connected to the signal input terminals of the image signal processing path and the pass-through path via the switching module. The signal output terminal of the image signal processing path is connected to a first signal input terminal of the application processor, and the signal output terminal of the pass-through path is connected to a second signal input terminal of the application processor. The switching module is used to connect the image sensor to the image signal processing path or to the pass-through path. The image data output by the image sensor is processed by the image signal processing path and then transmitted to the application processor, or transmitted to the application processor through the pass-through path. The image signal processing path is provided with an image processing unit. The input end of the image processing unit is connected to the signal input end of the image signal processing path, and the output end of the image processing unit is connected to the signal output end of the image signal processing path. The signal input terminal of the transparent transmission path is connected to the signal output terminal of the transparent transmission path, and the output signal of the transparent transmission path is the same as the input signal of the transparent transmission path. The image signal processing path and the transparent transmission path are powered independently.

2. A method for handling shooting anomalies, characterized in that, Performed by the electronic device of claim 1, the method includes: The application processor detects the status of the image processing chip; In the event of an abnormal state of the image processing chip, the application processor controls the switching module to connect the image sensor to the transparent transmission path, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transparent transmission path.

3. The method according to claim 2, characterized in that, In the event of an abnormal state of the image processing chip, the method further includes: The application processor resets the software code running on the image processing chip to restore the image processing chip to its normal state.

4. The method according to claim 3, characterized in that, The method further includes: After resetting the software code, the application processor checks the state of the image processing chip again. If the image processing chip is still in an abnormal state, the application processor reconfigures the power supply to the image processing chip to restore it to a normal state.

5. The method according to claim 4, characterized in that, The method further includes: The application processor reconfigures the power supply to the image processing chip and then checks the status of the image processing chip again. If the image processing chip is still in an abnormal state, the application processor marks the image processing chip as pass-through mode and keeps the image sensor connected to the pass-through path.

6. The method according to any one of claims 2 to 5, characterized in that, The method further includes: When the image processing chip is in normal condition, the application processor controls the switching module to connect the image sensor to the image signal processing path, so as to process the image data acquired by the image sensor through the image signal processing path, and then transmit the image data processed by the image signal processing path to the application processor for processing.

7. The method according to claim 2, characterized in that, The application processor detects the state of the image processing chip, including: When the electronic device is powered on or the camera of the electronic device is activated, the application processor detects the status of the image processing chip.

8. The method according to claim 2, characterized in that, When the image processing chip is powered on, the switching module is set by default to connect the image sensor and the transparent transmission path.

9. The method according to claim 2, characterized in that, After the application processor controls the switching module to connect the image sensor to the transparent transmission path, the method further includes: The image data acquired by the image sensor is transmitted to the application processor through the transmission path. The application processor uses a software algorithm to replace the image signal processing path to process the image data.

10. A device for handling abnormal shooting conditions, characterized in that, The electronic device according to claim 1, wherein the abnormal shooting processing device comprises: The detection module is used to detect the status of the image processing chip; The control module is used to control the switch module to connect the image sensor to the transparent transmission path when the image processing chip is in an abnormal state, so as to transmit the image data acquired by the image sensor to the application processor for processing through the transparent transmission path.

11. An electronic device, characterized in that, It includes a processor and a memory, the memory storing programs or instructions that can run on the processor, the programs or instructions being executed by the processor to implement the steps of the shooting anomaly handling method as described in any one of claims 2 to 9.

12. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the shooting anomaly handling method as described in any one of claims 2 to 9.

Images