Camera anomaly detection and processing method, electronic system and storage medium

Abstract

The invention provides a camera anomaly detection and processing method, an electronic system and a storage medium. The camera anomaly detection and processing method comprises the following steps: performing access verification on a camera in the camera system; if the access verification fails, resetting the camera; and in response to the reset, performing a first configuration on the camera, where the first configuration includes an address configuration.

Description

Technical Field

[0001] The embodiments in the present disclosure relate to the field of camera devices, and particularly to a method for camera anomaly detection and processing, an electronic system, and a storage medium. Background Art

[0002] The camera in a camera system is an important component in an autonomous driving system. However, when the camera performs image acquisition, it is often interfered by some external factors, resulting in abnormal operation of the serializer or photosensitive device in the camera system. Seriously, it may even lead to the failure of autonomous driving. Among them, the external factors can be electromagnetic interference, temperature change, power instability, mechanical vibration or impact, dust or moisture, etc.

[0003] The autonomous driving system requires the camera system to achieve real-time environmental perception and scene understanding. The camera system captures information such as surrounding roads, traffic signs, pedestrians, vehicles, etc., and provides visual data for the autonomous driving system to analyze and make decisions. If the camera system fails or is damaged, it may affect the understanding of road conditions by the autonomous driving vehicle and increase the risk of accidents. Therefore, a method that can detect camera anomalies and take recovery measures for the abnormal operation of the camera is needed to ensure the normal operation of the camera system. Summary of the Invention

[0004] In view of this, the present disclosure proposes a method for camera anomaly detection and processing, an electronic system, and a storage medium, which ensure the normal operation of the camera by performing anomaly detection and recovery on the camera system in real time.

[0005] The first aspect of the present disclosure proposes a method for camera anomaly detection and processing, including performing access verification on the camera in the camera system; if the access verification fails, resetting the camera; and in response to the reset, performing a first configuration on the camera, where the first configuration includes address configuration.

[0006] The second aspect of the present disclosure proposes an electronic system, which includes a memory and a processor. At least one computer program instruction is stored in the memory, and the at least one computer program instruction is loaded and executed by the processor to implement the method for camera anomaly detection and processing proposed by the present disclosure.

[0007] The third aspect of the present disclosure proposes a computer-readable storage medium, in which at least one computer program instruction is stored, and when the at least one computer program instruction is executed by a processor, it can implement the method for camera anomaly detection and processing proposed by the present disclosure. Brief Description of the Drawings

[0008] The accompanying drawings exemplarily illustrate embodiments and constitute a part of the specification, and are used together with the written description of the specification to explain the exemplary implementation manners of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts. In all the drawings, the same reference numerals refer to similar but not necessarily identical elements. Figure 1 is a schematic diagram showing a vehicle according to an embodiment of the present disclosure. Figure 2 is a block diagram showing an electronic system according to an embodiment of the present disclosure. Figure 3A is a schematic diagram showing the first process in a camera anomaly detection and processing method according to an embodiment of the present disclosure. Figure 3B is a schematic diagram showing the second process in a camera anomaly detection and processing method according to an embodiment of the present disclosure. Detailed Description of the Embodiments

[0009] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present disclosure, rather than all of them. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0010] In the present disclosure, the term "plurality" means two or more, unless otherwise specified. In the present disclosure, the term "and / or" describes the associated relationship of associated objects and covers any one of the listed objects and all possible combination manners. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0011] In the present disclosure, unless otherwise specified, the terms "first", "second", etc. are used to distinguish similar objects and are not intended to limit their positional relationship, chronological relationship or importance relationship. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present disclosure described herein can be implemented in a manner other than those illustrated or described herein.

[0012] In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these process, method, system, product or device.

[0013] Figure 1 It is a schematic diagram of a vehicle 100 traveling on a road 130. The vehicle 100 can be a sedan, a truck, a motorcycle, a bus, a recreational vehicle, an amusement park vehicle, a tram, a golf cart, a train, a trolleybus, or other vehicles. The vehicle 100 can operate completely or partially in an autonomous driving mode.

[0014] The vehicle 100 can include an autonomous driving (also referred to as driverless) system, so as to be able to operate completely or partially in an autonomous driving mode. In this sense, the vehicle 100 is also called an autonomous vehicle. When in the autonomous driving mode, the vehicle 100 can control itself. For example, the vehicle 100 can determine the current state of the vehicle and the current state of the environment where the vehicle is located, determine the predicted behavior of at least one other vehicle in the environment, determine the confidence level corresponding to the possibility that the at least one other vehicle performs the predicted behavior, and control the vehicle 100 itself based on the determined information. When in the autonomous driving mode, the vehicle 100 can operate without human interaction.

[0015] The vehicle 100 can include various sensors for sensing information about the environment and conditions of the vehicle, such as a camera 103. In addition to the camera, the sensors on the vehicle 100 can also include an inertial measurement unit (IMU), a global navigation satellite system (GNSS) transceiver (such as a global positioning system (GPS) transceiver), a radio detection and ranging (RADAR) sensor, a light detection and ranging (LIDAR) sensor, an acoustic sensor, or an ultrasonic sensor, etc. Those skilled in the art can also understand that although Figure 1 only one camera 103 is shown, the vehicle 100 can include more cameras.

[0016] The vehicle 100 can also include a computing system, and the computing system can include one or more computing devices, such as computing devices 110 and 120. The computing system can control some or all functions of the vehicle 100. The computing system (such as the computing devices 110 and / or 120 of the computing system) can include, for example, an autonomous driving control unit (also called an autonomous driving unit), and the autonomous driving unit can be composed of one or more algorithm modules for identifying, evaluating, and avoiding or bypassing potential obstacles in the environment where the vehicle 100 is located. In some embodiments, the autonomous driving unit is used to combine data from sensors to determine the driving path or trajectory of the vehicle 100. The autonomous driving system of the vehicle 100 can include, for example, sensors and a computing system.

[0017] Each of computing devices 110 and 120 may include at least one processor (which may include at least one microprocessor) and a memory (the memory is an example of a computer-readable storage medium), and the processor executes processing instructions stored in the memory. In some embodiments, the memory may contain processing instructions (e.g., program logic) that are executed by the processor to implement various functions of vehicle 100. In addition to storing the processing instructions, the memory may store various information or data, such as images received from a camera. Certain or all functions of the autonomous driving unit may be implemented using program code instructions residing in the memory of computing device 110 and / or 120 and executed by the processor. Vehicle 100 may also include a communication system (not shown in the figure), and the communication system may provide a way for vehicle 100 to communicate with one or more devices or other surrounding vehicles. In an exemplary embodiment, the communication system may communicate directly or through a communication network with one or more devices. The communication system may be, for example, a wired or wireless communication system. For example, the communication system may use 3G cellular communication (e.g., CDMA, EVDO, GSM / GPRS) or 4G cellular communication (e.g., WiMAX or LTE), and may also use 5G cellular communication. Optionally, the communication system may communicate with a wireless local area network (WLAN) (e.g., using ). Information / data may be propagated between the communication system of vehicle 100 and a computing device (e.g., computing device 106) remotely located with respect to vehicle 100 via network 114. Network 114 may be a single network or a combination of at least two different networks. Network 114 may include, but is not limited to, one or a combination of several of a local area network, a wide area network, a public network, a private network, etc.

[0018] Computing device 110 receives sensor data from sensors of vehicle 100 (e.g., camera 103), performs preliminary processing (e.g., format conversion) on the received sensor data, and then sends the processed sensor data to computing device 120. The autonomous driving unit in computing device 120 further processes the preliminarily processed sensor data received from computing device 110 (e.g., object detection and tracking) to obtain information about the road or objects around the vehicle for route planning and navigation of the vehicle.

[0019] It should be noted that although Figure 1 in the example, the computing system of vehicle 100 includes two computing devices, namely, computing devices 110 and 120, the computing system of vehicle 100 may include more or fewer computing devices. For example, the computing system of vehicle 100 may include only one computing device, and this computing device may have all the functions of computing devices 110 and 120.

[0020] Figure 2is a block diagram showing an electronic system 200 according to an embodiment of the present disclosure. The electronic system 200 is Figure 1 an example of an autonomous driving system of the vehicle.

[0021] As Figure 2 shown, in some embodiments, the electronic system 200 may include a computing device 202 and a camera system 204. The camera anomaly detection and processing method according to the embodiments of the present disclosure may be executed by the computing device 202. The computing device 202 may be Figure 1 an example of the computing device (such as the computing device 110) of the computing system in

[0022] wherein, the camera system 204 includes a camera 218. In addition, the camera system 204 may include more than one camera 218. The computing device 202 may further include a processor 206, a memory 208, and one or more deserializers 210. The memory 208 stores at least one computer program instruction. When the processor 206 executes the at least one computer program instruction, the method in any one of the embodiments described in the present disclosure can be implemented. The deserializer 210 is used to convert serial data into parallel data for providing to the processor 206 for processing.

[0023] The memory 208 may represent a machine-readable medium (or a computer-readable storage medium) on which one or more instruction sets, software, firmware, or other processing logic for implementing any one or more of the methods or functions described and / or claimed herein are stored. Although the machine-readable medium (or computer-readable storage medium) of the example embodiments may be a single medium, the term "machine-readable medium" (or computer-readable storage medium) should be understood to include a single non-transitory medium or multiple non-transitory media (such as a centralized or distributed database and / or associated caches and computing systems) that store one or more instruction sets. The term "machine-readable medium" (or computer-readable storage medium) may also be understood to include any non-transitory medium that is capable of storing, encoding, or carrying an instruction set for a machine to execute and cause the machine to execute any one or more of the methods of the various embodiments or capable of storing, encoding, or carrying a data structure utilized by or associated with such an instruction set. The term "machine-readable medium" (or computer-readable storage medium) may thus be understood to include, but is not limited to, solid-state memory, optical media, and magnetic media.

[0024] The deserializer 210 may be a deserializer that supports a Gigabit Multimedia Serial Link (GMSL) or a deserializer that supports a Flat Panel Display Link (FPD-Link).

[0025] In some embodiments, each camera in the camera system 204 may have substantially the same structure. For example, each camera 218 may include components such as a serializer 212, a power chip 214, and a photosensitive device 216. The photosensitive device is also referred to as an image sensor. The serializer 212 is used to convert parallel data into serial data. In addition, the serializer 212 is connected to the deserializer 210. The serializer 212 may be connected to the deserializer 210 through a coaxial cable. Each deserializer 210 may be connected to the serializers of one or more cameras 218. The deserializer 210 is used to receive the serial data transmitted from the serializer 212 and convert the serial data into parallel data. The power chip 214 is used to provide power to the camera system. The photosensitive device 216 is used to capture optical signals, convert optical information into electrical signals, and generate image data. Each camera 218 may also include Figure 2 an optical unit not shown, which may include, for example, one or more lenses to collect light from an object to be photographed (such as, Figure 1 an object around the vehicle 100 shown) and direct the light to the photosensitive device 216.

[0026] In some embodiments, the serializer 212 may be a serializer supporting GMSL or a serializer supporting FPD-Link.

[0027] The camera anomaly detection and handling method according to the embodiments of the present disclosure may be implemented by two processes in the computing device 202 (or the processor 206 of the computing device 202). Figure 3A FIG. is a flowchart showing the first process 320 of the camera anomaly detection and handling method according to an embodiment of the present disclosure; Figure 3B FIG. is a flowchart showing the second process 300 of the camera anomaly detection and handling method according to an embodiment of the present disclosure. Note that although Figure 3A and Figure 3B each step in is depicted as an independent block and seemingly separate steps, these steps should not be construed as necessarily being executed in the order shown.

[0028] Specifically, the camera anomaly detection and handling method is executed by the computing device 202 (such as the processor 206 of the computing device 202), and includes a first process 320 and a second process 300 that can be parallel. The following first describes the first process 320.

[0029] Step 322: The processor 206 acquires camera component information.

[0030] In this step, the processor 206 acquires the camera component information to ensure the correct operation of the camera system 204 and provide corresponding control. The camera component information may be the model, access method, or access information of the camera component.

[0031] In some embodiments, the processor 206 acquires the camera component information, for example, from an external configuration file. The external configuration file may be a text file or a data file storing camera component information, which contains configuration parameters such as the model, access method, access information, etc. of the camera component. In some embodiments, the access method refers to the way the processor communicates with the camera component. Different camera components may have different communication protocols or interfaces, such as Inter-Integrated Circuit (I2C), Serial Peripheral Interface (SPI), etc. In other words, if the access method of the camera component is I2C, the processor needs to use the I2C protocol for data exchange when communicating with it. In some embodiments, the access information refers to specific parameters or addresses, etc. required for communication. These information may include component addresses, register addresses, etc., depending on the communication protocol and the design of the camera component.

[0032] In some embodiments, by configuring the access mode and access information of the camera component, the processor 206 can flexibly communicate with camera components of different types or models to meet the requirements of different application scenarios. This flexibility in configuration enables the camera component to adapt to various different hardware and application environments.

[0033] As described above, the cameras in the camera system 204 have multiple camera components. The multiple camera components include, for example, the photosensitive device 216 and the serializer 212. The processor 206 can obtain the component information of the photosensitive device 216 and the component information of the serializer. The information of the photosensitive device 216 includes the model of the photosensitive device 216, the access mode of the photosensitive device 216, and / or the access information of the photosensitive device 216. Among them, the access mode of the photosensitive device 216 can be, for example, the I2C access mode. Therefore, the processor 206 can perform data exchange with the photosensitive device 216 through the I2C protocol. In some embodiments, the information of the serializer 212 includes the model of the serializer 212, the access mode of the serializer 212, and / or the access information of the serializer 212. Among them, the access mode of the serializer 212 can be the I2C access mode. Therefore, the processor can perform data exchange with the serializer through the I2C protocol.

[0034] Step 324: The processor 206 obtains the connection status of the camera 218.

[0035] In this step, the processor 206 determines the connection status between the camera 218 and the deserializer 210 in the computing device 202.

[0036] In some embodiments, the camera system may include one or more cameras. The computing device 202 may include a deserializer 210. The processor 206 may determine the connection status of the camera 218 by determining whether the deserializer 210 in the computing device 202 and the serializer 212 in the camera 218 are connected. Further, the processor 206 may read the register of the deserializer 210 to determine whether the deserializer 210 and the serializer 212 are connected, where the register of the deserializer 210 may be a status register. Generally, the deserializer stores information indicating whether the deserializer and the serializer are connected in the status register. If the deserializer 210 in the computing device 202 and the serializer 212 in the camera 218 are determined by the processor 206 to be connected, step 326 will be entered. If the deserializer 210 in the computing device 202 and the serializer 212 in the camera 218 are determined by the processor 206 to be not connected, step 324 will be re-entered, that is, the processor 206 continuously repeats reading the status register of the deserializer 210. In this way, during the operation of the electronic system 200, abnormal detection of the camera can be continuously performed.

[0037] Step 326: The processor 206 performs access verification on the camera 218.

[0038] In this step, the processor 206 performs access verification on the camera 218 in the camera system 204.

[0039] In some embodiments, the processor 206 accesses the camera 218 in the camera system 204. The access may include the processor 206 sending an instruction to the camera 218. After the camera 218 receives the instruction from the processor 206, the camera will reply to the processor 206 with a response. If the processor 206 can receive the response from the camera 218, it can be indicated that the access is successful; if the processor 206 cannot receive the response from the camera 218, it can be indicated that the access fails.

[0040] In some embodiments, the processor 206 verifies access to the camera 218 by reading the registers of the camera 218. Further, the processor 206 can verify access to the camera 218 by reading the registers of at least one of the serializer 212 or the photosensitive device 216 of the camera 218. The access verification is performed by comparing the information (such as a value) read from the registers of at least one of the serializer 212 or the photosensitive device 216 of the camera 218 with predetermined information (such as a value). For example, the processor 206 determines whether the value of the register of the serializer 212 is consistent with the corresponding predetermined value, or whether the value of the register of the photosensitive device 216 is consistent with the corresponding predetermined value.

[0041] When the access verification of the camera 218 is successful, step 324 is re-entered. In this way, during the operation of the electronic system 200, abnormal detection of the camera can be continuously performed. When the access verification of the camera 218 fails, step 328 is entered.

[0042] In some embodiments, the registers of the serializer may include a serializer address register, a serializer status register, a serializer control register, or a serializer data register. The registers of the photosensitive device may include a photosensitive device address register, a photosensitive device status register, a photosensitive device control register, or a photosensitive device data register.

[0043] Step 328: The processor 206 resets the camera 218.

[0044] In this step, the processor 206 resets the camera 218 that is determined to have failed the access verification. Further, resetting the camera includes restarting the camera 218.

[0045] In some embodiments, the processor 206 resetting the camera 218 includes controlling the power chip 214 of the camera 218 to perform a power-off reset on the camera 218.

[0046] Step 330: The processor 206 completes the basic configuration of the camera 218.

[0047] In this step, the processor 206 performs a basic configuration on the camera 218 according to the reset camera 218, and the basic configuration includes address configuration.

[0048] In some embodiments, the processor 206 configures the camera 218 for the first time according to the restarted camera 218. The first configuration includes address configuration because after the camera is restarted, the address of the camera 218 (such as the address of the serializer of the camera 218) is restored to the factory setting. For example, the address of the camera 218 (such as the address of the serializer of the camera 218) can be set through an integrated circuit bus. As mentioned above, the camera system 204 may include multiple cameras. To ensure that the computing device 202 (or the processor 206 of the computing device 202) can correctly identify and distinguish these cameras, basic configuration of the cameras is required to ensure that each camera has a unique identifier, that is, an address.

[0049] In some embodiments, the computing device 202 (or the processor 206 of the computing device 202) configures the address of the serializer 212 and / or the photosensitive device 216 of the camera 218.

[0050] In some embodiments, after the processor 206 completes the first configuration (i.e., the basic configuration) of the camera 218, the first process 320 enters step 324 again, and the processor 206 continues to obtain the connection status of the camera 218 and repeats steps 324 to 330 of the first process 320.

[0051] It should be noted that the first process 320 is described above for one camera in the camera system 204. In fact, the processor 206 of the computing device 202 will execute the above first process for each camera in the camera system 204. The following describes the second process 300, and then refer to Figure 3B .

[0052] Step 302: The processor 206 obtains camera component information.

[0053] In this step, the processor 206 obtains camera component information to ensure the correct operation of the camera system 204 and provide corresponding control. The camera component information can be the model, access method, or access information of the camera component.

[0054] In some embodiments, the processor 206 obtains camera component information from an external configuration file, for example. The external configuration file can be a text file or a data file storing camera component information, which contains configuration parameters such as the model, access method, access information, etc. of the camera components. In some embodiments, the access method refers to the way the processor communicates with the camera components. Different camera components may have different communication protocols or interfaces, such as Inter-Integrated Circuit (I2C), Serial Peripheral Interface (SPI), etc. In other words, if the access method of the camera component is I2C, the processor needs to use the I2C protocol for data exchange when communicating with it. In some embodiments, the access information refers to specific parameters or addresses, etc. required for communication. These information may include component addresses, register addresses, etc., depending on the communication protocol and the design of the camera component.

[0055] In some embodiments, by configuring the access method and access information of the camera component, the processor 206 can flexibly communicate with different types or models of camera components to meet the requirements of different application scenarios. This flexibility of configuration enables the camera component to adapt to various different hardware and application environments.

[0056] As described above, the camera in the camera system 204 has multiple camera components. The multiple camera components include, for example, a photosensitive device 216 and a serializer 212. The processor 206 can obtain the component information of the photosensitive device 216 and the component information of the serializer. The information of the photosensitive device 216 includes the model of the photosensitive device 216, the access method of the photosensitive device 216, and / or the access information of the photosensitive device 216. Among them, the access method of the photosensitive device 216 can be, for example, the I2C access method. Therefore, the processor 206 can perform data exchange with the photosensitive device 216 through the I2C protocol. In some embodiments, the information of the serializer 212 includes the model of the serializer 212, the access method of the serializer 212, and / or the access information of the serializer 212. Among them, the access method of the serializer 212 can be the I2C access method. Therefore, the processor can perform data exchange with the serializer through the I2C protocol.

[0057] Step 304: The processor 206 performs access verification on the camera 218.

[0058] In this step, the processor 206 performs access verification on the camera 218 in the camera system 204.

[0059] Since the first process 320 and the second process 300 can be carried out in parallel, step 304 and step 326 can be different steps that are independently executed.

[0060] In some embodiments, the processor 206 first accesses the camera 218 in the camera system 204. The access can be that the processor 206 sends an instruction to the camera 218. After the camera 218 receives the instruction from the processor 206, the camera will send a response back to the processor 206. If the processor 206 can receive the response from the camera 218, it can be indicated that the access is successful; if the processor 206 cannot receive the response from the camera 218, it can be indicated that the access fails.

[0061] In some embodiments, the processor 206 accesses and verifies the camera 218 by reading the registers of the camera 218. Further, the processor 206 can access and verify the camera 218 by reading the registers of at least one of the serializer 212 or the photosensitive device 216 of the camera 218. The access verification is to compare the information (such as a value) read from at least one register of the serializer 212 or the photosensitive device 216 of the camera 218 with a predetermined information (such as a value). For example, the processor 206 determines whether the value of the register of the serializer 212 is consistent with the corresponding predetermined value, or whether the value of the register of the photosensitive device 216 is consistent with the corresponding predetermined value.

[0062] After the access verification of the camera 218 fails, step 306 is entered; after the access verification of the camera 218 is successful, step 308 is entered.

[0063] In some embodiments, the registers of the serializer can include a serializer address register, a serializer status register, a serializer control register, or a serializer data register. The registers of the photosensitive device can include a photosensitive device address register, a photosensitive device status register, a photosensitive device control register, or a photosensitive device data register.

[0064] Step 306: The processor 206 sets the flag bit to a specified value.

[0065] In this step, after the processor 206 determines that the access verification of the camera 218 fails, the processor 206 will set the flag bit to a specified value. The flag bit is, for example, a variable in a program or process. The processor 206 will set this variable to a specified value to indicate that the access verification of the camera fails.

[0066] In some embodiments, the flag bit can be used to represent a certain condition or event. Whether the flag bit is set to a specified value can indicate whether a certain condition or event has occurred. Generally speaking, if the flag bit defaults to 0, then the flag bit being set to a specified value different from the default value (for example, 1) indicates the occurrence of a certain condition or event. In some embodiments, after the processor 206 determines that the access verification for the camera 218 fails, the processor 206 will set the flag bit to the specified value; when the processor 206 determines that the access verification for the camera 218 is successful, the flag bit will not be set to the specified value.

[0067] In some embodiments, after the processor 206 sets the flag bit, the second process 300 will re-enter step 304, and the processor 206 will continuously re-perform the access verification for the camera 218 until the access verification for the camera 218 is successful. In this way, during the operation of the electronic system 200, abnormal detection of the camera can be continuously performed. In some embodiments, when the access verification is successful, step 308 will be entered.

[0068] When the first process 320 and the second process 300 are executed in parallel, when the first process 320 determines that the access verification for the camera 218 fails, the second process 300 will also determine that the access verification for the camera 218 fails. As described above, when the first process 320 determines that the access verification for the camera 218 fails, the camera 218 will be reset. After the camera 218 is reset, the camera 218 can be accessed successfully. However, since resetting the camera 218 by the first process 320 takes a certain amount of time, during the reset process of the camera 218, the second process 300 will continuously perform access verification on the camera 218 and each time it will fail. After the camera 218 is reset, the access verification by the second process 300 for the camera 218 will be successful.

[0069] Step 308, the processor 206 determines whether the flag bit is set to the specified value.

[0070] In this step, the processor 206 will determine whether the flag bit is set to the specified value. Further, that is, the processor 206 will determine whether the access verification for the camera 218 has ever failed and the camera 218 has not been repaired or reset.

[0071] In some embodiments, when the processor 206 determines that the flag bit is set to the specified value, the second process 300 will enter step 310.

[0072] In some embodiments, when the processor 206 determines that the flag bit is not set to a specified value (e.g., the flag bit is at its default value), the second process 300 returns to step 304, and the processor 206 re-verifies access to the camera 218. That is, when the processor 206 determines that the access verification to the camera 218 (e.g., after the previous repair or reset) has not failed, there is no need to enter step 310 to reset the camera. Therefore, the second process 300 returns to step 304, and the processor 206 verifies access to the camera.

[0073] Step 310, the processor 206 reconfigures the camera 218.

[0074] In this step, the processor 206 performs a second configuration on the camera (i.e., resets the camera). This is because if the flag bit is set to the specified value, it means that in the first process 320, step 328 will be entered to reset the camera 218, and after the camera is reset, the configuration of the camera (e.g., the camera sensor device 216 and the serializer 212) will be restored to the factory settings. Therefore, in order to enable the camera 218 to return to its normal operating state, the processor 206 resets the camera 218 in step 310. In some embodiments, the second configuration includes configuring parameters in the registers of the camera 218, where the parameters include at least one of the output image format, trigger mode, and exposure. The output image format can be the data format of the image generated by the camera, such as JPEG (Joint Photographic Experts Group), PNG (Portable Network Graphics), RAW (raw file), BMP (Bitmap), or TIFF (Tagged Image File Format). The trigger mode can be the way the camera starts image capture, such as instant trigger, external trigger, timed trigger, or software trigger. The exposure affects the brightness of the image.

[0075] In some embodiments, the parameters can further include resolution, focus parameters, and mode parameters. The resolution parameter is used to affect the clarity of the image; the focus parameters are used to control the focal length and focusing mode of the camera; the mode parameters are used to switch between different operating modes of the camera; the mode parameters can include auto mode or night mode.

[0076] In some embodiments, step 310 further includes the processor 206 resetting the flag bit, for example, restoring the flag bit to its default value.

[0077] In some embodiments, after the processor 206 completes the reset of the camera, the second process 300 will re-enter step 304, and the processor 206 will re-perform the access verification on the camera 218. In this way, during the operation of the electronic system 200, the camera can be continuously detected for anomalies.

[0078] It should be noted that the second process 300 is described above for one camera in the camera system 204. In fact, the processor 206 of the computing device 202 will execute the above second process for each camera in the camera system 204.

[0079] When a deserializer is connected to multiple serializers (i.e., serializers of multiple cameras), if the connection to one camera fails (at this time, the access verification of this camera fails), the deserializer may modify its own configuration information. For example, it may modify the number of connected serializers in its configuration information, and the deserializer will also modify the configuration information of its multiple pins accordingly. In this case, in the first process, the processor 206 not only needs to reset the camera 218 with failed access verification, but also needs to modify the configuration of the deserializer connected to this camera, which takes a certain amount of time. In the embodiments of the present disclosure, by setting the parallel first process and second process, after the processor 206 resets the camera 218 in the first process, the processor 206 can quickly reset the camera 218 in the second process.

[0080] The embodiments of the present disclosure also provide a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by the computer, the computer executes the data processing method in any of the above embodiments.

[0081] In summary, the present disclosure performs real-time anomaly detection on the camera system to reset and restart the cameras with abnormal operation or access failure, and at the same time determines the timing of camera reconfiguration by setting the flag bit, so that the cameras after reset and restart can return to the normal operation state to ensure the normal operation of the cameras.

[0082] The described various embodiments can also be implemented as one or more computer program products, that is, one or more modules of computer program instructions encoded on a computer-readable medium to be executed by the camera anomaly detection and processing device or to control the operation of the camera anomaly detection and processing device. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a substance composition affecting the machine-readable propagation signal, or a combination of one or more of them.

[0083] The term "camera anomaly detection and handling device" in this disclosure encompasses all devices, equipment, and machines for handling camera anomaly detection and handling, such as programmable processors, computers, or multiple processors or computers. In addition to hardware, the camera anomaly detection and handling device may also include code that creates an execution environment for computer programs, such as code that constitutes processor firmware, protocol stacks, database management systems, operating systems, or a combination of one or more of them.

[0084] Some of the embodiments mentioned in this disclosure can be implemented as devices or modules using hardware circuits, software, or a combination thereof. For example, a hardware circuit implementation may include discrete analog and / or digital components, which may be integrated, for example, as part of a printed circuit board. Alternatively or additionally, the disclosed components or modules can be implemented as application-specific integrated circuits (ASICs) and / or field-programmable gate array (FPGA) devices. Additionally or alternatively, some embodiments may include digital signal processors (DSPs). Similarly, the various components or sub-components within each module can be implemented in software, hardware, or firmware. Any one of the connection methods and media known in the art can be used to provide connections between modules and / or components within a module.

[0085] Although this document includes many details, these details should not be construed as limitations on the scope of the claimed disclosure, but rather as descriptions of features specific to particular embodiments. Certain features described in the context of different embodiments herein can also be combined in a single embodiment. Conversely, the various features described in the context of a single embodiment can also be separated or implemented in multiple embodiments in any suitable sub-combination. Additionally, although features may be described as acting in certain combinations and even initially claimed, one or more features from the claimed combination can in some cases be removed from the combination, and the claimed combination can be directed to a sub-combination or a variation of a sub-combination. Similarly, although operations are depicted in the figures in a particular order, this should not be understood to require that such operations be performed in the particular order shown or in a sequential order, or that all of the illustrated operations be performed to achieve a desired result.

[0086] Only a few embodiments and examples have been described, and other implementations, enhancements, and variations can be made based on what is described and shown in this disclosure.

Claims

1. A method for camera anomaly detection and handling, characterized in that, The method includes: Performing a first access verification on a camera in a camera system; If the first access verification fails, resetting the camera; and In response to the reset, performing a first configuration on the camera, where the first configuration includes address configuration.

2. The camera anomaly detection and processing method according to claim 1, characterized in that Performing a first access verification on a camera in the camera system includes: Performing a first access verification on the camera in the camera system by a first process, The method further includes: Performing a second access verification on the camera in the camera system by a second process; If the second access verification is successful, determining whether to perform a second configuration on the camera based on a flag bit.

3. The camera anomaly detection and processing method according to claim 2, wherein The method further includes: If the second access verification fails, setting the flag bit.

4. The camera anomaly detection and processing method according to claim 2, wherein, Performing a second configuration on the camera includes: Configuring parameters in a register of the camera, where the parameters include at least one of an output image format, a triggering mode, and an exposure of the camera.

5. The camera anomaly detection and processing method according to claim 2, wherein Performing a second access verification on the camera in the camera system by a second process includes: Performing a second access verification on the camera by the second process by reading a register of the camera.

6. The camera anomaly detection and processing method according to claim 5, characterized in that, The camera includes a serializer and a photosensitive device, Performing a second access verification on the camera by the second process by reading a register of the camera includes: Performing a second access verification on the camera by the second process by reading a register of at least one of the serializer and the photosensitive device of the camera.

7. The camera anomaly detection and processing method according to any one of claims 2-6, characterized in that, The first process and the second process are executed in parallel independently of each other by a processor.

8. The camera anomaly detection and processing method according to any one of claims 1-6, characterized in that, The camera includes a serializer and a photosensitive device, performing a first access verification on the camera includes: Performing a first access verification on the camera by the first process by reading a register of at least one of the serializer and the photosensitive device of the camera.

9. The camera anomaly detection and processing method according to any one of claims 1-6, characterized in that, The camera system includes multiple cameras, performing a first access verification on a camera in the camera system includes: Performing a first access verification on each camera in the camera system separately.

10. The camera anomaly detection and processing method according to any one of claims 1-6, characterized in that, Performing the reset on the camera includes: Controlling the power of the camera to perform a power-off reset on the camera.

11. The camera anomaly detection and processing method according to any one of claims 1-6, characterized in that, It further includes: Judging the connection state of the camera; And Based on the connection state, performing the access verification on the camera in the camera system.

12. The camera anomaly detection and processing method according to claim 11, wherein, The camera includes a serializer, judging the connection state of the camera includes: Judging whether a deserializer and the serializer of the camera are connected by a computing device having a deserializer.

13. The camera anomaly detection and processing method according to claim 12, characterized in that, Judging whether the deserializer and the serializer of the camera are connected includes: Reading a register of the deserializer to judge whether the deserializer and the serializer of the camera are connected.

14. The camera anomaly detection and processing method according to claim 11, wherein The camera system includes multiple cameras, the deserializer is connected to at least two cameras among the multiple cameras, the method further includes: If the first access verification fails, reconfiguring the deserializer.

15. An electronic system, characterized in that, The electronic system includes: A memory storing at least one computer program instruction; A processor, where the at least one computer program instruction is loaded and executed by the processor to implement the camera anomaly detection and processing method according to any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that, Stored in the computer-readable storage medium are at least one computer program instruction, and when the at least one computer program instruction is executed by a processor, it can implement the camera anomaly detection and processing method described in any one of claims 1 to 14.

Images