Camera configuration system, method, vehicle, storage medium and program product

The device configuration and verification mechanism of the dual-controller architecture solves the problem that low-security-level controllers cannot meet the video stream requirements and fast startup of high-security-level controllers, thus achieving a balance between security and real-time performance in camera configuration.

CN120786173BActive Publication Date: 2026-01-02ZHEJIANG GEELY HLDG GRP CO LTD +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202511294806.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-09-11
Publication Date
2026-01-02
Estimated Expiration
2045-09-11

AI Technical Summary

Technical Problem

In the existing technology, controllers with low functional safety levels cannot meet the video stream requirements of high functional safety level controllers for cameras, and also cannot achieve the requirement of fast startup.

Method used

The system adopts a dual-controller architecture. The first controller, with a low security level, quickly writes the camera configuration information through the device configuration connection and then closes the connection. The second controller, with a high security level, performs verification and feedback through the device verification connection after the connection is closed, forming a dual-channel isolation mechanism for device configuration and verification.

Benefits of technology

While meeting the rapid startup requirements of low-security-level controllers, high functional safety requirements are achieved through the verification mechanism of high-security-level controllers, forming a safety closed loop to ensure the reliability and security of camera configuration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120786173B_ABST
    Figure CN120786173B_ABST
Patent Text Reader

Abstract

The present specification provides a camera configuration system and method, a vehicle, a storage medium and a program product, which are applied to a vehicle. The vehicle is configured with a first controller and a second controller sharing a camera. The first controller and the camera establish a device configuration connection, and the second controller and the camera establish a device verification connection. The functional safety level requirement of the camera for the first controller is lower than that for the second controller. The first controller is configured to write device configuration information to the camera through the device configuration connection, close the device configuration connection, and receive a device configuration verification result from the second controller. The second controller is configured to acquire the written device configuration information in the camera through the device verification connection when the device configuration connection is closed, verify the acquired device configuration information, and send the corresponding device configuration verification result to the first controller.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present specification relates to the technical field of vehicles, and in particular to a camera configuration system and method, a vehicle, a storage medium, and a program product. BACKGROUND

[0002] In a vehicle system, there are essential differences in the use requirements of different controllers for a shared camera. The core requirement of one type of controller is extremely short camera startup time to meet its real-time requirement for environmental information, but the functional safety level requirement of the camera is usually low, such as a smart cockpit controller (Domain Head Unit, DHU). The core requirement of another type of controller is to obtain a video stream with a specific functional safety level (Automotive Safety Integrity Level, ASIL, also known as automotive safety integrity level), and the camera startup time requirement is relatively relaxed, such as an autonomous driving domain controller (Autonomous Driving Control Unit, ADCU) or a body domain controller (Body Domain Control Unit, BDCU). Based on the above two types of controllers, the industry urgently needs a camera configuration method to meet the requirements of each controller.

[0003] In related technologies, to meet the fast startup requirement of the first controller, the corresponding camera is usually connected and directly processed by the first controller. However, the signal provided by the camera also needs to meet the high functional safety level required by the second controller. Since the processing unit of the first controller is usually designed only for a low functional safety level, its hardware architecture and software mechanism lack the necessary ability to implement high-level functional safety, and therefore cannot meet the safety requirements of the second controller. SUMMARY

[0004] Therefore, the present specification provides a camera configuration system and method, a vehicle, a storage medium, and a program product to solve the deficiencies in related technologies.

[0005] Specifically, the present specification is implemented through the following technical solutions:

[0006] According to a first aspect of the present specification, a camera configuration system is provided, applied to a vehicle, the vehicle being configured with a first controller and a second controller sharing a camera, the first controller and the camera establishing a device configuration connection, and the second controller and the camera establishing a device verification connection; the functional safety level requirement of the first controller for the camera is lower than that of the second controller; wherein:

[0007] The first controller is configured to write device configuration information to the camera through the device configuration connection, close the device configuration connection, and receive a device configuration verification result from the second controller.

[0008] The second controller is configured to, when the device configuration connection is closed, acquire the device configuration information written in the camera through the device verification connection, verify the acquired device configuration information, and send a corresponding device configuration verification result to the first controller.

[0009] According to a second aspect of the present specification, a configuration method of a camera is provided, which is applied to a first controller configured in a vehicle, the first controller sharing a camera with a second controller configured in the vehicle, the first controller establishing a device configuration connection with the camera, and the second controller establishing a device verification connection with the camera; the functional safety level requirement of the first controller on the camera is lower than that of the second controller; and the method comprises:

[0010] writing device configuration information to the camera through the device configuration connection;

[0011] closing the device configuration connection, so that the second controller acquires the device configuration information written in the camera through the device verification connection and verifies the acquired device configuration information;

[0012] receiving a device configuration verification result from the second controller.

[0013] According to a third aspect of the present specification, a configuration method of a camera is provided, which is applied to a second controller configured in a vehicle, the second controller sharing a camera with a first controller configured in the vehicle, the first controller establishing a device configuration connection with the camera, and the second controller establishing a device verification connection with the camera; the functional safety level requirement of the first controller on the camera is lower than that of the second controller; and the method comprises:

[0014] when the device configuration connection is closed, acquiring device configuration information written in the camera through the device verification connection, the device configuration information being written to the camera by the first controller through the device configuration connection;

[0015] verifying the acquired device configuration information and sending a corresponding device configuration verification result to the first controller.

[0016] According to a fourth aspect of the present specification, there is provided a processor, a memory for storing processor-executable instructions, a first controller, a second controller, and a camera; wherein the processor implements the steps of the method of any one of the second aspect and the third aspect by running the executable instructions.

[0017] According to a fifth aspect of the present specification, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method of any one of the second aspect and the third aspect.

[0018] According to a sixth aspect of the present specification, there is provided a computer program product comprising computer program / instructions which, when executed by a processor, implements the steps of the method of any one of the second aspect and the third aspect.

[0019] In the present specification, the contradiction that a low-security-level controller cannot guarantee high-security requirements is solved by reconstructing the first controller and the second controller architecture, i.e., the first controller with fast startup but low security level is connected to quickly write configuration and immediately close the connection through device configuration, meeting the real-time requirement; at the same time, the second controller with high security level is connected to obtain configuration information through device verification connection for high-reliability verification after the configuration connection is closed, and the result is fed back to the first controller, thereby filling the fundamental defect that a low-level functional safety controller cannot achieve high-level functional safety through the safety mechanism of the second controller while retaining the speed advantage of the first controller, and further meeting the safety requirements of the second controller while meeting the fast startup requirements of the first controller. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the present specification, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present specification, and those skilled in the art can also obtain other drawings according to these drawings without creative labor.

[0021] Figure 1 is a schematic diagram of the configuration system for the camera according to an exemplary embodiment of the present specification;

[0022] Figure 2 is a schematic diagram of the configuration system for the camera according to an exemplary embodiment of the present specification;

[0023] Figure 3 is a schematic diagram of the configuration system for the camera according to an exemplary embodiment of the present specification;

[0024] Figure 4is a flow diagram of another method for configuring a camera according to an example embodiment of the present specification;

[0025] Figure 5 is a structural diagram of a device according to an example embodiment of the present specification;

[0026] Figure 6 is a structural diagram of a configuration device for a camera according to an example embodiment of the present specification;

[0027] Figure 7 is a structural diagram of another configuration device for a camera according to an example embodiment of the present specification. DETAILED DESCRIPTION

[0028] The example embodiments will be described in detail herein with reference to the attached drawings. In the following description, same numbers refer to same elements in all figures. The following detailed description includes specific details for the purpose of providing a thorough understanding of the various aspects of the embodiments. However, it will be apparent to those skilled in the art that the embodiments can be practiced without these specific details. In some instances, well-known structures and components are not described in detail in order to avoid obscuring aspects of the described embodiments.

[0029] The terminology used in the present specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the present specification. As used in the present specification and the appended claims, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0030] It is to be understood that although the terms first, second, third, etc. can be used herein to describe various information, these terms are not intended to denote a temporal or chronological order. Rather, these terms are used only to distinguish one from another. For example, a first information can be termed a second information, and similarly, a second information can also be termed a first information, without departing from the scope of the present specification. As used herein, the word "if' can be interpreted to mean "when" or "upon" or "in response to determining" taking into account the context in which the term is used.

[0031] Embodiments of the traffic accident guiding method of the present specification will be described in detail below with reference to the accompanying drawings.

[0032] Figure 1 is a structural diagram of a traffic accident guiding system according to an example embodiment of the present specification. As shown in Figure 1 the system can include a first controller 12, a second controller 14, and a camera 16 in a vehicle 10.

[0033] The vehicle 10 adopts a dual-controller architecture to realize single-camera safety sharing. The first controller 12 and the second controller 14 access the shared camera 16 through independent physical links to form a dual-channel isolation mechanism of device configuration connection and device verification connection. At the same time, the vehicle 10 includes pure electric, hybrid or fuel vehicle models, which are not limited in this specification.

[0034] The first controller 12 is a low safety level configuration subject, which has a functional safety level requirement for the camera 16 that is not higher than that of the second controller 14, for example, QM (Quality Management) level, but has millisecond-level startup capability. The controller writes device configuration information to the camera 16 through the device configuration connection, and closes the connection immediately after writing is completed to meet the real-time requirement. At the same time, it receives the device configuration verification result from the second controller 14, and decides whether to reinitialize according to the verification state. Taking DHU as an example, when it is the first controller 12, its core requirement is to quickly start the camera to realize real-time environmental perception, for example, less than 5 seconds of sentinel mode initialization, but it does not need to bear the functional safety responsibility.

[0035] The second controller 14 is a high safety level verification subject, which has a functional safety level requirement for the camera 16 that is higher than that of the first controller 12, for example, ASIL B level or above. After the device configuration connection is closed, the controller obtains the configuration information in the camera 16 through the physically isolated device verification connection, and performs ASIL level diagnosis. The verification result is fed back to the first controller 12 through the inter-controller communication interface to form a safety closed loop. Its verification delay is relatively large compared with the startup of the first controller 12, so it can form a time effectiveness complement with the first controller 12. Taking ADCU as an example, when it is the second controller 14, its core requirement is to obtain a video stream that meets the ASIL B level safety requirement, such as line parking control, and its initialization process allows synchronous multi-sensor startup timing.

[0036] The camera 16 is an image acquisition device carried in the vehicle 10, for example, a camera module based on a surround-view camera or a front-view vehicle-mounted camera, and its registers are exposed to the device configuration connection and the device verification connection at the same time. At the same time, the configuration stage only responds to the write instruction of the first controller 12, and in the verification stage, it only provides read-only access to the second controller 14. The above-mentioned dual-channel architecture can meet the real-time configuration requirement of the low safety level controller, and also provide a verifiable data source for the high safety level controller.

[0037] In the above configuration system, first, the first controller with fast startup but low security level writes configuration to the camera through a device configuration connection and closes the connection, thereby meeting the real-time requirement of the first controller; at the same time, after the above device configuration connection is closed, the second controller with high security level obtains configuration information through a device verification connection for high-reliability verification, and feeds back the result to the first controller, thereby retaining the speed advantage of the first controller while filling the fundamental defect of the low-level functional safety controller that cannot realize high-level functional safety through the safety mechanism of the second controller.

[0038] The above device configuration connection is a data writing channel between the first controller and the camera, which can be realized in the form of an Inter-Integrated Circuit (I2C) or a similar master-slave serial communication protocol (such as Serial Peripheral Interface, SPI) and the like. This connection can be used for the first controller to transmit device configuration information such as resolution, frame rate, and exposure parameters to the camera. Specifically, it can be realized by operating two basic signal lines: the Serial Clock Line (SCL) controls the timing synchronization, and the Serial Data Line (SDA) carries the configuration data stream. For example, the system-on-chip (SoC) of the DHU as the first controller can establish an I2C connection with the camera through an I2C channel and an I2C connection as the above device configuration connection. Figure 2 2 For example, the SoC of the DHU as the first controller can establish an I2C connection with the camera through an I2C channel and an I2C connection as the above device configuration connection. 2 For example, the SoC of the DHU as the first controller can establish an I2C connection with the camera through an I2C channel and an I2C connection as the above device configuration connection.

[0039] The above device verification connection is a security verification channel between the second controller and the camera, which can be realized by I2C or enhanced protocols, such as Serial Peripheral Interface with CRC (SPI-CRC). This connection can be completely isolated from the above device configuration connection through independent pins / wiring, etc., thereby ensuring the blocking of the fault propagation path. After detecting that the device configuration connection is closed, the second controller can read the device configuration information in the camera register through the above channel and execute an ASIL-compliant diagnostic algorithm such as Cyclic Redundancy Check (CRC). Figure 2 For example, the SoC of the ADU as the second controller can also establish an I2C connection with the camera through an I2C channel and an I2C connection as the above device configuration connection. 2 For example, the SoC of the ADU as the second controller can also establish an I2C connection with the camera through an I2C channel and an I2C connection as the above device configuration connection.

[0040] ​As mentioned above, the first controller can establish or disconnect the device verification connection by introducing a control module that is independent of the device configuration connection channel. This physical separation ensures that the use of any one connection does not occupy or interfere with the channel of the other connection, avoiding the conflict between the device verification connection and the device configuration connection that cannot work effectively at the same time due to sharing the same physical data channel such as the SDA / SCL pin pair. The corresponding physical form of the control module in this specification is not limited, which can be an integrated I Figure 2 2 C level, or an external element independent of the first controller.

[0041] Based on this, the microcontroller unit (MCU) in the first controller can actively control the control module to disconnect the physical channel used by the device configuration connection according to the predefined safety strategy, such as immediate execution or execution after a specified delay, by controlling the enable signal or switching the switch state, etc., after receiving the confirmation signal from the SoC of the first controller that the device configuration information is successfully written to the camera, thereby preventing subsequent unauthorized tampering and releasing the communication resources of the device configuration connection to create conditions for safe access of the device verification connection. Conversely, if the MCU receives an indication that the SoC fails to write the device configuration information, or fails to receive a successful confirmation within the expected time, it will perform operations according to the pre-set error handling process, including but not limited to: instructing the SoC to retry writing configuration information for a pre-set number of times, reporting configuration failure events and error types to higher-level controllers such as vehicle central controllers, triggering a degradation mode or safely shutting down related functions according to functional safety requirements, and choosing to keep the device configuration connection for further diagnosis or reconfiguration attempts, etc.

[0042] For the second controller, after the device configuration connection is actively disconnected by the MCU of the first controller, the second controller can access the camera using the device verification connection. Specifically, the second controller reads the device configuration information stored in the camera register and previously written by the SoC of the first controller through this connection. Then, the second controller performs a pre-set diagnostic verification algorithm on the read device configuration information to determine whether the camera is successfully configured. Finally, the second controller needs to send the device configuration verification result to the first controller through the established secure communication mechanism. The so-called secure communication mechanism can be, for example Figure 2 ​The IP-based scalable service-oriented middleware (Scalable Service-Oriented Middleware over IP, SOME / IP) interface between the first controller and the second controller can also be implemented through a controller area network (Controller Area Network, CAN) and Ethernet, and the present specification does not limit this.

[0043] At this point, the first controller reliably receives the device configuration verification result sent by the second controller through the above-mentioned secure communication mechanism. The result explicitly indicates the verification state of the device configuration information and can contain relevant diagnostic details, such as the actual calculated CRC value, error location, etc. Accordingly, the first controller can determine whether the device configuration information currently running in the camera is consistent with the expected written configuration and has not been tampered with. If the verification result indicates that the configuration is correct, the first controller can confirm that the camera configuration is valid and allow it to enter a normal working state or perform subsequent operations. Conversely, if the verification result indicates that the configuration is incorrect, such as CRC mismatch, timeout without receiving the result, or receiving an invalid / incorrectly formatted result, etc., the first controller will trigger a pre-set fault handling process.

[0044] On the basis of the dual-channel security mechanism at the device level, the system further expands the coverage of security verification, forming a layered security monitoring architecture. Specifically, the configuration verification originally targeting the camera as a whole, such as between the first controller and the camera, and between the second controller and the camera, is extended to the information configured by the first controller and the second controller themselves.

[0045] The SoC of the first controller can establish a corresponding element configuration connection with the first type of element in the first controller, and the SoC of the second controller can establish a corresponding element verification connection with the first type of element in the first controller and the second type of element in the second controller, respectively. Among them, Figure 2For example, the first type of element can include a serializer in the first controller for converting a parallel video stream from the camera into serial data, a deserializer for receiving the original video stream from the camera and converting it into parallel data, and a power management integrated circuit (PMIC) for providing configurable power supply parameters for the camera. The second type of element can include a deserializer inside the second controller, which can be used to receive the video stream forwarded by the serializer of the first controller. Meanwhile, the element configuration connection and the element verification connection can be implemented using the same protocols and channels as the device configuration connection and the device verification connection described above, and this specification does not limit them.

[0046] At this time, the first controller can write the corresponding element configuration information, such as the serializer transmission rate and the PMIC output voltage, to the first type of element through the element configuration connection. After receiving the configuration completion confirmation signal from the SoC, the first controller MCU can cut off the physical configuration channel of the corresponding element. Meanwhile, in the case where the element configuration connection is closed, the SoC in the second controller can obtain the element configuration information written in the first type of element and the second type of element through the element verification connection, i.e., the element configuration information in the first type of element and the configuration written to the deserializer when the SoC is powered on. Further, the obtained element configuration information is verified, such as the set value-actual value closed loop verification of the PMIC or the double CRC verification of the serializer / deserializer configuration. The corresponding element verification result can be sent to the first controller together with or separately from the device configuration verification result through a secure communication mechanism.

[0047] Those skilled in the art can understand that the closing operation of the element configuration connection and the device configuration connection can be associated with the same operation, such as Figure 2 The SoC of the DHU in the middle can access the same set of I 2 The C-level channel connects the camera with all the first type of elements, i.e., the serializer, the deserializer, and the PMIC. In other words, at this time, only the I2C master controller enable signal needs to be closed to simultaneously disconnect the device configuration connection with the camera and the element configuration connection with all the first type of elements, thereby avoiding the timing risk introduced by multiple switching operations and ensuring the synchronous isolation of the device and element configuration channels.

[0048] In addition, the SoC of the second controller can access the element configuration information in each element in a multiplexing manner, such as using the chip select signal to switch the access target based on the SPI bus to achieve time division multiplexing.

[0049] As mentioned earlier, the serializer and deserializer in the first type of component, and the deserializer in the second type of component, can be used to achieve efficient transmission of video stream data or to provide video stream data to the SoCs of the first and second controllers. Specifically, the serializer converts parallel data into serial data that is easy to transmit at high speed over a line, while the deserializer, on the contrary, is responsible for converting the received serial data stream back into a parallel data stream so that the receiving SoC can process this data. Figure 2 For example, the deserializer of the first type of component, the DHU, can convert the video stream data transmitted by the camera via a Gigabit Multimedia Serial Link (GMSL) from a serial data stream to a parallel data stream. This parallel data stream is then provided to the DHU's SoC by the Mobile Industry Processor Interface (MIPI) to implement vehicle services such as Sentry Mode. Simultaneously, it provides a serializer to the DHU, which converts the parallel data stream back into a serial data stream and transmits it via GMSL to the deserializer of the second type of component, the ADCU. Finally, the deserializer converts the video stream data back into a parallel data stream, which is then provided to the ADCU's SoC by the MIPI to implement vehicle services such as parking control. At this point, both the first and second controllers also receive the video stream data generated by the camera.

[0050] In addition to processing the aforementioned video stream data, the SoC of the first controller can also work with its own MCU to perform power management for the camera, for example, by... Figure 2 When the SoC of the DHU determines that the camera function is abnormal through the device configuration verification result, it can generate a restart request command to the MCU, and the MCU can control MIPI to perform a power restart operation on the camera based on the command.

[0051] Based on static configuration verification, this system, by reusing device verification connections, empowers the second controller with the ability to diagnose the camera's running status in real time, forming a security protection system that combines dynamic and static features.

[0052] In an embodiment, the second controller can further acquire device dynamic information in the camera through the device verification connection, and perform anomaly detection on the acquired device dynamic information; and send the corresponding device detection result to the first controller. After the configuration verification is completed, the device verification connection can automatically switch to a dynamic monitoring mode for acquiring the device dynamic information. The device dynamic information in the camera can include safety mechanism data (SM data) in the corresponding register, such as clock jitter, operating temperature of the camera, and real-time data such as data integrity and frame rate stability of the corresponding video. The second controller can predict possible failures of the camera and perform early warning according to a preset priority rule.

[0053] Of course, this mechanism can also be applied to the first type of element and the second type of element, that is, by multiplexing the element verification connection, the second controller is given the real-time diagnostic capability of the runtime state of each element, and this specification is not limited in this regard.

[0054] In addition, the second controller in the above embodiment is in an enabled state by default, that is, in a normal state of being powered on or awakened. In particular, if the second controller is in a disabled state due to power-off or hibernation, etc., the first controller can choose not to perform device configuration verification of the camera, and directly apply the camera data from the configuration of the first controller by the first controller, while also directly acquiring device dynamic information in the camera through the device configuration connection and verifying the acquired device dynamic information, to finally detect the state of the camera.

[0055] Figure 3 is a flowchart of a configuration method of a camera according to an example embodiment of the present specification. As shown in Figure 3 the method is applied to a first controller configured in a vehicle, the first controller and a second controller configured in the vehicle share a camera, the first controller and the camera establish a device configuration connection, the second controller and the camera establish a device verification connection; the functional safety level requirement of the first controller for the camera is lower than that of the second controller; the method comprises:

[0056] Step S302, write device configuration information to the camera through the device configuration connection;

[0057] Step S304, close the device configuration connection, so that the second controller acquires the written device configuration information in the camera through the device verification connection, and verifies the acquired device configuration information;

[0058] Step S306, receiving the device configuration verification result from the second controller.

[0059] As described above, the system on chip (SoC) of the first controller is connected to the first type of elements in the first controller through corresponding element configuration connections, and the system on chip (SoC) of the second controller is connected to the first type of elements in the first controller and the second type of elements in the second controller through corresponding element verification connections; the method further comprises:

[0060] writing corresponding element configuration information to the first type of elements through the element configuration connections;

[0061] closing the element configuration connections;

[0062] receiving the element configuration verification result from the second controller.

[0063] As described above, the first type of elements include a serializer for transmitting video stream data of the camera, a deserializer, and a power management integrated circuit for the camera;

[0064] The second type of elements include a deserializer for transmitting video stream data of the camera.

[0065] As described above, the method further comprises:

[0066] receiving video stream data from the camera through the deserializer in the first type of elements, and sending the video stream data to the second controller through the serializer in the first type of elements.

[0067] As described above, the method further comprises:

[0068] In the case where the second controller is not enabled, obtaining the device configuration information written in the camera through the device configuration connections, and verifying the obtained device configuration information.

[0069] Figure 4 is another flowchart of a camera configuration method according to an exemplary embodiment of the present specification. As shown in Figure 4 the method is applied to a second controller configured in a vehicle, the second controller sharing a camera with a first controller configured in the vehicle, the first controller being connected to the camera through device configuration connections, and the second controller being connected to the camera through device verification connections; the functional safety level requirement of the first controller for the camera is lower than that of the second controller; the method comprises:

[0070] Step S402, in the case that the device configuration connection is closed, the device verification connection is used to obtain the device configuration information written in the camera, which is written by the first controller through the device configuration connection to the camera.

[0071] Step S404, the obtained device configuration information is verified, and the corresponding device configuration verification result is sent to the first controller.

[0072] As described above, the system on chip (SoC) of the first controller establishes a corresponding element configuration connection with the first type of element in the first controller, and the system on chip (SoC) of the second controller establishes a corresponding element verification connection with the first type of element in the first controller and the second type of element in the second controller, respectively; the method further comprises:

[0073] In the case that the element configuration connection is closed, the element verification connection is used to obtain the element configuration information written in the first type of element and the second type of element, respectively, and the obtained element configuration information is verified; the element configuration verification result of the first type of element is sent to the first controller.

[0074] As described above, the first type of element includes a serializer for transmitting video stream data of the camera, a deserializer, and a power management integrated circuit for the camera;

[0075] The second type of element includes a deserializer for transmitting video stream data of the camera.

[0076] As described above, the method further comprises:

[0077] The video stream data from the first controller is received by the deserializer in the second type of element.

[0078] As described above, the method further comprises:

[0079] The device dynamic information in the camera is obtained through the device verification connection, and the obtained device dynamic information is detected for abnormalities; and the corresponding device detection result is sent to the first controller.

[0080] Figure 5 FIG. 1 is a schematic structural diagram of an electronic device in an example embodiment. Please refer to Figure 5At the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and can also include other required hardware. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs, and at the logical level, forms a kind of camera configuration device. Of course, in addition to the software implementation, the present specification does not exclude other implementation modes, such as logic device or software and hardware combined mode and the like, that is, the execution subject of the following processing flow is not limited to each logical unit, but can also be hardware or logic device.

[0081] Corresponding to the foregoing embodiment of the camera configuration method, the present specification also provides an embodiment of the camera configuration device.

[0082] Reference is made to Figure 6 , Figure 6 is a structural schematic diagram of a kind of camera configuration device shown in an exemplary embodiment. As Figure 7 Indicated, the device is applied to the first controller configured in vehicle, the first controller shares camera with the second controller configured in vehicle, the first controller establishes device configuration connection with the camera, the second controller establishes device verification connection with the camera;The functional safety level requirement of the camera of the first controller is lower than the second controller;The device includes:

[0083] Configuration information writing unit 602, for writing device configuration information to the camera through the device configuration connection;

[0084] Connection closing unit 604, for closing the device configuration connection, so that the second controller obtains the device configuration information written in the camera through the device verification connection, and verifies the obtained device configuration information;

[0085] Verification result receiving unit 606, for receiving device configuration verification result from the second controller.

[0086] Optionally, the system on chip SoC of the first controller establishes corresponding element configuration connection with the first type element in the first controller, and the system on chip SoC of the second controller establishes corresponding element verification connection with the first type element in the first controller and the second type element in the second controller respectively;The device further includes:

[0087] Element configuration information writing unit, for writing corresponding element configuration information to the first type element through the element configuration connection;

[0088] Close the element configuration connection;

[0089] receive the element configuration verification result from the second controller.

[0090] Optionally, the first type of element includes a serializer for transmitting video stream data of the camera, a deserializer, and a power management integrated circuit for the camera.

[0091] The second type of element includes a deserializer for transmitting video stream data of the camera.

[0092] Optionally, the apparatus further includes:

[0093] a video stream data processing unit configured to receive video stream data from the camera through the deserializer in the first type of element, and transmit the video stream data to the second controller through the serializer in the first type of element.

[0094] Optionally, the method further includes:

[0095] an independent verification unit configured to, when the second controller is not enabled, acquire device configuration information written in the camera through the device configuration connection, and verify the acquired device configuration information.

[0096] Please refer to Figure 7 , Figure 7 is a structural schematic diagram of a configuration apparatus of a camera according to an example embodiment. As shown in Figure 7 , the apparatus is applied to a second controller configured in a vehicle, the second controller sharing a camera with a first controller configured in the vehicle, the first controller establishing a device configuration connection with the camera, and the second controller establishing a device verification connection with the camera; the first controller having a lower functional safety level requirement for the camera than the second controller; and the apparatus including:

[0097] a configuration information acquisition unit 702 configured to, when the device configuration connection is closed, acquire device configuration information written in the camera through the device verification connection, the device configuration information being written in the camera by the first controller through the device configuration connection;

[0098] a configuration information verification unit 704 configured to verify the acquired device configuration information, and send a corresponding device configuration verification result to the first controller.

[0099] Optionally, a system on chip (SoC) of the first controller is connected with the first type of elements in the first controller through corresponding element configuration connections, and a system on chip (SoC) of the second controller is connected with the first type of elements in the first controller and the second type of elements in the second controller through corresponding element verification connections; the apparatus further comprises:

[0100] an element configuration information obtaining unit, configured to, in a case where the element configuration connections are closed, obtain element configuration information written in the first type of elements and the second type of elements respectively through the element verification connections, and verify the obtained element configuration information; and send an element configuration verification result of the first type of elements to the first controller.

[0101] Optionally, the first type of elements comprises a serializer for transmitting video stream data of the camera, a deserializer, and a power management integrated circuit for the camera.

[0102] the second type of elements comprises a deserializer for transmitting video stream data of the camera.

[0103] Optionally, the apparatus further comprises:

[0104] a video stream data receiving unit configured to receive video stream data from the first controller through the deserializer in the second type of elements.

[0105] Optionally, the apparatus further comprises:

[0106] an abnormality detection information unit configured to obtain device dynamic information in the camera through the device verification connections, perform abnormality detection on the obtained device dynamic information, and send corresponding device detection results to the first controller.

[0107] For the apparatus embodiment, since it basically corresponds to the method embodiment, the related parts are described in the part of the method embodiment. The apparatus embodiment described above is only illustrative, and the units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units, i.e., they can be located in one place or distributed on multiple network units. According to actual needs, some or all of the modules can be selected to achieve the purposes of the present application. Those skilled in the art can understand and implement it without creative labor.

[0108] Based on the same idea as the above method, the specification also provides a vehicle, comprising: a processor, a memory for storing processor-executable instructions, a first controller, a second controller, and a camera; wherein the processor implements the steps of the method as claimed in any one of the above embodiments by running the executable instructions.

[0109] Based on the same idea as the above method, the specification also provides a computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, implement the steps of the method as claimed in any one of the above embodiments.

[0110] Based on the same idea as the above method, the specification also provides a computer program product comprising computer program / instructions, which, when executed by a processor, implement the steps of the method as claimed in any one of the above embodiments.

[0111] Embodiments of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly-embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Embodiments of the subject matter described in this specification can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a tangible non-transitory program carrier for execution by, or to control the operation of, data processing apparatus. Alternatively or additionally, the program instructions can be encoded on an artificially generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. The computer storage medium can be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.

[0112] The processes and logic flows described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit), and the apparatus can be a special purpose logic circuitry. The processes and logic flows can also be performed by a general purpose computer selectively activated or deactivated, or reconfigured by a computer program stored in the computer.

[0113] Computers suitable for the execution of a computer program include, by way of example, general and / or special purpose microprocessors, or any other kind of central processing unit. Generally, a central processing unit will receive instructions and data from a read-only memory and / or a random access memory. The essential elements of a computer are a central processing unit for performing or executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Moreover, a computer can be embedded in another device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a GPS receiver, or a portable storage device (e.g., a universal serial bus (USB) flash drive), to name just a few.

[0114] Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

[0115] While the specification contains many specifics, these should not be construed as limiting the scope of any invention or of the required claims in any way. The specification and the described embodiments are illustrative of the principles of the present invention and should not be construed as limiting the scope of the invention or the required claims in any way. Certain features described herein in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described herein in the context of a single embodiment can also be implemented in multiple embodiments. Moreover, although features can be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination and the claimed combination can be directed to a sub-combination or variation of a sub-combination.

[0116] Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring such order nor limiting of all illustrations to that order, nor requiring that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing can be advantageous. Moreover, the separation of various system modules and components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.

[0117] Accordingly, particular embodiments of the subject matter have been described. Further, the processes depicted in the accompanying figures do not require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing can be advantageous.

[0118] The above-described embodiments are merely meant to be illustrative of the present disclosure and should not be taken as limiting. Any modifications, equivalents, improvements, and the like that are made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims

1. A configuration system of a camera, characterized by, The application is applied to a vehicle, the vehicle is configured with a first controller and a second controller sharing a camera, the first controller and the camera establish a device configuration connection, and the second controller and the camera establish a device verification connection; the functional safety level requirement of the first controller to the camera is lower than that of the second controller; wherein: The first controller is configured to write device configuration information to the camera through the device configuration connection, close the device configuration connection, receive a device configuration verification result from the second controller, and trigger a preset fault handling process if the configuration safety verification result indicates a configuration error; The second controller is configured to acquire the written device configuration information in the camera through the device verification connection when the device configuration connection is closed, verify the acquired device configuration information, and send the corresponding device configuration verification result to the first controller.

2. The system of claim 1, wherein, The system on chip (SoC) of the first controller and the first type of element in the first controller establish a corresponding element configuration connection, and the system on chip (SoC) of the second controller and the first type of element in the first controller and the second type of element in the second controller establish a corresponding element verification connection respectively; The first controller is further configured to write corresponding element configuration information to the first type of element through the element configuration connection, close the element configuration connection, and receive an element configuration verification result from the second controller; The second controller is further configured to acquire the written element configuration information in the first type of element and the second type of element through the element verification connection when the element configuration connection is closed, and verify the acquired element configuration information; The element configuration verification result of the first type of element is sent to the first controller.

3. The system of claim 2, wherein: The first type of element includes a serializer for transmitting video stream data of the camera, a deserializer, and a power management integrated circuit for the camera; The second type of element includes a deserializer for transmitting video stream data of the camera.

4. The system of claim 3, wherein: The first controller is further configured to receive video stream data from the camera through the deserializer in the first type of element, and send the video stream data to the second controller through the serializer in the first type of element; The second controller is further configured to receive video stream data from the first controller through the deserializer in the second type of element.

5. The system of claim 1, wherein, The second controller is further configured to: Acquire device dynamic information in the camera through the device verification connection, and perform anomaly detection on the acquired device dynamic information; and send the corresponding device detection result to the first controller.

6. The system of claim 5, wherein, The first controller is further configured to: Acquire device dynamic information in the camera through the device configuration connection when the second controller is not enabled, and perform anomaly detection on the acquired device dynamic information.

7. A method for configuring a camera, the method comprising: A first controller configured in a vehicle, the first controller sharing a camera with a second controller configured in the vehicle, the first controller establishing a device configuration connection with the camera, the second controller establishing a device verification connection with the camera; The first controller has a lower functional safety level requirement on the camera than the second controller; and the method comprises: writing device configuration information to the camera through the device configuration connection; closing the device configuration connection, so that the second controller acquires the written device configuration information in the camera through the device verification connection and verifies the acquired device configuration information; receiving a device configuration verification result from the second controller, and triggering a preset fault handling process if the configuration safety verification result indicates a configuration error.

8. A method for configuring a camera, the method comprising: A second controller configured in a vehicle, the second controller sharing a camera with a first controller configured in the vehicle, the first controller establishing a device configuration connection with the camera, the second controller establishing a device verification connection with the camera; The first controller has a lower functional safety level requirement on the camera than the second controller; and the method comprises: acquiring device configuration information written in the camera through the device verification connection in a case where the device configuration connection is closed, the device configuration information being written to the camera by the first controller through the device configuration connection; verifying the acquired device configuration information and sending a corresponding device configuration verification result to the first controller, so that the first controller triggers a preset fault handling process if the configuration safety verification result indicates a configuration error.

9. A vehicle characterized by comprising: comprise: a processor, a memory for storing processor-executable instructions, a first controller, a second controller, and a camera; wherein the processor implements the steps of the method of any one of claims 7-8 by running the executable instructions.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to implement the steps of the method of any one of claims 7-8.

11. A computer program product, characterised in that, comprise computer programs / instructions that are executed by the processor to implement the steps of the method of any one of claims 7-8.

Citation Information

Patent Citations

  • Data processing method and device of camera control system, vehicle and storage medium

    CN120602763A