Central computing platform, control method of camera module, chip circuit and vehicle

Abstract

The invention discloses a central computing platform, a camera module control method, a chip circuit and a vehicle. In the platform, a deserializer is used for transmitting video stream data from a camera module to a cabin chip and an automatic driving core; the cabin chip is used for enabling and controlling the deserializer to transmit video stream data after awakening and starting, and monitoring the automatic driving chip; when the automatic driving chip is started, the control right of the deserializer is transferred to the automatic driving chip through the serial interface; the automatic driving chip is used for taking over the control right of the deserializer, controlling the deserializer to continue to transmit video stream data and sending a first synchronous frame signal; according to the platform, the control right of the panoramic camera can be switched on demand in the cabin chip and the automatic driving chip, so that the requirements for camera data streams in different application scenes of a cabin and automatic driving are met, and meanwhile, the problems that a cabin AVM is started slowly, power consumption is large in a sentry mode scene, and driving safety is poor due to cabin chip failure are solved.

Description

Technical Field

[0001] The present invention relates to the field of autonomous driving technology, and in particular to a central computing platform, a control method for a camera module, a chip circuit and a vehicle. Background Art

[0002] In the domain control electronic and electrical architecture, there are two domain controllers, namely the autonomous driving domain and the smart cockpit domain. In order to fully share the panoramic camera sensor, the autonomous driving domain controller needs to access the data of the panoramic camera and use the data for assisted parking or obstacle detection. At the same time, the smart cockpit domain controller also needs to access the data of the panoramic camera to display panoramic images or panoramic images.

[0003] Both the autonomous driving domain and the smart cockpit domain have the authority to control the panoramic camera, but the order of control of the panoramic camera by the autonomous driving domain and the smart cockpit domain is different, or the requirements for the video data stream transmitted by the panoramic camera are different in different application scenarios. This will cause the cockpit AVM (Around View Monitor, panoramic imaging system) to take a long time to start, or high power consumption in scenarios such as sentry mode, or the parking function to fail due to failure of the cockpit chip. Summary of the invention

[0004] In view of this, the present invention provides a central computing platform, a control method for a camera module and a chip circuit to solve or improve the problems of slow startup of the cockpit AVM, high power consumption in the sentry mode scenario, and driving safety caused by failure of the cockpit chip.

[0005] In a first aspect, the present invention provides a central computing platform, the platform comprising: a deserializer, a cockpit chip and an autonomous driving chip, wherein the cockpit chip and the autonomous driving chip are directly connected via a serial interface;

[0006] The deserializer includes a plurality of ports for connecting an external camera module and a cockpit chip and an autonomous driving chip, and transmitting video stream data from the camera module to the cockpit chip and the autonomous driving chip through the plurality of ports;

[0007] The cockpit chip is connected to the deserializer to enable and control the deserializer to transmit video stream data and monitor the startup of the autonomous driving chip after wake-up. When the startup of the autonomous driving chip is completed, the control of the deserializer is transferred to the autonomous driving chip through the serial interface.

[0008] The autonomous driving chip is used to take over the control of the deserializer after startup is completed, control the deserializer to continue transmitting video stream data, and send a first synchronization frame signal to the deserializer; the first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to switch synchronously with the second synchronization frame signal generated inside the deserializer.

[0009] The method provided by this aspect is that when the cockpit chip is powered on first and the autonomous driving chip is powered on later, the cockpit chip first controls the deserializer to transmit video stream data. After the autonomous driving chip is powered on, the cockpit chip transfers the control of the deserializer to the autonomous driving chip, so that the autonomous driving chip takes over the control of the deserializer and continues to control the deserializer to transmit video stream data. This method does not rely on the autonomous driving domain controller, and enables the user to quickly start the AVM function after entering the vehicle. When the initialization of the entire AVM camera is completed, the image can be immediately output, saving startup time and improving the efficiency of outputting images.

[0010] In addition, this method does not completely rely on cockpit chip control, but is interactively controlled by the cockpit chip and the autonomous driving chip. When the user unlocks and enters the vehicle scene, the cockpit chip fails unexpectedly. Since there is a communication interaction process between the autonomous driving chip and the cockpit chip, the status of the cockpit chip will be confirmed after the autonomous driving chip is powered on. If an abnormality occurs in the cockpit chip, the autonomous driving chip directly takes over the power-on of the AVM camera and the initialization process of the AVM camera link, thereby ensuring the normal function of the AVM camera and improving driving safety.

[0011] In combination with the first aspect, in a possible implementation, the platform further includes a first power supply unit and a second power supply unit, wherein an enable end of the first power supply unit and an enable end of the second power supply unit are both connected to the cockpit chip, and the second power supply unit is also connected to the automatic driving chip and the camera module;

[0012] The cockpit chip is also used to enable the first power supply unit to power the deserializer, enable the second power supply unit to power the camera module, and initialize the deserializer after wake-up.

[0013] In combination with the first aspect, in another possible implementation, the cockpit chip is further configured to transfer control of the second power supply unit to the autonomous driving chip through the serial interface when the autonomous driving chip is started;

[0014] The autonomous driving chip is also used to take over control of the second power supply unit after startup is completed, and control the second power supply unit to continue to supply power to the camera module.

[0015] In combination with the first aspect, in another possible implementation manner, the deserializer is specifically configured to receive the video stream data collected by the camera module after being enabled, convert the video stream data into video stream data in a first format, and transmit the video stream data in the first format to the cockpit chip;

[0016] The deserializer is specifically used to receive the first synchronization frame signal, control the camera module to synchronously expose and output images, and synchronously switch the first synchronization frame signal and the second synchronization frame signal.

[0017] In combination with the first aspect, in another possible implementation, the deserializer is also used to continue transmitting the video stream data in the first format to the cockpit chip after the autonomous driving chip takes over control, and after converting the video stream data into a second format, transmit the video stream data in the second format to the autonomous driving chip.

[0018] In combination with the first aspect, in another possible implementation, the cockpit chip is also used to determine that the startup of the autonomous driving chip is complete when a heartbeat message from the autonomous driving chip is monitored through a serial interface; wherein the serial interface is a UART interface or an SPI interface.

[0019] In combination with the first aspect, in another possible implementation, the autonomous driving chip is further used to determine whether there is a current demand for using the camera module when the entire vehicle is powered off, and if there is no demand, transfer control of the deserializer and the second power supply unit to the cockpit chip, and start the power-off process;

[0020] The cockpit chip is also used to determine whether there is a current need to use the camera module after taking over the control. If so, control the second power supply unit to continuously power the camera module and continuously receive the video stream data in the first format sent by the deserializer.

[0021] The method provided in this embodiment turns on the vehicle sentry mode when the user locks the vehicle and leaves the vehicle. At this time, the vehicle needs to turn on the AVM camera to detect the vehicle's surrounding environment in real time, and the AVM camera video stream data transmission control only depends on the cockpit chip. Therefore, in this sentry mode scenario, the autonomous driving chip is in a power-off and non-working state, thereby solving the problem of high power consumption of the autonomous driving chip in the sentry mode scenario. At the same time, the cockpit chip can also control the AVM camera to continuously output images and continuously monitor the vehicle environment in the sentry mode scenario.

[0022] In combination with the first aspect, in another possible implementation, the cockpit chip is also used to execute a power-off process for the second power supply chip, the deserializer and the cockpit chip when it is determined that there is no need to use the camera module.

[0023] In combination with the first aspect, in another possible implementation, the platform also includes a connector; one end of the connector is connected to the camera module, and the other end is connected to the deserializer, for transmitting video stream data between the camera module and the deserializer.

[0024] In a second aspect, the present invention further provides a method for controlling a camera module, which can be applied to a cockpit chip, and the method comprises:

[0025] After waking up and starting, enable and control the deserializer to transmit video stream data, and monitor the startup status of the autonomous driving chip;

[0026] When the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface, so that the autonomous driving chip takes over the control and controls the external camera module to transmit video stream data.

[0027] In combination with the second aspect, in a possible implementation, the method also includes: when the autonomous driving chip is started, transferring control of the second power supply unit to the autonomous driving chip, and the second power supply unit is used to power the camera module.

[0028] In combination with the second aspect, in another possible implementation, the method further includes: after the vehicle is powered off and a handover request is received from the autonomous driving chip, taking over control of the deserializer and the second power supply unit;

[0029] Determine whether there is a current need to use the camera module;

[0030] If yes, the second power supply unit is controlled to continuously supply power to the camera module, and continuously receive the video stream data in the first format sent by the deserializer.

[0031] In combination with the second aspect, in another possible implementation, the method further includes: if it is determined that there is no need to use the camera module, executing a power-off process for the second power supply chip, the deserializer and the cockpit chip.

[0032] In a third aspect, the present invention further provides a method for controlling a camera module, which can be applied to an autonomous driving chip, and the method comprises:

[0033] After the cockpit chip is awakened and started, maintaining communication with the cockpit chip using a serial interface;

[0034] When the self-startup is completed, taking over the control of the deserializer, controlling the deserializer to transmit the video stream data, and controlling the second power supply unit to continue to supply power to the camera module;

[0035] Generate and send a first synchronization frame signal to the deserializer, where the first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to synchronously switch with a second synchronization frame signal generated inside the deserializer.

[0036] In combination with the third aspect, in a possible implementation, the method further includes: when the self-startup is completed, taking over the control of the second power supply unit, and controlling the second power supply unit to supply power to the camera module.

[0037] In combination with the third aspect, in another possible implementation, the method also includes: when the entire vehicle is powered off, determining whether there is a current need to use the camera module; if there is no need, transferring control of the deserializer and the second power supply unit to the cockpit chip, and starting the power-off process.

[0038] In a fourth aspect, the present invention provides a chip circuit, comprising a memory and a processor, wherein the memory and the processor are connected; computer instructions are stored in the memory, and the processor executes the control method of the camera module in any embodiment of the second or third aspect by executing the computer instructions.

[0039] In a fifth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the camera module control method described in the second aspect or the third aspect above.

[0040] In addition, the present invention provides a computer program product, including computer instructions, which are used to enable a computer to execute the control method of the camera module in any embodiment of the second aspect or the third aspect.

[0041] In a sixth aspect, the present invention provides a vehicle comprising a central computing platform and a camera module; the camera module is connected to the central computing platform, and the central computing platform is the central computing platform in the aforementioned first aspect or any one of the embodiments of the first aspect, and is used to execute the control method of the camera module in the aforementioned second aspect or any one of the embodiments of the third aspect.

[0042] The present invention provides a central computing platform, a control method for a camera module, and a chip circuit. In the central computing platform, the control of a panoramic camera can be switched between a cockpit chip and an autonomous driving chip on demand, thereby meeting the requirements for the panoramic camera data stream in different application scenarios of the cockpit and autonomous driving. At the same time, it also solves the problems of slow cockpit AVM startup, high power consumption in sentinel mode scenarios, and driving safety caused by cockpit chip failure. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1A is a schematic diagram of a scene of a panoramic camera data transmission method according to the present invention;

[0045] Figure 1B is a schematic diagram of a scene of another panoramic camera data transmission method according to the present invention;

[0046] Figure 1C is a schematic diagram of a scene of another panoramic camera data transmission method according to the present invention;

[0047] Figure 2 2 is a schematic structural diagram of a cabin-driver fusion panoramic camera control system according to an embodiment of the present invention;

[0048] Figure 3 is a signaling flow chart of a method for controlling a camera module according to an embodiment of the present invention;

[0049] Figure 4 is a signaling flow chart of another camera module control method according to an embodiment of the present invention;

[0050] Figure 5 is a signaling flow chart of another camera module control method according to an embodiment of the present invention;

[0051] Figure 6 is a flow chart of a method for controlling a camera module according to an embodiment of the present invention;

[0052] Figure 7 is a flow chart of another method for controlling a camera module according to an embodiment of the present invention;

[0053] Figure 8 is a flow chart of another method for controlling a camera module according to an embodiment of the present invention;

[0054] Fig. 9 is a schematic diagram of the hardware structure of a chip circuit according to an embodiment of the present invention;

[0055] Fig.10 is a schematic structural diagram of a vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0057] The term "module" as used herein may be a software or hardware object executed on the computing system. The various components, modules, engines, and services described herein may be implementation objects on the computing system. The apparatus and methods described herein may be implemented in software or in hardware, and are all within the scope of protection of this application.

[0058] In the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0059] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, or mutual communication; it can be a direct connection, or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0060] The technical solution provided by the embodiment of the present invention is applied to the automotive electronic and electrical architecture, in which the automotive domain controller is used to manage and control various systems of the vehicle. The automotive domain controller is an electronic control unit (ECU) that integrates multiple functions. Among them, intelligent / autonomous driving and intelligent cockpit are designed as two different domain controllers, which are interconnected through multiple different types of data buses, such as controller area network bus, media-oriented system transmission bus, etc. Figures 1A to 1C As shown in the figure, three scenarios of panoramic camera data transmission between the autonomous driving domain controller and the intelligent cockpit domain controller are given as examples.

[0061] Scenario 1: Figure 1A As shown, after the system is powered on, the panoramic camera is first connected to the autonomous driving domain controller. The SOC (System-on-chip) of the autonomous driving controller processes the video stream data collected by the panoramic camera internally, and then outputs the processed video stream data to the smart cockpit domain controller through a coaxial cable.

[0062] The panoramic camera includes camera modules arranged in the front, rear, left and right directions of the vehicle. Each camera module is connected to the autonomous driving domain controller via a coaxial cable harness.

[0063] Scenario 2: If Figure 1B As shown in the figure, after the system is powered on, the panoramic camera is first connected to the autonomous driving domain controller, and then the camera video stream data is Bypass transmitted to the smart cockpit domain controller, which then processes and displays the video data stream internally. Among them, Bypass transmission refers to the technology of bypassing traditional intermediate devices such as routers and switches and directly connecting to the target device. In this scenario, it means that the video stream data collected by the camera bypasses the autonomous driving domain controller and directly transmits the video stream data to the deserializer 2 through the deserializer "D-PHY" (MIPI Differential PHY, a differential serial physical layer interface developed by the MIPI Alliance) interface.

[0064] Scenario 3: If Figure 1C As shown, after the system is powered on, the panoramic camera is first connected to the smart cockpit domain controller, and then the smart cockpit domain controller bypasses the video stream data collected by the camera to the smart cockpit domain controller.

[0065] For the above-mentioned "Scenario 1" and "Scenario 2", after the user unlocks and enters the vehicle, it is usually necessary to quickly turn on the AVM surround view function to determine whether there are any obstacles around the vehicle. At this time, the vehicle needs to quickly turn on the AVM camera to detect the vehicle's surroundings in real time, and the power-on of the AVM camera and the initialization of the AVM camera link need to rely on the autonomous driving domain controller in this scenario. After the vehicle is unlocked and powered on, the autonomous driving domain controller is usually in a cold start process, and its startup is expected to take more than 10 seconds. After the user enters the vehicle, if he wants to quickly start the AVM surround view function, it is usually in a no-picture state, and he needs to wait until the autonomous driving domain controller is started and initialized before it can start, resulting in a long startup time and slow response speed for the smart cockpit domain controller AVM.

[0066] Among them, AVM (Around View Monitor, full name panoramic parking image system) is a modern automobile intelligent driving assistance technology, designed to provide drivers with all-round visual safety protection.

[0067] In addition, in the above "Scenario 1", after the user locks the vehicle and leaves the vehicle, the vehicle's "Sentinel Mode" is turned on. At this time, the vehicle needs to turn on the AVM camera to detect the vehicle's surroundings in real time, and the AVM camera video stream data needs to be processed inside the autonomous driving controller in this scenario. Therefore, in this "Sentinel Mode" scenario, the autonomous driving domain controller is usually in working state. In the working state, the autonomous driving domain controller usually has a high power consumption state. When the user finds that turning on the vehicle's "Sentinel Mode" may cause excessive power consumption, for example, turning on the sentinel mode for one night will cause the vehicle's cruising range to be reduced by 50 km.

[0068] In addition, the above-mentioned "Scenario 3" may cause the smart cockpit controller to fail. Specifically, when the user unlocks and enters the vehicle or is performing automatic assisted driving, the vehicle requires the AVM camera to work normally. The power-on of the AVM camera and the initialization of the AVM camera link are completely dependent on the smart cockpit domain controller in this "Scenario 3". Generally speaking, the smart cockpit domain controller is a non-functional safety component, which itself may have unexpected functional failures. Therefore, when the user has turned on the automatic assisted navigation driving function or the parking function, if the smart cockpit domain controller fails unexpectedly, the AVM camera will be abnormal, which will directly lead to abnormal automatic assisted driving, and in severe cases may cause vehicle driving accidents.

[0069] Based on the problems existing in the above-mentioned scenarios 1 to 3, an embodiment of the present invention provides a central computing platform to effectively control the panoramic camera, overcome the technical problems of the above-mentioned scenarios, and meet the requirements for the panoramic camera data flow in different application scenarios.

[0070] It should be understood that the central computing platform in this embodiment uses independent cockpit chips and autonomous driving chips. In addition, it can also be other platforms or systems that include cockpit chips and autonomous driving chips. This embodiment does not limit this.

[0071] The technical solution provided by the embodiment of the present invention is described in detail below.

[0072] See also Figure 2 , a central computing platform provided by an embodiment of the present invention. The central computing platform includes: a deserializer, a cockpit chip and an autonomous driving chip, wherein the cockpit chip and the autonomous driving chip are directly connected via a serial interface. In addition, the deserializer is also connected to the cockpit chip and the autonomous driving chip respectively.

[0073] Among them, the deserializer includes multiple ports, which are used to connect the external camera module and the cockpit chip and the autonomous driving chip, and transmit the video stream data from the camera module to the cockpit chip and the autonomous driving chip through the multiple ports.

[0074] Specifically, the deserializer is responsible for converting the data in the serial signal format sent from the external camera module back to the original parallel data format; then, the video stream data is transmitted to the cockpit chip through D-PHY, so that the AVM video stream data in the parallel data format is input into the CSI interface of the cockpit chip. Furthermore, the CSI interface can be a MIPI-CSI interface.

[0075] The image sensor in the external camera module is responsible for capturing light and converting it into raw electrical signals, which are then converted into clear AVM image signals suitable for human viewing by the internal image signal processor (ISP, etc.), and then input into the cockpit chip through the MIPI-CSI interface. The AVM image signal is serialized and converted into a serial signal format suitable for long-distance transmission, and then the AVM video stream data is transmitted to the central computing platform through a coaxial cable (coax).

[0076] It should be understood that the present embodiment takes a panoramic camera or a camera module as an example, and other vehicle cameras, such as a front-view binocular camera and a side-view camera, may also be applicable, and the present embodiment does not limit this.

[0077] The deserializer in the central computing platform receives the AVM video stream data collected by the external camera module through the connector.

[0078] In addition, the deserializer is also used to connect to the autonomous driving chip through C-PHY (MIPI Camera PHY, a camera serial physical layer interface developed by the MIPI Alliance) so as to simultaneously input the AVM video stream data in parallel data format into the MIPI-CSI interface of the autonomous driving chip.

[0079] Among them, C-PHY is a physical layer specification developed by the MIPI (Mobile Industry Processor Interface) Alliance, mainly used in mobile devices and related applications, such as connecting displays and cameras to application processors.

[0080] The cockpit chip and the deserializer are connected through at least one interface, and the at least one interface includes: a CSI interface, an I2C (Inter-Integrated Circuit, abbreviated as IIC or I2C) interface, a power control terminal (PWDNB), an error detection terminal (Error), a lock signal terminal (Lock) or one or more, and a synchronization signal terminal (SYNC).

[0081] In this embodiment, the deserializer can be used to realize bidirectional video data stream transmission to the cockpit chip and the autonomous driving chip at the same time.

[0082] like Figure 2 As shown, the cockpit chip includes multiple interfaces, such as one or more of a CSI_1 interface, an enable terminal (EN), a signal control terminal (I2C1), a power control terminal PWDNB (Power Down), an error detection terminal (Error), and a lock signal terminal (Lock). Among them, the enable terminal (EN) is connected to the first power supply unit; the CSI_1 interface (for example, it can be a MIPI-CSI interface) is connected to a port of the deserializer to receive video stream data using a D-PHY serial interface. The I2C1 in the cockpit chip is used to transmit I2C control signals to and from the deserializer. PWDNB is connected to the second power supply unit.

[0083] Among them, the MIPI-CSI interface is called the Mobile Industry Processor Interface-Camera Serial Interface. It is a high-speed serial interface technology used to connect the camera module and the processor. In this embodiment, the MIPI-CSI interface is used to connect the deserializer and receive video stream data in a certain format sent from the external camera module through the deserializer.

[0084] Similarly, the autonomous driving chip also includes at least one interface, such as Figure 2 As shown, it includes: a lock signal terminal (Lock), an error detection terminal (Error), PWDNB, a signal control terminal (I2C2), a CSI_0 interface, and a synchronization signal terminal (SYNC), etc. Furthermore, the CSI_0 interface is a MIPI-CSI interface, through which the autonomous driving chip can receive the AVM video stream data in the front, rear, left, and right directions, and after being processed by the internal driving or parking algorithm model, perform parking assistance or obstacle detection.

[0085] Optionally, the cockpit chip may be a cockpit SOC (System on Chip) or a cockpit circuit. Similarly, the autonomous driving chip may be an autonomous driving SOC or an autonomous driving circuit.

[0086] In addition, the cockpit chip and the autonomous driving chip each include a serial interface, and the two chips are directly connected through their respective serial interfaces, so that data transmission between the cockpit chip and the autonomous driving chip can be achieved through the serial interface.

[0087] Optionally, the serial interface includes but is not limited to: a UART interface (Universal Asynchronous Receiver / Transmitter) or an SPI interface (Serial Peripheral Interface). In addition, the serial interface may also be an interface of other types or protocols, which is not limited in this embodiment.

[0088] Optionally, the above platform also includes a connector, such as Figure 2 As shown, one end of the connector is connected to the camera module, and the other end is connected to the deserializer, which is used to transmit video stream data between the camera module and the deserializer.

[0089] See also Figure 3 , is a signaling flow chart of a camera module control method provided by an embodiment of the present invention, which can be used to implement control switching between a cockpit chip and an autonomous driving chip. Specifically, the method includes:

[0090] Step S1: After the cockpit chip is awakened and started, it enables and controls the deserializer to transmit video stream data.

[0091] Specifically, the user unlocks the vehicle, enters the vehicle, starts the vehicle IGN ON and powers on. The cockpit chip is started first, and after the cockpit chip wakes up and starts, the quick startup is completed through the STR (Suspend to Ram) mode. STR mode is a power management technology, also known as system-level sleep or hibernation mode. STR mode allows the current system state to be saved to memory and reduces the power consumption of other hardware devices so that it can be quickly restored to the previous working state later. During this process, key components such as the CPU and memory remain active, but other hardware devices such as hard drives, displays, etc. enter low power consumption mode or are completely turned off.

[0092] Specifically, one implementation method of enabling control is that the cockpit chip sends an enable signal to the deserializer through the enable terminal (EN) and the PWDNB pin, enables the deserializer power supply chip to power the deserializer, and initializes the deserializer through I2C1. The deserializer chip is initialized and configured. After the deserializer is initialized, the cockpit chip writes the deserializer register through I2C1, triggers the deserializer to send a synchronization frame signal, and controls multiple (for example, 4) external camera modules to synchronously expose and output images.

[0093] After the deserializer is enabled, it receives the video data stream collected by the camera module and transmits the video data stream to the cockpit chip. Correspondingly, the cockpit chip receives the video data stream using the D-PHY serial interface through the CSI_1 interface. Optionally, the CSI_1 interface is a MIPI-CSI interface.

[0094] Step S2: The cockpit chip monitors the startup status of the autonomous driving chip. The startup status of the autonomous driving chip includes two states: not started and startup completed.

[0095] When the cockpit chip is powered on, the startup status of the autonomous driving chip is monitored through the serial interface communication between the cockpit chip and the autonomous driving chip, wherein the communication can be monitored by transmitting heartbeat messages or heartbeat messages to each other.

[0096] Step S3: When the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface.

[0097] The autonomous driving chip can notify the cockpit SOC chip of the completion of startup through the UART interface or SPI interface. A specific implementation method is that the cockpit chip monitors the heartbeat message from the autonomous driving chip through a serial interface, such as a UART interface. When the autonomous driving chip completes self-startup, it will send a heartbeat message or a heartbeat message to the cockpit chip.

[0098] The cockpit chip starts the real-time monitoring function. Once a heartbeat message or heartbeat message is received from the autonomous driving chip through the UART interface or SPI interface, it is determined that the autonomous driving chip has started. If no heartbeat message or heartbeat message is detected, it is determined that the self-start of the autonomous driving chip is not completed.

[0099] When the self-start of the autonomous driving chip is confirmed to be complete, the cockpit chip will transfer the control of the deserializer to the autonomous driving chip. After the transfer, the cockpit chip no longer reads and writes the deserializer through the signal control terminal (I2C1), while the autonomous driving chip reads and writes the deserializer through the signal control terminal (I2C0), thus transferring the control of the deserializer to the autonomous driving chip.

[0100] After the autonomous driving chip takes over the control of the deserializer, it continues to control the deserializer to transmit video stream data, such as sending control instructions to the deserializer to instruct the deserializer to convert the video stream data from the camera module according to the preset format and transmit it to the cockpit chip and the autonomous driving chip respectively. At this time, two video data streams are transmitted to the cockpit chip and the autonomous driving chip.

[0101] The above method further includes:

[0102] Step S4: The autonomous driving chip sends a first synchronization frame signal to the deserializer. The first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to synchronously switch with the second synchronization frame signal generated inside the deserializer.

[0103] Specifically, the cockpit chip releases control of the deserializer and no longer controls the deserializer through I2C1. The autonomous driving chip takes over the deserializer through I2C0 and controls the deserializer to continue transmitting video stream data.

[0104] According to the above Figure 2 In the circuit structure shown, in this step, the autonomous driving chip sends a first synchronization frame signal to the deserializer, which specifically includes: the autonomous driving chip uses the synchronization signal terminal (SYNC) to send the first synchronization frame signal to the deserializer.

[0105] Step S5: After receiving the first synchronization frame signal, the deserializer switches the synchronization frame signal generated inside the deserializer, such as the second synchronization frame signal, to the first synchronization frame signal, thereby achieving the function of signal frame synchronization switching.

[0106] In addition, the deserializer is also used to control the camera module and continuously transmit the video data stream to the cockpit chip and the autonomous driving chip. At the same time, it controls the camera module to expose the image synchronously.

[0107] In the method provided in this embodiment, when the cockpit chip is powered on first and the autonomous driving chip is started later, the cockpit chip first controls the deserializer to transmit video stream data. After the autonomous driving chip is started, the cockpit chip transfers the control of the deserializer to the autonomous driving chip, so that the autonomous driving chip takes over the control of the deserializer and continues to control the deserializer to transmit video stream data. After the user unlocks and enters the vehicle, the power-on of the AVM camera, the initialization of the AVM camera link and other operations of this method rely on the cockpit chip, and do not rely on the autonomous driving domain controller. After the vehicle is unlocked and powered on, the cockpit chip completes a quick startup through the STR mode, and its startup is expected to take less than 2 seconds. Compared with the unlocking time of 10 seconds in the above "Scene 1" and "Scene 2", this method realizes the quick startup of the AVM function after the user enters the vehicle. When the initialization of the entire AVM camera is completed, the image can be immediately output, saving startup time and improving the efficiency of output.

[0108] In addition, in another possible implementation of this embodiment, during the above-mentioned process of transferring control rights, it also includes: the cockpit chip also transfers the control rights of the power supply module / power supply unit to the autonomous driving chip.

[0109] Specifically, Figure 2 As shown, the central computing platform also includes: a first power supply unit and a second power supply unit. The first power supply unit is connected between the deserializer and the cockpit chip, and includes an enable terminal, and the enable terminal of the first power supply unit is connected to the EN terminal of the cockpit chip. The second power supply unit also includes an enable terminal, and the second power supply unit is connected to the deserializer, the cockpit chip and the autonomous driving chip.

[0110] In addition, the second power supply unit is also connected to the camera module, such as Figure 2 As shown, four camera modules are powered by four coaxial cables, and the power is transmitted from the coaxial signal lines to the camera modules.

[0111] The cockpit chip is also used to enable the first power supply unit to power the deserializer and enable the second power supply unit after wake-up. Specifically, the cockpit chip can enable the deserializer and the first power supply unit to start through the enable terminal (EN) and the PWDNB pin, and the first power supply unit is used to power the deserializer. Optionally, the first power supply unit is a deserializer power supply chip.

[0112] like Figure 4 As shown, in the above step S2, when it is detected that the autopilot chip has completed startup, the cockpit chip is also used to transfer the control of the second power supply unit to the autopilot chip through the serial interface. Correspondingly, the autopilot chip is also used to take over the control of the second power supply unit after the startup is completed, and control the second power supply unit to continue to supply power to the camera module.

[0113] The process of transferring control rights can be carried out through the above-mentioned UART interface or SPI interface.

[0114] It should be noted that when the cockpit chip transfers the control right of the second power supply unit, the transfer timing may be Figure 3 In step S3 shown, the control right of the deserializer is submitted together when it is handed over, or the control right can be handed over in batches, which is not limited in this embodiment.

[0115] Optionally, in this embodiment, the second power supply unit is a camera power supply chip, or a POC power supply chip. Because the power supply channel uses POC (Power over Coax, coaxial cable power supply technology), power and data are sent simultaneously through a single coaxial cable harness, so that after the autonomous driving chip is started, the POC power supply chip continues to control the power supply of the camera module and initializes the deserializer through I2C1.

[0116] The first power supply unit is a deserializer power supply unit, which is used to supply power to the deserializer after being powered on and enabled.

[0117] In this embodiment, during the process of transferring control in step S3, the control of the first power supply unit of the cockpit chip can also be transferred to the automatic driving chip. The specific transfer method is the same as the method of transferring the deserializer and the second power supply unit in this embodiment, and this embodiment will not repeat it.

[0118] like Figure 3 and Figure 4As shown, after the deserializer is enabled, it receives the video stream data collected by the camera module, converts the video stream data into the first format, and transmits the first format video stream data to the cockpit chip. At this time, before the automatic driving chip is started, the video stream data is only transmitted to the cockpit chip.

[0119] Optionally, the first format is a video stream format encoded using a SerDes physical layer D-PHY interface, where D-PHY is mainly used for data communication between a camera and a display and a main processor.

[0120] The deserializer is also used to receive the first synchronization frame signal, such as SYNC, through the synchronization interface, control the camera module to synchronously expose and output images, and synchronously switch the first synchronization frame signal with the second synchronization frame signal. The specific process is referred to the aforementioned steps S4 and S5, which will not be repeated here.

[0121] The deserializer is also used to continue transmitting the video stream data in the first format to the cockpit chip after the autonomous driving chip takes over control, and to transmit the video stream data in the second format to the autonomous driving chip after converting the video stream data into the second format. At this time, the deserializer outputs two video stream data at the same time, which are transmitted to the cockpit chip and the autonomous driving chip respectively.

[0122] Optionally, the second format is a video stream format encoded using the SerDes physical layer C-PHY interface. C-PHY is an advanced physical layer interface standard that achieves efficient, flexible and low-power data transmission through its unique three-phase symbol encoding technology and embedded clock link design. It is generally used to connect peripherals such as displays and cameras to the application processor of a mobile device.

[0123] In the platform provided by this embodiment, when the user unlocks and enters the vehicle or is performing automatic assisted driving, the vehicle requires the AVM camera to work normally, and the control of powering on the AVM camera, initializing the AVM camera link, etc. does not completely rely on the cockpit chip, but is interactively controlled by the cockpit chip and the autonomous driving chip.

[0124] When the user unlocks and enters the vehicle, the cockpit chip fails unexpectedly. Since there is a communication interaction process between the autonomous driving chip and the cockpit chip, the cockpit chip status will be confirmed after the autonomous driving chip is powered on. If the cockpit chip is abnormal, the autonomous driving chip directly takes over the power-on of the AVM camera and the initialization process of the AVM camera link, thereby ensuring the normal function of the AVM camera.

[0125] If an automatic assisted driving scenario is in progress and the cockpit chip fails unexpectedly, since the control of the AVM camera has been taken over by the automatic driving chip after entering the vehicle, the unexpected failure of the cockpit chip does not affect the AVM camera function, nor does it cause automatic assisted driving abnormalities. Therefore, the method provided in this embodiment solves the problem of driving risks caused by cockpit chip failure.

[0126] During the vehicle power-off process, the central computing platform provided in this embodiment also provides a chip switching function.

[0127] See also Figure 5 , is a signaling flow chart of another camera module control method according to an embodiment of the present invention, the method comprising:

[0128] Step S6: When the vehicle is no longer in use, the vehicle is IGN OFF and powered off.

[0129] Step S7: When the vehicle is powered off, the autonomous driving chip determines whether there is a need to use the camera module.

[0130] Step S8: If there is no demand, the control of the deserializer and the second power supply unit is transferred to the cockpit chip, and the power-off process is started.

[0131] The autonomous driving chip notifies the cockpit chip through the serial port to take over the AVM camera, and the cockpit chip takes over the control of the deserializer and the second power supply unit. The autonomous driving chip executes the power-off process.

[0132] It also includes: If there is a need, the autonomous driving chip will still be in control and control will not be transferred to the cockpit chip for the time being.

[0133] Step S9: After taking over control, the cockpit chip determines whether there is a need to use the camera module.

[0134] If there is a use demand, execute step S10; if there is no use demand, execute step S11.

[0135] Step S10: If yes, the cockpit chip controls the second power supply unit to continuously supply power to the camera module, and continuously receives the video stream data in the first format sent by the deserializer.

[0136] Specifically, if the cockpit chip determines that there are other camera application scenarios (such as sentry mode), it will first remain in a non-sleep state and continue to maintain the power supply of the second power supply unit and the deserializer, so that the video stream data collected by the camera module can still be transmitted to the cockpit chip.

[0137] When the cockpit chip recognizes that the camera application scenario has ended (for example, the sentry mode is remotely turned off), it executes a power-off process for the second power supply unit / deserializer / cockpit chip.

[0138] An implementation method of a cockpit chip detecting whether a sentinel mode is turned on includes: a user turns on the sentinel mode before leaving the vehicle, and the cockpit chip obtains information that the user has turned on the sentinel mode, and determines that the sentinel mode is currently turned on. If the user does not turn on the sentinel mode before leaving the vehicle, the cockpit chip cannot detect the turn-on information, and then the cockpit chip determines that the sentinel mode is not turned on.

[0139] Step S11: If not, that is, when it is determined that there is no need to use the camera module, the cockpit chip executes a power-off process for the second power supply chip, the deserializer and the cockpit chip.

[0140] This embodiment provides a switching process between the cockpit chip and the autonomous driving chip when the vehicle is powered off. When the user locks the vehicle and leaves the vehicle, the vehicle sentry mode is turned on. At this time, the vehicle needs to turn on the AVM camera to detect the vehicle's surrounding environment in real time, and the AVM camera video stream data transmission control only depends on the cockpit chip. Therefore, in this sentry mode scenario, the autonomous driving chip is in a power-off and non-working state, thereby solving the problem of high power consumption of the autonomous driving chip in the sentry mode scenario. At the same time, the cockpit chip can also control the AVM camera to continuously output images and continuously monitor the vehicle environment in the sentry mode scenario.

[0141] In the embodiment of the present invention, the above-mentioned process of enabling and initializing the first power supply unit, the second power supply unit, and the deserializer is first completed by the cockpit chip, which can also be replaced by being first completed by the autonomous driving chip, or by an additional MCU chip.

[0142] In addition, the above-mentioned autonomous driving chip and cockpit chip are both independent chips. In a variation, the autonomous driving chip and the cockpit chip may be physically combined into one chip or one circuit structure, and this application does not impose any restrictions on this.

[0143] The functions of the above cockpit chips are summarized as follows:

[0144] In sleep and wake-up scenarios, as well as in specific scenarios, control the power-on of the deserializer power supply chip and the POC power supply chip, and initialize the deserializer chip in the central computing platform. Receive the front, back, left, and right AVM video stream data through the MIPI-CSI interface, and display the panoramic image after internal AVM splicing processing. Perform diagnostic monitoring on the camera module, the deserializer and the POC power supply unit in the central computing platform to ensure the normal operation of the AVM camera link. Receive the Error or Lock signal detected by the deserializer, and re-initialize the deserializer; exchange information and control rights of the camera status with the autonomous driving chip through the serial port.

[0145] The functions of the above autonomous driving chips are summarized as follows:

[0146] Receive the front, rear, left, and right AVM video stream data through the MIPI-CSI interface, and perform parking assistance or obstacle detection after being processed by the internal driving or parking algorithm model. Responsible for taking over and controlling the entire AVM video link after the deserializer, POC power supply chip, etc. are initialized and the autonomous driving chip is powered on. Perform diagnostic monitoring on the camera module, the deserializer and the POC power supply unit in the central computing platform to ensure the normal operation of the AVM camera link. Receive the Error or Lock signal detected by the deserializer and re-initialize the deserializer. Interact with the cockpit SOC chip through the serial port to exchange information and control rights of the camera status. Send an external synchronization frame signal FSYNC to the deserializer to control all cameras to output images synchronously.

[0147] In this embodiment, a control method of a camera module is also provided, which can be used for the above-mentioned cockpit chip or cockpit SOC. Figure 6 is a flow chart of a control method of a camera module of this embodiment, such as Figure 6 As shown, the process includes:

[0148] Step S201: After waking up and starting, enable and control the deserializer to transmit video stream data, and monitor the startup status of the autonomous driving chip.

[0149] Step S202: When the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface, so that the autonomous driving chip takes over the control and controls the external camera module to transmit video stream data.

[0150] In addition, it also includes: when the autonomous driving chip is started, the control of the second power supply unit is also transferred to the autonomous driving chip, and the second power supply unit is used to power the camera module.

[0151] Correspondingly, in the method flow of the autonomous driving chip, such as Figure 7 As shown, the method can be used for the above-mentioned autonomous driving chip or autonomous driving SOC, and further includes:

[0152] Step S203: After the cockpit chip wakes up and starts, the autonomous driving chip uses the serial interface to maintain communication with the cockpit chip, such as sending a heartbeat message through the serial interface to communicate and determine whether the autonomous driving chip has been started.

[0153] Step S204: When the self-start is completed, the autonomous driving chip takes over the control of the deserializer and controls the deserializer to transmit video stream data.

[0154] The autonomous driving chip takes over control of the second power supply unit and controls the second power supply unit to continue to supply power to the camera module.

[0155] Step S205: The autonomous driving chip generates and sends a first synchronization frame signal to the deserializer. The first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to synchronously switch with the second synchronization frame signal generated inside the deserializer.

[0156] The detailed process of each step of this embodiment can be found in the aforementioned Figure 3 and Figure 4 The power-on process and corresponding instructions shown are not repeated in this embodiment.

[0157] In addition, during the power-off process, if Figure 8 As shown, the control method also includes:

[0158] Step S301: After the vehicle is powered off, the autonomous driving chip takes over control of the deserializer and the second power supply unit when receiving a handover request from the autonomous driving chip.

[0159] Among them, the autonomous driving chip taking over control of the second power supply unit is an optional step.

[0160] Step S302: Determine whether there is a current need to use the camera module.

[0161] Step S303: If yes, the autonomous driving chip controls the second power supply unit to continuously power the camera module and continuously receive the video stream data in the first format sent by the deserializer.

[0162] Step S304: If it is determined that there is no need to use the camera module, the autonomous driving chip executes a power-off process for the second power supply chip, the deserializer, and the autonomous driving chip.

[0163] In the power-off process provided in this embodiment, the detailed process of each step can be found in the above Figure 5 The power-off process and corresponding instructions shown are not repeated in this embodiment.

[0164] The present invention provides a method for controlling a panoramic camera module with cabin-cockpit integration. The method can switch the control of the panoramic camera between a cockpit chip and an autonomous driving chip on demand, thereby meeting the requirements for the panoramic camera data stream in different application scenarios of the cockpit and autonomous driving.

[0165] In addition, this method also saves at least one serializer and deserializer chip, saves costs and has fewer intermediate signal transmission links; by utilizing the STR mode of the cockpit chip, the problem of fast startup and image output of the cockpit AVM is solved.

[0166] In this embodiment, a control device for a camera module is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and will not be repeated hereafter. As used below, the term "module" may be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0167] This embodiment provides a control device for a camera module, and the control device includes: an enabling module, a processing module, a transceiver module, etc. In addition, the device may also include other more or fewer units and modules, such as a storage module, etc.

[0168] When the control device is used as a cockpit chip or cockpit functional device, the above-mentioned Figures 3 to 5 ,or Figures 6 to 8 Method steps for the cockpit chip.

[0169] When the control device is used as an autonomous driving chip or an autonomous driving functional device, the aforementioned Figures 3 to 5 ,or Figures 6 to 8 The method steps for autonomous driving chips.

[0170] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0171] The control device in this embodiment is presented in the form of a functional unit or module, where the unit refers to a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0172] The embodiment of the present invention further provides a chip circuit, which may include the control device of the camera module mentioned above. The chip circuit is used to execute the panoramic camera module control method of the aforementioned embodiment, and switch the control right of the panoramic camera between the cockpit chip and the autonomous driving chip as needed, so as to realize the requirements for the panoramic camera data stream in different application scenarios of the cockpit and the autonomous driving.

[0173] See also Fig. 9 , is a schematic diagram of a chip circuit provided by an optional embodiment of the present invention, the chip circuit includes: one or more processing modules 10, a storage module 20, and a communication interface for connecting various components, including a high-speed interface and a low-speed interface. The various components communicate with each other using different buses, and can be installed on a common mainboard or installed in other ways as needed. Fig. 9 A processing module 10 is taken as an example.

[0174] The processing module 10 may be a processor, such as a central processing unit (CPU). The processing module 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic, or any combination thereof.

[0175] The storage module 20 stores instructions executable by at least one processing module 10, so that the at least one processing module 10 executes the control method of the camera module shown in the above embodiment.

[0176] The storage module 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the storage module 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the storage module 20 may include a memory remotely arranged relative to the processing module 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0177] The storage module 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the storage module 20 may also include a combination of the above types of memory.

[0178] In addition, the chip circuit also includes multiple communication interfaces 30, including but not limited to CSI interface, I2C interface, PWDNB, EN interface, Error interface, lock signal terminal (Lock), synchronization signal terminal (SYNC), etc., which are used for the chip circuit to communicate with other devices or communication networks, such as connecting with a deserializer, an autonomous driving chip, a first power supply unit, a second power supply unit, etc.

[0179] It should be noted that the above-mentioned chip circuit can be the cockpit chip of the aforementioned embodiment, or the autonomous driving chip, or it can also be a circuit board integrating the cockpit chip and the autonomous driving chip, or it can also be a central computing platform, and this embodiment does not impose any restrictions on this.

[0180] This embodiment also provides a vehicle, such as Fig.10 As shown, the vehicle includes: a central computing platform 100 and a camera module 200; the camera module 200 is connected to the central computing platform 100.

[0181] The internal structure of the central computing platform 100 can be found in the above Figure 2 The structure of the central computing platform shown is used to execute the control method of the camera module described in the above embodiment.

[0182] The camera module 200 is used to transmit video stream data to the cockpit chip and / or the autonomous driving chip in the central computing platform 100 under the control of the central computing platform 100. Specifically, the transmission of video stream data and the control method refer to the description of the above embodiment, which will not be repeated here.

[0183] An embodiment of the present invention also provides a computer-readable storage medium, and the above-mentioned method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented by downloading through a network and originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware.

[0184] The storage medium may be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid state drive, etc.; further, the storage medium may also include a combination of the above-mentioned types of memories. It is understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, processor or hardware, the control method shown in the above embodiment is implemented.

[0185] Embodiments of the present application may also provide a computer program product, including computer program instructions, which, when executed by a processor, cause the processor to perform the steps in the above method. Wherein, the computer program product may be written in any combination of one or more programming languages ​​to perform program codes for performing the operations of the disclosed embodiments, wherein the programming languages ​​include object-oriented programming languages, such as Java, C++, etc., and also include conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device, partially on a remote computing device, or entirely on a remote computing device or server.

[0186] The above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than to limit them. Although the embodiments of the present invention are described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some of the technical features therein by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A central computing platform, characterized in that: The platform includes: a deserializer, a cockpit chip and an autonomous driving chip, wherein the cockpit chip and the autonomous driving chip are directly connected via a serial interface; The deserializer includes a plurality of ports for connecting an external camera module and a cockpit chip and an autonomous driving chip, and transmitting video stream data from the camera module to the cockpit chip and the autonomous driving chip through the plurality of ports; The cockpit chip is connected to the deserializer to enable and control the deserializer to transmit video stream data and monitor the startup of the autonomous driving chip after wake-up; when the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface; The autonomous driving chip is used to take over control of the deserializer after startup is completed, control the deserializer to continue transmitting video stream data, and send a first synchronization frame signal to the deserializer; the first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to switch synchronously with the second synchronization frame signal generated inside the deserializer.

2. The central computing platform according to claim 1, characterized in that: The platform further includes a first power supply unit and a second power supply unit, wherein an enabling end of the first power supply unit and an enabling end of the second power supply unit are both connected to the cockpit chip, and the second power supply unit is also connected to the automatic driving chip and the camera module; The cockpit chip is also used to enable the first power supply unit to power the deserializer, enable the second power supply unit to power the camera module, and initialize the deserializer after wake-up.

3. The central computing platform according to claim 2, characterized in that: The cockpit chip is further used to transfer the control right of the second power supply unit to the autonomous driving chip through the serial interface when the autonomous driving chip is started; The autonomous driving chip is also used to take over control of the second power supply unit after startup is completed, and control the second power supply unit to continue to supply power to the camera module.

4. The central computing platform according to claim 1, characterized in that: The deserializer is further configured to receive the video stream data collected by the camera module after being enabled, convert the video stream data into video stream data in a first format, and transmit the video stream data in the first format to the cockpit chip; The deserializer is further specifically used to receive the first synchronization frame signal, control the camera module to synchronously expose and output an image, and synchronously switch the first synchronization frame signal and the second synchronization frame signal.

5. The central computing platform according to claim 4, characterized in that: The deserializer is also used to continue transmitting the video stream data in the first format to the cockpit chip after the autonomous driving chip takes over control, and to transmit the video stream data in the second format to the autonomous driving chip after converting the video stream data into a second format.

6. The central computing platform according to any one of claims 1 to 5, characterized in that: The cockpit chip is also used to determine that the startup of the autonomous driving chip is complete when a heartbeat message from the autonomous driving chip is monitored through the serial interface.

7. The central computing platform according to claim 3, characterized in that: The autonomous driving chip is further used to determine whether there is a current demand for using the camera module when the vehicle is powered off. If there is no demand, the control of the deserializer and the second power supply unit is transferred to the cockpit chip, and the power-off process is started; The cockpit chip is also used to determine whether there is a current need to use the camera module after taking over the control. If so, control the second power supply unit to continuously power the camera module and continuously receive the video stream data in the first format sent by the deserializer.

8. The central computing platform according to claim 7, characterized in that: The cockpit chip is also used to execute a power-off process for the second power supply chip, the deserializer and the cockpit chip when it is determined that there is no need to use the camera module.

9. The central computing platform according to any one of claims 1 to 5, characterized in that: The platform also includes a connector; One end of the connector is connected to the camera module, and the other end is connected to the deserializer, and is used to transmit video stream data between the camera module and the deserializer.

10. A method for controlling a camera module, characterized in that: Applied to a cockpit chip, the method comprises: After waking up and starting, enable and control the deserializer to transmit video stream data, and monitor the startup status of the autonomous driving chip; When the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface, so that the autonomous driving chip takes over the control and controls the external camera module to transmit video stream data.

11. The method according to claim 10, characterized in that The method further comprises: When the autonomous driving chip is started up, control of the second power supply unit is transferred to the autonomous driving chip, and the second power supply unit is used to power the camera module.

12. The method according to claim 10 or 11, characterized in that: The method further comprises: After the vehicle is powered off, upon receiving a handover request from the autonomous driving chip, taking over control of the deserializer and the second power supply unit; Determine whether there is a current need to use the camera module; If yes, the second power supply unit is controlled to continuously supply power to the camera module, and continuously receive the video stream data in the first format sent by the deserializer.

13. The method according to claim 12, characterized in that The method further comprises: If it is determined that there is no need to use the camera module, a power-off process is performed on the second power supply chip, the deserializer and the cockpit chip.

14. A method for controlling a camera module, characterized in that: Applied to an autonomous driving chip, the method includes: After the cockpit chip is awakened and started, maintaining communication with the cockpit chip using a serial interface; When the self-start is completed, taking over the control of the deserializer, and controlling the deserializer to transmit the video stream data; Generate and send a first synchronization frame signal to the deserializer, where the first synchronization frame signal is used to control the camera module to synchronously expose and output images, and to synchronously switch with a second synchronization frame signal generated inside the deserializer.

15. The method according to claim 14, characterized in that The method further comprises: When the self-startup is completed, the control of the second power supply unit is taken over, and the second power supply unit is controlled to supply power to the camera module.

16. The method according to claim 15, characterized in that The method further comprises: When the vehicle is powered off, determining whether there is a need to use the camera module; If there is no demand, the control of the deserializer and the second power supply unit is transferred to the cockpit chip, and the power-off process is started.

17. A chip circuit, characterized in that: comprising a memory and a processor, wherein the memory and the processor are connected; The memory stores computer instructions, and the processor executes the method for controlling the camera module according to any one of claims 10 to 13, or any one of claims 14 to 16, by executing the computer instructions.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the control method of the camera module according to any one of claims 10 to 13, or any one of claims 14 to 16.

19. A vehicle, characterized in that: The vehicle includes a central computing platform and a camera module; The camera module is connected to the central computing platform, and the central computing platform is the central computing platform as described in any one of claims 1 to 9.

Images