Central computing platform, camera module control method, chip circuit and vehicle
By interactively controlling the deserializer between the cockpit chip and the autonomous driving chip in the central computing platform, the problems of slow AVM startup, high power consumption and cockpit chip failure are solved, and the panoramic camera can be quickly started and safely and reliably monitor the vehicle environment.
Patent Information
- Application Number
- CN202411475528.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-21
- Publication Date
- 2025-10-24
- Estimated Expiration
- 2044-10-21
AI Technical Summary
In the domain control electronic and electrical architecture, the autonomous driving domain and the smart cockpit domain have different orders of control over the panoramic camera, resulting in long AVM startup time, high power consumption, or failure of the cockpit chip, leading to driving safety issues.
A central computing platform is used to directly connect the cockpit chip and the autonomous driving chip through the serial interface to achieve interactive control of the deserializer, ensure the transmission and synchronization of video stream data, avoid dependence on the autonomous driving domain controller, and utilize interactive control between the cockpit chip and the autonomous driving chip to ensure the rapid startup and normal operation of the AVM camera.
It achieves fast startup of the AVM camera, saves startup time, reduces power consumption in sentry mode, ensures driving safety, and avoids driving abnormalities caused by cockpit chip failure.
Smart Images

Figure CN119329438B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of automatic driving, in particular to a central computing platform, a control method of a camera module, a chip circuit and a vehicle. BACKGROUND
[0002] In the domain control electronic and electrical architecture, two domain controls are included, which are an automatic driving domain and an intelligent cabin domain. In order to fully share the panoramic camera sensor, the automatic driving domain controller needs to access the data of the panoramic camera and utilize the data for auxiliary parking or obstacle detection, and at the same time, the intelligent cabin domain controller also needs to access the data of the panoramic camera in order to display panoramic images or panoramic images.
[0003] The automatic driving domain and the intelligent cabin domain both have the right to control the panoramic camera, but based on the different sequences of the control right of the automatic driving domain and the intelligent cabin domain to the panoramic camera, or the different requirements for the video data stream transmitted by the panoramic camera in different application scenarios, it will cause the long time consumption of starting the cabin AVM (Around View Monitor, panoramic image system), or the large power consumption in the sentry mode scenario, or the invalidation of the driving and parking functions caused by the invalidation of the cabin chip. SUMMARY
[0004] Therefore, the present application provides a central computing platform, a control method of a camera module and a chip circuit to solve or improve the problems of slow starting of the cabin AVM, large power consumption in the sentry mode scenario, driving safety caused by the invalidation of the cabin chip and the like.
[0005] In a first aspect, the present application provides a central computing platform, which comprises a deserializer, a cabin chip and an automatic driving chip, wherein the cabin chip and the automatic driving chip are directly connected through a serial interface;
[0006] The deserializer comprises a plurality of ports for connecting an external camera module, a cabin chip and an automatic driving chip, and transmitting video stream data from the camera module to the cabin chip and the automatic driving chip through the plurality of ports;
[0007] The cabin chip is connected with the deserializer, and is used for enabling and controlling the deserializer to transmit video stream data after wake-up starting, and monitoring the starting condition of the automatic driving chip; when the automatic driving chip is started, the control right of the deserializer is transferred to the automatic driving chip through the serial interface;
[0008] The autonomous driving chip is used to take over control of the deserializer after startup is completed, control the deserializer to continue transmitting video stream data, and send a first synchronization frame signal to the deserializer; the first synchronization frame signal is used to control the synchronous exposure and output of the camera module, and to switch synchronously with the second synchronization frame signal generated inside the deserializer.
[0009] The method provided by this aspect is that, when the cockpit chip is powered on first and the autonomous driving chip is powered on later, the cockpit chip first controls the deserializer to transmit video stream data. After the autonomous driving chip is powered on, the cockpit chip transfers control of the deserializer to the autonomous driving chip, allowing the autonomous driving chip to take over control of the deserializer and continue to control the deserializer to transmit video stream data. This method does not rely on the autonomous driving domain controller and enables the AVM function to be quickly started after the user enters the vehicle. When the entire AVM camera is initialized, the image can be immediately output, saving startup time and improving image output efficiency.
[0010] Furthermore, this method doesn't rely solely on cockpit chip control, but rather relies on the interaction between the cockpit chip and the autonomous driving chip. If the cockpit chip unexpectedly fails after the user unlocks and enters the vehicle, the autonomous driving chip and the cockpit chip communicate and interact, and the cockpit chip's status is confirmed after powering on. If the cockpit chip experiences an anomaly, the autonomous driving chip directly takes over the AVM camera power-up and initialization of the AVM camera link, ensuring proper AVM camera functionality and improving driving safety.
[0011] In conjunction with the first aspect, in one possible implementation, the platform further includes a first power supply unit and a second power supply unit, wherein an enable terminal of the first power supply unit and an enable terminal of the second power supply unit are both connected to the cockpit chip, and the second power supply unit is further connected to the autonomous driving chip and the camera module;
[0012] The cockpit chip is also used to enable the first power supply unit to power the deserializer, enable the second power supply unit to power the camera module, and initialize the deserializer after waking up.
[0013] In conjunction with the first aspect, in another possible implementation, the cockpit chip is further configured to transfer control of the second power supply unit to the autonomous driving chip through the serial interface when the autonomous driving chip is started.
[0014] The autonomous driving chip is also used to take over control of the second power supply unit after startup is completed, and control the second power supply unit to continue to supply power to the camera module.
[0015] In a possible implementation of the first aspect, the deserializer is specifically configured to enable the camera module to receive the video stream data and convert the video stream data into the first format of video stream data, and transmit the first format of video stream data to the cockpit chip.
[0016] The deserializer is further configured to receive the first synchronization frame signal, control the camera module to synchronize exposure and output images, and synchronize switching of the first synchronization frame signal and the second synchronization frame signal.
[0017] In a possible implementation of the first aspect, the deserializer is further configured to continue transmitting the first format of video stream data to the cockpit chip after the autonomous driving chip takes over the control, and transmit the second format of video stream data to the autonomous driving chip after the video stream data is converted into the second format.
[0018] In a possible implementation of the first aspect, the cockpit chip is further configured to determine that the autonomous driving chip is started when the heartbeat message from the autonomous driving chip is monitored through the serial interface.
[0019] In a possible implementation of the first aspect, the autonomous driving chip is further configured to determine whether there is a demand for using the camera module when the vehicle is powered off, and if there is no demand, hand over the control of the deserializer and the second power supply unit to the cockpit chip, and start a power-off process.
[0020] The cockpit chip is further configured to determine whether there is a demand for using the camera module after taking over the control, and if there is a demand, control the second power supply unit to continuously supply power to the camera module, and continuously receive the first format of video stream data sent by the deserializer.
[0021] The method provided in the embodiment enables the vehicle to start the sentinel mode when the user locks the vehicle and leaves the vehicle. At this time, the vehicle needs to start the AVM camera to detect the environment around the vehicle in real time, and the AVM camera video stream data transmission control only depends on the cockpit chip. Therefore, in the sentinel mode scenario, the autonomous driving chip is in a powered-off and non-working state, thereby solving the problem of high power consumption of the autonomous driving chip in the sentinel mode scenario, and enabling the cockpit chip to control the AVM camera to continuously output images and continuously monitor the vehicle environment in the sentinel mode scenario.
[0022] In a possible implementation of the first aspect, the cockpit chip is further configured to execute a power-off process of the second power supply chip, the deserializer and the cockpit chip when it is determined that there is no demand for using the camera module.
[0023] In combination with the first aspect, in another possible implementation, the platform further includes a connector; one end of the connector is connected to the camera module, and the other end is connected to the deserializer, for transmitting video stream data between the camera module and the deserializer.
[0024] In a second aspect, the present invention further provides a method for controlling a camera module, which can be applied to a cockpit chip. The method includes:
[0025] After waking up and starting up, enable and control the deserializer to transmit video stream data, and monitor the startup status of the autonomous driving chip;
[0026] When the autonomous driving chip is started, the control of the deserializer is transferred to the autonomous driving chip through the serial interface, so that the autonomous driving chip takes over the control and controls the external camera module to transmit video stream data.
[0027] In combination with the second aspect, in a possible implementation, the method further includes: when the autonomous driving chip is started, the control of the second power supply unit is transferred to the autonomous driving chip, and the second power supply unit is used to power the camera module.
[0028] In conjunction with the second aspect, in another possible implementation, the method further includes: after the entire vehicle is powered off and upon receiving a handover request from the autonomous driving chip, taking over control of the deserializer and the second power supply unit;
[0029] Determine whether there is a current need to use the camera module;
[0030] If yes, the second power supply unit is controlled to continuously supply power to the camera module, and continuously receive the video stream data in the first format sent by the deserializer.
[0031] In combination with the second aspect, in another possible implementation, the method further includes: if it is determined that there is no need to use the camera module, executing a power-off process for the second power supply chip, the deserializer, and the cockpit chip.
[0032] In a third aspect, the present invention further provides a method for controlling a camera module, which can be applied to an autonomous driving chip. The method includes:
[0033] After the cockpit chip wakes up and starts, maintaining communication with the cockpit chip using the serial interface;
[0034] When the self-startup is completed, taking over the control of the deserializer, controlling the deserializer to transmit the video stream data, and controlling the second power supply unit to continue to supply power to the camera module;
[0035] The first synchronization frame signal is generated and sent to the deserializer, and the first synchronization frame signal is used to control the camera module to synchronize exposure and switching with a second synchronization frame signal generated internally in the deserializer.
[0036] In combination with the third aspect, in a possible implementation, the method further includes: when the startup is completed, taking over the control right of the second power supply unit, and controlling the second power supply unit to supply power to the camera module.
[0037] In combination with the third aspect, in another possible implementation, the method further includes: when the whole vehicle is powered off, judging whether there is a demand for using the camera module at present; if there is no demand, transferring the control right of the deserializer and the second power supply unit to the cockpit chip, and starting a power-off process.
[0038] In the fourth aspect, the application provides a chip circuit, including a memory and a processor, the memory and the processor are connected; the memory stores computer instructions, and the processor executes the computer instructions to perform the control method of the camera module in any of the embodiments of the second aspect or the third aspect.
[0039] In the fifth aspect, the application provides a computer readable storage medium, which stores computer instructions, and the computer instructions are used to make a computer execute the control method of the camera module in the second aspect or the third aspect.
[0040] In addition, the application provides a computer program product, which includes computer instructions, and the computer instructions are used to make a computer execute the control method of the camera module in any of the embodiments of the second aspect or the third aspect.
[0041] In the sixth aspect, the application provides a vehicle, which includes a central computing platform and a camera module; the camera module is connected with the central computing platform, and the central computing platform is the central computing platform in the first aspect or any of the embodiments of the first aspect, and is used to execute the control method of the camera module in any of the embodiments of the second aspect or the third aspect.
[0042] The application provides a central computing platform, a control method of a camera module and a chip circuit, in the central computing platform, the control right of a panoramic camera can be switched between a cockpit chip and an automatic driving chip on demand, so that the requirements of the cockpit and the automatic driving for the panoramic camera data stream in different application scenarios are realized, and the problems of slow cockpit AVM startup, high power consumption in the sentinel mode scenario and driving safety caused by cockpit chip failure are solved. BRIEF DESCRIPTION OF DRAWINGS
[0043] In order to more clearly illustrate the technical solutions in the specific embodiments of the present application or the prior art, the drawings needed to be used in the description of the specific embodiments or the prior art will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative effort on the basis of these drawings.
[0044] Figure 1A is a scene schematic diagram of a panoramic camera data transmission method according to the present application;
[0045] Figure 1B is a scene schematic diagram of another panoramic camera data transmission method according to the present application;
[0046] Figure 1C is a scene schematic diagram of still another panoramic camera data transmission method according to the present application;
[0047] Figure 2 is a structural schematic diagram of a cabin fusion panoramic camera control system according to an embodiment of the present application;
[0048] Figure 3 is a signaling flow diagram of a camera module control method according to an embodiment of the present application;
[0049] Figure 4 is a signaling flow diagram of another camera module control method according to an embodiment of the present application;
[0050] Figure 5 is a signaling flow diagram of still another camera module control method according to an embodiment of the present application;
[0051] Figure 6 is a flow schematic diagram of a camera module control method according to an embodiment of the present application;
[0052] Figure 7 is a flow schematic diagram of another camera module control method according to an embodiment of the present application;
[0053] Figure 8 is a flow schematic diagram of still another camera module control method according to an embodiment of the present application;
[0054] Figure 9 is a hardware structure schematic diagram of a chip circuit according to an embodiment of the present application;
[0055] Figure 10 is a structural schematic diagram of a vehicle according to an embodiment of the present application. DETAILED DESCRIPTION
[0056] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.
[0057] The term "module" used herein can be a software or hardware object executed on the computing system. Different components, modules, engines and services described herein can be implemented as implemented objects on the computing system. The apparatuses and methods described herein can be implemented in software, of course, but can also be implemented in hardware, and both fall within the scope of the present application.
[0058] In the description of the present application, it should be noted that the terms "center", "upper", "lower", "left", "right", "inner", "outer" and the like indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application. In addition, the terms "first", "second", "third" are only for descriptive purposes and cannot be understood as indicating or implying relative importance.
[0059] In the description of the present application, it should be noted that unless otherwise explicitly specified and limited, the terms "connected", "connected" should be understood broadly, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected or can communicate with each other; it can be directly connected, or indirectly connected through an intermediate medium, or it can be the internal connection of two elements or the interaction relationship between two elements. For a person of ordinary skill in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.
[0060] The technical solutions provided by the embodiments of the present application are applied to an automotive electronic and electrical architecture, in which a vehicle domain controller is used to manage and control various systems of a vehicle. The automotive domain control is an electronic control unit (ECU, Electronic Control Unit) integrated with multiple functions. Among them, intelligent / automatic driving and intelligent cockpit are designed as two different domain controls, which are associated with each other through multiple different types of data buses, such as controller area network bus, media-oriented system transport bus, etc. As shown in the figure, three automatic driving domain controller and intelligent cockpit domain controller panoramic camera data transmission scenarios are exemplified. Figures 1A-1C As shown in the figure, three automatic driving domain controller and intelligent cockpit domain controller panoramic camera data transmission scenarios are exemplified.
[0061] Scenario 1: asFigure 1A As shown in the figure, after the system is powered on, the panoramic camera is first connected to the autonomous driving domain controller. The SOC (System-on-chip) of the autonomous driving controller processes the video stream data collected by the panoramic camera internally and outputs the processed video stream data to the smart cockpit domain controller through a coaxial cable.
[0062] The panoramic camera system includes four camera modules positioned in the front, rear, left, and right directions of the vehicle. Each camera module is connected to the autonomous driving domain controller via a coaxial cable harness.
[0063] Scenario 2: If Figure 1B As shown in the figure, after the system is powered on, the panoramic camera first connects to the autonomous driving domain controller and then bypasses the camera video stream data to the intelligent cockpit domain controller. The intelligent cockpit domain controller then processes and displays the video data stream internally. Bypass transmission refers to the technology of bypassing traditional intermediate devices such as routers and switches and connecting directly to the target device. In this scenario, the video stream data collected by the camera bypasses the autonomous driving domain controller and is directly transmitted to the serializer 2 through the deserializer "D-PHY" (MIPI Differential PHY, a differential serial physical layer interface developed by the MIPI Alliance) interface.
[0064] Scenario 3: If Figure 1C As shown in the figure, after the system is powered on, the panoramic camera is first connected to the smart cockpit domain controller, and then the smart cockpit domain controller bypasses the video stream data collected by the camera to the smart cockpit domain controller.
[0065] For the above-mentioned "Scenario 1" and "Scenario 2", after the user unlocks and enters the vehicle, it is usually necessary to quickly turn on the AVM surround view function to determine whether there are any obstacles around the vehicle. At this time, the vehicle needs to quickly turn on the AVM camera to detect the vehicle's surroundings in real time. In this scenario, the power-on of the AVM camera and the initialization of the AVM camera link need to rely on the autonomous driving domain controller. After the vehicle is unlocked and powered on, the autonomous driving domain controller is usually in a cold start process, and its startup is expected to take more than 10 seconds. After the user enters the vehicle, if he wants to quickly start the AVM surround view function, it is usually in a no-picture state, and he needs to wait until the autonomous driving domain controller is initialized before it can be started. This results in a long startup time and slow response of the smart cockpit domain controller AVM.
[0066] Among them, AVM (Around View Monitor, full name for panoramic parking image system) is a modern car intelligent driving auxiliary technology, which aims to provide all-round visual safety protection for the driver.
[0067] In addition, in the above-mentioned "scenario 1", the user locks the car and leaves the vehicle, and the vehicle is started in the "sentinel mode". At this time, the vehicle needs to start the AVM camera to detect the environment around the vehicle in real time, and the AVM camera video stream data needs to be processed inside the automatic driving controller in this scenario, so the automatic driving domain controller is usually in working state in this "sentinel mode" scenario. When the user finds that the vehicle is started in the "sentinel mode", the automatic driving domain controller is usually in a large power consumption state, which may cause excessive power consumption, for example, the vehicle's cruising range is reduced by 50Km when the sentinel mode is started for one night.
[0068] In addition, in the above-mentioned "scenario 3", the intelligent cockpit controller may fail. Specifically, the user is unlocking the vehicle or is performing automatic assisted driving, and the vehicle needs the AVM camera to work normally. The power-on of the AVM camera and the initialization of the AVM camera link completely depend on the intelligent cockpit domain controller in this "scenario 3". For the intelligent cockpit domain controller, it is usually a non-functional safety component, which may have unexpected functional failure. Therefore, when the user has started the automatic assisted navigation driving function or the parking function, if the intelligent cockpit domain controller fails unexpectedly, the AVM camera will be abnormal at this time, which will directly cause the abnormality of the automatic assisted driving, and may cause vehicle driving accidents in serious cases.
[0069] Based on the problems in the above-mentioned scenarios 1 to 3, the embodiment of the present application provides a central computing platform for effectively controlling the panoramic camera, overcoming the technical problems of the above-mentioned scenarios, and meeting the requirements of the panoramic camera data stream in different application scenarios.
[0070] It should be understood that the central computing platform in the embodiment adopts an independent cockpit chip and an automatic driving chip, and in addition to this, it can also be other platforms or systems containing cockpit chips and automatic driving chips, which are not limited in the embodiment.
[0071] The technical solutions provided by the embodiment of the present application will be described in detail below.
[0072] Referring to Figure 2 A central computing platform is provided in the embodiment of the present application. The central computing platform comprises a deserializer, a cockpit chip and an automatic driving chip, wherein the cockpit chip and the automatic driving chip are directly connected through a serial interface. In addition, the deserializer is also connected with the cockpit chip and the automatic driving chip respectively.
[0073] The deserializer includes a plurality of ports for connecting the external camera module and the cockpit chip and the autonomous driving chip, and transmitting the video stream data from the camera module to the cockpit chip and the autonomous driving chip through the plurality of ports.
[0074] Specifically, the deserializer is responsible for converting the data in the serial signal format sent from the external camera module back to the original parallel data format; then, the video stream data is transmitted to the cockpit chip through the D-PHY, so as to input the AVM video stream data in the parallel data format into the CSI interface of the cockpit chip, and further, the CSI interface can be a MIPI-CSI interface.
[0075] The image sensor in the external camera module is responsible for capturing light and converting it into an original electrical signal, and converting it into a clear AVM image signal suitable for human eyes to watch through an internal image signal processor (ISP, etc.), and then inputting the AVM image signal into the cockpit chip through the MIPI-CSI interface. And the AVM image signal is serialized and converted into a serial signal format suitable for long-distance transmission, and then the AVM video stream data is transmitted to the central computing platform through a coaxial cable.
[0076] It should be understood that in the embodiment, the panoramic camera or camera module is exemplified, and other vehicle cameras, such as front-view binocular cameras and side-view cameras, are also applicable, and the embodiment does not limit this.
[0077] The deserializer in the central computing platform receives the AVM video stream data collected in the external camera module through the connector.
[0078] In addition, the deserializer is also used to be connected to the autonomous driving chip through the C-PHY (MIPI Camera PHY, a camera serial physical layer interface specified by the MIPI Alliance), so as to input the AVM video stream data in the parallel data format into the MIPI-CSI interface of the autonomous driving chip at the same time.
[0079] The C-PHY is a physical layer specification developed by the MIPI (Mobile Industry Processor Interface) Alliance, mainly used in mobile devices and related applications, such as connecting displays and cameras to application processors.
[0080] The cockpit chip and the deserializer are connected through at least one interface, and the at least one interface includes one or more of a CSI interface, an I2C (Inter-Integrated Circuit, referred to as IIC or I2C) interface, a power control end (PWDNB), an error detection end (Error), and a lock signal end (Lock), and a synchronization signal end (SYNC).
[0081] In this embodiment, the deserializer can be used to realize the bidirectional video data stream transmission of the cockpit chip and the autonomous driving chip at the same time.
[0082] As shown in Figure 2 The cockpit chip includes one or more of a plurality of interfaces, such as a CSI_1 interface, an enable end (EN), a signal control end (I2C1), a power control end PWDNB (Power Down), an error detection end (Error), and a lock signal end (Lock). Among them, the enable end (EN) is connected with the first power supply unit; the CSI_1 interface (which can be a MIPI-CSI interface) is connected with a port of the deserializer, and is used to receive video stream data in D-PHY serial interface. The I2C1 in the cockpit chip is used to transmit I2C control signals between the deserializer. The PWDNB is connected with the second power supply unit.
[0083] The MIPI-CSI interface is a high-speed serial interface technology for connecting camera modules and processors. In this embodiment, the MIPI-CSI interface is used to connect the deserializer, and receive video stream data in a certain format from the external camera module through the deserializer.
[0084] Similarly, the autonomous driving chip also includes at least one interface, as shown in Figure 2 The autonomous driving chip includes a lock signal end (Lock), an error detection end (Error), a PWDNB, a signal control end (I2C2), a CSI_0 interface, and a synchronization signal end (SYNC), etc. Further, the CSI_0 interface is a MIPI-CSI interface, and the autonomous driving chip can receive AVM video stream data in front, rear, left, and right directions through the MIPI-CSI interface, and after processing by an internal driving or parking algorithm model, perform parking assistance or obstacle detection.
[0085] Optionally, the cockpit chip described above can be a cockpit SOC (System on Chip) or cockpit circuit. Similarly, the autonomous driving chip can also be an autonomous driving SOC or autonomous driving circuit.
[0086] In addition, the cockpit chip and the autonomous driving chip each further include a serial interface, and the two chips are directly connected through the respective serial interfaces, so that data transmission between the cockpit chip and the autonomous driving chip can be realized through the serial interfaces.
[0087] Optionally, the serial interface includes but is not limited to a UART interface (Universal Asynchronous Receiver / Transmitter) or an SPI interface (Serial Peripheral Interface). In addition, the serial interface can also be an interface of other types or protocols, and the embodiments are not limited thereto.
[0088] Optionally, the platform further includes a connector, such as Figure 2 As shown, one end of the connector is connected to the camera module, and the other end is connected to the deserializer, for transmitting video stream data between the camera module and the deserializer.
[0089] Referring to Figure 3 A signaling flow diagram of a control method of a camera module is provided for the embodiments of the application, and the method can be used to realize switching of control right between a cockpit chip and an automatic driving chip. Specifically, the method includes:
[0090] Step S1: After the cockpit chip is started up, the deserializer is enabled and controlled to transmit video stream data.
[0091] Specifically, the user unlocks the vehicle and enters the vehicle, and starts up the vehicle IGN ON power-on. The cockpit chip is started up first, and after the cockpit chip is started up, the STR (Suspend to Ram) mode is used to complete fast start-up. The STR mode is a power management technology, also known as a system-level sleep or hibernate mode. The STR mode allows the current system state to be saved to the memory, and reduces the power consumption of other hardware devices, so as to be able to quickly recover to the previous working state afterwards. In this process, the CPU and the memory and other key components remain in an active state, but other hardware devices such as hard disks, displays, etc. enter a low-power mode or are completely turned off.
[0092] Specifically, an implementation of enabling control is that the cockpit chip sends an enabling signal to the deserializer through an enabling end (EN) and a PWDNB pin, enables the deserializer, powers the deserializer, and initializes the deserializer through I2C1. The deserializer chip is initialized and configured, and after the initialization of the deserializer is completed, the cockpit chip writes the deserializer register through I2C1, triggers the deserializer to internally send a synchronization frame signal, and controls the synchronization exposure of the plurality of (for example, 4) camera modules.
[0093] After the deserializer is enabled to work, the video data stream collected from the camera module is received, and the video data stream is transmitted to the cockpit chip. Correspondingly, the cockpit chip receives the video data stream in the D-PHY serial interface through the CSI_1 interface. Optionally, the CSI_1 interface is an MIPI-CSI interface.
[0094] Step S2: The cockpit chip monitors the start-up status of the autonomous driving chip. The start-up status of the autonomous driving chip includes two states: not started and started.
[0095] When the cockpit chip is powered on, the start-up status of the autonomous driving chip is monitored through the respective serial interfaces of the cockpit chip and the autonomous driving chip. The communication can be monitored by transmitting heartbeat messages or heartbeat messages to each other.
[0096] Step S3: When the autonomous driving chip is started, the control of the deserializer is handed over to the autonomous driving chip through the serial interface.
[0097] The autonomous driving chip can notify the cockpit SOC chip of the completion of the start-up through the UART interface or the SPI interface. In a specific embodiment, the cockpit chip monitors the heartbeat message from the autonomous driving chip through the serial interface, such as the UART interface. When the autonomous driving chip is started, it will send a heartbeat message or a heartbeat message to the cockpit chip.
[0098] The cockpit chip starts the real-time listening function, and once it receives the heartbeat message or the heartbeat message sent by the autonomous driving chip from the UART interface or the SPI interface, it determines that the autonomous driving chip is started. If no heartbeat message or heartbeat message is detected, it is determined that the autonomous driving chip is not started.
[0099] When it is determined that the autonomous driving chip is started, the cockpit chip will hand over the control of the deserializer to the autonomous driving chip. After the handover, the cockpit chip no longer performs read and write operations on the deserializer through the signal control end (I2C1), and the autonomous driving chip performs read and write operations on the deserializer through the signal control end (I2C0), thereby realizing the operation of handing over the control of the deserializer to the autonomous driving chip.
[0100] After the autonomous driving chip takes over the control of the deserializer, it continues to control the deserializer to transmit video stream data, such as sending control instructions to the deserializer to instruct the deserializer to convert the video stream data from the camera module according to a preset format and transmit the video stream data to the cockpit chip and the autonomous driving chip, respectively. At this time, two-way video data streams are transmitted to the cockpit chip and the autonomous driving chip.
[0101] The above method further comprises:
[0102] Step S4: The autonomous driving chip sends a first synchronization frame signal to the deserializer. The first synchronization frame signal is used to control the camera module to synchronize exposure and output images, and to synchronize switching with a second synchronization frame signal generated internally by the deserializer.
[0103] Specifically, the cockpit chip releases the control right of the deserializer, and no longer controls the deserializer through the I2C1. The autonomous driving chip takes over the deserializer through the I2C0 and controls the deserializer to continue transmitting the video stream data.
[0104] According to the above Figure 2 According to the circuit structure shown in the figure, in this step, the autonomous driving chip sends a first synchronization frame signal to the deserializer, specifically including: the autonomous driving chip sends the first synchronization frame signal to the deserializer through the synchronization signal end (SYNC).
[0105] Step S5: After receiving the first synchronization frame signal, the deserializer switches the synchronization frame signal generated inside the deserializer, such as the second synchronization frame signal, to the first synchronization frame signal, thereby realizing the function of synchronization frame switching.
[0106] In addition, the deserializer is also used to control the camera module and continuously transmit the video data stream to the cockpit chip and the autonomous driving chip. At the same time, the camera module is controlled to be exposed synchronously.
[0107] The method provided in this embodiment, in the case that the cockpit chip starts first and the autonomous driving chip starts later, the cockpit chip first controls the deserializer to transmit the video stream data, and after the autonomous driving chip starts, the cockpit chip transfers the control right of the deserializer to the autonomous driving chip, so that the autonomous driving chip takes over the control right of the deserializer and continues to control the deserializer to transmit the video stream data. This method depends on the cockpit chip, not the autonomous driving domain controller, for the power-on of the AVM camera, the initialization of the AVM camera link and other operations after the user unlocks the vehicle. After the cockpit chip is powered on after the vehicle is unlocked, it completes the fast start through the STR mode, and the start is expected to take less than 2s. Compared with the 10s unlocking time in the above-mentioned "scene 1" and "scene 2", this method realizes the fast start of the AVM function after the user enters the vehicle, and can immediately expose the picture when the initialization of the entire AVM camera is completed, saving the start time and improving the picture exposure efficiency.
[0108] In addition, in another possible implementation manner of the embodiment, in the process of transferring the control right, the cockpit chip also transfers the control right of the power supply module / unit to the autonomous driving chip.
[0109] Specifically, as Figure 2 shown, the central computing platform further includes a first power supply unit and a second power supply unit. The first power supply unit is connected between the deserializer and the cockpit chip and includes an enable end, and the enable end of the first power supply unit is connected to the EN end of the cockpit chip. The second power supply unit also includes an enable end, and the second power supply unit is connected to the deserializer, the cockpit chip and the autonomous driving chip.
[0110] In addition, the second power supply unit is also connected with the camera module, as shown in Figure 2 The power supply is transmitted from the coaxial signal line to the camera module.
[0111] The cockpit chip is also used to enable the first power supply unit to supply power to the deserializer after the wake-up start, and to enable the second power supply unit. Specifically, the cockpit chip can enable the deserializer and the first power supply unit to start through the enable end (EN) and the PWDNB pin, and the first power supply unit is used to supply power to the deserializer. Optionally, the first power supply unit is a deserializer power supply chip.
[0112] As shown in Figure 4 In the above step S2, when it is detected that the automatic driving chip starts to complete, the cockpit chip is also used to transfer the control right of the second power supply unit to the automatic driving chip through the serial interface. Correspondingly, the automatic driving chip is also used to take over the control right of the second power supply unit after the start is completed, and control the second power supply unit to continue to supply power to the camera module.
[0113] The process of transferring the control right can be through the above-mentioned UART interface or SPI interface.
[0114] It should be noted that when the cockpit chip transfers the control right of the second power supply unit, the transfer timing can be together with the transfer of the control right of the deserializer as shown in Figure 3 , or the control right can also be transferred in batches, and the embodiment does not limit this.
[0115] Optionally, in the embodiment, the second power supply unit is a camera power supply chip, or a POC power supply chip. Because the power supply channel is a POC (Power over Coax, coaxial cable power supply technology) that transmits power and data through a single coaxial cable, after the automatic driving chip starts, the POC power supply chip is controlled to continue to supply power to the camera module, and the deserializer is initialized through I2C1.
[0116] The first power supply unit is a deserializer power supply unit, which is used to supply power to the deserializer after being enabled.
[0117] In the embodiment, in the process of transferring the control right in step S3, the cockpit chip can also transfer the control right of the first power supply unit to the automatic driving chip, and the specific transfer method is the same as the method of transferring the deserializer and the second power supply unit in the embodiment, and the embodiment will not be repeated here.
[0118] As shown in Figure 3 and Figure 4As shown, the deserializer specifically enables the reception of video stream data collected by the camera module, and converts the video stream data into video stream data in a first format, and then transmits the video stream data in the first format to the cockpit chip. At this time, before the automatic driving chip is started, the video stream data is only transmitted to the cockpit chip.
[0119] Optionally, the first format is a video stream format encoded by a SerDes physical layer D-PHY interface, and the D-PHY is mainly used for data communication between the camera and the display and the main processor.
[0120] The deserializer is also specifically used to receive a first synchronization frame signal, such as SYNC, by using a synchronization interface, control the camera module to synchronize exposure and output images, and synchronize switching of the first synchronization frame signal and a second synchronization frame signal. For details, refer to the foregoing steps S4 and S5, which will not be described here.
[0121] The deserializer is also used to continue transmitting the video stream data in the first format to the cockpit chip after the automatic driving chip takes over the control, and convert the video stream data into a second format, and then transmit the video stream data in the second format to the automatic driving chip. At this time, the deserializer simultaneously outputs two video stream data, which are transmitted to the cockpit chip and the automatic driving chip, respectively.
[0122] Optionally, the second format is a video stream format encoded by a SerDes physical layer C-PHY interface, and the C-PHY is an advanced physical layer interface standard, which realizes efficient, flexible and low-power data transmission through its unique three-phase symbol encoding technology and embedded clock link design. It is generally used to connect displays, cameras and other peripherals to application processors on mobile devices.
[0123] The platform provided in the embodiment provides that when a user unlocks the vehicle or is in the process of automatic auxiliary driving, the vehicle needs the AVM camera to work normally, and the power-on of the AVM camera and the initialization of the AVM camera link are not completely dependent on the cockpit chip, but are controlled by the cockpit chip and the automatic driving chip.
[0124] In the user unlocking the vehicle scenario, if the cockpit chip fails unexpectedly, since there is a communication interaction process between the automatic driving chip and the cockpit chip, the automatic driving chip will confirm the state of the cockpit chip after power-on is completed. If the cockpit chip is abnormal, the automatic driving chip directly takes over the power-on of the AVM camera and the initialization process of the AVM camera link, thereby ensuring the normal function of the AVM camera.
[0125] If the automatic auxiliary driving scene is being carried out, the cabin chip has an unexpected failure, since entering the vehicle, the control of the AVM camera has been taken over by the automatic driving chip, the unexpected failure of the cabin chip does not affect the function of the AVM camera, and will not cause the abnormality of the automatic auxiliary driving, so the method provided in the embodiment solves the problem of driving risk caused by the failure of the cabin chip.
[0126] During the power-off process of the vehicle, the central computing platform provided in the embodiment also provides a chip switching function.
[0127] Referring to Figure 5 The signaling flowchart of another control method of the camera module provided in the embodiment of the application, the method comprises:
[0128] Step S6: When the use of the vehicle ends, the whole vehicle is powered off.
[0129] Step S7: The automatic driving chip judges whether there is a demand for using the camera module at the time of powering off the whole vehicle.
[0130] Step S8: If there is no demand, the control right of the deserializer and the second power supply unit is transferred to the cabin chip, and a power-off process is started.
[0131] The automatic driving chip informs the cabin chip to take over the AVM camera through a serial port, the cabin chip takes over the control right of the deserializer and the second power supply unit, and the automatic driving chip executes a power-off process.
[0132] Further, if there is a demand, the control right is still controlled by the automatic driving chip, and the control right is not temporarily transferred to the cabin chip.
[0133] Step S9: After taking over the control right, the cabin chip judges whether there is a demand for using the camera module.
[0134] If there is a demand for use, step S10 is executed; if there is no demand for use, step S11 is executed.
[0135] Step S10: If yes, the cabin chip controls the second power supply unit to continuously supply power to the camera module, and continuously receives the video stream data in the first format sent by the deserializer.
[0136] Specifically, the cabin chip judges whether there is another camera application scene (such as a sentinel mode), and will first remain in a non-sleep state, continuously maintains the power supply of the second power supply unit and the deserializer, so that the video stream data collected by the camera module can still be transmitted to the cabin chip.
[0137] When the cabin chip identifies that the camera application scene ends (for example, the sentinel mode is remotely turned off), it executes a power-off process of the second power supply unit / deserializer / cabin chip.
[0138] An embodiment in which the cockpit chip detects whether the sentinel mode is enabled includes: a user enabling the sentinel mode before leaving the vehicle, the cockpit chip obtaining information that the user enables the sentinel mode, and determining that the sentinel mode is enabled. If the user does not enable the sentinel mode before leaving the vehicle, the cockpit chip cannot detect the enabling information, and thus the cockpit chip determines that the sentinel mode is not enabled.
[0139] Step S11: If no, that is, in the case of determining that there is no demand for using the camera module, the cockpit chip performs a power-off process of the second power supply chip, the deserializer, and the cockpit chip.
[0140] The embodiment provides a switching process of the cockpit chip and the automatic driving chip when the vehicle is powered off, and the sentinel mode of the vehicle is enabled after the user locks the vehicle and leaves the vehicle. At this time, the vehicle needs to enable the AVM camera to detect the environment around the vehicle in real time, and the AVM camera video stream data transmission control only depends on the cockpit chip, so that the automatic driving chip is in a power-off and non-working state in the sentinel mode scenario, thereby solving the problem of high power consumption of the automatic driving chip in the sentinel mode scenario, and the cockpit chip can also control the AVM camera to continuously output images, and continuously perform vehicle environment monitoring in the sentinel mode scenario.
[0141] In the embodiment of the application, the above-mentioned enabling and initialization process of the first power supply unit, the second power supply unit, and the deserializer is first completed by the cockpit chip, or can be replaced by first being completed by the automatic driving chip, or being completed by an additional MCU chip.
[0142] In addition, the above-mentioned automatic driving chip and cockpit chip are independent chips, and in a variant, the automatic driving chip and the cockpit chip can be physically combined into one chip or one circuit structure, which is not limited in the application.
[0143] The functions of the cockpit chip are summarized as follows:
[0144] In the sleep wake-up scenario and specific scenarios, the power-on of the deserializer power supply chip and the POC power supply chip is controlled, and the deserializer chip in the central computing platform is initialized. The front, rear, left and right AVM video stream data are received through the MIPI-CSI interface, and after internal AVM splicing processing, the panoramic image is displayed. The camera module, the deserializer in the central computing platform, and the POC power supply unit are diagnosed and monitored to ensure the normal work of the AVM camera link. The Error or Lock signal detected by the deserializer is received, and the deserializer is reinitialized. The camera state information and control right are exchanged with the automatic driving chip through the serial port.
[0145] The functions of the automatic driving chip are summarized as follows:
[0146] The AVM video stream data of front, rear, left and right is received through the MIPI-CSI interface, and after being processed by the internal driving or parking algorithm model, the parking assistance or obstacle detection is performed. After the initialization of the deserializer, the POC power supply chip and the power-on of the automatic driving chip are completed, the control of the entire AVM video link is taken over. The deserializer and the POC power supply unit in the camera module and the central computing platform are diagnosed and monitored to ensure the normal operation of the AVM camera link. The Error or Lock signal detected from the deserializer is received, and the initialization operation of the deserializer is performed again. The camera state information interaction and control right interaction are performed with the cabin SOC chip through the serial port. The external synchronization frame signal FSYNC is sent to the deserializer to control all the cameras to synchronize the picture output.
[0147] In the embodiment, a control method of the camera module is also provided, which can be used for the above-mentioned cabin chip or cabin SOC, Figure 6 is a flow chart of a control method of the camera module in the embodiment, as Figure 6 shown, the flow includes:
[0148] Step S201: after the wake-up start, enabling and controlling the deserializer to transmit the video stream data, and monitoring the start of the automatic driving chip.
[0149] Step S202: when the automatic driving chip is started, the control right of the deserializer is transferred to the automatic driving chip through the serial interface, so that the automatic driving chip takes over the control right and controls the external camera module to transmit the video stream data.
[0150] In addition, it also includes: when the automatic driving chip is started, the control right of the second power supply unit is also transferred to the automatic driving chip, and the second power supply unit is used for power supply for the camera module.
[0151] Correspondingly, the method flow of the automatic driving chip, as Figure 7 shown, can be used for the above-mentioned automatic driving chip or automatic driving SOC, and the method further includes:
[0152] Step S203: after the wake-up start of the cabin chip, the automatic driving chip keeps communicating with the cabin chip through the serial interface. For example, the communication is performed by sending a heartbeat message through the serial interface to determine whether the automatic driving chip is started.
[0153] Step S204: when the automatic driving chip is started, the automatic driving chip takes over the control right of the deserializer and controls the deserializer to transmit the video stream data.
[0154] The automatic driving chip takes over the control right of the second power supply unit and controls the second power supply unit to continue to supply power for the camera module.
[0155] Step S205: The automatic driving chip generates and sends a first synchronization frame signal to the deserializer, and the first synchronization frame signal is used for controlling the camera module to synchronously expose and output images, and synchronously switching with a second synchronization frame signal generated in the deserializer.
[0156] The detailed processes of the steps of the embodiment can be referred to the foregoing Figure 3 and Figure 4 power-on process and the corresponding description, and the embodiment will not be described here.
[0157] In addition, in the power-off process, as shown in Figure 8 , the control method further comprises:
[0158] Step S301: After the whole vehicle is powered off, the automatic driving chip receives a handover request from the automatic driving chip, and takes over the control right of the deserializer and the second power supply unit.
[0159] Optionally, the automatic driving chip takes over the control right of the second power supply unit.
[0160] Step S302: It is judged whether there is a demand for using the camera module at present.
[0161] Step S303: If yes, the automatic driving chip controls the second power supply unit to continuously supply power to the camera module, and continuously receives the video stream data in the first format sent by the deserializer.
[0162] Step S304: If it is determined that there is no demand for using the camera module, the automatic driving chip executes a power-off process of the second power supply chip, the deserializer and the automatic driving chip.
[0163] In the power-off process provided by the embodiment, the detailed processes of the steps can be referred to the foregoing Figure 5 power-off process and the corresponding description, and the embodiment will not be described here.
[0164] The application provides a cabin-driving fusion panoramic camera module control method, which can switch the control right of the panoramic camera between the cabin chip and the automatic driving chip according to needs, so as to realize the requirements of the cabin and the automatic driving for the panoramic camera data stream in different application scenarios.
[0165] In addition, the method saves at least one deserializer chip, saves cost and has fewer signal intermediate transmission links; by using the STR mode of the cabin chip, the problem of AVM rapid start of the cabin is solved.
[0166] A control device of the camera module is also provided in the embodiment, which is used to implement the above-mentioned embodiments and preferred embodiments, and will not be described again. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware is also possible and contemplated.
[0167] The embodiment provides a control device of the camera module, which includes an enabling module, a processing module, a transceiver module, and the like. In addition, the device can also include more or fewer units, modules, such as a storage module, and the like.
[0168] When the control device is a cockpit chip or a cockpit function device, the method steps of the cockpit chip in the above-mentioned Figures 3-5 , or Figures 6-8 can be performed.
[0169] When the control device is an autonomous driving chip or an autonomous driving function device, the method steps of the autonomous driving chip in the above-mentioned Figures 3-5 , or Figures 6-8 can be performed.
[0170] Further function descriptions of the above-mentioned various modules and units are the same as those of the corresponding embodiments described above, and will not be described again.
[0171] The control device in the embodiment is presented in the form of functional units or modules, where the unit refers to a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above-mentioned functions.
[0172] The embodiment of the application also provides a chip circuit, which can include the control device of the camera module described above. The chip circuit is used to perform the panoramic camera module control method of the above-mentioned embodiments, and switches the control right of the panoramic camera between the cockpit chip and the autonomous driving chip as needed, so as to realize the requirements of the panoramic camera data stream in different application scenarios of the cockpit and the autonomous driving.
[0173] Please refer to Figure 9 , which is a structural schematic diagram of a chip circuit provided by an optional embodiment of the application. The chip circuit includes one or more processing modules 10, a storage module 20, and a communication interface for connecting various components, including a high-speed interface and a low-speed interface. Various components are connected to each other by using different buses, and can be installed on a common mainboard or in other ways as needed. Figure 9 The processing module 10 is taken as an example in the above-mentioned
[0174] The processing module 10 can be a processor, such as a central processing unit (CPU). The processing module 10 can further include a hardware chip. The hardware chip can be an application specific integrated circuit, a programmable logic device, or a combination thereof. The programmable logic device can be a complex programmable logic device, a field programmable logic device, a general array logic, or any combination thereof.
[0175] The storage module 20 stores instructions executable by the at least one processing module 10 to cause the at least one processing module 10 to perform the control method of the camera module as described in the above embodiments.
[0176] The storage module 20 can include a program storage area and a data storage area. The program storage area can store an operating system and application programs required by at least one function. The data storage area can store data created according to the use of the computer device, and the like. In addition, the storage module 20 can include a high-speed random access memory, and can further include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or another non-transitory solid-state memory device. In some alternative embodiments, the storage module 20 can include a memory remotely disposed relative to the processing module 10, and the remote memory can be connected to the computer device through a network. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.
[0177] The storage module 20 can include a volatile memory, such as a random access memory. The storage module 20 can also include a non-volatile memory, such as a flash memory, a hard disk, or a solid state disk. The storage module 20 can further include a combination of the above types of memories.
[0178] In addition, the chip circuit further includes a plurality of communication interfaces 30, including but not limited to a CSI interface, an I2C interface, a PWDNB, an EN interface, an Error interface, and a lock signal end (Lock), a synchronization signal end (SYNC), and the like, for the chip circuit to communicate with other devices or communication networks, such as being connected with a deserializer, an automatic driving chip, a first power supply unit, a second power supply unit, and the like.
[0179] It should be noted that the above chip circuit can be the cockpit chip of the foregoing embodiments, or can be an automatic driving chip, or can be a circuit board integrated with the cockpit chip and the automatic driving chip, or can be a central computing platform, and the present embodiment does not limit this.
[0180] The present embodiment also provides a vehicle, as shown in the figure, the vehicle includes a central computing platform 100 and a camera module 200; the camera module 200 is connected with the central computing platform 100. Figure 10
[0181] The internal structure of the central computing platform 100 can refer to the foregoing Figure 2 The structure of the central computing platform shown in FIG. 1 is used to execute the control method of the camera module described in the foregoing embodiments.
[0182] The camera module 200 is used to transmit video stream data to the cockpit chip and / or the automatic driving chip in the central computing platform 100 under the control of the central computing platform 100. Specifically, the transmission of the video stream data and the control method can refer to the description of the foregoing embodiments, which will not be described here.
[0183] The embodiments of the present application also provide a computer readable storage medium. The method according to the embodiments of the present application can be implemented in hardware, firmware, or recorded in a storage medium, or stored in a remote storage medium or a non-transitory machine readable storage medium and stored in a local storage medium by downloading through a network, so that the method described herein can be processed by such software on a storage medium using a general purpose computer, a special purpose processor or programmable or special purpose hardware.
[0184] The storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk or a solid state disk, etc. Further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that the computer, the processor, the microprocessor controller or the programmable hardware includes a storage component that can store or receive software or computer code, which, when accessed and executed by the computer, the processor or the hardware, implements the control method shown in the foregoing embodiments.
[0185] The embodiments of the present application can also provide a computer program product including computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the above method. The computer program product can be written in any combination of one or more programming languages to implement the operations of the embodiments of the present disclosure, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. The program code can be executed entirely on a user computing device, partially on a user device, as a separate software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0186] The above examples are only used to illustrate the technical solutions of the embodiments of the present application, but not to limit them; although the embodiments of the present application are described in detail with reference to the foregoing examples, those of ordinary skill in the art should understand that the technical solutions recorded in the foregoing examples can be modified, or some technical features thereof can be replaced by equivalents; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A central computing platform, characterized by, The platform comprises a deserializer, a cockpit chip and an automatic driving chip, wherein the cockpit chip and the automatic driving chip are directly connected through a serial interface; The deserializer comprises a plurality of ports for connecting an external camera module, the cockpit chip and the automatic driving chip, and transmitting video stream data from the camera module to the cockpit chip and the automatic driving chip through the plurality of ports; The cockpit chip is connected with the deserializer, and is configured to enable and control the deserializer to transmit the video stream data after wake-up starting, and monitor starting of the automatic driving chip; when the automatic driving chip is started, the control right of the deserializer is transferred to the automatic driving chip through the serial interface; The automatic driving chip is configured to take over the control right of the deserializer after starting, control the deserializer to continue transmitting the video stream data, and send a first synchronization frame signal to the deserializer; the first synchronization frame signal is used for controlling the camera module to synchronously expose and output images, and synchronously switching with a second synchronization frame signal generated in the deserializer.
2. The central computing platform of claim 1, wherein, The platform further comprises a first power supply unit and a second power supply unit, wherein an enabling end of the first power supply unit and an enabling end of the second power supply unit are connected with the cockpit chip, and the second power supply unit is further connected with the automatic driving chip and the camera module; The cockpit chip is further configured to enable the first power supply unit to supply power for the deserializer, enable the second power supply unit to supply power for the camera module, and initialize the deserializer after wake-up starting.
3. The central computing platform according to claim 2, wherein The cockpit chip is further configured to transfer the control right of the second power supply unit to the automatic driving chip through the serial interface when the automatic driving chip is started; The automatic driving chip is further configured to take over the control right of the second power supply unit after starting, and control the second power supply unit to continue supplying power for the camera module.
4. The central computing platform according to claim 1, wherein The deserializer is further configured to receive the video stream data collected by the camera module after being enabled, convert the video stream data into video stream data in a first format, and transmit the video stream data in the first format to the cockpit chip; The deserializer is particularly configured to receive the first synchronization frame signal, control the camera module to synchronously expose and output images, and synchronously switch the first synchronization frame signal and the second synchronization frame signal.
5. The central computing platform according to claim 4, wherein The deserializer is further configured to continue transmitting the video stream data in the first format to the cockpit chip after the automatic driving chip takes over the control right, convert the video stream data into video stream data in a second format, and transmit the video stream data in the second format to the automatic driving chip.
6. The central computing platform according to any one of claims 1-5, wherein The cockpit chip is further configured to determine that the automatic driving chip is started up completely when a heartbeat message from the automatic driving chip is monitored through the serial interface. 7.The central computing platform of claim 3, wherein, The automatic driving chip is further configured to determine whether there is a demand for using the camera module when the whole vehicle is powered off, and if not, hand over the control right of the deserializer and the second power supply unit to the cockpit chip, and start a power-off process. The cockpit chip is further configured to determine whether there is a demand for using the camera module after taking over the control right, and if so, control the second power supply unit to continuously supply power to the camera module, and continuously receive the video stream data in the first format sent by the deserializer. 8.The central computing platform of claim 7, wherein, The cockpit chip is further configured to execute a power-off process for the second power supply unit, the deserializer, and the cockpit chip when it is determined that there is no demand for using the camera module.
9. The central computing platform of any one of claims 1-5, wherein, The platform further comprises a connector; One end of the connector is connected to the camera module, and the other end is connected to the deserializer, for transmitting video stream data between the camera module and the deserializer. 10.A method for controlling a camera module, the method comprising: The method applied to the cockpit chip comprises: After wake-up startup, enable and control the deserializer to transmit video stream data, and monitor the startup of the automatic driving chip; When the automatic driving chip is started up completely, hand over the control right of the deserializer to the automatic driving chip through the serial interface, so that the automatic driving chip takes over the control right and controls the external camera module to transmit video stream data.
11. The method of claim 10, wherein, The method further comprises: When the automatic driving chip is started up completely, hand over the control right of the second power supply unit to the automatic driving chip, and the second power supply unit is used to supply power to the camera module.
12. The method according to claim 10 or 11, characterized in that, The method further comprises: After the whole vehicle is powered off, receive the handover request from the automatic driving chip, and take over the control right of the deserializer and the second power supply unit; Determine whether there is a demand for using the camera module; If so, control the second power supply unit to continuously supply power to the camera module, and continuously receive the video stream data in the first format sent by the deserializer.
13. The method of claim 12, wherein, The method further comprises: If it is determined that there is no demand for using the camera module, execute a power-off process for the second power supply unit, the deserializer, and the cockpit chip. 14.A method for controlling a camera module, the method comprising: The method applied to the automatic driving chip comprises: After the cockpit chip is woken up and started up, keep communication with the cockpit chip through the serial interface; When the startup is completed, take over the control right of the deserializer, and control the deserializer to transmit video stream data; Generate and send a first synchronization frame signal to the deserializer, and the first synchronization frame signal is used to control the camera module to synchronize exposure and output images, and synchronize switching with a second synchronization frame signal generated internally in the deserializer.
15. The method of claim 14, wherein, The method further comprises: When the startup is completed, take over the control right of the second power supply unit, and control the second power supply unit to supply power to the camera module.
16. The method of claim 15, wherein, The method further includes: When the whole vehicle is powered off, it is judged whether there is a demand for using the camera module at present; If there is no demand, the control right of the deserializer and the second power supply unit is transferred to the cockpit chip, and a power-off process is started.
17. A chip circuit, characterized by comprising a memory and a processor, the memory and the processor being connected; The memory stores computer instructions, and the processor executes the computer instructions to perform the camera module control method in any one of claims 10-13 or any one of claims 14-16.
18. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for causing a computer to execute the camera module control method in any one of claims 10-13 or any one of claims 14-16.
19. A vehicle characterized by comprising: The vehicle comprises a central computing platform and a camera module; The camera module is connected with the central computing platform, and the central computing platform is the central computing platform in any one of claims 1-9.
Citation Information
Patent Citations
Vehicle control method, cabin controller, vehicle-mounted computing system and vehicle
CN118387123A
In-vehicle monitoring method, device and equipment, vehicle and storage medium
CN118457490A