A panoramic image fast ejection map system, method, device and medium

Abstract

The application provides a panoramic image fast rendering system, method, device and medium. The system comprises: a deserializer unit configured to receive and deserialize surround view video data transmitted by a surround view camera, and transmit the deserialized surround view video data to a driving domain SOC chip and a cabin domain; a driving domain microcontroller configured to receive a wake-up signal and configure the deserializer unit, and in the case that a surround view flow opening request transmitted by the cabin domain SOC chip is acquired, configure the deserializer unit to transmit the deserialized surround view video data to the cabin domain SOC chip; the driving domain SOC chip configured to receive the deserialized surround view video data transmitted by the deserializer unit; and the cabin domain SOC chip configured to, upon receiving the wake-up signal, send a surround view flow opening request to the driving domain microcontroller, acquire the deserialized surround view video data, and generate a panoramic image based on the deserialized surround view video data. The cabin domain and the driving domain are decoupled by directly acquiring data from the deserializer unit by the cabin domain SOC chip, the rendering time delay is reduced, and the system complexity is reduced.

Description

Technical Field

[0001] This application relates to the field of driver assistance technology, and in particular to a panoramic imaging quick-start system, method, device and medium. Background Technology

[0002] With the accelerated development of intelligent new energy vehicles, users have significantly increased their demands for parking safety and experience. Panoramic imaging technology can provide a 360° field of view the moment the vehicle is powered on, not only improving parking efficiency but also reducing the risk of low-speed accidents. In intelligent driving and intelligent cockpit technologies, the principle of panoramic imaging technology is to use surround-view cameras installed around the vehicle to provide the driver with a 360-degree panoramic view.

[0003] However, in current methods for quickly starting panoramic images, the surround-view camera is directly connected to the microcontroller unit (MCU) of the intelligent driving domain. The intelligent driving domain's SOC chip (System on Chip) processes the data from the surround-view camera, pushes the stitched top-down view and single-view video streams to the intelligent cockpit, and outputs the panoramic interface display request signal to the intelligent cockpit system. The intelligent cockpit system then displays the panoramic image based on the received display request signal and video stream. This method suffers from long panoramic image output time delays and high system complexity. Summary of the Invention

[0004] The purpose of this application is to provide a panoramic image fast-start output system, method, electronic device and storage medium, which can solve the problem that in the prior art, panoramic image output time is long and system complexity is high because the data from the surround view camera must be processed and forwarded by the intelligent driving domain SOC chip before it can be output to the intelligent cockpit.

[0005] In a first aspect, embodiments of this application provide a panoramic image fast-start image output system, the system comprising: The deserializer unit is used to receive and deserialize the surround-view video data sent by the vehicle's surround-view camera, and send the deserialized surround-view video data to the driver domain SOC chip and the cockpit domain. The driving domain microcontroller is used to receive a wake-up signal and configure the deserializer unit. When a surround-view open-current request is received from the cockpit domain SOC chip, the deserializer unit is configured to send the deserialized surround-view video data to the cockpit domain SOC chip. A driving domain SOC chip is used to receive the deserialized surround-view video data sent by the deserializer unit; The cockpit domain SOC chip is used to send a surround-view open-circuit request to the driving domain microcontroller upon receiving the wake-up signal, obtain the deserialized surround-view video data, and generate a panoramic image based on the deserialized surround-view video data.

[0006] Optionally, a first video channel is provided between the deserializer unit and the cockpit domain SOC chip; a first configuration channel is provided between the deserializer unit and the driving domain microcontroller. The driving domain microcontroller initializes the deserializer unit during cold start through the first configuration channel, and controls the deserializer unit to open the first video channel when the driving domain microcontroller receives the surround view open request sent by the cockpit domain SOC chip. The deserializer unit sends the deserialized surround-view video data to the cockpit domain SOC chip through the first video channel.

[0007] Optionally, the driving domain microcontroller includes a surround view deserializer configuration module, which is used to initialize the deserializer unit in advance through the first configuration channel when the vehicle is cold-started.

[0008] Optionally, a second video channel is provided between the deserializer unit and the driving domain SOC chip; a second configuration channel is provided between the deserializer unit and the driving domain SOC chip. After a cold start is completed, the driving domain SOC chip takes over the configuration rights of the deserializer unit through the second configuration channel, and controls the deserializer unit to open the second video channel through the second configuration channel; it receives the deserialized surround view video data sent by the deserializer unit through the second video channel. Optionally, the driving domain SOC chip includes at least: a camera frame synchronization module, a perception algorithm module, a driving module, and a parking module. After the driving domain SOC chip is powered on, the bootloader, operating system and basic services set in the driving domain SOC chip are started, and the configuration permissions of the deserializer unit are taken over. The second configuration channel controls the deserializer unit to open the second video channel and receive the deserialized surround view video data sent by the second video channel; The deserialized surround-view video data is input into the camera frame synchronization module, the perception algorithm module, the driving module, and the parking module.

[0009] Optionally, the cockpit domain SOC chip sends the surround view open flow request to the driving domain microcontroller via a hardware interrupt.

[0010] Optionally, the cockpit domain SOC chip includes at least: a panoramic image service module; the panoramic image service module includes a panoramic surround view monitoring system algorithm and a video display module; After the cockpit domain SOC chip sends a surround view open-circuit request to the driving domain microcontroller, the panoramic image service module is activated. The panoramic image service module acquires the deserialized surround view video data through the first video channel; The deserialized surround view video data is processed according to the algorithm of the panoramic surround view monitoring system, and the panoramic image is output. The panoramic image is sent to the vehicle's video display device via the video display module.

[0011] Secondly, embodiments of this application provide a method for rapid panoramic image output, applied to a panoramic image rapid output system. The panoramic image rapid output system includes: a deserializer unit, a driver domain microcontroller, a driver domain SOC chip, and a cockpit domain SOC chip. The method includes: Receive the vehicle's wake-up signal and the surround-view video data sent by the vehicle's surround-view camera; The surround view video data is processed by the deserializer unit to generate deserialized surround view video data. When the driving domain microcontroller receives the wake-up signal, the surround view deserializer configuration module of the driving domain microcontroller is activated to initialize and configure the deserializer unit; When the cockpit domain SOC chip receives the wake-up signal, it sends a surround view open current request to the driving domain microcontroller via a hardware interrupt. When the driving domain microcontroller receives the surround view open-circuit request, it configures the deserializer unit to send the deserialized surround view video data to the cockpit domain SOC chip. The cockpit domain SOC chip is used to receive the deserialized surround view video data and generate the corresponding panoramic image.

[0012] Thirdly, embodiments of this application provide an electronic device, including: a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method described above.

[0013] Fourthly, embodiments of this application provide a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the method described above.

[0014] Compared with the prior art, the embodiments of this application have the following advantages: In this embodiment of the application, the panoramic image quick-start system includes: a deserializer unit, which receives and deserializes surround-view video data sent by a surround-view camera, and sends the deserialized surround-view video data to a driver domain SOC chip and a cockpit domain SOC chip; a driver domain microcontroller, which receives a wake-up signal and configures the deserializer unit to send the deserialized surround-view video data to the cockpit domain SOC chip when it receives a surround-view open-current request sent by the cockpit domain SOC chip; a driver domain SOC chip, which receives the deserialized surround-view video data sent by the deserializer unit; and a cockpit domain SOC chip, which, upon receiving a wake-up signal, sends a surround-view open-current request to the driver domain microcontroller, obtains the deserialized surround-view video data, and generates a panoramic image based on the deserialized surround-view video data. By establishing an independent video transmission channel between the decoder unit and the cockpit domain SOC chip, the deserialized surround view image does not need to be processed and forwarded by the driving domain SOC chip, reducing time delays caused by indirect video forwarding and reliance on intelligent driving applications; by decoupling the acquisition and processing of surround view images by the cockpit domain SOC chip from the intelligent driving domain, the complexity of the system is reduced. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 This is a schematic diagram of the structure of a panoramic image fast-start system provided in an embodiment of this application; Figure 2 This is a timing diagram of a panoramic image fast-start image output system provided in an embodiment of this application; Figure 3 This is a flowchart illustrating a hardware interrupt-based surround view open-flow request in a panoramic image fast-start system provided in this application embodiment; Figure 4 This is a flowchart of the steps of a panoramic image fast-starting image extraction method provided in an embodiment of this application; Figure 5 This is a schematic diagram of an electronic device provided in an embodiment of this application; Figure 6 This is a schematic diagram of a computer-readable storage medium provided in an embodiment of this application. Detailed Implementation

[0017] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0018] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein. Furthermore, in this application, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0019] The following description, in conjunction with the accompanying drawings, details a panoramic image fast-start system, method, electronic device, and storage medium provided in this application through specific embodiments and application scenarios.

[0020] With the accelerated development of intelligent new energy vehicles, users have significantly increased their demands for parking safety and experience. Panoramic imaging technology can provide a 360° field of view the moment the vehicle is powered on, not only improving parking efficiency but also reducing the risk of low-speed accidents. In intelligent driving and intelligent cockpit technologies, the principle of panoramic imaging technology is to use surround-view cameras installed around the vehicle to provide the driver with a 360-degree panoramic view.

[0021] However, current methods for quickly generating panoramic images involve directly connecting the surround-view camera to the microcontroller unit (MCU) in the intelligent driving domain. The intelligent driving domain processes the data from the surround-view camera, pushing the stitched top-down and single-view video streams to the intelligent cockpit, and outputting a panoramic display request signal to the intelligent cockpit system. The intelligent cockpit system then displays the panoramic image based on the received display request signal and video streams. This method requires the surround-view camera data to be processed and forwarded by the intelligent driving domain's SOC chip before being output to the intelligent cockpit, resulting in a long delay in panoramic image generation and high system complexity.

[0022] In this embodiment, the driving domain microcontroller is the MCU (Micro Controller Unit) of the intelligent driving domain, hereinafter referred to as the driving domain MCU; the driving domain SOC chip is the chip component or system on chip (SOC) of the intelligent driving domain; and the cockpit domain SOC chip is the chip component or system on chip (SOC) of the intelligent cockpit domain.

[0023] Reference Figure 1 The diagram shows a structural schematic of a panoramic image fast-start system provided in an embodiment of this application, which may specifically include the following: The panoramic image fast start-up mapping system of this application is applied to the cockpit fusion scenario. The panoramic image fast start-up mapping system is run through the cockpit fusion central processor. The system specifically includes: a deserializer unit, a driving domain microcontroller, a driving domain SOC chip and a cockpit domain SOC chip.

[0024] Specifically, the traditional method for quick panoramic image output is applied to cockpit-separated scenarios. In the architecture of cockpit-separated scenarios, the intelligent driving domain and the intelligent cockpit domain are completely independent. The panoramic surround view calculation is performed in the intelligent driving domain, while the display is performed in the intelligent cockpit domain. It is necessary to first start the MCU / SOC in the intelligent driving domain to complete the initialization of the surround view cameras and image stitching, and then transmit it to the intelligent cockpit domain via Ethernet. The startup timing of the two independent systems needs to be coordinated, which limits the cold start image output speed. In addition, the camera data must be processed and forwarded by the intelligent driving domain SOC chip before it can be output to the intelligent cockpit, resulting in a long delay in panoramic image output time and high system complexity.

[0025] The architecture of the cockpit fusion scenario integrates driving and cockpit functions on the same hardware platform or high-speed interconnection system, namely the cockpit fusion central processor. Through the architecture of the cockpit fusion scenario, cameras and display modules can be initialized in parallel. The intelligent cockpit can directly acquire surround view video data without the need for intelligent driving domain SOC chip processing, which greatly shortens the panoramic surround view startup time.

[0026] The deserializer unit is used to receive and deserialize the surround-view video data sent by the vehicle's surround-view camera, and send the deserialized surround-view video data to the driver domain SOC chip and the cockpit domain SOC chip. In this embodiment, the deserializer unit is connected to the vehicle's surround-view cameras and is used to receive the camera signals and surround-view video data sent by each surround-view camera. It is also used to deserialize the surround-view video data sent by the surround-view cameras and send the deserialized surround-view video data to the driver domain SOC chip and the cockpit domain SOC chip. The surround-view cameras are used to provide the raw data of the surround-view video.

[0027] The driving domain microcontroller is used to receive a wake-up signal and configure the deserializer unit. When a surround-view open-current request is received from the cockpit domain SOC chip, the deserializer unit is configured to send the deserialized surround-view video data to the cockpit domain SOC chip. After the driving domain MCU is powered on, it receives the wake-up signal sent by the wake-up source, powers on the chip components in the driving domain (including the driving domain SOC chip, deserialization chip, etc.) and peripherals such as the surround view camera, and configures the surround view camera deserializer unit. When it receives the surround view open current request sent from the cockpit domain SOC chip, it configures the deserializer unit to send the deserialized surround view video data to the cockpit domain SOC chip. Here, power-on is the physical process of power connection.

[0028] A driving domain SOC chip is used to receive the deserialized surround-view video data sent by the deserializer unit; In this embodiment, after the driving domain SOC chip is powered on, it is used to receive surround-view video data deserialized from the deserializer unit.

[0029] The cockpit domain SOC chip is used to send a surround-view open-circuit request to the driving domain microcontroller upon receiving the wake-up signal, obtain the deserialized surround-view video data, generate a panoramic image based on the deserialized surround-view video data, and display it on the vehicle's display device, wherein the display device is used to display the generated panoramic image.

[0030] After the cockpit domain SOC chip is powered on, it configures the surround view data receiving interface, sends a surround view open current request to the driver domain MCU, and then directly obtains the deserialized surround view video data from the deserializer unit, and generates a panoramic image based on the deserialized surround view video data.

[0031] In this embodiment of the application, the panoramic image quick-start system includes: a deserializer unit, which receives and deserializes surround-view video data sent by a surround-view camera, and sends the deserialized surround-view video data to a driver domain SOC chip and a cockpit domain SOC chip; a driver domain microcontroller, which receives a wake-up signal and configures the deserializer unit to send the deserialized surround-view video data to the cockpit domain SOC chip when it receives a surround-view open-current request sent by the cockpit domain SOC chip; a driver domain SOC chip, which receives the deserialized surround-view video data sent by the deserializer unit; and a cockpit domain SOC chip, which, upon receiving a wake-up signal, sends a surround-view open-current request to the driver domain microcontroller, obtains the deserialized surround-view video data, and generates a panoramic image based on the deserialized surround-view video data. By establishing an independent video transmission channel between the decoder unit and the cockpit domain SOC chip, the deserialized surround view image does not need to be processed and forwarded by the driving domain SOC chip, reducing time delays caused by indirect video forwarding and reliance on intelligent driving applications; by decoupling the acquisition and processing of surround view images by the cockpit domain SOC chip from the intelligent driving domain, the complexity of the system is reduced.

[0032] In one embodiment of this application, a first video channel is provided between the deserializer unit and the cockpit domain SOC chip; a first configuration channel is provided between the deserializer unit and the driving domain microcontroller. The driving domain microcontroller initializes the deserializer unit during cold start through the first configuration channel, and controls the deserializer unit to open the first video channel when the driving domain microcontroller receives the surround view open request sent by the cockpit domain SOC chip. The deserializer unit sends the deserialized surround-view video data to the cockpit domain SOC chip through the first video channel.

[0033] In this embodiment, the first video channel is a hardware video channel between the cockpit domain SOC chip and the deserializer unit, used to transmit the surround-view video data deserialized by the deserializer unit to the cockpit domain SOC chip; the first configuration channel is a hardware channel for configuring the deserializer unit by the driver domain MCU, used to initialize the deserializer unit during cold start and control the deserializer unit to open the first video channel, wherein the cold start is a system startup process that includes a full self-test and system loading.

[0034] When the driver domain MCU receives a surround view open request from the cockpit domain SOC chip, it controls the deserializer unit to open the first video channel video stream through the first configuration channel; the deserializer unit sends the deserialized surround view video data to the cockpit domain SOC chip through the first video channel.

[0035] This embodiment establishes a configuration channel between the driver domain MCU and the deserializer unit, and a hardware video channel between the cockpit domain SOC chip and the deserializer unit. The surround-view camera can be directly connected to the cockpit domain SOC chip via the bypass function of the deserializer unit. The deserialized surround-view video data can be directly transmitted to the cockpit domain SOC chip for processing and display, reducing the link latency caused by forwarding the video stream through the driver domain SOC chip.

[0036] In one embodiment of this application, the driving domain microcontroller includes a surround-view deserializer configuration module, which is used to initialize the deserializer unit in advance through the first configuration channel when the vehicle is cold-started.

[0037] In this embodiment, a view deserializer configuration module is embedded in the driving domain MCU. During cold start, the view deserializer configuration module of the driving domain MCU initializes the deserializer unit in advance through the first configuration channel.

[0038] Specifically, due to the high functional safety level of the MCU, the MCU controls the power supply of the entire system in the design. During the system startup process, the MCU will power on and start first, and then the MCU will control the SOC power supply to power on, and then the SOC will start. Therefore, the MCU of the driving domain starts before the driving domain SOC chip starts, and the startup speed is better than that of the SOC system.

[0039] After the visual deserializer configuration module of the driving domain MCU initializes and configures the deserializer unit in advance through the first configuration channel to complete the cold start, the surround view deserializer configuration module in the driving domain SOC chip will take over the configuration rights of the deserializer unit through the second configuration channel to meet the configuration requirements of the surround view camera for the intelligent driving application within the driving domain SOC chip.

[0040] This embodiment embeds a surround view deserializer configuration module into the driving domain MCU, which, compared to configuring the surround view deserializer unit within the SOC system, can advance the surround view deserializer configuration completion time, thereby reducing the panoramic image generation time.

[0041] In this embodiment, a second video channel is provided between the deserializer unit and the driving domain SOC chip; a second configuration channel is provided between the deserializer unit and the driving domain SOC chip. After a cold start is completed, the driving domain SOC chip takes over the configuration rights of the deserializer unit through the second configuration channel, and controls the deserializer unit to open the second video channel through the second configuration channel; and receives the deserialized surround view video data sent by the deserializer unit through the second video channel.

[0042] In this embodiment, the second video channel is a hardware video channel between the driving domain SOC chip and the deserializer unit, used to transmit the surround-view video data deserialized by the deserializer unit to the driving domain SOC chip; the second configuration channel is a hardware channel for the driving domain SOC chip to configure the deserializer unit, used to allow the driving domain SOC chip to take over the configuration rights of the deserializer unit after a cold start, so as to meet the configuration requirements of the surround-view camera for the intelligent driving application within the driving domain SOC chip.

[0043] Specifically, after the cold start is completed, the driving domain SOC chip takes over the configuration rights of the deserializer unit through the second configuration channel, and controls the deserializer unit to open the second video channel through the second configuration channel; and receives the deserialized surround view video data sent by the deserializer unit through the second video channel.

[0044] In this embodiment, configuration channels are established simultaneously between the driving domain SOC chip and the deserializer unit, and between the driving domain MCU and the deserializer unit. After achieving rapid cold start surround view mapping, the configuration rights of the deserializer unit can be delegated to the driving domain SOC chip. The driving domain SOC chip can directly configure the deserializer unit without changing the configuration requirements of the intelligent assisted driving application for surround view video data in the driving domain SOC chip. Furthermore, in the central controller of the cockpit fusion scenario, the driving domain SOC chip and the cockpit domain SOC chip can share the data of the surround view camera and the deserializer unit. Compared with the domain controller of the traditional cockpit separation scenario, it can save one deserializer and one serializer chip, reducing hardware costs.

[0045] In one embodiment of this application, the driving domain SOC chip includes at least: a camera frame synchronization module, a perception algorithm module, a driving module, and a parking module; After the driving domain SOC chip is powered on, the bootloader, operating system and basic services set in the driving domain SOC chip are started, and the configuration permissions of the deserializer unit are taken over. The second configuration channel controls the deserializer unit to open the second video channel and receive the deserialized surround view video data sent by the second video channel; The deserialized surround-view video data is input into the camera frame synchronization module, the perception algorithm module, the driving module, and the parking module.

[0046] Specifically, in addition to the basic operating system and surround view deserializer configuration module, the driving domain SOC chip also includes functional modules required for intelligent assisted driving applications, such as camera frame synchronization module, perception algorithm module, driving module, and parking module.

[0047] After the driving domain SOC chip is powered on, the bootloader, operating system, and basic services set up within the driving domain SOC chip are started, and the configuration permissions of the deserializer unit are taken over. Among them, the bootloader is the first program that runs after the driving domain SOC chip system is powered on, and it is used to boot and load the operating system, which is equivalent to the BIOS program of a PC.

[0048] The driving domain SOC chip then takes over the configuration permissions of the deserializer unit through the second configuration channel and controls the deserializer unit to open the second video channel video stream. It receives the deserialized surround view video data sent by the deserializer unit through the second video channel, and then inputs the deserialized surround view video data into the camera frame synchronization module, perception algorithm module, driving module, parking module and other functional modules required by intelligent assisted driving applications to realize the relevant functions of intelligent assisted driving.

[0049] In this embodiment, after the surround-view deserializer configuration module is embedded into the driving domain MCU, the driving domain SOC chip does not need to repeatedly configure the surround-view deserializer unit during startup. After startup, the driving domain SOC chip directly takes over the configuration rights of the deserialization unit through the second configuration channel, and then directly obtains the deserialized surround-view video data through the second video channel, passing it to the functional modules required by the intelligent assisted driving application for use by the intelligent assisted driving application. In terms of process, the startup of the surround-view deserializer configuration module of the driving domain MCU and the driving domain SOC chip system are carried out in parallel, which can further shorten the startup time of the driving domain system and improve system performance.

[0050] In one embodiment of this application, the cockpit domain SOC chip sends the surround view open current request to the driving domain microcontroller via a hardware interrupt.

[0051] Reference Figure 3 This document illustrates a flowchart of a panoramic image fast-start map system initiating a surround-view opening request via a hardware interrupt, as provided in an embodiment of this application. The process may specifically include the following steps: Step S1: The cockpit domain SOC chip initialization is complete, ready to receive the deserialized surround view video data; Step S2: The cockpit domain SOC chip calls the interface to send an interrupt signal (e.g., high level or low level) to the driver domain MCU via GPIO; Step S3: The driver domain MCU receives an interrupt signal, generates an interrupt, and executes the interrupt handler. Step S4: The driving domain MCU configures the video stream switch of the deserializer unit in the interrupt handler and turns on the video stream of the first video channel; Step S5: The first video channel video stream is started and the cockpit domain SOC chip obtains the deserialized surround view video data through the first video channel.

[0052] In this embodiment, since the startup speed of the driving domain MCU is faster than that of the intelligent cockpit system, after the cockpit domain SOC chip is initialized, it sends a surround view open stream request signal to the driving domain MCU through a hardware interrupt. After receiving the surround view open stream request, the driving domain MCU configures the deserializer unit and starts the video stream. Compared with the traditional method of communicating through data packets, there is no need to wait for network transmission and protocol parsing, which greatly shortens the communication delay and reduces the time delay of surround view video data transmission, thereby improving the generation and display speed of panoramic images.

[0053] In one embodiment of this application, the cockpit domain SOC chip includes at least: a panoramic image service module; the panoramic image service module includes a panoramic surround view monitoring system algorithm and a video display module; After the cockpit domain SOC chip sends a surround view open-circuit request to the driving domain microcontroller, the panoramic image service module is activated. The panoramic image service module acquires the deserialized surround view video data through the first video channel; The deserialized surround view video data is processed according to the algorithm of the panoramic surround view monitoring system, and the panoramic image is output. The panoramic image is sent to the vehicle's video display device via the video display module.

[0054] In this embodiment, the cockpit domain SOC chip includes at least: a panoramic image service module; the panoramic image service module includes an AVM panoramic surround view monitoring system algorithm and a video display module; After the cockpit domain SOC chip sends a surround view open current request to the driver domain MCU, it starts the panoramic image service module. The panoramic image service module obtains the deserialized surround view video data through the first video channel. Then, it processes the deserialized surround view video data according to the AVM panoramic surround view monitoring system algorithm, outputs the corresponding panoramic image, and sends the panoramic image to the vehicle's video display device through the video display module.

[0055] This application deploys a panoramic imaging service module within the cockpit SOC. Through the AVM algorithm and video display module included in the module, after acquiring surround-view video data from the first video channel, it directly processes the data using the AVM algorithm and outputs it to the video display device. This decouples the acquisition and processing of surround-view video data by the cockpit domain SOC chip from the driver domain SOC chip, reducing the software complexity within the system.

[0056] Reference Figure 2 This document illustrates a timing diagram of a panoramic image fast-start map generation system provided in an embodiment of this application, which may specifically include the following steps: Step A1: The system powers on / wakes up. The driver domain MCU and cockpit domain SOC chip receive the wake-up signal and start simultaneously. Step A2: After the basic system of the driving domain MCU is started, the MCU application powers on the chip components in the driving domain (including the driving domain SOC chip, deserialization chip, etc.) and peripheral devices such as the surround view camera; after power-on, the surround view deserializer configuration module is started to configure the deserializer unit. Step A3: After receiving the wake-up signal, the cockpit domain SOC chip loads the basic operating system, completes the configuration of the first video channel receiving interface, and initiates a surround view opening request to the driver domain MCU. Step A4: After receiving the surround view open current request signal from the cockpit domain SOC chip, the driver domain MCU configures the deserializer unit through the first configuration channel and enables the video stream of the first video channel. Step A5: The cockpit domain SOC chip receives the deserialized surround view image data, processes it through the panoramic image service module, and outputs the panoramic image.

[0057] Step A6: After the driving domain SOC chip is powered on, the Bootloader, operating system, and system basic services are started sequentially. Then, the configuration permissions of the deserializer unit are taken over through the second configuration channel, and the second video channel is configured to open the current through the second configuration channel. The deserialized surround view image data from the second video channel is received for the functional modules required by intelligent assisted driving applications such as camera frame synchronization, perception algorithm module, driving module, and parking module.

[0058] This embodiment of the panoramic image fast-start system includes: a deserializer unit, which receives and deserializes surround-view video data sent by surround-view cameras, and sends the deserialized surround-view video data to the driver domain SOC chip and the cockpit domain SOC chip; a driver domain microcontroller, which receives a wake-up signal and configures the deserializer unit, and, upon receiving a surround-view open-current request sent by the cockpit domain SOC chip, configures the deserializer unit to send the deserialized surround-view video data to the cockpit domain SOC chip; a driver domain SOC chip, which receives the deserialized surround-view video data sent by the deserializer unit; and a cockpit domain SOC chip, upon receiving a wake-up signal, sending a surround-view open-current request to the driver domain microcontroller, obtaining the deserialized surround-view video data, and generating a panoramic image based on the deserialized surround-view video data. By establishing an independent video transmission channel between the decoder unit and the cockpit domain SOC chip, the deserialized surround view image does not need to be processed and forwarded by the driving domain SOC chip, reducing time delays caused by indirect video forwarding and reliance on intelligent driving applications; by decoupling the acquisition and processing of surround view images by the cockpit domain SOC chip from the intelligent driving domain, the complexity of the system is reduced.

[0059] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of actions. However, those skilled in the art should understand that the embodiments of this application are not limited to the described order of actions, because according to the embodiments of this application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of this application.

[0060] Reference Figure 4 The flowchart illustrates the steps of a panoramic image fast image extraction method provided in an embodiment of this application, which may specifically include the following: Step S101: Receive the vehicle's wake-up signal and the surround-view video data sent by the vehicle's surround-view camera; Step S102: Process the surround view video data according to the deserializer unit to generate deserialized surround view video data; Step S103: When the driving domain microcontroller receives the wake-up signal, the surround view deserializer configuration module of the driving domain microcontroller is started to initialize and configure the deserializer unit. Step S104: When the cockpit domain SOC chip receives the wake-up signal, it sends a surround view open current request to the driving domain microcontroller via a hardware interrupt. Step S105: When the driving domain microcontroller receives the surround view open flow request, the deserializer unit is configured to send the deserialized surround view video data to the cockpit domain SOC chip. The cockpit domain SOC chip is used to receive the deserialized surround view video data and generate the corresponding panoramic image.

[0061] As the method embodiments are basically similar to the system embodiments, they are described in a relatively simple manner. For relevant details, please refer to the description of the system embodiments.

[0062] like Figure 5 As shown, in another embodiment provided in this application, an electronic device 300 is also provided, including a memory 310 and a processor 320. The memory 310 and the processor 320 are connected via a bus for communication. The memory 310 stores a computer program, which can run on the processor 320 to implement the above steps.

[0063] like Figure 6 As shown, in another embodiment provided in this application, a computer-readable storage medium 401 is also provided, which stores a computer program that implements the methods described in the above embodiments when executed by a processor.

[0064] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus, or computer program products. Therefore, embodiments of this application can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of this application can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0065] Although preferred embodiments of the present invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present invention.

[0066] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus, or computer program products. Therefore, embodiments of this application can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of this application can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0067] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0068] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0069] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal equipment, causing a series of operational steps to be performed on the computer or other programmable terminal equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable terminal equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0070] Although preferred embodiments of the present application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of the embodiments of the present application.

[0071] Finally, it should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0072] It should also be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0073] The panoramic image quick-start system provided by the present invention has been described in detail above. Specific examples have been used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the idea of ​​the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A panoramic image fast-start system, characterized in that, The system includes: The deserializer unit is used to receive and deserialize the surround-view video data sent by the vehicle's surround-view camera, and send the deserialized surround-view video data to the driver domain SOC chip and the cockpit domain SOC chip. The driving domain microcontroller is used to receive a wake-up signal and configure the deserializer unit. When a surround-view open-current request is received from the cockpit domain SOC chip, the deserializer unit is configured to send the deserialized surround-view video data to the cockpit domain SOC chip. A driving domain SOC chip is used to receive the deserialized surround-view video data sent by the deserializer unit; The cockpit domain SOC chip is used to send a surround-view open-circuit request to the driving domain microcontroller upon receiving the wake-up signal, obtain the deserialized surround-view video data, and generate a panoramic image based on the deserialized surround-view video data.

2. The system according to claim 1, characterized in that, A first video channel is provided between the deserializer unit and the cockpit domain SOC chip; a first configuration channel is provided between the deserializer unit and the driving domain microcontroller; The driving domain microcontroller initializes the deserializer unit during cold start through the first configuration channel, and controls the deserializer unit to open the first video channel when the driving domain microcontroller receives the surround view open request sent by the cockpit domain SOC chip. The deserializer unit sends the deserialized surround-view video data to the cockpit domain SOC chip through the first video channel.

3. The system according to claim 2, characterized in that, The driving domain microcontroller includes a surround view deserializer configuration module, which is used to initialize the deserializer unit in advance through the first configuration channel when the vehicle is cold-started.

4. The system according to claim 1, characterized in that, A second video channel is provided between the deserializer unit and the driving domain SOC chip; a second configuration channel is provided between the deserializer unit and the driving domain SOC chip; After the cold start is completed, the driving domain SOC chip takes over the configuration rights of the deserializer unit through the second configuration channel, and controls the deserializer unit to open the second video channel through the second configuration channel; The second video channel receives the deserialized surround-view video data sent by the deserializer unit.

5. The system according to claim 4, characterized in that, The driving domain SOC chip includes at least: a camera frame synchronization module, a perception algorithm module, a driving module, and a parking module; After the driving domain SOC chip is powered on, the bootloader, operating system and basic services set in the driving domain SOC chip are started, and the configuration permissions of the deserializer unit are taken over. The second configuration channel controls the deserializer unit to open the second video channel and receive the deserialized surround view video data sent by the second video channel; The deserialized surround-view video data is input into the camera frame synchronization module, the perception algorithm module, the driving module, and the parking module.

6. The system according to claim 1, characterized in that, The cockpit domain SOC chip sends the surround view open flow request to the driving domain microcontroller via a hardware interrupt.

7. The system according to claim 1, characterized in that, The cockpit domain SOC chip includes at least: a panoramic imaging service module; the panoramic imaging service module includes a panoramic surround view monitoring system algorithm and a video display module; After the cockpit domain SOC chip sends a surround view open-circuit request to the driving domain microcontroller, the panoramic image service module is activated. The panoramic image service module acquires the deserialized surround view video data through the first video channel; The deserialized surround view video data is processed according to the algorithm of the panoramic surround view monitoring system, and the panoramic image is output. The panoramic image is sent to the vehicle's video display device via the video display module.

8. A method for quickly extracting panoramic images, characterized in that, An application is made in a panoramic image fast-start image output system, the panoramic image fast-start image output system comprising: a deserializer unit, a driver domain microcontroller, a driver domain SOC chip, and a cockpit domain SOC chip, the method comprising: Receive the vehicle's wake-up signal and the surround-view video data sent by the vehicle's surround-view camera; The surround view video data is processed by the deserializer unit to generate deserialized surround view video data. When the driving domain microcontroller receives the wake-up signal, the surround view deserializer configuration module of the driving domain microcontroller is activated to initialize and configure the deserializer unit; When the cockpit domain SOC chip receives the wake-up signal, it sends a surround view open current request to the driving domain microcontroller via a hardware interrupt. When the driving domain microcontroller receives the surround view open-circuit request, it configures the deserializer unit to send the deserialized surround view video data to the cockpit domain SOC chip. The cockpit domain SOC chip is used to receive the deserialized surround view video data and generate the corresponding panoramic image.

9. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored on the memory, wherein the processor executes the computer program to implement the method of claim 8.

10. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the method as described in claim 8.

Images