Control method and system, controller, vehicle, medium and product
By switching the control rights of the first controller to the second controller when the preset conditions are met, the problem of slow picture output speed after the display device is started is solved, and fast picture output is achieved.
Patent Information
- Application Number
- CN202510402993.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-31
- Publication Date
- 2025-08-12
AI Technical Summary
The display device needs to wait for a while to start displaying images after startup, resulting in slower image production.
When the preset control right switching condition is satisfied, the control right of the first controller to the image transmission unit is switched to the second controller to send image data to the display device.
It realizes rapid image production during startup and improves the response speed of the display device.
Smart Images

Figure CN120475124A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of automotive technology, and in particular to a control method, system, controller, vehicle, medium and product, wherein the system includes a control system and an image display system, the medium is a computer-readable storage medium, and the product is a computer program product. Background Art
[0002] After the display device is started, it usually takes a while to start displaying images, and the image output speed is slow. Summary of the Invention
[0003] The embodiments of the present application provide a control method, system, controller, vehicle, medium and product that can achieve rapid drawing output.
[0004] In order to achieve the above object, according to a first aspect of the present application, a control method is provided, comprising:
[0005] When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller, and the control right is used to control the image transmission unit to send image data to the display device.
[0006] According to a second aspect of the present application, there is provided a control system comprising a first controller and a second controller;
[0007] When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller, and the control right is used to control the image transmission unit to send image data to the display device.
[0008] According to a third aspect of the present application, there is provided an image display system, the image display system comprising a control system and an image transmission unit;
[0009] The first controller is configured to switch control rights of the image transmission unit to the second controller when a preset control rights switching condition is met, wherein the control rights are used to control the image transmission unit to send image data to the display device;
[0010] The display device is used to display a corresponding image based on the image data.
[0011] According to a fourth aspect of the present application, a control device is provided, comprising:
[0012] The switching unit is used to switch the control right of the first controller over the image transmission unit to the second controller when a preset control right switching condition is met, and the control right is used to control the image transmission unit to send image data to the display device.
[0013] According to a fifth aspect of the present application, a controller is provided, comprising a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute any one of the control methods provided in the embodiments of the present application.
[0014] According to a sixth aspect of the present application, a vehicle is provided, comprising a controller; the vehicle executes any one of the control methods provided in the embodiments of the present application through the controller.
[0015] According to a seventh aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, and the computer program is loaded by a processor to execute any one of the control methods provided in the embodiments of the present application.
[0016] According to an eighth aspect of the present application, a computer program product is provided, which includes a computer program or instructions, and the computer program or instructions are loaded by a processor to execute any one of the control methods provided in the embodiments of the present application.
[0017] In an embodiment of the present application, when a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller. The control right is used to control the image transmission unit to send image data to the display device, thereby achieving rapid image output. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] To more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.
[0019] Figure 1 is a flow chart of the control method provided in an embodiment of the present application;
[0020] Figure 2 This is a schematic diagram of the control switching architecture provided by an embodiment of the present application;
[0021] Figure 3 is a flow chart of the control method provided in an embodiment of the present application;
[0022] Figure 4 is a schematic diagram of a control device provided in an embodiment of the present application;
[0023] Figure 5 It is a schematic diagram of the structure of the controller provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.
[0025] The embodiments of the present application provide a control method, device, vehicle, and computer-readable storage medium. The control device can be integrated into a controller.
[0026] It should be noted that the order of description of the following embodiments is not intended to limit the preferred order of the embodiments.
[0027] A control method provided in an embodiment of the present application is as follows: Figure 1 As shown, the specific process of the control method can be as follows:
[0028] 101. When a preset control right switching condition is met, switch the control right of the first controller over the image transmission unit to the second controller, where the control right is used to control the image transmission unit to send image data to a display device.
[0029] Among them, the first controller may include a microcontroller unit (MCU), which is a microcomputer; the first controller may also be a controller other than a microcontroller, and can be flexibly set according to the needs of actual application scenarios. The second controller may include a microcontroller, or may be a controller other than a microcontroller.
[0030] In one embodiment, the method provided in the embodiment of the present application can be applied to a domain controller, which includes the first controller and the second controller.
[0031] In one embodiment, the first controller starts up faster than the second controller, and / or the second controller has better computing performance than the first controller. The first controller starts up faster than the second controller, or the first controller's startup time is shorter than the second controller's startup time, allowing the first controller to control the display device to output images before the second controller completes startup, thereby increasing the output speed. The second controller has better computing performance than the first controller, allowing further processing of image data.
[0032] In one embodiment, the first controller includes a microprocessor, and / or the second controller includes a system on chip (SoC) or an FPGA (Field Programmable Gate Array). FPGA stands for Field Programmable Gate Array. A system on chip may also be called a system on chip (SoC).
[0033] Among them, the image transmission unit may include a unit that can obtain image data and output the image data to a display device. For example, the image transmission unit may include a deserializer and a serializer, etc. The image transmission unit may also include other units that can realize image transmission, but does not include a deserializer and a serializer; the display device may be a tablet computer on the vehicle, etc., used to display images based on image data. In one embodiment, the image data may be a panoramic image collected by the vehicle's surround-view camera of the vehicle's environment. Based on the panoramic image, the display device can display a panoramic video of the vehicle's environment.
[0034] The first controller or the second controller having the control right can control the image transmission unit to send image data to the display device of the vehicle so that the display device can display the image.
[0035] In one embodiment, the preset control right switching condition may include the second controller having completed startup, so that control of the image transmission unit can be promptly switched to the second controller. Optionally, the preset control right switching condition may also include the load of the first controller being greater than a preset load threshold. The load of the first controller being greater than the preset load threshold may indicate that the first controller has fewer idle resources.
[0036] In one embodiment, when a preset control right switching condition is not satisfied, the first controller controls the image transmission unit to send the image data to the display device.
[0037] In one embodiment, when the first controller is in working mode and the second controller has not yet been completely started, the first controller controls the image transmission unit to send the image data to the display device based on the control right it possesses.
[0038] The working mode is an operation mode of the first controller, and the working mode may also be referred to as a "Working" mode. In the working mode, the first controller may operate normally, and the peripherals and processor of the first controller are all in operation.
[0039] When the second controller has not been started up, the first controller in working mode controls the image transmission unit to send image data to the display device, so that before the second controller is started up, the display device can also display the image under the control of the first controller, thereby achieving rapid image output.
[0040] In one embodiment, before controlling the image transmission unit through the first controller, the first controller controls the image acquisition device to be powered on, so as to acquire image data through the image acquisition device.
[0041] In one embodiment, when the first controller is in a low power consumption mode or is started, the first controller controls the image acquisition device to power on and initialize.
[0042] Specifically, when the first controller is in low-power mode or is activated, the first controller controls the image acquisition device to be powered on, and the image acquisition device is pre-powered on and initialized to complete a self-test. The pre-initialization of the image acquisition device can thereby increase the image output speed.
[0043] Low-energy mode is an operating mode of the first controller, also known as "StandBy+" mode. Low-energy mode can be used to extend battery life or reduce power consumption while maintaining some basic functions. Upon detecting a door unlock signal, the first controller is first controlled to enter low-energy mode, allowing the first controller to quickly enter operating mode.
[0044] The sleep mode is an operating mode of the first controller, and may also be referred to as a “Sleep” mode. In the sleep mode, the first controller can be quickly awakened to enter the working mode.
[0045] In one embodiment, when the second controller is not started, the first controller is controlled to be in a sleep mode, and the first controller controls the image acquisition device to be powered off.
[0046] When the second controller is not started, the first controller is controlled to be in sleep mode, and the image acquisition device is controlled to be powered off by the first controller, thereby reducing the power consumption of the image acquisition device and further reducing the consumption of the vehicle battery.
[0047] In one embodiment, the control right is used to control the image transmission unit to send the image data to the display device via a bypass method. The bypass method includes hardware bypass, software bypass, or a hybrid bypass method, so that the image transmission unit directly sends the image data to the image transmission unit, thereby increasing the transmission speed of the image data and thereby increasing the image output speed.
[0048] In one embodiment, the method provided in the embodiment of the present application can be applied to a vehicle. The control method provided in the embodiment of the present application can also include:
[0049] When the vehicle is in an operating state requiring surround view image output, and a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller.
[0050] In one embodiment, the operating state of the surround view map output includes at least one of a preset driving state, a preset driving scene, and an activated map output mode.
[0051] Among them, the preset driving status may include a driving speed greater than a first speed threshold, or less than a second speed threshold. When the vehicle's driving speed is greater than the first speed threshold, or less than the second speed threshold, and the preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller.
[0052] Among them, when the first speed threshold is greater than the second speed threshold, the driving speed is greater than the first speed threshold and the preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller. When the vehicle is driving at high speed, the surround view output can be controlled by the second controller to ensure safe driving.
[0053] If the vehicle speed remains less than the second speed threshold for a certain period of time, it can be considered that the vehicle is in a complex driving environment. The control of the image transmission unit by the first controller can be switched to the second controller. When the vehicle is in complex road conditions, the surround view image can be controlled by the second controller to ensure safe driving.
[0054] In one embodiment, the preset driving scene may include a vehicle driving on a road scene of a specified type, such as an expressway, a winding mountain road, or an urban road.
[0055] In one embodiment, starting the map output mode may include the vehicle being in a parking state.
[0056] In one embodiment, starting the map output mode may include the vehicle being in a parked state.
[0057] In one embodiment, starting the map output mode may include the vehicle being in an intelligent driving state.
[0058] For example, if the vehicle is detected to be in a driving or parking state and a preset control right switching condition is met, the first controller switches control of the image transmission unit to the second controller. This allows the second controller to control the image transmission unit to transmit image data when the vehicle is in the driving or parking state, thereby reducing vehicle energy consumption. Optionally, the image data transmitted by the image transmission unit can be related to the vehicle's surrounding environment, and the display device can display the surrounding environment based on the image data.
[0059] In one embodiment, the preset control right switching condition may be met by receiving an event that triggers the control right switching of the image transmission unit, such as receiving an interactive operation performed by a user that triggers the control right switching. For example, the user presses a button on the vehicle, or operates on the display device of the vehicle, etc., which triggers the control right switching.
[0060] The second controller can be activated when the vehicle is in the "ON" gear, or at other times. In one embodiment, the control method provided by the embodiment of the present application is applied to a vehicle. The control method provided by the embodiment of the present application can also include: activating the second controller when a door unlock signal is detected. Activating the second controller when the door is unlocked allows the second controller to quickly obtain control of the image transmission unit.
[0061] In one embodiment, the control method provided by the embodiment of the present application further includes:
[0062] When the vehicle is in an unignited state, the first controller is controlled to be in a sleep mode, and / or the second controller is powered off, so as to reduce energy consumption of the first controller and the second controller.
[0063] Optionally, the first controller may be controlled to be in a sleep mode when a vehicle door is closed and an ignition switch of the vehicle is not in a target gear position.
[0064] The door closing may include detecting a door closing signal, or after a preset time after detecting a door unlocking signal.
[0065] Exemplarily, after detecting the door unlock signal, if the ignition switch of the vehicle is not in the target gear position, the second controller can be controlled to be powered off, and / or the first controller can be placed in sleep mode. If after detecting the door unlock signal, it is not detected that the ignition switch of the vehicle is not in the target gear position, the second controller can be controlled to be powered off, and / or the first controller can be placed in sleep mode, so as to reduce the power consumption of the entire vehicle and reduce the consumption of the vehicle battery. Optionally, it is also possible to control the second controller to be powered off, and / or the first controller to be placed in sleep mode, if it is not detected that the ignition switch of the vehicle is not in the target gear position within a preset time (for example, within 60 seconds) after detecting the door unlock signal.
[0066] In one embodiment, the control method provided in the embodiment of the present application may further include:
[0067] When the ignition switch of the vehicle is in the target gear position, the first controller is controlled to be in the working mode.
[0068] The target gear may be an ignition gear of the vehicle, for example, the target gear may be an "ON" gear, or a "STRAT" gear, etc., and may be flexibly set according to specific needs.
[0069] Specifically, when the ignition switch of the vehicle is in the target gear position, controlling the first controller to be in the working mode can avoid the first controller being in the working state all the time, resulting in high power consumption of the first controller.
[0070] In one embodiment, the first controller may be controlled to be in the working mode when a vehicle door is closed and an ignition switch of the vehicle is in a target gear position.
[0071] The door closing may include detecting a door closing signal, or after a preset time after detecting a door unlocking signal.
[0072] Specifically, when the vehicle door is closed and the ignition switch is in the target gear position, controlling the first controller to be in the working mode can avoid the first controller being in the working state all the time, resulting in high power consumption of the first controller.
[0073] In one embodiment, the control method provided in the embodiment of the present application may further include:
[0074] After the door unlocking signal is detected and the ignition switch of the vehicle is in the target gear position, the first controller is in the working mode.
[0075] For example, if after detecting the door unlocking signal, the vehicle's ignition switch is detected to be in the target gear position, the first controller originally in the low-energy mode is put into the working mode, the control can quickly enter the working mode while reducing the power consumption of the first controller.
[0076] Optionally, within a preset time after the door unlocking signal is detected, if it is detected that the ignition switch of the vehicle is in the target gear position, the first controller which was originally in the low energy consumption mode is controlled to be in the working mode.
[0077] In one embodiment, the control method provided in the embodiment of the present application may further include:
[0078] When a door unlock signal is detected, a wake-up message is sent to the domain controller;
[0079] The first controller is woken up by the domain controller based on the wake-up message, and the first controller is controlled to enter a low-power mode.
[0080] When a door unlock signal is detected, a wake-up message may be sent to a domain controller unit (DCU). After receiving the wake-up message, the domain controller wakes up the first controller and controls the first controller to enter a low-power mode.
[0081] Optionally, the domain controller can manage the first controller and the second controller, for example, controlling the power on and off of the first controller and the second controller, and controlling the operating mode of the first controller. Optionally, the domain controller can be an intelligent driving domain controller for controlling intelligent driving and / or intelligent parking of the vehicle.
[0082] For example, the vehicle receives a communication signal indicating that the door is open, i.e., a door unlocking signal, wakes up the vehicle's multimedia, and wakes up the domain controller by sending a 0x14C message through the multimedia network. After the domain controller receives the 0x14C message, it wakes up the first controller and controls the first controller to enter the StandBy+ operation mode.
[0083] In one embodiment, the power on and off of the image acquisition device can be controlled by a power management unit. The power management unit may belong to the image acquisition device or may not belong to the image acquisition device. The image acquisition device may belong to the system or device to which the method provided in the embodiment of the present application is applied.
[0084] The power management unit is used to power the image acquisition device, enabling it to be powered on, and to stop powering it, enabling it to be powered off, allowing for flexible control over powering on and placing orders for the acquisition device. If the preset control right switching conditions are met, the second controller controls the power management unit; if the preset control right switching conditions are not met, the first controller controls the power management unit.
[0085] For example, when the preset control right switching conditions are not met, the first controller controls the power management unit so that the first controller controls the power on and off of the image acquisition device through the power management unit. When the preset control right switching conditions are met, the control of the power management unit by the first controller is switched to the second controller so that the second controller controls the power on and off of the image acquisition device through the power management unit.
[0086] In one embodiment, the image transmission unit is controlled by a control signal, and the step of “switching the control right of the first controller over the image transmission unit to the second controller” may include:
[0087] The object for transmitting control signals to the image transmission unit is switched from the first controller to the second controller.
[0088] The second controller replaces the first controller to send a control signal to the image transmission unit, and / or the second controller replaces the first controller to receive a control signal sent by the image transmission unit.
[0089] For example, the image transmission unit may be controlled by a control signal. When receiving the transmission signal, the image transmission unit may perform corresponding operations based on the transmission signal, such as starting and receiving image data sent by the display device.
[0090] Before switching the control of the image transmission unit from the first controller to the second controller, the controller processing unit is allowed to send control signals to the image transmission unit and receive control signals sent by the image transmission unit. After switching the control of the image transmission unit from the first controller to the second controller, the second controller is allowed to send control signals to the image transmission unit and receive control signals sent by the image transmission unit.
[0091] In one embodiment, the step of “switching the object for transmitting the control signal to the image transmission unit from the first controller to the second controller” may include:
[0092] At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller.
[0093] The at least one pin may be a pin related to controlling the image transmission unit to perform image data transmission, synchronization, startup, and fault detection on the image transmission unit.
[0094] The first switch device can be used to control the disconnection of at least one pin of the image transmission unit from being connected to the first controller, and the second switch device can be used to control the disconnection of at least one pin of the image transmission unit from being connected to the second controller.
[0095] In one embodiment, the control method provided in the embodiment of the present application may further include:
[0096] At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller through a switch control unit.
[0097] The switch control unit can be used to control the input signal, thereby controlling whether the first controller or the second controller sends the control signal to the image transmission unit, and whether the first controller or the second controller receives the control signal sent by the image transmission unit, so as to quickly switch the control of the image transmission unit from the first controller to the second controller.
[0098] In one embodiment, the image transmission unit includes a serializer and a deserializer. The control method provided in the embodiment of the present application may further include:
[0099] At least one pin of the serializer and at least one pin of the deserializer are switched from being connected to the first controller to being connected to the second controller through a switch control unit.
[0100] Exemplarily, the switch control unit can switch at least one of the I2C interface, enable pin, synchronization pin, lock pin and fault detection pin of the serializer and the deserializer from being connected to the first controller to being connected to the second controller.
[0101] In one embodiment, the first controller is an MCU, the second controller is a system on a chip, and the image acquisition device ( Figure 2 Surround view cameras in), display devices, deserializers, serializers, microcontrollers ( Figure 2 MCU) and System on Chip ( Figure 2 The architecture of the SoC in Figure 2 shown.
[0102] Add deserializer enable pin ( Figure 2 The PWDNB pin in the switch control unit is connected to both the MCU and the SoC; the ERROR pin (fault detection pin) and the LOCK pin ( Figure 2The lock pin in the switch control unit is connected to both the MCU and the SoC; the synchronization pin ( Figure 2 The FSYNC pin in the serializer is connected to both the MCU and the SoC through a switch control unit, and the switch control unit can be used to control the pins of the serializer and the deserializer to be connected to the MCU or the SoC.
[0103] In one embodiment, the switch control unit may include an I2C SWITCH chip and a GPIO switch module. The I2C SWITCH chip can be used to switch channels of I2C signals. The GPIO signals of the enable pins and fault detection pins of the serializer and deserializer can switch channels through the GPIO SWITCH chip, so that the GPIO signals of the serializer and deserializer are input to the second controller.
[0104] In one embodiment, the deserializer is configured to decrypt the received image data and output the decrypted image data to the serializer.
[0105] In one embodiment, the serializer is used to perform preset processing on the decrypted image data to obtain image data to be output to the display device, so as to output the image data to the display device.
[0106] In one embodiment, the control signal includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal.
[0107] Among them, the enable signal is used to control the image transmission unit to be in working state, the synchronization signal is used to synchronize the signals of the image transmission unit, the fault diagnosis signal is used to diagnose the fault of the image transmission device. If there is a fault, the fault needs to be stored and processed at this time, and the configuration signal is used to configure the serializer and deserializer to facilitate the display device to quickly output images.
[0108] In one embodiment, the control signal for the deserializer includes at least one of the enable signal, the synchronization signal, the fault diagnosis signal, and the configuration control signal, and the control signal for the serializer includes at least one of the enable signal, the synchronization signal, the fault diagnosis signal, and the configuration control signal.
[0109] In one embodiment, the step of “switching the control right of the first controller over the image transmission unit to the second controller” may include:
[0110] When a preset control right switching condition is met, sending a control right switching instruction to the first controller through the second controller;
[0111] The step of switching the control right of the first controller over the image transmission unit to the second controller is performed by the first controller according to the control right switching instruction.
[0112] When the first controller has control over the image transmission unit, and when the preset control switching conditions are met, the second controller sends a control switching instruction to the first controller. The control switching instruction can be used to instruct the first controller to release control over the image transmission unit. After receiving the control switching instruction, the first controller switches control over the image transmission unit to the second controller.
[0113] In one embodiment, when the first controller controls the image transmission unit, the control right identification information of the image transmission unit is set as a first control identification, and the first control identification indicates that the control right belongs to the first controller.
[0114] In one embodiment, when the second controller controls the image transmission unit, the control right identification information of the image transmission unit is set as a second control identification, and the second control identification indicates that the control right belongs to the second controller.
[0115] For example, when the first controller has control over the image transmission unit, the control right identification information may be first control right identification information. After the control over the image transmission unit is switched to the second controller, the control right identification information may be set to second control right identification information. The second control right identification information indicates that the control right belongs to the second controller.
[0116] In one embodiment, the control method provided by the embodiment of the present application further includes:
[0117] When the first controller controls the image transmission unit, the first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data.
[0118] In one embodiment, the first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data to obtain first fault diagnosis information;
[0119] When the preset control right switching condition is met, the first fault diagnosis information is synchronized to the second controller.
[0120] In one embodiment, when the second controller controls the image transmission unit, the second controller performs fault diagnosis on the transmission of the image data and / or the display of the image data, obtains second fault diagnosis information, and synchronizes the second fault diagnosis information to the first controller.
[0121] When the preset control right switching condition is met, the fault diagnosis information is synchronized to the second controller through the communication channel between the first controller and the second controller.
[0122] Before the control right of the image processing unit is switched to the second controller, the first controller has the control right of the image transmission unit. The first controller can perform fault diagnosis on the transmission and display of the image data through the transmission unit.
[0123] Take the first controller as MCU and the second controller as SoC as an example to illustrate, the image acquisition device ( Figure 2 Surround view cameras in), display devices, deserializers, serializers, microcontrollers ( Figure 2 MCU) and System on Chip ( Figure 2 The architecture of the SoC in Figure 2 As shown, the ERROR pins (i.e., fault detection pins) of the serializer and deserializer are connected to both the MCU and the SoC through the switch control unit. The microcontroller can perform fault diagnosis on the transmission and display of image data through the signal input from the fault detection pin to obtain fault diagnosis information.
[0124] When the preset control switching conditions are met, the first controller will transfer the control of the image transmission unit to the second controller, so that the second controller can continue to perform fault diagnosis on the transmission and display of image data through the signal input from the fault detection pin, and the first controller will send the fault diagnosis information obtained from the fault diagnosis to the second controller through the IPC channel.
[0125] In one embodiment, the control method provided by the embodiment of the present application further includes:
[0126] When the second controller has the control right, the second controller controls the vehicle to perform intelligent driving, intelligent parking, and / or output driving prompt information based on the image data.
[0127] When the preset control switching conditions are met, the image data is sent to the second controller through the image transmission unit. The second controller has good computing power and can control the vehicle to perform intelligent driving, intelligent parking, and / or output driving prompt information based on the image data.
[0128] In one embodiment, the image transmission unit includes a serializer and a deserializer, and the step of “switching control of the image transmission unit from the first controller to the second controller” may include:
[0129] When the preset control right switching condition is met, the communication interface of the deserializer is controlled to communicate with the second controller, and the communication interface is used to send the image data to the second controller.
[0130] The communication interface may be an interface for transmitting image data, for example, a MIPI interface, or other interfaces, which may be set according to the application scenario and are not limited here.
[0131] Take the first controller as MCU and the second controller as SoC as an example. Figure 2 As shown, the MIPI pin of the deserializer is connected to the SoC, and the image data is output to the SoC through the MIPI pin.
[0132] Taking the first controller as MCU and the second controller as SoC as an example, the control method provided in the embodiment of the present application is described. The image acquisition device in the embodiment of the present application can be a surround view camera. The architecture of the surround view camera and the MCU, SoC, etc. can be as follows: Figure 2 As shown in the figure, the surround-view camera is connected to the deserializer chip, which decrypts and transmits the signal. After receiving the video signal, the deserializer first outputs the signal to the serializer chip through two MIPI pins, and then the serializer directly outputs the signal to the vehicle's PAD end (i.e., display device) for fast image display.
[0133] The deserializer also outputs the video signal to the SoC computing chip through a MIPI pin. This video signal provides the image to the SoC for parking signal perception, planning, and control.
[0134] The serializer and deserializer PWDNB terminals and the power supply enable control are connected to both the MCU and the SoC computing chip. When the MCU is fast-started, they can be enabled through the PWDNB terminal.
[0135] The ERROR and LOCK signals of the serializer and deserializer are connected to both the MCU and the SoC computing chip. When the MCU is fast-started, fault diagnosis can be performed on the serializer and deserializer. If a fault occurs, the fault is stored and processed. When the SoC is started, the fault and alarm information is synchronized to the SoC computing chip.
[0136] The FSYNC synchronization signals of the serializer and deserializer are connected to both the MCU and the SoC computing chip. When the MCU is fast-started, the serializer and deserializer signals need to be synchronized and managed.
[0137] The I2C communication configuration signals of the serializer and deserializer are connected to both the MCU and the SoC computing chip. After the MCU is fast-started, the MCU configures the addresses and attributes of the serializer, deserializer, and surround-view camera through the I2C communication configuration signals. At the same time, the serializer, deserializer, and surround-view camera are initialized to facilitate fast image generation and fast driving and parking applications.
[0138] Power Management Chip ( Figure 2 The I2C communication signal, EN enable signal, and INT interrupt signal of the power supply in the system are also connected to the MCU and SoC computing power chip at the same time. After the MCU is started, it manages and enables the power supply. If there is a diagnostic fault and the camera needs to be restarted or reset, the I2C communication signal, EN enable signal, and INT interrupt signal are required for logical processing. At the same time, after the SoC is running, the I2C communication signal, EN enable signal, and INT interrupt signal can be used to control the restart or reset of the surround view camera.
[0139] Once the MCU is started (generally within 200ms), it can quickly output images to the PAD display. Even if the user quickly starts the PAD after opening the car door, the video function can be used seamlessly without waiting for the video to load.
[0140] When the SoC computing chip starts (usually about 30 seconds, starting from the moment the door is unlocked), the surround view processing and control tasks handled by the MCU will be taken over by the SoC computing chip. At this time, after the MCU receives the SoC takeover request, it needs to switch the control pins. Specifically, the I2C channels of the serializer, deserializer, and power supply can be switched through the switch control unit. After the switching, the SoC communicates with the serializer, deserializer, and power supply based on the I2C channel, and the switch control unit switches the input of the enable pins of the serializer, deserializer, and power supply from the input to the MCU to the SoC end, and switches the GPIO signal of the fault detection pin of the serializer and deserializer from the input to the MCU to the input to the SoC end.
[0141] In one embodiment, the first controller and the second controller switch control rights of the image transmission unit through an inter-process communication signal.
[0142] Among them, the inter-process communication signal can be Inter-Process Communication (IPC). The first controller and the second controller can transmit instructions, fault diagnosis information, etc. through IPC to achieve the switching of control rights. IPC can achieve high-speed transmission of data between the first controller and the second controller, which can further improve the output speed.
[0143] From the above, it can be seen that the embodiment of the present application switches the control of the image transmission unit from the first controller to the second controller when the preset control switching conditions are met. The control right is used to control the image transmission unit to send image data to the display device, thereby achieving rapid image output.
[0144] In order to facilitate better implementation of the control method provided in the embodiment of the present application, a control system is also provided in one embodiment, wherein the meanings of the terms are the same as those in the above control method, and the specific implementation details can be referred to the description in the method embodiment.
[0145] The control system includes a first controller and a second controller. When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller. The control right is used to control the image transmission unit to send image data to the display device.
[0146] In one embodiment, the control system includes a domain controller.
[0147] In one embodiment, when a preset control right switching condition is met, the domain controller switches the control right from the first controller to the second controller.
[0148] In one embodiment, when the preset control right switching condition is met, the second controller sends a control right switching instruction to the first controller; and the first controller switches the control right of the image transmission unit to the second controller based on the control right switching instruction.
[0149] In one embodiment, the control system further includes a switch control unit, and the image transmission unit includes a serializer and a deserializer; the first controller is used to send a switching instruction to the switch control unit based on the control right switching instruction; the switch control unit is used to switch at least one pin of the serializer and at least one pin of the deserializer from being connected to the first controller to being connected to the second controller according to the switching instruction.
[0150] Exemplarily, the first controller may send a switching instruction to the switch control unit in response to the control authority switching instruction; the switch control unit may switch at least one of the I2C interface, enable pin, synchronization pin, and fault detection pin of the serializer and deserializer from being connected to the first controller to being connected to the second controller in response to the switching instruction.
[0151] In one embodiment, when a preset control right switching condition is met, the switch control unit controls the communication interface of the deserializer to communicate with the second controller, so that the deserializer sends image data to the second controller through the communication interface.
[0152] The following describes the control system provided by the embodiment of the present application by taking the first controller as MCU and the second controller as SoC as an example. The image acquisition device ( Figure 2 Surround view camera in the manual), display device, deserializer, serializer, power supply (ie power management unit in the manual), first controller ( Figure 2 MCU in) and the second controller ( Figure 2 The architecture of the SoC in Figure 2 shown.
[0153] Enable pins for serializer and deserializer ( Figure 2 The PWDNB pin in the switch control unit is connected to both the MCU and the SoC; the ERROR pin (fault detection pin) and the LOCK pin ( Figure 2 The lock pin in the switch control unit is connected to both the MCU and the SoC; the synchronization pin ( Figure 2 The FSYNC pin in the control unit is connected to both the MCU and the SoC through the switch control unit.
[0154] The switch control unit can control the pins of the serializer and deserializer to be connected to the MCU end, or to the SoC, thereby realizing the switching of control rights.
[0155] From the above, it can be seen that the embodiment of the present application switches the control of the image transmission unit from the first controller to the second controller when the preset control switching conditions are met. The control right is used to control the image transmission unit to send image data to the display device, thereby achieving rapid image output.
[0156] In order to facilitate better implementation of the control method provided in the embodiment of the present application, an image display system is also provided in one embodiment. The meanings of the terms are the same as those in the above control method, and the specific implementation details can be referred to the description in the method embodiment.
[0157] The image display system includes a control system and an image transmission unit.
[0158] The first controller is configured to switch control rights over the image transmission unit to the second controller when a preset control rights switching condition is met, and the control rights are used to control the image transmission unit to send image data to the display device.
[0159] The display device is used to display a corresponding image based on the image data.
[0160] For example, the image display system is applied to a vehicle for illustration, such as Figure 3As shown, when the vehicle is detected to be unlocked and the door is opened, the body domain controller wakes up the multimedia, and the multimedia wakes up the intelligent driving domain controller by sending a wake-up message signal 0x14C to the intelligent driving domain controller; the intelligent driving domain controller receives the bus wake-up signal and starts the MCU to enter the "StandBy+" mode. The MCU controls the camera power supply module to power on. At this time, the camera completes the parameter initialization self-test in advance and starts the SoC.
[0161] Since the camera, serializer, and deserializer are initialized, turning the vehicle ON quickly outputs surround view images to the PAD and enables the SoC's parking function to be quickly applied. If the vehicle's ON signal is not detected within 60 seconds after the vehicle door is opened, indicating that the driver does not intend to park immediately, the intelligent driving domain controller can be controlled to enter sleep mode, powering down the camera and SoC, thereby reducing vehicle power consumption.
[0162] If the vehicle receives an ON gear signal within 60 seconds after the door is opened, the MCU enters Working mode, the camera is powered on and works normally, all radars are powered on and work, and the deserializer bypasses the video signal and outputs it to the PAD for the user to watch the video.
[0163] The MCU sets the current control identifier AVM_Ctrl = 1:MCU. It also performs fault diagnosis on the entire video input and output system and feedback signals. If a fault occurs, the MCU handles and controls it, and the SoC continues to boot synchronously. It also provides unified management and control of all adders, deserializers, and cameras (enable signals, synchronization signals, fault diagnosis signals, and configuration control signals).
[0164] After the SoC computing chip is started, the SoC computing chip sends a handover request AVM_Ctrol_Change=1: to the MCU through the internal high-speed communication channel of the IPC. After receiving the control handover instruction AVM_Ctrol_Change=1: handover signal of the SoC, the MCU hands over the control of the surround view (enable signal, synchronization signal, fault diagnosis signal, configuration control signal) and the video output MIPI signal to the SoC for control and intelligent driving algorithm processing, releasing the resources and computing power of the MCU.
[0165] After the control transfer is completed, the MCU sets the current control identifier AVM_Ctrl = 2: SoC. The SoC performs fault diagnosis on the entire video input and output system and feedback signals. If there is a fault, the SoC will handle it. If there is a fault, it will be synchronously transmitted to the MCU side for storage management. At the same time, the SoC can directly apply the video signal used for the parking function, and uniformly control all serializers and cameras (enable signal, synchronization signal, fault diagnosis signal, configuration control signal).
[0166] The control handover between the MCU and the SoC must be able to interact with the high-speed communication signals within the IPC to improve the efficiency of the handover;
[0167] Since the parking algorithm function is executed on the SoC side, when the MCU is started to perform video input and output fault diagnosis in the early stage, if there is a fault, the fault needs to be notified to the SoC through the IPC internal communication method after the SoC is started, and the SoC will implement the parking function strategy and alarm processing.
[0168] From the above, it can be seen that the embodiment of the present application switches the control of the image transmission unit from the first controller to the second controller when the preset control switching conditions are met. The control right is used to control the image transmission unit to send image data to the display device, thereby achieving rapid image output.
[0169] In order to facilitate better implementation of the control method provided in the embodiment of the present application, a control device is also provided in one embodiment. The meanings of the terms are the same as those in the above control method, and the specific implementation details can be referred to the description in the method embodiment.
[0170] The control device can be integrated into the controller, such as Figure 4 As shown, the control device may include: a switching unit 301, specifically as follows:
[0171] The switching unit 301 is used to switch the control right of the first controller over the image transmission unit to the second controller when a preset control right switching condition is met, and the control right is used to control the image transmission unit to send image data to the display device.
[0172] In one embodiment, the startup time of the first controller is shorter than the startup time of the second controller, and / or the computing performance of the second controller is better than that of the first controller.
[0173] In one embodiment, the preset control right switching condition includes completion of startup of the second controller.
[0174] In one embodiment, the control device may also be used to:
[0175] When a preset control right switching condition is not satisfied, the first controller controls the image transmission unit to send the image data to the display device.
[0176] In one embodiment, the control device may also be used to:
[0177] When the first controller is in the working mode and the second controller has not yet been completely started, the image transmission unit is controlled by the first controller to send the image data to the display device.
[0178] In one embodiment, the control device may also be used to:
[0179] The first controller controls the image acquisition device to power on.
[0180] In one embodiment, the image data is collected by an image acquisition device, and the control device may further be used to:
[0181] When the first controller is in a low-power consumption mode or is started, the first controller controls the image acquisition device to power on and initialize.
[0182] In one embodiment, the control device may also be used to:
[0183] When the second controller is not started, the first controller is controlled to be in a sleep mode, and the image acquisition device is controlled to be powered off.
[0184] In one embodiment, the control right is used to control the image transmission unit to send the image data to the display device in a bypass manner.
[0185] In one embodiment, the invention is applied to a domain controller, and the domain controller includes the first controller and the second controller.
[0186] In one embodiment, the control device may further be configured to: when a preset control right switching condition is met, the domain controller switches the control right from the first controller to the second controller.
[0187] In one embodiment, applied to a vehicle, the control device may also be used to:
[0188] When the vehicle is in the operating state of surround view image output, and the preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller.
[0189] In one embodiment, the operating state of the surround view map output includes at least one of a preset driving state, a preset driving scene, and an activated map output mode.
[0190] In one embodiment, applied to a vehicle, the control device may also be used to:
[0191] When a door unlocking signal is detected, the second controller is started.
[0192] In one embodiment, applied to a vehicle, the control device may also be used to:
[0193] When the vehicle is in an ignition-off state, the first controller is controlled to be in a sleep mode, and / or the second controller is powered off.
[0194] In one embodiment, the control device may also be used to:
[0195] When the vehicle door is closed and the ignition switch of the vehicle is not in the target gear position, the first controller is controlled to be in a sleep mode.
[0196] In one embodiment, applied to a vehicle, the control device may also be used to:
[0197] When a door unlocking signal is detected, the first controller is controlled to enter a low energy consumption mode.
[0198] In one embodiment, the control device may also be used to:
[0199] When the door unlock signal is detected, a wake-up message is sent to the domain controller;
[0200] The first controller is woken up by the domain controller based on the wake-up message, and the first controller is controlled to enter the low-power mode.
[0201] In one embodiment, applied to a vehicle, the control device may also be used to:
[0202] When the ignition switch of the vehicle is in a target gear position, the first controller is controlled to be in a working mode.
[0203] In one embodiment, the control device may also be used to:
[0204] When the vehicle door is closed and the ignition switch of the vehicle is in the target gear position, the first controller is controlled to be in the working mode.
[0205] In one embodiment, the control device may also be used to:
[0206] When the preset control right switching condition is met, the second controller controls the power management unit;
[0207] When the preset control right switching condition is not met, the first controller controls the power management unit.
[0208] In one embodiment, the image transmission unit is controlled by a control signal, and the switching unit 301 includes:
[0209] The object for transmitting control signals to the image transmission unit is switched from the first controller to the second controller.
[0210] In one embodiment, the switching unit 301 includes:
[0211] At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller.
[0212] In one embodiment, the control device may also be used to:
[0213] At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller through a switch control unit.
[0214] In one embodiment, the image transmission unit includes a serializer and a deserializer, and the method further includes:
[0215] At least one pin of the serializer and at least one pin of the deserializer are switched from being connected to the first controller to being connected to the second controller through a switch control unit.
[0216] In one embodiment, the deserializer is configured to decrypt the received image data and output the decrypted image data to the serializer.
[0217] In one embodiment, the serializer is used to perform preset processing on the decrypted image data to obtain image data to be output to the display device, so as to output the image data to the display device.
[0218] In one embodiment, the control signal includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal.
[0219] In one embodiment, the control signal for the deserializer includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal, and the control signal for the serializer includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal.
[0220] In one embodiment, the control device may also be used to:
[0221] When the preset control right switching condition is met, sending a control right switching instruction to the first controller through the second controller;
[0222] The step of switching the control right of the first controller over the image transmission unit to the second controller is performed by the first controller according to the control right switching instruction.
[0223] In one embodiment, the control device may also be used to:
[0224] When the first controller controls the image transmission unit, the control right identification information of the image transmission unit is set as a first control identification, and the first control identification indicates that the control right belongs to the first controller.
[0225] In one embodiment, the control device may also be used to:
[0226] When the first controller controls the image transmission unit, the first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data.
[0227] In one embodiment, the control device may also be used to:
[0228] The first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data to obtain first fault diagnosis information;
[0229] When the preset control right switching condition is met, the first fault diagnosis information is synchronized to the second controller.
[0230] In one embodiment, the control device may also be used to:
[0231] When the second controller controls the image transmission unit, the control right identification information of the image transmission unit is set as a second control identification, and the second control identification indicates that the control right belongs to the second controller.
[0232] In one embodiment, the control device may also be used to:
[0233] When the second controller controls the image transmission unit, the second controller performs fault diagnosis on the transmission of the image data and / or the display of the image data, obtains second fault diagnosis information, and synchronizes the second fault diagnosis information to the first controller.
[0234] In one embodiment, applied to a vehicle, the control device may also be used to:
[0235] When the second controller has control over the image transmission unit, the second controller controls the vehicle to perform intelligent driving, intelligent parking, and / or output driving prompt information based on the image data.
[0236] In one embodiment, the image transmission unit includes a deserializer, and the switching unit 301 includes:
[0237] When the preset control right switching condition is met, the communication interface of the deserializer is controlled to communicate with the second controller, and the communication interface is used to send the image data to the second controller.
[0238] In one embodiment, the first controller includes a microprocessor, and / or the second controller includes a system on chip or an FPGA.
[0239] In one embodiment, the first controller and the second controller switch control rights of the image transmission unit through an inter-process communication signal.
[0240] From the above, it can be seen that in the embodiment of the present application, the switching unit 301 switches the control right of the first controller over the image transmission unit to the second controller when the preset control right switching conditions are met. The control right is used to control the image transmission unit to send image data to the display device, thereby achieving rapid image output.
[0241] The embodiment of the present application also provides a controller, which may be a domain controller or other controllers, such as Figure 5 , which shows a schematic diagram of the structure of the controller involved in the embodiment of the present application, specifically:
[0242] The controller may include one or more processors 1001 of processing cores, one or more computer-readable storage media memories 1002, a power supply 1003, an input unit 1004 and other components. Those skilled in the art will appreciate that Figure 5 The controller structure shown in the figure does not constitute a limitation on the controller, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0243] Processor 1001 is the controller's control center, connecting all components of the controller using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 1002 and accessing data stored in memory 1002, it performs various controller functions and processes data, thereby providing overall monitoring of the controller. Optionally, processor 1001 may include one or more processing cores; preferably, processor 1001 may integrate an application processor and a modem processor, with the application processor primarily processing the operating system, user interface, and computer programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 1001.
[0244] The memory 1002 can be used to store software programs and modules. The processor 1001 executes various functional applications and control methods by running the software programs and modules stored in the memory 1002. The memory 1002 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the controller, etc. In addition, the memory 1002 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 1002 may also include a memory controller to provide the processor 1001 with access to the memory 1002.
[0245] The controller also includes a power supply 1003 for supplying power to various components. Preferably, the power supply 1003 can be logically connected to the processor 1001 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 1003 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.
[0246] The controller may further include an input unit 1004, which may be configured to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
[0247] Although not shown, the controller may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 1001 in the controller will load the executable files corresponding to one or more computer program processes into the memory 1002 according to the following instructions, and the processor 1001 will run the computer programs stored in the memory 1002 to implement various functions as follows:
[0248] When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller, and the control right is used to control the image transmission unit to send image data to the display device.
[0249] The specific implementation of the above operations can be found in the previous embodiments and will not be described in detail here.
[0250] From the above, it can be seen that the embodiment of the present application switches the control right of the first controller over the image transmission unit to the second controller when the preset control right switching conditions are met. The control right is used to control the image transmission unit to send image data to the display device to achieve rapid image output.
[0251] According to one aspect of the present application, a vehicle is provided, including a controller, etc., through which the vehicle can execute the control methods provided in various optional implementations of the above embodiments. The vehicle can be a gasoline-powered vehicle, a plug-in hybrid vehicle, or a new energy vehicle, etc., and this application does not specifically limit this.
[0252] According to one aspect of the present application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a vehicle reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the vehicle to perform the methods provided in various optional implementations of the aforementioned embodiments.
[0253] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0254] To this end, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program can be loaded by a processor to execute any control method provided in the embodiment of the present application.
[0255] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.
[0256] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0257] Since the computer program stored in the computer-readable storage medium can execute any one of the control methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the control methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0258] The above is a detailed introduction to a control method, device, vehicle and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, based on the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A control method, characterized in that: include: When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller, and the control right is used to control the image transmission unit to send image data to the display device.
2. The method according to claim 1, characterized in that The startup time of the first controller is shorter than the startup time of the second controller, and / or the computing performance of the second controller is better than that of the first controller.
3. The method according to claim 1, characterized in that The preset control right switching condition includes completion of startup of the second controller.
4. The method according to claim 1, wherein The method further comprises: When a preset control right switching condition is not satisfied, the first controller controls the image transmission unit to send the image data to the display device.
5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: When the first controller is in the working mode and the second controller has not yet been completely started, the image transmission unit is controlled by the first controller to send the image data to the display device.
6. The method according to claim 5, characterized in that Before controlling the image transmission unit by the first controller, the method includes: The first controller controls the image acquisition device to power on.
7. The method according to claim 1, characterized in that The image data is collected by an image acquisition device, and the method includes: When the first controller is in a low-power consumption mode or is started, the first controller controls the image acquisition device to power on and initialize.
8. The method according to claim 7, characterized in that The method comprises: When the second controller is not started, the first controller is controlled to be in a sleep mode, and the first controller controls the image acquisition device to be powered off.
9. The method according to claim 1, characterized in that The control right is used to control the image transmission unit to send the image data to the display device in a bypass manner.
10. The method according to any one of claims 1 to 9, characterized in that: Applied to a domain controller, the domain controller includes the first controller and the second controller.
11. The method according to claim 10, characterized in that The method comprises: When a preset control right switching condition is met, the domain controller switches the control right from the first controller to the second controller.
12. The method according to any one of claims 1 to 9, characterized in that: Applied to a vehicle, the method further comprises: When the vehicle is in the operating state of surround view image output, and the preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller.
13. The method according to claim 12, characterized in that The operating state of the surround view map output includes at least one of a preset driving state, a preset driving scene, and an activated map output mode.
14. The method according to claim 1, wherein Applied to a vehicle, the method further comprises: When a door unlocking signal is detected, the second controller is started.
15. The method according to claim 14, characterized in that Applied to a vehicle, the method further comprises: When the vehicle is in an ignition-off state, the first controller is controlled to be in a sleep mode, and / or the second controller is powered off.
16. The method according to claim 15, characterized in that The method further comprises: When the vehicle door is closed and the ignition switch of the vehicle is not in the target gear position, the first controller is controlled to be in a sleep mode.
17. The method according to any one of claims 1 to 16, characterized in that Applied to a vehicle, the method further comprises: When a door unlocking signal is detected, the first controller is controlled to enter a low energy consumption mode.
18. The method according to claim 17, characterized in that The method further comprises: When the door unlock signal is detected, a wake-up message is sent to the domain controller; The first controller is woken up by the domain controller based on the wake-up message, and the first controller is controlled to enter the low-power mode.
19. The method according to claim 1, wherein Applied to a vehicle, the method further comprises: When the ignition switch of the vehicle is in a target gear position, the first controller is controlled to be in a working mode.
20. The method according to claim 19, characterized in that The method further comprises: When the vehicle door is closed and the ignition switch of the vehicle is in the target gear position, the first controller is controlled to be in the working mode.
21. The method according to any one of claims 1 to 20, characterized in that The method further comprises: When the preset control right switching condition is met, the second controller controls the power management unit; When the preset control right switching condition is not satisfied, the first controller controls the power management unit.
22. The method according to any one of claims 1 to 20, characterized in that The image transmission unit is controlled by a control signal, and the control right of the first controller over the image transmission unit is switched to the second controller, comprising: The object for transmitting control signals to the image transmission unit is switched from the first controller to the second controller.
23. The method according to claim 22, characterized in that The switching of the object for transmitting control signals to the image transmission unit from the first controller to the second controller includes: At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller.
24. The method according to claim 23, wherein The method further comprises: At least one pin of the image transmission unit is switched from being connected to the first controller to being connected to the second controller through a switch control unit.
25. The method according to claim 24, characterized in that The image transmission unit includes a serializer and a deserializer, and the method further includes: The switch control unit switches at least one pin of the serializer and at least one pin of the deserializer from being connected to the first controller to being connected to the second controller.
26. The method according to claim 25, characterized in that The deserializer is used to decrypt the received image data and output the decrypted image data to the serializer.
27. The method according to claim 26, characterized in that The serializer is used to perform preset processing on the decrypted image data to obtain image data to be output to the display device, so as to output the image data to the display device.
28. The method according to claim 22, wherein The control signal includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal.
29. The method according to claim 25, characterized in that The control signal for the deserializer includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal; the control signal for the serializer includes at least one of an enable signal, a synchronization signal, a fault diagnosis signal, and a configuration control signal.
30. The method according to any one of claims 1 to 29, characterized in that The method further comprises: When the preset control right switching condition is met, sending a control right switching instruction to the first controller through the second controller; The step of switching the control right of the first controller over the image transmission unit to the second controller is performed by the first controller according to the control right switching instruction.
31. The method according to claim 1, wherein The method comprises: When the first controller controls the image transmission unit, the control right identification information of the image transmission unit is set to a first control identification, and the first control identification indicates that the control right belongs to the first controller.
32. The method according to claim 1, wherein The method comprises: When the first controller controls the image transmission unit, the first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data.
33. The method according to claim 32, characterized in that The method comprises: The first controller performs fault diagnosis on the transmission of the image data and / or the display of the image data to obtain first fault diagnosis information; When the preset control right switching condition is met, the first fault diagnosis information is synchronized to the second controller.
34. The method according to claim 1, wherein The method comprises: When the second controller controls the image transmission unit, the control right identification information of the image transmission unit is set to a second control identification, and the second control identification indicates that the control right belongs to the second controller.
35. The method according to claim 1, wherein The method comprises: When the second controller controls the image transmission unit, the second controller performs fault diagnosis on the transmission of the image data and / or the display of the image data, obtains second fault diagnosis information, and synchronizes the second fault diagnosis information to the first controller.
36. The method according to any one of claims 1 to 35, characterized in that Applied to a vehicle, the method further comprises: When the second controller has control over the image transmission unit, the second controller controls the vehicle to perform intelligent driving, intelligent parking, and / or output driving prompt information based on the image data.
37. The method according to claim 36, wherein The image transmission unit includes a deserializer, and the switching of control rights of the image transmission unit from the first controller to the second controller includes: When the preset control right switching condition is met, the communication interface of the deserializer is controlled to communicate with the second controller, and the communication interface is used to send the image data to the second controller.
38. The method according to any one of claims 1 to 37, characterized in that The first controller includes a microprocessor, and / or the second controller includes a system on chip or an FPGA.
39. The method according to any one of claims 1 to 37, characterized in that The first controller and the second controller switch control rights of the image transmission unit through an inter-process communication signal.
40. A control system, characterized in that: including a first controller and a second controller; When a preset control right switching condition is met, the control right of the first controller over the image transmission unit is switched to the second controller, and the control right is used to control the image transmission unit to send image data to the display device.
41. The system according to claim 40, wherein: The control system includes a domain controller.
42. The system according to claim 41, wherein: When a preset control right switching condition is met, the domain controller switches the control right from the first controller to the second controller.
43. The system according to claim 40, wherein: The second controller is configured to send a control right switching instruction to the first controller when the preset control right switching condition is met; The first controller is configured to switch the control right of the image transmission unit to the second controller based on the control right switching instruction.
44. The system according to claim 40, wherein: The system further includes a switch control unit, and the image transmission unit includes a serializer and a deserializer; The first controller is configured to send a switching instruction to the switch control unit based on the control right switching instruction; The switch control unit is configured to switch, according to the switching instruction, at least one pin of the serializer and at least one pin of the deserializer from being connected to the first controller to being connected to the second controller.
45. The system according to claim 44, characterized in that: The switch control unit is configured to control the communication interface of the deserializer to communicate with the second controller when the preset control right switching condition is met; The deserializer is configured to send the image data to the second controller through the communication interface.
46. An image display system, characterized in that The image display system comprises the control system and the image transmission unit according to claim 40; The first controller is configured to switch the control right of the image transmission unit to the second controller when a preset control right switching condition is met, and the control right is used to control the image transmission unit to send image data to the display device.
47. The system according to claim 46, wherein: The system further includes a display device configured to display a corresponding image based on the image data.
48. A controller, characterized in that It comprises a memory and a processor; the memory stores a computer program, and the processor is used to run the computer program in the memory to execute the control method described in any one of claims 1 to 39.
49. A vehicle, characterized in that It includes the control system according to claim 40, the image display system according to claim 46 or the controller according to claim 48; the vehicle executes the control method according to any one of claims 1 to 39 through the controller.
50. A computer-readable storage medium, characterized in that The computer-readable storage medium is used to store a computer program, and the computer program is loaded by a processor to execute the control method according to any one of claims 1 to 39.
51. A computer program product, characterized in that The method comprises a computer program or instructions, wherein the computer program or instructions are loaded by a processor to execute the control method according to any one of claims 1 to 39.
Citation Information
Cited By
Data processing method, storage medium, program product and electronic device
CN121012904A