Image output method, image output system, integrated circuit, and domain controller

Abstract

The invention is suitable for the technical field of image processing, and provides an image output method, an image output system, an integrated circuit, a domain controller and a delivery vehicle, and the method comprises the steps: determining a first transmission path as a first target path when a to-be-output image is detected; the first transmission path only comprises a sending end, a receiving end and a first channel selector; and transmitting the to-be-output image to the display device based on the first target path. Compared with the prior art, the method has the advantages that when the image to be detected is detected, the image to be output can be quickly sent to the display equipment only through the sending end, the receiving end and the first channel selector of the equipment, other components do not need to be additionally added, the cost is reduced, and the image output efficiency is improved.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and in particular relates to an image output method, an image output system, an integrated circuit, and a domain controller. Background Art

[0002] Currently, when a user is in a scenario where they need to perform corresponding operations based on the output image, in order to facilitate the user to promptly understand the situation based on the above image and perform accurate operations, the above image usually needs to be displayed quickly. For example, in the scenario where the user is using a vehicle, when the user needs to park the vehicle, reverse the vehicle, or check the environment on the side of the vehicle to make turns, change lanes, etc., in order to facilitate the user to promptly understand the situation around the vehicle, the imaging system in the vehicle (such as the Around View Monitor (AVM)) needs to quickly display image information used to describe the situation around the vehicle. However, existing image output methods are difficult to meet actual needs and increase costs. Summary of the Invention

[0003] The embodiments of the present application provide an image output method, an image output system, an integrated circuit, and a domain controller, which not only improve image output efficiency but also reduce costs.

[0004] In a first aspect, an embodiment of the present application provides an image output method, comprising:

[0005] When an image to be output is detected, a first transmission path is determined as a first target path; wherein the first transmission path only includes a transmitting end, a receiving end, and a first channel selector;

[0006] Based on the first target path, the image to be output is transmitted to a display device.

[0007] An embodiment of the present application provides an image output method. Upon detecting an image to be output, a first transmission path is determined as a first target path. The first transmission path comprises only a transmitter, a receiver, and a first channel selector. Based on the first target path, the image to be output is transmitted to a display device. Compared to existing technologies, this method, upon detecting an image to be output, only requires the device's built-in transmitter, receiver, and first channel selector to quickly transmit the image to be output to the display device, eliminating the need for additional components. This reduces costs and improves image output efficiency.

[0008] Optionally, before determining the first transmission path as the first target path, the method further includes:

[0009] Start the CPU;

[0010] Controlling the central processing unit to initialize the video input module, the image processing module and the display module;

[0011] Connecting a second transmission path; the second transmission path includes the transmitting end, the receiving end, the first channel selector, the second channel selector, the video input module, the image processing module and the display module;

[0012] Accordingly, after transmitting the image to be output to the display device based on the first target path, the method further includes:

[0013] When it is detected that the display module receives any frame of image after the image to be output, the second transmission path is determined as a second target path by the second channel selector;

[0014] Based on the second target path, the arbitrary frame image and the next frame image after the arbitrary frame image are sequentially transmitted to the display device.

[0015] Optionally, after determining the second transmission path as the second target path by the second channel selector, the method further includes:

[0016] Controlling the serializer and the deserializer based on the central processor;

[0017] Controlling the central processing unit to send a first prompt message to the micro control unit; the first prompt message is used to instruct the micro control unit to stop controlling the serializer and the deserializer;

[0018] The central processing unit is controlled to receive second prompt information sent by the micro control unit; the second prompt information is used to describe that the micro control unit has stopped controlling the serializer and the deserializer.

[0019] Optionally, the sequentially transmitting the arbitrary frame image and the next frame image after the arbitrary frame image to the display device based on the second target path includes:

[0020] Transmitting the arbitrary frame image and the next frame image to the receiving end in sequence through a deserializer;

[0021] sequentially transmitting the arbitrary frame image and the next frame image to the video input module through the first channel selector;

[0022] storing the arbitrary frame image and the next frame image in sequence into a memory through the video input module;

[0023] Controlling the image processing module to sequentially obtain the arbitrary frame image and the next frame image from the memory, and sequentially perform image processing on the arbitrary frame image and the next frame image to obtain images to be displayed corresponding to the arbitrary frame image and the next frame image, and storing each frame of images to be displayed in the memory;

[0024] Controlling the display module to sequentially obtain the frames of images to be displayed from the memory, and sequentially transmitting the frames of images to be displayed to the transmitting end;

[0025] The frames of the image to be displayed are transmitted to the display device in sequence through a serializer.

[0026] Optionally, before starting the central processing unit, the method further includes:

[0027] Start the micro control unit;

[0028] Controlling the microcontroller to initialize the image sensor, the serializer, and the deserializer;

[0029] The first transmission path is connected.

[0030] Optionally, transmitting the to-be-output image to a display device based on the first target path includes:

[0031] transmitting the image to be output to the receiving end through the deserializer;

[0032] transmitting the image to be output to the transmitting end through the first channel selector;

[0033] The image to be output is transmitted to the display device through the serializer.

[0034] In a second aspect, an embodiment of the present application provides an image output device, comprising:

[0035] A first determining unit is configured to determine a first transmission path as a first target path when an image to be output is detected; wherein the first transmission path only includes a transmitting end, a receiving end, and a first channel selector;

[0036] The first transmission unit is configured to transmit the image to be output to a display device based on the first target path.

[0037] In a third aspect, an embodiment of the present application provides an image output system, including:

[0038] An image sensor, connected to the image output device, for collecting image data of the area where the vehicle is located;

[0039] The image output device is connected to the display device and is used to execute the image output method according to any one of the first aspects;

[0040] The display device is used to display the image data transmitted by the image output device.

[0041] In a fourth aspect, an embodiment of the present application provides an image output device, comprising: at least one processor, at least one processor coupled to a memory, the memory storing a computer program that can be run on the processor, and when the processor executes the computer program, an image output method as described in any one of the first aspects above is implemented.

[0042] In a fifth aspect, an embodiment of the present application provides an integrated circuit, comprising: a micro control unit and a central processing unit, wherein the integrated circuit is used to execute the image output method as described in any one of the first aspects above.

[0043] In a sixth aspect, an embodiment of the present application provides a domain controller, comprising an integrated circuit, wherein the integrated circuit is used to execute the image output method as described in any one of the first aspects above.

[0044] In a seventh aspect, an embodiment of the present application provides a vehicle, comprising a domain controller, the domain controller comprising an integrated circuit, the integrated circuit being used to execute the image output method as described in any one of the first aspects.

[0045] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the image output method as described in any one of the above-mentioned first aspects is implemented.

[0046] In a ninth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an image output device, the image output device can execute the image output method described in any one of the first aspects above.

[0047] It can be understood that the beneficial effects of the second to ninth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0049] Figure 1is a structural diagram of an image output system provided by an embodiment of the present application;

[0050] Figure 2 is a structural diagram of an image output device provided by an embodiment of the present application;

[0051] Figure 3 is a structural diagram of an image output device provided by another embodiment of the present application;

[0052] Figure 4 This is a schematic diagram of the control flow of an image output device provided by an embodiment of the present application;

[0053] Figure 5 is a transmission schematic diagram of a first transmission path and a second transmission path provided in one embodiment of the present application;

[0054] Figure 6 This is a flowchart of an implementation of an image output method provided in one embodiment of the present application;

[0055] Figure 7 is a flowchart of an implementation of an image output method provided by another embodiment of the present application;

[0056] Figure 8 is a flowchart of an implementation of an image output method provided in yet another embodiment of the present application;

[0057] Figure 9 is a structural diagram of an image output device provided by an embodiment of the present application;

[0058] Figure 10 It is a structural diagram of an image output device provided in yet another embodiment of the present application. DETAILED DESCRIPTION

[0059] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0060] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0061] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0062] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0063] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0064] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0065] In actual applications, when a user is in a scenario where they need to perform corresponding operations based on the output images, in order to facilitate the user to understand the situation in a timely manner based on the above images and perform accurate operations, it is usually necessary to quickly display the above images. For example, taking the scenario where the user is using a vehicle as an example, when the user needs to park the vehicle, reverse, or check the environment on the side of the vehicle to perform actions such as turning or changing lanes, in order to facilitate the user to understand the situation around the vehicle in a timely manner, the imaging system in the vehicle (such as the Around View Monitor (AVM)) needs to quickly display image information used to describe the situation around the vehicle. Among them, the Around View Monitor is a system that uses an on-board display screen to view 360-degree panoramic fusion, ultra-wide viewing angle, and seamlessly spliced ​​real-time image information around the vehicle body. It can be well used to understand the blind spots around the vehicle, thereby assisting in parking the vehicle more intuitively and safely.

[0066] Taking a panoramic surveillance imaging system as an example, image output relies on the startup of the Intelligent Driving Domain System on Chip (SOC) running the Linux system. Due to the long startup time of the Intelligent Driving Domain SOC, the image takes a long time to be successfully output, meaning that the image data cannot be displayed quickly. Therefore, the existing technology proposes to add at least one additional serializer and deserializer to the existing equipment to achieve rapid image display during the startup process of the Intelligent Driving Domain SOC, that is, to improve image output efficiency.

[0067] Therefore, in order to improve image output efficiency while reducing costs, in all embodiments of the present application, the image output device in the image output system can achieve rapid image display through the corresponding method embodiments shown in the following figures, which will not be described in detail here.

[0068] See also Figure 1 , Figure 1 FIG. 1 is a schematic diagram of the structure of an image output system provided by an embodiment of the present application. Figure 1 As shown, the image output system 1 provided in the embodiment of the present application includes: at least one image sensor (only one is shown in the figure) 10, an image output device 20, and a display device 30. The at least one image sensor 10 is communicatively connected to the image output device 20, and the image output device 20 is communicatively connected to the display device 30.

[0069] It should be noted that the above communication connection mode can be a wireless communication connection or a wired communication connection.

[0070] In the embodiment of the present application, at least one image sensor 10 is used to collect image data of the area where the vehicle is located. The at least one image sensor 10 may be a vehicle-mounted camera.

[0071] The image output device 20 is configured to transmit image data to the display device 30 upon receiving image data transmitted by at least one image sensor 10 .

[0072] Specifically, how the image output device 20 transmits the image data to the display device 30 can be found in the image output method shown in the corresponding embodiment below, and will not be elaborated here.

[0073] The display device 30 is used to display the image data transmitted by the image output device 20. The display device 30 may be a cockpit display screen.

[0074] Please also refer to Figure 2 , Figure 2 Schematic diagram of the structure of an image output device provided by an embodiment of the present application. Figure 2 As shown, the image output device 20 includes: a deserializer 21, a first image output sub-device 22, a second image output sub-device 23, and a serializer 24. The deserializer 21 is connected to the first image output sub-device 22 and the second image output sub-device 23 respectively, the first image output sub-device 22 is connected to the second image output sub-device 23 and the serializer 24 respectively, and the second image output sub-device 23 is connected to the serializer 24.

[0075] It should be noted that the deserializer 21 and the serializer 24, also known as deserializers / serializers, are interface circuits in high-speed data communications.

[0076] In this embodiment, the deserializer 21 is configured to receive the image data transmitted by the image sensor 10 and other image data subsequent to the image data.

[0077] The first image output sub-device 22 is configured to connect a first transmission path and transmit the image data to the serializer 24 via the first transmission path when detecting that the central processing unit in the second image output sub-device 23 is not started. The first transmission path includes a transmitting end, a receiving end, and a first channel selector.

[0078] In the embodiment of the present application, the transmitting end may be a transmitting end of a mobile industry processor interface (Mobile Industry Processor Interface Transmitter, MIPI TX), and the receiving end may be a receiving end of a mobile industry processor interface (Mobile Industry Processor Interface Receiver, MIPI RX).

[0079] In practical applications, the Mobile Industry Processor Interface is an open standard and specification initiated by the MIPI Alliance for mobile application processors.

[0080] The channel selector is a device controller that selects which channel and which device to perform I / O operations on.

[0081] Based on this, please also refer to Figure 3 , Figure 3 FIG. 1 is a structural diagram of an image output device provided by another embodiment of the present application. Figure 3As shown, the first image output sub-device 22 includes: a microcontroller unit (MCU) 221, a receiving end 222, a transmitting end 223, and a first channel selector 224. The MCU 221 is connected to the serializer 24, the deserializer 21, the receiving end 222, the transmitting end 223, and the first channel selector 224 respectively; the receiving end 222 is connected to the first channel selector 224, and the first channel selector 224 is connected to the transmitting end 223.

[0082] It should be noted that the micro control unit 221 is used to control the serializer 24 and the deserializer 21 and connect the first transmission path.

[0083] For example, see Figure 4 , Figure 4 This is a schematic diagram of the control flow of an image output device provided by an embodiment of the present application. Figure 4 As shown, the micro control unit 221 controls the deserializer 21 through the first bidirectional serial bus interface I2C0, and controls the serializer 24 through the second bidirectional serial bus interface I2C1. At the same time, the micro control unit 221 sends a control signal to the deserializer 21 by controlling the pulse width modulation (PWM) circuit.

[0084] The receiving end 222 is configured to receive the image data transmitted by the deserializer 21 and transmit the image data to the transmitting end 224 via the first channel selector 223 .

[0085] The sending end 224 is used to transmit the above image data to the serializer 24.

[0086] In this embodiment, the second image output sub-device 23 is configured to connect to a second transmission path upon detecting that its own central processing unit has started, and transmit other image data to the serializer 24 via the second transmission path. The second transmission path includes a transmitter, a receiver, a first channel selector, a second channel selector, a video input module, an image processing module, and a display module.

[0087] Based on this, please continue to see Figure 3 ,like Figure 3As shown, the second image output sub-device 23 includes: a central processing unit (AMD Central Processing Unit, ACPU) 231, a receiving end 222, a transmitting end 223, a first channel selector 224, a video output (Video Input, VI) module 232, a memory (DDR) 233, an image processing (Image Process, IPS) module 234, a display module (Display) 235, and a second channel selector 236. The central processing unit 231 is respectively connected to the receiving end 222, the transmitting end 223, the first channel selector 224, the video input module 232, the memory 233, the image processing module 234, the display module 235, and the second channel selector 236; the receiving end 222 is connected to the first channel selector 224, the first channel selector 224 is connected to the video input module 232, the memory 233 is respectively connected to the video input module 232, the image processing module 234, and the display module 235; and the display module 235 is connected to the second channel selector 236.

[0088] It should be noted that the central processor 231 is used to control the serializer 24 and the deserializer 21 and connect the second transmission path.

[0089] For example, please see Figure 4 ,like Figure 4 As shown, the central processing unit 231 controls the deserializer 21 through the third bidirectional serial bus interface I2C2, and the central processing unit 231 controls the serializer 24 through the fourth bidirectional serial bus interface I2C3. At the same time, the central processing unit 231 sends a control signal to the deserializer 21 by controlling the pulse width modulation (PWM) circuit.

[0090] The receiving end 222 is configured to receive other image data transmitted by the deserializer 21 , and transmit the other image data to the video input end 232 through the first channel selector 223 .

[0091] The video input module 232 is used to store the above-mentioned other image data into the memory 233 .

[0092] The image processing module 234 is configured to obtain the other image data from the memory 233 , perform image processing on the other image data to obtain an image to be displayed, and store the image to be displayed in the memory 233 .

[0093] The display module 235 is configured to obtain the image to be displayed from the memory 233 and transmit the image to be displayed to the transmitting end 224 via the second channel selector 236 .

[0094] The sending end 224 is used to transmit the image to be displayed to the serializer 24 .

[0095] The serializer 24 is used to transmit the above image data and the image to be displayed obtained by processing other image data to the display device 30.

[0096] For example, see Figure 5 , Figure 5 Schematic diagram of the transmission of the first transmission path and the second transmission path provided in one embodiment of the present application.

[0097] It should be noted that in all embodiments of the present application, the first image output sub-device 22 performs the image output process only before the vehicle's intelligent driving domain system-level chip is completely started, so as to achieve the purpose of quickly outputting images before the vehicle's intelligent driving domain system-level chip is completely started. After the intelligent driving domain system-level chip is completely started, that is, after the central processing unit 231 in the second image output sub-device 23 is completely started, the subsequent image output process is completed by the second image output sub-device 23.

[0098] See also Figure 6 , Figure 6 This is a flowchart for implementing an image output method provided in one embodiment of the present application. In this embodiment of the present application, the image output method is performed by an image output device. The image output device is disposed in a vehicle. The vehicle may be a vehicle.

[0099] like Figure 6 As shown, the image output method provided in one embodiment of the present application may include S101 to S102, which are described in detail as follows:

[0100] In S101 , when an image to be output is detected, a first transmission path is determined as a first target path; wherein the first transmission path only includes a transmitting end, a receiving end, and a first channel selector.

[0101] In an embodiment of the present application, during the startup of a vehicle's intelligent driving domain system-on-chip (SOC), to improve image output efficiency, the image output device may determine a first transmission path as a first target path upon detecting an image to be output. The first transmission path only includes a transmitter, a receiver, and a first channel selector.

[0102] In one embodiment of the present application, in order to ensure that the first transmission path can transmit the image, the image output device may further perform the following steps before step S101: Figure 7 Steps S201 to S203 are described in detail as follows:

[0103] In S201 , the micro control unit is started.

[0104] In S202 , the micro control unit is controlled to initialize the image sensor, the serializer, and the deserializer.

[0105] In S203, the first transmission path is connected.

[0106] In this embodiment, during the startup process of the vehicle's intelligent driving domain system-on-chip (SOC), since it only takes milliseconds for the microcontroller to start up, in order to improve the image output efficiency, the image output device can start the microcontroller and realize rapid output of the image through the microcontroller.

[0107] After detecting that the micro control unit has completed startup, the image output device can initialize the image sensor, the serializer, and the deserializer through the micro control unit.

[0108] Specifically, the microcontroller unit can configure the deserializer parameters through its own first bidirectional serial bus interface to implement the initialization operation of the deserializer; the microcontroller unit can configure the serializer parameters through its own second bidirectional serial bus interface to implement the initialization operation of the serializer.

[0109] In some possible embodiments, in order to implement image output operations through a microcontroller, the microcontroller may send a control signal to a deserializer through a pulse width modulation (PWM) circuit to instruct the image sensor connected to the deserializer to transmit the image to be output.

[0110] It should be noted that each frame of the image to be output transmitted by the image sensor needs to be transmitted to the deserializer after detecting the control signal sent by the microcontroller unit to the deserializer through the pulse width modulation (PWM) circuit.

[0111] In this embodiment, after the image output device controls the micro control unit to initialize the image sensor, the serializer, and the deserializer, it can connect the first transmission path to ensure that the first transmission path can transmit images.

[0112] In S102 , the image to be output is transmitted to a display device based on the first target path.

[0113] In the embodiment of the present application, after the image output device determines the first target path, since the first transmission path is already connected, the image output device can transmit the image to be output to the display device based on the first target path.

[0114] In one embodiment of the present application, in combination with S201 to S203, the image output device can implement step S102 according to the following steps, which are described in detail as follows:

[0115] transmitting the image to be output to the receiving end through the deserializer;

[0116] transmitting the image to be output to the transmitting end through the first channel selector;

[0117] The image to be output is transmitted to the display device through the serializer.

[0118] In this embodiment, after the image output device detects the image to be transmitted transmitted by the image sensor, it can control the deserializer to receive the image to be transmitted, and transmit the image to be transmitted to the receiving end through the deserializer.

[0119] After receiving the image to be transmitted, the receiving end may transmit the image to be transmitted to the first channel selector.

[0120] After receiving the image to be transmitted, the first channel selector can directly transmit the image to be transmitted to the transmitting end because the first transmission path is already connected.

[0121] After receiving the image to be transmitted, the transmitting end may transmit the image to be transmitted to the serializer.

[0122] After receiving the image to be transmitted, the serializer may transmit the image to be transmitted to the display device.

[0123] In the embodiment of the present application, after receiving the image to be transmitted, the display device may display the image to be transmitted.

[0124] As can be seen above, the image output method provided by the embodiments of the present application determines a first transmission path as a first target path upon detecting an image to be output; the first transmission path only includes a transmitter, a receiver, and a first channel selector; and based on the first target path, the image to be output is transmitted to a display device. Compared to the prior art, this method, upon detecting an image to be output, only requires the device's built-in transmitter, receiver, and first channel selector to quickly transmit the image to be output to the display device, eliminating the need for additional components. This not only reduces costs but also improves image output efficiency.

[0125] In actual applications, since the microcontroller unit only executes the above-mentioned image output process before the vehicle's intelligent driving domain system-level chip is started up, the purpose of quickly outputting the image before the vehicle's intelligent driving domain system-level chip is started up is achieved. That is to say, after the intelligent driving domain system-level chip is started up, that is, after the central processing unit is started up, the central processing unit will realize the output of the image after the output image.

[0126] Based on this, see Figure 8 , Figure 8 This is a flowchart of an image output method according to another embodiment of the present application. Figure 7 Correspondingly, this embodiment may further include S301 to S303 after S201, and correspondingly, may further include S304 to S305 after step S102, as detailed below:

[0127] In S301, the central processing unit is started.

[0128] In S302, the central processing unit is controlled to initialize the video input module, the image processing module and the display module.

[0129] In S303, a second transmission path is connected; the second transmission path includes the transmitting end, the receiving end, the first channel selector, the second channel selector, the video input module, the image processing module and the display module.

[0130] In this embodiment, after the micro control unit is started, in order to enable the subsequent output of the image by the central processing unit, the image output device may start the central processing unit.

[0131] After detecting that the central processing unit has been started, the image output device can initialize the video input module, the image processing module and the display module through the central processing unit.

[0132] In this embodiment, after the image output device controls the micro control unit to initialize the video input module, the image processing module and the display module, it can connect the second transmission path to ensure that the second transmission path can transmit images.

[0133] In S304, when it is detected that the display module receives any frame of image after the image to be output, the second transmission path is determined as a second target path through the second channel selector.

[0134] In this embodiment, since the second transmission path is connected, that is, each component in the second transmission path can receive any frame of image after the image to be output. Since the second channel selector is used to determine whether to ultimately select the second connected path as the transmission path for the above-mentioned any frame of image, when the image output device detects that the display module located before the second channel selector has received the any frame of image, it indicates that the second transmission path is ready and can transmit the image. Therefore, the image output device can determine the second transmission path as the second target path through the second channel selector.

[0135] In actual applications, when the central processing unit starts to execute the image output operation, the micro control unit can terminate its own image output operation. Therefore, in one embodiment of the present application, in order to switch the control of various components from the micro control unit to the central processing unit, the image output device can specifically perform the following steps, which are detailed as follows:

[0136] Controlling the serializer and the deserializer based on the central processor;

[0137] Controlling the central processing unit to send a first prompt message to the micro control unit; the first prompt message is used to instruct the micro control unit to stop controlling the serializer and the deserializer;

[0138] The central processing unit is controlled to receive second prompt information sent by the micro control unit; the second prompt information is used to describe that the micro control unit has stopped controlling the serializer and the deserializer.

[0139] In this embodiment, after the image output device determines the second transmission path as the second target path, the central processing unit can configure the deserializer parameters through its own third bidirectional serial bus interface to achieve control of the deserializer; the central processing unit can configure the serializer parameters through its own fourth bidirectional serial bus interface to achieve control of the serializer.

[0140] In some possible embodiments, in order to implement image output operations through the central processing unit, the central processing unit may also send a control signal to the deserializer through a pulse-controlled pulse width modulation (PWM) circuit to instruct the image sensor connected to the deserializer to transmit the next frame of image after any of the above-mentioned frames of image.

[0141] Afterwards, the image output device may control the central processor to send a first prompt message to the micro control unit, wherein the first prompt message is used to instruct the micro control unit to stop controlling the serializer and the deserializer.

[0142] After receiving the first prompt message, the microcontroller unit may stop controlling the serializer and the deserializer and send a second prompt message to the central processor, wherein the second prompt message is used to describe that the microcontroller unit has stopped controlling the serializer and the deserializer.

[0143] Afterwards, the image output device may control the central processor to receive the second prompt information sent by the micro control unit, thereby completing the process of switching the control rights of various components from the micro control unit to the central processor.

[0144] In S305 , based on the second target path, the arbitrary frame image and the next frame image after the arbitrary frame image are sequentially transmitted to the display device.

[0145] In this embodiment, after the image output device determines the second target path, since the second transmission path is connected at this time, the image output device can sequentially transmit any frame of image and the next frame of image after the arbitrary frame of image to the display device based on the second target path.

[0146] In one embodiment of the present application, the image output device may implement step S305 according to the following steps, which are described in detail as follows:

[0147] Transmitting the arbitrary frame image and the next frame image to the receiving end in sequence through a deserializer;

[0148] sequentially transmitting the arbitrary frame image and the next frame image to the video input module through the first channel selector;

[0149] storing the arbitrary frame image and the next frame image in sequence into a memory through the video input module;

[0150] Controlling the image processing module to sequentially obtain the arbitrary frame image and the next frame image from the memory, and sequentially perform image processing on the arbitrary frame image and the next frame image to obtain images to be displayed corresponding to the arbitrary frame image and the next frame image, and storing each frame of images to be displayed in the memory;

[0151] Controlling the display module to sequentially obtain the frames of images to be displayed from the memory, and sequentially transmitting the frames of images to be displayed to the transmitting end;

[0152] The frames of the image to be displayed are transmitted to the display device in sequence through a serializer.

[0153] In this embodiment, after the image output device detects any frame image and the next frame image sequentially transmitted by the image sensor, it can control the deserializer to receive the image to be transmitted, and transmit the image to be transmitted to the receiving end through the deserializer.

[0154] After receiving the above-mentioned arbitrary frame image and the next frame image in sequence, the receiving end may transmit the above-mentioned arbitrary frame image and the next frame image in sequence to the first channel selector.

[0155] After receiving the above arbitrary frame image and the next frame image, the first channel selector can sequentially transmit the above arbitrary frame image and the next frame image to the video input module because the second transmission path is connected at this time.

[0156] After receiving the above-mentioned arbitrary frame image and the next frame image in sequence, the video input module can store the above-mentioned arbitrary frame image and the next frame image in sequence in the memory.

[0157] After the memory stores the above-mentioned any one frame image and the next frame image in sequence, the image output device can control the image processing module to obtain the above-mentioned any one frame image and the next frame image in sequence from the memory, and perform image processing on the above-mentioned any one frame image and the next frame image in sequence to obtain the images to be displayed corresponding to the above-mentioned any one frame image and the next frame image, and store each frame of the images to be displayed in sequence to the memory.

[0158] After the memory sequentially stores the above-mentioned frames of images to be displayed, the image output device can control the display module to sequentially obtain the above-mentioned frames of images to be displayed from the memory, and sequentially transmit the frames of images to be displayed to the transmitting end.

[0159] After receiving the above-mentioned frames of images to be displayed in sequence, the transmitting end may transmit the frames of images to be displayed to the serializer in sequence.

[0160] After sequentially receiving the above-mentioned frames of images to be displayed, the serializer may sequentially transmit the frames of images to be displayed to the display device.

[0161] In this embodiment, after sequentially receiving the above-mentioned frames of images to be displayed, the display device may sequentially display the frames of images to be displayed.

[0162] As can be seen from the above, the image output method provided by this embodiment starts the central processing unit after starting the microcontroller; controls the central processing unit to initialize the video input module, image processing module, and display module; connects the second transmission path; then, upon detecting that the display module has received any frame of image after the image to be output, determines the second transmission path as the second target path through the second channel selector; and based on the second target path, sequentially transmits the arbitrary frame of image and the next frame of image after the arbitrary frame of image to the display device. This method implements path switching only when the display module in the second connected path receives any of the aforementioned frames of image, thereby switching the image output process from the microcontroller to the central processing unit, thereby achieving output without image delay. At the same time, the switching process does not cause image output interruption, thereby improving the user experience.

[0163] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0164] Corresponding to the image output method described in the above embodiment, Figure 9 The following is a schematic diagram showing the structure of an image output device provided by an embodiment of the present application. For the sake of convenience, only the parts related to the embodiment of the present application are shown. Figure 9 The image output device 400 includes: a first determining unit 41 and a first transmitting unit 42.

[0165] The first determining unit 41 is configured to determine the first transmission path as the first target path when detecting an image to be output; wherein the first transmission path only includes a transmitting end, a receiving end, and a first channel selector.

[0166] The first transmission unit 42 is configured to transmit the to-be-output image to a display device based on the first target path.

[0167] In one embodiment of the present application, the image output device 400 further includes: a first starting unit, a first control unit, a first connecting unit, a first determining unit, and a first transmitting unit.

[0168] The first starting unit is used for starting the central processing unit.

[0169] The first control unit is used to control the central processing unit to perform initialization operations on the video input module, the image processing module and the display module.

[0170] The first connecting unit is used to connect the second transmission path; the second transmission path includes the transmitting end, the receiving end, the first channel selector, the second channel selector, the video input module, the image processing module and the display module.

[0171] The first determining unit is configured to determine the second transmission path as the second target path through the second channel selector when detecting that the display module receives any frame of image subsequent to the image to be output.

[0172] The first transmission unit is configured to transmit the arbitrary frame image and a next frame image subsequent to the arbitrary frame image to the display device in sequence based on the second target path.

[0173] In one embodiment of the present application, the image output device 400 further includes: a second control unit, a third control unit, and a fourth control unit.

[0174] The second control unit is configured to control the serializer and the deserializer based on the central processor.

[0175] The third control unit is used to control the central processing unit to send a first prompt message to the micro control unit; the first prompt message is used to instruct the micro control unit to stop controlling the serializer and the deserializer.

[0176] The fourth control unit is used to control the central processing unit to receive the second prompt information sent by the micro control unit; the second prompt information is used to describe that the micro control unit has stopped controlling the serializer and the deserializer.

[0177] In one embodiment of the present application, the first transmission unit specifically includes: a second transmission unit, a third transmission unit, a storage unit, a fifth control unit, a sixth control unit, and a fourth transmission unit.

[0178] The second transmission unit is used to transmit the arbitrary frame image and the next frame image to the receiving end in sequence through a deserializer.

[0179] The third transmission unit is used to transmit the arbitrary frame image and the next frame image to the video input module in sequence through the first channel selector.

[0180] The storage unit is used to store the arbitrary frame image and the next frame image in the memory in sequence through the video input module.

[0181] The fifth control unit is used to control the image processing module to obtain the arbitrary frame image and the next frame image from the memory in turn, and perform image processing on the arbitrary frame image and the next frame image in turn to obtain the images to be displayed corresponding to the arbitrary frame image and the next frame image, and store each frame of the images to be displayed in the memory.

[0182] The sixth control unit is used to control the display module to sequentially obtain the frames of images to be displayed from the memory, and sequentially transmit the frames of images to be displayed to the transmitting end.

[0183] The fourth transmission unit is configured to transmit the frames of the to-be-displayed image to the display device in sequence through a serializer.

[0184] In one embodiment of the present application, the image output device 400 further includes: a second starting unit, a seventh control unit, and a second connecting unit.

[0185] The second starting unit is used to start the micro control unit.

[0186] The seventh control unit is used to control the micro control unit to perform initialization operations on the image sensor, the serializer, and the deserializer.

[0187] The second connecting unit is used to connect the first transmission path.

[0188] In one embodiment of the present application, the first transmission unit 42 specifically includes: a fifth transmission unit, a sixth transmission unit, and a seventh transmission unit.

[0189] The fifth transmission unit is configured to transmit the image to be output to the receiving end through the deserializer.

[0190] The sixth transmission unit is configured to transmit the image to be output to the transmitting end through the first channel selector.

[0191] The seventh transmission unit is configured to transmit the image to be output to the display device through the serializer.

[0192] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0193] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0194] Figure 10 This is a schematic diagram of the structure of an image output device provided in one embodiment of the present application. Figure 10 As shown, the image output device 5 of this embodiment includes: at least one processor 50 ( Figure 10 The processor 50 is coupled to a memory, in which a computer program that can be run on the at least one processor 50 is stored. When the processor 50 executes the computer program 52, the steps of any of the above-mentioned embodiments of the image output method are implemented.

[0195] The image output device may include, but is not limited to, a processor 50. Those skilled in the art will appreciate that Figure 10 It is only an example of the image output device 5 and does not constitute a limitation on the image output device 5. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, etc.

[0196] The processor 50 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0197] An embodiment of the present application further provides an integrated circuit, including: a micro control unit and a central processing unit, and the integrated circuit can implement the steps in the above-mentioned various method embodiments.

[0198] An embodiment of the present application further provides a domain controller, including an integrated circuit, which can implement the steps in the above-mentioned various method embodiments.

[0199] An embodiment of the present application provides a vehicle, including a domain controller, wherein the domain controller includes an integrated circuit, and the integrated circuit can implement the steps in the above-mentioned various method embodiments.

[0200] It should be noted that the means of transport may be a vehicle or other means for carrying people or goods.

[0201] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0202] An embodiment of the present application provides a computer program product. When the computer program product is run on an image output device, the image output device can implement the steps of the above-mentioned method embodiments when executing the computer program product.

[0203] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to an image output device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0204] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0205] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. An image output method, characterized in that: include: When an image to be output is detected, a first transmission path is determined as a first target path; wherein the first transmission path only includes a transmitting end, a receiving end, and a first channel selector; Based on the first target path, the image to be output is transmitted to a display device.

2. The image output method according to claim 1, wherein: Before determining the first transmission path as the first target path, the method further includes: Start the CPU; Controlling the central processing unit to initialize the video input module, the image processing module and the display module; Connecting a second transmission path; the second transmission path includes the transmitting end, the receiving end, the first channel selector, the second channel selector, the video input module, the image processing module and the display module; Accordingly, after transmitting the image to be output to the display device based on the first target path, the method further includes: When it is detected that the display module receives any frame of image after the image to be output, the second transmission path is determined as a second target path by the second channel selector; Based on the second target path, the arbitrary frame image and the next frame image after the arbitrary frame image are sequentially transmitted to the display device.

3. The image output method according to claim 2, wherein: After determining the second transmission path as the second target path by the second channel selector, the method further includes: Controlling the serializer and the deserializer based on the central processor; Controlling the central processing unit to send a first prompt message to the micro control unit; the first prompt message is used to instruct the micro control unit to stop controlling the serializer and the deserializer; The central processing unit is controlled to receive second prompt information sent by the micro control unit; the second prompt information is used to describe that the micro control unit has stopped controlling the serializer and the deserializer.

4. The image output method according to claim 2, wherein: The transmitting, based on the second target path, the arbitrary frame image and the next frame image after the arbitrary frame image to the display device in sequence, includes: Transmitting the arbitrary frame image and the next frame image to the receiving end in sequence through a deserializer; sequentially transmitting the arbitrary frame image and the next frame image to the video input module through the first channel selector; storing the arbitrary frame image and the next frame image in sequence into a memory through the video input module; Controlling the image processing module to sequentially obtain the arbitrary frame image and the next frame image from the memory, and sequentially perform image processing on the arbitrary frame image and the next frame image to obtain images to be displayed corresponding to the arbitrary frame image and the next frame image, and storing each frame of images to be displayed in the memory; Controlling the display module to sequentially obtain the frames of images to be displayed from the memory, and sequentially transmitting the frames of images to be displayed to the transmitting end; The frames of the image to be displayed are transmitted to the display device in sequence through a serializer.

5. The image output method according to claim 2, wherein: Before starting the central processing unit, the method further includes: Start the micro control unit; Controlling the microcontroller to initialize the image sensor, the serializer, and the deserializer; The first transmission path is connected.

6. The image output method according to claim 5, wherein: The step of transmitting the image to be output to a display device based on the first target path includes: transmitting the image to be output to the receiving end through the deserializer; transmitting the image to be output to the transmitting end through the first channel selector; The image to be output is transmitted to the display device through the serializer.

7. An image output system, characterized in that: include: An image sensor, connected to the image output device, for collecting image data of the area where the vehicle is located; The image output device is connected to the display device and is used to execute the image output method according to any one of claims 1 to 6; The display device is used to display the image data transmitted by the image output device.

8. The image output system according to claim 7, wherein: The image output device comprises: a deserializer connected to the image sensor, the first image output sub-device, and the second image output sub-device, and configured to receive the image data transmitted by the image sensor and other image data subsequent to the image data; The first image output sub-device is connected to the second image output sub-device and the serializer, and is configured to connect a first transmission path and transmit the image data to the serializer via the first transmission path when detecting that the central processing unit in the second image output sub-device is not started; the first transmission path only includes a transmitting end, a receiving end, and a first channel selector; The second image output sub-device is configured to connect a second transmission path when detecting that the central processing unit has been started, and transmit the other image data to the serializer through the second transmission path; the second transmission path includes the transmitting end, the receiving end, the first channel selector, the second channel selector, the video input module, the image processing module, and the display module; The serializer is connected to the display device and is used to send the image data and the other image data to the display device.

9. The image output system according to claim 8, wherein: The first image output sub-device includes: a micro control unit, a transmitting end, a receiving end and a first channel selector; The micro control unit is connected to the serializer, the deserializer, the transmitter, the receiver, and the first channel selector, and is used to control the serializer and the deserializer and connect the first transmission path; The receiving end is connected to the first channel selector, and is used to receive the image data transmitted by the deserializer, and transmit the image data to the transmitting end through the first channel selector; The transmitting end is connected to the serial adder and is used to transmit the image data to the serial adder.

10. The image output system according to claim 8, wherein: The second image output sub-device includes: a central processing unit, a transmitting end, a receiving end, a first channel selector, a second channel selector, a video input module, an image processing module, a display module and a memory; The central processing unit is connected to the serializer, the deserializer, the transmitter, the receiver, the first channel selector, the second channel selector, the video input module, the image processing module, the display module, and the memory, and is used to control the serializer and the deserializer and connect the second transmission path; The receiving end is connected to the first channel selector, and is used to receive the other image data transmitted by the deserializer, and transmit the other image data to the video input end through the first channel selector; The video input module is connected to the memory and is used to store the other image data into the memory; The image processing module is connected to the memory, and is used to obtain the other image data from the memory, perform image processing on the other image data to obtain an image to be displayed, and store the image to be displayed in the memory; The display module is connected to the memory and the second channel selector, and is used to obtain the image to be displayed from the memory and transmit the image to be displayed to the transmitting end through the second channel selector; The transmitting end is connected to the serial adder and is used to transmit the image to be displayed to the serial adder.

11. An integrated circuit, characterized in that: include: A micro control unit and a central processing unit, wherein the integrated circuit is used to execute the image output method according to any one of claims 1 to 6.

12. A domain controller, characterized in that: comprising the integrated circuit of claim 11.

13. A vehicle, characterized in that: Comprising the domain controller of claim 12.

Images