A vehicle-mounted display screen image display method, system, storage medium and vehicle
By first outputting the environmental image to the in-vehicle display screen and then displaying it a second time after the SOC system diagnoses, the problem of long display time for environmental images is solved, thus improving the user experience.
Patent Information
- Application Number
- CN202310302044.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-03-27
- Publication Date
- 2025-12-23
- Estimated Expiration
- 2043-03-27
AI Technical Summary
In in-vehicle displays using complex operating systems, the display of environmental images takes too long, affecting the user experience, especially when it is difficult to quickly output the reversing image during system startup.
The acquired environmental images are first displayed on the screen, and after the SOC system completes initialization, diagnostic processing is performed to obtain driving assistance images, which are then displayed a second time.
It reduces the camera's image processing time, improves the user experience, and ensures that environmental and driver assistance images can be displayed quickly during system startup.
Smart Images

Figure CN116353344B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of vehicle display, in particular to a vehicle display screen image display method, system, storage medium and vehicle. BACKGROUND
[0002] With the intelligent development of modern cars, the system of domain controller carrying automatic driving function is also more and more complex, from the original lightweight system to the operating system with more functions, more safety and more responsible application, such as Linux and QNX. In actual use, most application scenarios require the vehicle to run in reverse mode after starting, and can quickly display the reverse image. However, after using a complex operating system, it is difficult to quickly output the reverse image after the vehicle display screen starts, which affects the actual user experience.
[0003] Due to the frequent changes of camera configuration function requirements, functional safety upgrades, etc., in order to stabilize the system, it is usually not configured in the driver layer, but generally configured in the application layer. In a heterogeneous domain controller, the computing unit is usually composed of a SOC system and an MCU system. In the system startup process, the minimum unit of the MCU system is initialized first, the power management program is activated, the driver layer of the SOC system is initialized, then the SOC system kernel is started, and finally the application layer related program is started. The whole process takes a long time to start, and the actual measurement even exceeds 10s. If the application layer runs more programs, the time will be longer. SUMMARY
[0004] To solve the above technical problems, the present application provides a vehicle display screen image display method, system, storage medium and vehicle. The environment image collected within the preset range of the current vehicle is output to the display screen and the SOC system respectively to complete the first display output of the environment image, and after the diagnostic processing of the environment image, the driving assistance image is obtained to complete the second display output.
[0005] Specifically, the present application provides a vehicle display screen image display method, comprising the following steps:
[0006] S10: After the vehicle system completes power-on, the environment image within the preset range of the current vehicle is collected, and the environment image is output to the display screen and the SOC system respectively.
[0007] S20: The display screen is driven by the MCU system to perform first display output according to the preset configuration format.
[0008] S30: After the SOC system completes power-on initialization, the environment image is loaded and diagnosed to obtain a driving assistance image.
[0009] S40: the display screen end loads the driving assistance image and performs secondary display output.
[0010] The preset configuration format in the step S20 is specifically that a first deserializer connected with the MCU system receives an environment image output by a first serializer in the acquisition module; the MCU system controls the first deserializer to output the environment image to a second serializer; and the second serializer sends the environment image to the display screen for primary display output.
[0011] The initialization in the step S30 at least includes SOC system kernel loading and environment image display program loading.
[0012] The driving assistance image obtained in the step S30 is specifically that the SOC system loads the environment image and performs obstacle diagnosis to obtain an obstacle image in a preset range of the current vehicle, and the obstacle image is fused with the environment image to obtain the driving assistance image.
[0013] Based on the same inventive concept, the application further provides a vehicle-mounted display screen image display system, which comprises:
[0014] An acquisition module is configured to acquire an environment image in a preset range of the current vehicle through an image sensor and output the environment image to a transmission module through a first serializer.
[0015] The transmission module is configured to receive the environment image through a first deserializer and output the environment image to an SOC system of a calculation unit, and output the environment image to a display screen through a second serializer; and the calculation unit further comprises an MCU system.
[0016] The display screen is configured to receive the environment image from the second serializer through a second deserializer, and perform primary display output through the MCU system and a display unit according to a preset configuration format; and when the SOC system completes power-on initialization, loads the environment image and performs diagnosis processing to obtain a driving assistance image, the display unit loads the driving assistance image for secondary display output.
[0017] The transmission module further comprises a power supply unit configured to supply power to the calculation unit.
[0018] The SOC system at least comprises a first driving layer, an application layer and a Linux system; and the MCU system at least comprises a second driving layer.
[0019] The first driving layer is configured to realize SOC system kernel loading to load the application layer and the Linux system.
[0020] The application layer is used for realizing an environment image display program loading.
[0021] The Linux system is used for running the environment image display program loading, completing obstacle diagnosis on the environment image, obtaining an obstacle image within a preset range of the current vehicle, and further used for fusing the obstacle image with the environment image, obtaining a driving assistance image and outputting the driving assistance image to the second driver layer.
[0022] The second driver layer is used for driving the second serializer to output the environment image to the second deserializer, receiving the driving assistance image, and driving the second serializer to output the driving assistance image to the second deserializer, and further used for controlling the power supply state of the power supply unit and controlling the first driver layer.
[0023] The image sensor is connected to the second serializer, the other end of the second serializer is connected to the first deserializer, the first deserializer is connected to the first driver layer and the first serializer respectively, the first driver layer is connected to the application layer and the Linux system respectively, the second driver layer is connected to the Linux system and connected to the first deserializer and the first serializer, and the second driver layer is further connected to the power supply unit, the other end of the power supply unit is connected to the first driver layer, the first serializer is connected to the second deserializer, and the other end of the second deserializer is connected to the display unit.
[0024] Based on the same inventive concept, the application further provides a storage medium, which is one of computer readable storage media, and a computer program is stored on the storage medium, and the computer program is executed by a processor to realize the vehicle-mounted display screen image display method.
[0025] Based on the same inventive concept, the application further provides a vehicle, which at least comprises a system for realizing the vehicle-mounted display screen image display method.
[0026] Compared with the prior art, the application has the following beneficial effects:
[0027] The application directly outputs the collected environment image within a preset range of the current vehicle to the display screen first, and then outputs the driving assistance image to the display screen after the SOC system diagnoses and processes the environment image and obtains the driving assistance image, so that the environment image can be displayed even if the SOC system has not completed the diagnosis and processing of the environment image, the image output time of the camera is reduced, the user experience is improved, and the technical problem of long environment image display time in the prior art is solved. BRIEF DESCRIPTION OF DRAWINGS
[0028] Figure 1 The application provides a vehicle-mounted display screen image display method.
[0029] Figure 2 For Figure 1 The system block diagram of the vehicle-mounted display screen image display method. DETAILED DESCRIPTION
[0030] The embodiment of the application provides a vehicle-mounted display screen image display method, system, storage medium and vehicle, so as to solve the technical problem of long display time of the environment image collected by the camera in the preset range of the current vehicle in the prior art.
[0031] The technical scheme in the embodiment of the application is to solve the above technical problem, and the general idea is as follows:
[0032] The vehicle-mounted display screen image display method comprises the following steps: after the vehicle-mounted system is powered on, an environment image in a preset range of a current vehicle is collected by a camera, and the environment image is respectively sent to a second serializer and an SOC system through a first deserializer connected with a first serializer in the camera; the MCU system drives the second serializer to output the environment image to a display screen for primary display output; further, after the SOC system is powered on and initialized, obstacle diagnosis is performed on the received environment image, so as to obtain an obstacle image in the preset range of the current vehicle, and the obstacle image and the environment image are fused to obtain a driving assistance image; then the MCU system drives the second serializer to output the driving assistance image to the display screen for secondary display output. The above technical scheme reduces the image output time of the camera and improves the user experience.
[0033] The vehicle-mounted display screen image display method, system, storage medium and vehicle of the application will be further described in detail below in combination with specific embodiments and drawings.
[0034] Please refer to Figure 1 The embodiment of the application provides a vehicle-mounted display screen image display method, and the specific implementation process of the vehicle-mounted display screen image display method is as follows by taking the application of the method to vehicle reversing as an example.
[0035] Step S10: after the vehicle-mounted system is powered on, an environment image in a preset range of a current vehicle is collected, and the environment image is respectively output to a display screen and an SOC system.
[0036] In one possible implementation, an image sensor in a vehicle rearview camera collects an environment image in a preset range behind a vehicle body of a current vehicle, and the environment image is output to a first deserializer in a domain controller through a first serializer of the vehicle rearview camera; then the deserializer respectively outputs the environment image to a display screen and an SOC system in the domain controller.
[0037] After the collection and distribution of the environment image are completed, step S20 can be executed.
[0038] Step S20: The display screen is driven by the MCU system to perform one-time display output in a preset configuration format.
[0039] It should be noted that the preset configuration format is specifically: the first deserializer connected with the MCU system receives the environment image output from the first serializer in the collection module; the MCU system controls the first deserializer to output the environment image to the second serializer; and the second serializer sends the environment image to the display screen for one-time display output.
[0040] While step S20 is executed, step S30 is executed.
[0041] The step S30: after the SOC system completes the power-on initialization, the environment image is loaded and diagnostic processing is performed to obtain a driving assistance image.
[0042] It should be noted that the initialization at least includes SOC system kernel loading and environment image display program loading; and obtaining the driving assistance image specifically includes: the SOC system loads the environment image and performs obstacle diagnosis to obtain an obstacle image within a preset range behind the vehicle body of the current vehicle, and fuses the obstacle image with the environment image to obtain the driving assistance image.
[0043] After the driving assistance image is obtained, step S40 can be executed.
[0044] S40: The display screen end loads the driving assistance image and performs secondary display output.
[0045] It should be noted that after the secondary display output is performed, the one-time display output is stopped, and only the driving assistance image is displayed in the display screen, so that the driver performs the reversing action according to the driving assistance image.
[0046] The embodiment of the application provides a vehicle-mounted display screen image display system, which adopts the vehicle-mounted display screen image display method described above, please refer to Figure 2 , the system comprises:
[0047] The collection module is used for collecting the environment image within a preset range of the current vehicle through an image sensor, and outputting the environment image to the transmission module through a first serializer.
[0048] The transmission module is used for receiving the environment image through a first deserializer and outputting the environment image to the SOC system of the calculation unit, and outputting the environment image to the display screen through a second serializer; the calculation unit further comprises an MCU system.
[0049] The display screen is configured to receive the environmental image from the second serializer through a second deserializer, and to drive a display unit to output the environmental image in a preset configuration format through the MCU system; and when the SOC system completes power-on initialization, loads the environmental image and performs diagnostic processing to obtain a driving assistance image, the display unit loads the driving assistance image and outputs the driving assistance image.
[0050] It should be noted that the acquisition module can be defined as a camera; the transmission module is a domain controller; the type and model of the display screen can be set according to actual needs.
[0051] The transmission module further includes a power supply unit configured to supply power to the computing unit.
[0052] The SOC system includes at least a first driving layer for implementing SOC system kernel loading to load the application layer and the Linux system, and an application layer for implementing environmental image display program loading.
[0053] The MCU system includes at least a second driving layer.
[0054] The Linux system is configured to run the environmental image display program loading, complete obstacle diagnosis on the environmental image to obtain an obstacle image within a preset range of a current vehicle, and perform fusion processing on the obstacle image and the environmental image to obtain a driving assistance image and output the driving assistance image to the second driving layer.
[0055] The second driving layer is configured to drive the second serializer to output the environmental image to the second deserializer, receive the driving assistance image, drive the second serializer to output the driving assistance image to the second deserializer, control the power supply state of the power supply unit, and control the first driving layer.
[0056] It should be noted that in addition to the Linux system, the QNX system can also be used; the Linux system and the QNX system are both UNIX-like operating systems; and a person skilled in the art can select the best operating system in an actual application scenario according to the characteristics of the Linux system and the QNX system.
[0057] Linux is a free and open-source Unix-like operating system, a multi-user, multi-tasking, multi-threading and multi-CPU operating system based on POSIX. Linux is composed of a number of microkernels, and its source code is completely open source; Linux inherits the characteristics of Unix, has very powerful network functions, supports all Internet protocols, and can develop new protocol stacks by using the network characteristics of Unix; the Linux system tool chain is complete, and a suitable development environment can be configured by simple operation, which can simplify the development process, reduce the obstacles of simulation tools in development, and make the system have strong portability.
[0058] QNX is a commercial Unix-like real-time operating system that complies with the POSIX specification, and its target market is mainly embedded systems. The microkernel structure of QNX is a distinctive feature that distinguishes it from other operating systems. Based on the high-reliability kernel, the innovative design of QNX makes it also highly efficient. The most striking place of QNX is that it is the Unix sibling isomorph, maintaining a high degree of similarity with Unix, and most Unix or Linux applications can be directly compiled under QNX.
[0059] It should be noted that the connection relationship of each module in the vehicle display screen image display system is as follows: the image sensor is connected to the second serializer; the other end of the second serializer is connected to the first deserializer; the first deserializer is connected to the first driving layer and the first serializer respectively; the first driving layer is connected with the application layer and the Linux system respectively; the second driving layer is connected with the Linux system, and is connected to the first deserializer and the first serializer, and the second driving layer is also connected to the power supply unit; the other end of the power supply unit is connected to the first driving layer; the first serializer is connected to the second deserializer; the other end of the second deserializer is connected to the display unit.
[0060] In a possible implementation, the camera collects an environmental image within a preset range behind the vehicle body of the current vehicle through the image sensor thereof, converts the environmental image into a parallel signal, and sends the parallel signal to the first serializer, the first serializer converts the parallel signal into a serial signal and sends the serial signal to the first deserializer, and the first deserializer converts the serial signal back into a parallel signal and outputs the parallel signal to the second serializer and the SOC system respectively.
[0061] It should be noted that the first deserializer sends the parallel signal to the second serializer via the MCU system control.
[0062] The second serializer converts the received parallel signal into a serial signal and sends the serial signal to a second deserializer in the display screen, the second deserializer converts the serial signal back into a parallel signal and sends the parallel signal to a display unit, the display unit analyzes the parallel signal and completes a first display output, and the first display output outputs an environmental image of a preset range behind a vehicle body of the current vehicle collected by the camera.
[0063] Meanwhile, the SOC system is powered on and initialized, after the initialization, the SOC system loads the received environmental image, and performs obstacle diagnosis processing on the environmental image to obtain an obstacle image of the preset range behind the vehicle body of the current vehicle, and then the SOC system fuses the obstacle image with the initial environmental image to obtain a parallel signal of a driving assistance image, and the parallel signal is sent to the second serializer through the MCU system, the second serializer converts the received parallel signal into a serial signal and sends the serial signal to the second deserializer in the display screen, the second deserializer converts the serial signal back into a parallel signal and sends the parallel signal to the display unit, the display unit analyzes the parallel signal and completes a second display output.
[0064] It should be noted that the first display output will be terminated when the second display output is performed, and the driver will drive the current vehicle according to the second display output result.
[0065] Based on the same inventive concept, the application further provides a storage medium, which is one of computer readable storage media, and has a computer program stored thereon, and the computer program is executed by a processor to realize the vehicle-mounted display screen image display method.
[0066] Based on the same inventive concept, the application further provides a vehicle, which at least comprises a system for realizing the vehicle-mounted display screen image display method.
[0067] In summary, the application provides a vehicle-mounted display screen image display method, a system, a storage medium and a vehicle, the environmental image of the preset range of the current vehicle collected is output to the display screen and the SOC system respectively to complete a first display output of the environmental image, and after the diagnosis processing on the environmental image to obtain a driving assistance image, a second display output is completed.
[0068] Although the example embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the example embodiments are only exemplary and are not intended to limit the scope of the application. Those of ordinary skill in the art can make various changes and modifications without departing from the scope and spirit of the application. All these changes and modifications are intended to be included within the scope of the application as claimed in the appended claims.
[0069] Those skilled in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0070] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.
[0071] Embodiments of various components of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that microprocessors or digital signal processors (DSP) can be used in practice to implement some or all of the functions of some modules according to embodiments of the present application. The present application can also be implemented as a device program (for example, a computer program and a computer program product) for executing part or all of the methods described herein. Such program implementing the present application can be stored on a computer readable medium, or can have one or more signals in the form. Such signals can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.
[0072] It should be noted that in this paper, relationship terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between the entities or operations. Moreover, the term "include", "contain" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of another identical element in the process, method, article or device including the element.
[0073] While the application has been described in connection with specific embodiments thereof, it will be understood that many modifications, substitutions and changes will be apparent to those skilled in the art in light of the foregoing description. Accordingly, it is intended to embrace all changes and modifications that fall within the spirit and scope of the claims.
Claims
1. A method of displaying an image on a display screen of a vehicle, characterized by, The method comprises the following steps: S10: after the vehicle-mounted system is powered on, the environment image within the preset range of the current vehicle is collected, and the environment image is output to the display screen and the SOC system respectively; S20: the display screen is driven by the MCU system to perform one-time display output in a preset configuration format; In the step S20, the first deserializer connected with the MCU system receives the environment image output from the first serializer in the collection module; the MCU system controls the first deserializer to output the environment image to the second serializer; and the second serializer sends the environment image to the display screen for one-time display output. S30: after the SOC system is powered on and initialized, the environment image is loaded and diagnosed to obtain a driving assistance image; S40: the display screen loads the driving assistance image and performs secondary display output.
2. The method of claim 1, wherein The initialization in the step S30 at least includes SOC system kernel loading and environment image display program loading.
3. The method of claim 1, wherein In the step S30, the SOC system loads the environment image and performs obstacle diagnosis to obtain an obstacle image within the preset range of the current vehicle, and the obstacle image and the environment image are fused to obtain a driving assistance image.
4. A system employing the image display method for a display screen of a vehicle according to any one of claims 1 to 3, characterized by The system comprises a collection module for collecting the environment image within the preset range of the current vehicle through an image sensor and outputting the environment image to a transmission module through a first serializer; The transmission module is configured to receive the environment image through a first deserializer and output the environment image to a SOC system of a calculation unit and a display screen through a second serializer; the calculation unit further comprises an MCU system; The display screen is configured to receive the environment image from the second serializer through a second deserializer, and drive a display unit to perform one-time display output in a preset configuration format through the MCU system; and when the SOC system is powered on and initialized, the environment image is loaded and diagnosed to obtain a driving assistance image, and the display unit loads the driving assistance image for secondary display output.
5. The system of claim 4, wherein, The transmission module further comprises a power supply unit configured to supply power to the calculation unit.
6. The system of claim 5, wherein, The SOC system at least comprises a first driving layer, an application layer and a Linux system; and the MCU system at least comprises a second driving layer; The first driving layer is configured to implement SOC system kernel loading to load the application layer and the Linux system; The application layer is configured to implement environment image display program loading; The Linux system is configured to run the environment image display program loading, complete obstacle diagnosis on the environment image to obtain an obstacle image within the preset range of the current vehicle, and further configured to fuse the obstacle image and the environment image to obtain a driving assistance image and output the driving assistance image to the second driving layer; The second drive layer is configured to drive the second serializer to output the ambient image to the second deserializer, and to receive the driving assistance image and drive the second serializer to output the driving assistance image to the second deserializer, and to control the power supply state of the power supply unit and control the first drive layer.
7. The system of claim 6, wherein, The image sensor is connected to the second serializer; the other end of the second serializer is connected to the first deserializer; the first deserializer is connected to the first drive layer and the first serializer respectively; the first drive layer is connected to the application layer and the Linux system respectively; the second drive layer is connected to the Linux system, and is connected to the first deserializer and the first serializer, and is further connected to the power supply unit; the other end of the power supply unit is connected to the first drive layer; the first serializer is connected to the second deserializer; The other end of the second deserializer is connected to the display unit.
8. A storage medium, being one of computer-readable storage media, characterized by, A computer program is stored thereon, and the computer program is executed by a processor to implement the image display method of the vehicle-mounted display screen according to any one of claims 1-3.
9. A vehicle characterized by comprising: At least a system for implementing the image display method of the vehicle-mounted display screen according to any one of claims 1-3.
Citation Information
Patent Citations
Automatic driving system, automatic driving control method and device, vehicle and equipment
CN115009303A
Image display method and device, electronic equipment and storage medium
CN115712404A