Display processing method, storage medium, display terminal and vehicle

By realizing data display of multiple operating systems on the same physical screen of the car display terminal, and layer synthesis processing, the problem of only compatible with a single operating system in the existing technology is solved, improving user experience and providing rich applications Ecological and personalized interface.

CN118672462BActive Publication Date: 2024-11-19BYD CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411038238.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-19
Estimated Expiration
2044-07-31

AI Technical Summary

Technical Problem

Existing automotive display terminals can only be compatible with a single operating system on the same physical screen, resulting in poor user experience and unable to meet the diverse needs of users.

Method used

By realizing the data display of multiple operating systems on the same physical screen, the first operating system generates layer data and sends it to the second operating system through communication connection for layer synthesis processing, and display data compatible with multiple operating systems is generated.

Benefits of technology

It realizes display compatible with multiple operating systems on the same physical screen, improves the user experience, which not only ensures the security and stability of the system, but also provides a rich application ecosystem and personalized graphical interface.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118672462B_ABST
    Figure CN118672462B_ABST
Patent Text Reader

Abstract

The present application relates to a display processing method, a storage medium, a display terminal and a vehicle, wherein at least one first layer data of an interface to be displayed by the first operating system is generated in a first operating system; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; through the second operating system, the synthesized layer data is processed into display data under the second operating system, and display is performed based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a display processing method, a storage medium, a display terminal and a vehicle. Background Art

[0002] Existing cars usually have terminals (display terminals) with in-vehicle systems. The display terminals can provide users with functions such as navigation and music playback, increasing the user's intuitive experience and operability. At present, the in-vehicle systems of display terminals mainly include Linux systems and Android systems. Different operating systems have different advantages. For example, the Linux system is safe, stable, open source and free, has a powerful command line, etc., and the Android system has a rich application ecology. In order to meet the diverse needs of users, the display terminal is compatible with two systems by providing at least two physical screens. However, since each physical screen can only display the graphical interface of one of the operating systems, that is, different physical screens are only compatible with the advantages of a single operating system, resulting in a poor user experience. Summary of the invention

[0003] The embodiments of the present application provide a display processing method, device, storage medium, display terminal and vehicle, which display data of multiple operating systems on the same physical screen to make the display terminal compatible with multiple operating systems and improve the user experience.

[0004] The embodiment of the present application provides a display processing method, which is applied to a display terminal, wherein the operating system of the display terminal includes a first operating system and a second operating system, including:

[0005] In the first operating system, generating at least one first layer data of an interface that needs to be displayed by the first operating system;

[0006] Based on the communication connection between the first operating system and the second operating system, sending the first layer data to the second operating system;

[0007] By means of the second operating system, performing layer synthesis processing based on the first layer data to obtain synthesized layer data;

[0008] The synthesized layer data is processed by the second operating system to obtain display data under the second operating system, and display is performed based on the display data.

[0009] Accordingly, an embodiment of the present application provides a display processing device, which is applied to a display terminal, wherein the operating system of the display terminal includes a first operating system and a second operating system, including:

[0010] A first layer data generating unit, configured to generate, in the first operating system, at least one first layer data of an interface to be displayed by the first operating system;

[0011] A data sending unit, configured to send the first layer data to the second operating system based on the communication connection between the first operating system and the second operating system;

[0012] A synthesis unit, configured to perform layer synthesis processing based on the first layer data through the second operating system to obtain synthesized layer data;

[0013] The display unit is used to process the synthesized layer data through the second operating system to obtain display data under the second operating system, and to display based on the display data.

[0014] In addition, an embodiment of the present application also provides a display terminal, including one or more processors and a memory, the memory stores a computer program, and the processor is used to run the computer program in the memory to implement the display processing method provided in the embodiment of the present application.

[0015] In addition, an embodiment of the present application also provides a vehicle, including the above-mentioned display terminal, and the above-mentioned display terminal is used to implement the display processing method provided in the embodiment of the present application.

[0016] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a display terminal, the computer program is used to enable the display terminal to execute any display processing method provided in the embodiment of the present application.

[0017] In addition, an embodiment of the present application further provides a computer program product, including a computer program, and when the computer program is executed by a processor, any one of the display processing methods provided in the embodiment of the present application is implemented.

[0018] In the embodiment of the present application, at least one first layer data of the interface that the first operating system needs to display is generated in the first operating system; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; through the second operating system, the synthesized layer data is processed into display data under the second operating system, and display is performed based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 It is a flowchart of the display processing method provided by this application;

[0021] Figure 2 This is a flowchart of data display and processing based on an Android system or a Linux system in the existing technology provided by this application;

[0022] Figure 3 This is a flowchart of data display processing based on Android system and Linux system provided by this application;

[0023] Figure 4 is a flow chart of a display processing method provided by an embodiment of the present application;

[0024] Figure 5 is another flow chart of a display processing method provided by an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of the structure of a display processing device provided in an embodiment of the present application;

[0026] Figure 7 It is a schematic diagram of the structure of the display terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0028] The embodiments of the present application provide a display processing method, device, computer-readable storage medium, display terminal and vehicle. The display processing device can be integrated in a display device, which can be a server or a terminal.

[0029] Among them, the server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), as well as big data and artificial intelligence platforms.

[0030] The terminal may be a display terminal such as a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The terminal and the server may be directly or indirectly connected via wired or wireless communication, and this application does not limit this.

[0031] In addition, the term "plurality" in the embodiments of the present application refers to two or more than two. The terms "first" and "second" in the embodiments of the present application are used to distinguish descriptions and should not be understood as implying relative importance.

[0032] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0033] See also Figure 1 , Figure 1 1 is a flow chart of a display processing method provided by an embodiment of the present application. The display processing method is applied to a display terminal, which is a multifunctional device installed inside a car and used to provide vehicle information, entertainment functions and other related services. It is usually composed of hardware and software, and is intended to enhance the driving experience, provide information and entertainment content, and realize vehicle control and management. The operating system of the display terminal includes a first operating system and a second operating system, and the display processing method may include the following steps S101 to S104:

[0034] S101. In a first operating system, generate at least one first layer data of an interface that needs to be displayed by the first operating system.

[0035] The first operating system refers to an operating system of a non-display subject in the operating system of the display terminal.

[0036] The first layer data refers to the layer data of the interface that the first operating system needs to display on the display screen of the display terminal. The layer data refers to the data set of each element used to draw the interface in the operating system and the image in the interface. Each visible element in the first operating system can be regarded as a layer, such as the window, view control, image, etc. of the application. Different interfaces of the first operating system can also be regarded as a layer. For example, application interface, system interface.

[0037] The first layer data may include first application layer data, and the first application layer data includes interface elements of an application program in the first operating system, such as activities, dialog boxes, and pop-up windows, etc. Figure 4 The first layer data may also include first system layer data, which includes system-level interface elements in the first operating system, such as a status bar, a navigation bar, a notification bar, etc. Figure 4 Surface3 in. The specific content of the first layer data can be adjusted according to actual conditions, and the embodiment of the present application does not limit it.

[0038] Among them, there are many ways to generate the first layer data. For example, the interface that the first operating system needs to display can be intercepted through the interface provided by the first operating system, and the first layer data can be determined based on the intercepted interface. For another example, when the first operating system is an Android system, SurfaceFlinger can also be used to obtain the Surface interface that needs to be displayed in the first operating system, and determine the first layer data corresponding to the Surface interface. The method of generating the first layer data can be adjusted according to actual conditions, and the embodiments of the present application are not limited. Among them, SurfaceFlinger is a system service provided by the Android system for graphics synthesis and display. Through SurfaceFlinger, the Android system's applications, system UI and other graphic elements can be synthesized into the final screen image, and sent to the physical display device for display.

[0039] S102: Based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system.

[0040] Among them, the second operating system refers to the operating system of the display subject in the operating system of the display terminal. The second operating system is responsible for managing and controlling the graphical interface on the display screen. Since the operating system of the display subject is usually the operating system with which the user mainly interacts, the second operating system is responsible for receiving user input, processing user commands and operations, and displaying the relevant graphical interface and results to the user through the display screen. The first operating system refers to the operating system of the non-display subject in the operating system of the display terminal, that is, the first operating system can be used as an auxiliary operating system running in the background, responsible for performing specific tasks or providing specific functions (such as richer application ecosystem functions).

[0041] When the vehicle starts, the second operating system will establish a connection with the display screen, and the second operating system will be responsible for displaying the specific graphical interface. The first operating system will send the first layer data to the second operating system through the communication connection with the second operating system, so that the second operating system can process the first layer data and display the interface that needs to be displayed in the first operating system on the display screen with the second operating system as the display body.

[0042] The second operating system and the first operating system have their own advantages. Through the communication connection, the graphical interfaces of the two operating systems can be displayed on the same physical screen, that is, the same physical screen can be compatible with the advantages of multiple operating systems. For example, the Linux system is safe, stable, open source and free, has a powerful command line, etc., and the Android system has a rich application ecology. In the operating system with the Linux system as the display body, through the communication connection between the Android system and the Linux system, the Android system can provide a richer, more diverse and personalized graphical interface for the display screen corresponding to the operating system with the Linux system as the display body, thereby ensuring the safe and stable operation of the system while providing a richer, more diverse and personalized graphical interface for the display screen, thereby improving the user experience.

[0043] In some embodiments of the present application, there are multiple ways to send the first layer data to the second operating system based on the communication connection between the first operating system and the second operating system. For example, the first layer data can be sent to the first target client in the second operating system through the client proxy object set in the first operating system, wherein the client proxy object is the proxy object of the first target client; the first layer data can be sent to the target server set in the second operating system through the first target client, and the first target client is set in the server proxy object of the target server.

[0044] The client proxy object refers to the intermediary between the first target client in the second operating system and the first layer data in the first operating system (i.e., the accessible object in the first operating system). The client proxy object is used to proxy the corresponding first target client, and there is a one-to-one correspondence between the client proxy object and the first target client, that is, if the client proxy object is set in the first operating system, then the first target client represented by the client proxy object is set in the second operating system.

[0045] Therefore, through the client proxy object, the first target client in the second operating system corresponding to the first layer data of the first operating system can be determined, and the first layer data in the first operating system can be sent to the first target client in the second operating system, thereby realizing the display of data of multiple operating systems on the same physical screen, so that the display terminal is compatible with multiple operating systems and improves the user experience.

[0046] For example, Figure 4 As shown, Proxy Client is a client proxy object, which sends the first layer data in the first operating system to the first target client in the second operating system through VSock. VSock is a network device and a virtualization technology provided by the Linux kernel, which is used to provide high-performance, low-latency, and reliable network communication between virtual machines.

[0047] The server proxy object refers to the intermediary between each first target client in the second operating system and the target server in the second operating system. Each first target client in the second operating system is set in the server proxy object. The server proxy object is connected to the target server of the second operating system, and the first layer data received by each first target client can be sent to the target server through the server proxy object.

[0048] For example, Figure 4 As shown, the Proxy Server is a server-side proxy object, in which each first target client Wayland Client in the second operating system is configured.

[0049] Before sending the first layer data to the target server set in the second operating system through the first target client, the method also includes: in the first operating system, based on a predetermined display protocol, creating a client proxy object for each first layer data; in the second operating system, based on the predetermined display protocol, creating a server proxy object of the target server, and creating a first target client corresponding to each client proxy object in the server proxy object.

[0050] The predetermined display protocol refers to a protocol used for displaying on a display screen of a display terminal, and the protocol may be a graphics management protocol or a window management protocol, such as a Wayland protocol, an X Window protocol, and the like.

[0051] For example, Figure 4As shown, the predetermined display protocol is the Wayland protocol. In the first operating system, based on the Wayland protocol, a client proxy object Proxy Client is created for each first layer data, and each Proxy Client is a proxy object of the corresponding Wayland Client in the second operating system. In the second operating system, based on the Wayland protocol, a server proxy object Proxy Server of the target server Wayland Server is created, and a first target client Wayland Client corresponding to each client proxy object is created in the server proxy object Proxy Server.

[0052] In some embodiments, the client proxy object is connected to the graphic overlay in the first operating system. Then, the process of sending the first layer data to the first target client in the second operating system through the client proxy object set in the first operating system may be: receiving at least one first layer data generated by the first operating system through the graphic overlay of the first operating system; and sending each first layer data to the first target client in the second operating system through a client proxy object respectively through the graphic overlay.

[0053] Since the first layer data of the first operating system will be transmitted to the graphic overlay, by connecting the client proxy object with the graphic overlay in the first operating system, the communication connection between the first operating system and the second operating system can be realized on the basis of the original hardware, and then the data of multiple operating systems can be displayed simultaneously on the same physical screen, so as to make the display terminal compatible with the advantages of multiple operating systems and improve the user experience.

[0054] For example, Figure 4 As shown, the client proxy object Proxy Client is set in the graphics overlay HWC in the Android system. The first application layer data and the first system layer data generated by the Android system are received by the graphics overlay HWC in the Android system. Assuming that the client proxy object corresponding to the first application layer data is ProxyClient1, and the client proxy object corresponding to the first system layer data is Proxy Client2, the first application layer data is sent to the first target client Wayland Client1 in the second operating system through the graphics overlay through Proxy Client1, and the first system layer data is sent to the first target client Wayland Client2 in the second operating system through the graphics overlay through Proxy Client2.

[0055] Among them, the display screen of the display terminal can be provided with various types of screens. For example, the display screen of the display terminal is provided with a main screen and a virtual screen. For another example, the display screen of the display terminal is provided with a main screen, a virtual screen and a sub-screen. Among them, the main screen is usually the main display screen of the display terminal, which is used to display the main user interface and content. The virtual screen is a logical concept that allows image data to be allocated to different screen areas or display outputs. The virtual screen can be used to realize the simultaneous display of multiple tasks or multiple applications, or to split or copy images between different screens. The sub-screen may refer to a display screen additionally configured for the display terminal, which is used to display auxiliary information or provide additional display functions. It can be adjusted according to actual conditions, and the embodiments of the present application are not limited.

[0056] In this embodiment, the first layer data carries a screen identifier, which is used to indicate the screen on which the first layer data is displayed; at least one instance object is set in the graphic overlay, and each instance object corresponds to a screen identifier. Then, sending each first layer data to the first target client in the second operating system through a client proxy object through the graphic overlay can further include: obtaining the first layer data under the screen identifier corresponding to the instance object through each instance object in the graphic overlay; sending the first layer data to the first target client in the second operating system through at least one client proxy object connected to each instance object.

[0057] For example, Figure 5As shown, an instance object HWCDisplay1 and an instance object HWC Display2 are set in the graphic overlay HWC in the Android system. Among them, the instance object HWC Display1 is connected to the client proxy object ProxyClient1 and the client proxy object Proxy Client2, and the instance object HWC Display2 is connected to the client proxy object Proxy Client3. Assume that the screen identifier corresponding to the instance object HWC Display1 is 0, and 0 indicates the main screen. The screen identifier corresponding to the instance object HWC Display2 is 1, and 1 indicates the virtual screen. The first layer data Layer3 is the first layer data under the screen identifier corresponding to the instance object HWCDisplay1, and the first layer data Layer3 corresponds to the client proxy object Proxy Client1 connected to the instance object HWCDisplay1. The first layer data Layer4-6 is the first layer data under the screen identifier corresponding to the instance object HWCDisplay2, and the first layer data Layer4-6 corresponds to the client proxy object Proxy Client3 connected to the instance object HWCDisplay2. The first layer data Layer3 is sent to the first target client Wayland Client1 in the second operating system through the client proxy object Proxy Client1, and the first layer data Layer4-6 is sent to the first target client Wayland Client3 in the second operating system through the client proxy object Proxy Client3.

[0058] Therefore, by setting multiple instance objects in the graphics overlay, when the display terminal has multiple display screens, the first layer data of the first operating system is sent to the second operating system through the instance object corresponding to the display screen and the client proxy object connected to the instance object, thereby improving the adaptability of the communication connection between the first operating system and the second operating system in various scenarios (such as single-screen scenarios, multi-screen scenarios).

[0059] S103: Perform layer synthesis processing based on the first layer data through the second operating system to obtain synthesized layer data.

[0060] The synthesized layer data refers to the layer data that needs to be displayed on the display screen and has been synthesized by graphics in the second operating system.

[0061] There are many ways to perform graphics synthesis in the second operating system. For example, graphics synthesis is performed in a synthesizer of the second operating system. For another example, layer synthesis processing is performed based on the first layer data through the target server in the second operating system to obtain synthesized layer data. Among them, the target server is provided with a server proxy object, and the first target client corresponding to each client proxy object of the first operating system is provided in the server proxy object.

[0062] There are multiple ways to obtain synthesized layer data by performing layer synthesis processing based on the first layer data through the target server in the second operating system.

[0063] For example, the target server can receive second layer data sent by a second target client of a second operating system, where the second layer data is generated by the second operating system; and the target server can perform layer synthesis on the first layer data and the second layer data to obtain synthesized layer data.

[0064] For example, Figure 4 As shown, the second target client of the second operating system is the WaylandClient indicated by S214. The second layer data sent by the second target client of the second operating system is received by the WaylandClient indicated by S214.

[0065] Among them, the second layer data is used to indicate the layer data of the interface generated by the second operating system that needs to be displayed on the display screen of the display terminal. The second layer data may include second application layer data, and the second application layer data includes interface elements of the application in the second operating system, such as activities, dialog boxes, and pop-up windows. The second layer data may also include second system layer data, and the second system layer data includes system-level interface elements in the second operating system, such as a status bar, a navigation bar, a notification bar, etc. The specific content of the second layer data can be adjusted according to actual conditions, and the embodiments of the present application are not limited.

[0066] There are many ways to generate the second layer data. For example, the interface that the second operating system needs to display can be intercepted through the interface provided by the second operating system, and the second layer data can be determined based on the intercepted interface. For another example, the accessibility service provided by the second operating system can be used to obtain the interface that needs to be displayed in the second operating system, and determine the second layer data corresponding to the interface. The method of generating the second layer data can be adjusted according to actual conditions, and the embodiments of the present application are not limited.

[0067] The second layer data may also carry a screen identifier, which is used to indicate the screen on which the second layer data is displayed. The target server may also perform layer synthesis on the first layer data and the second layer data carrying the same screen identifier to obtain synthesized layer data corresponding to at least one screen identifier.

[0068] S104: Processing the synthesized layer data through the second operating system to obtain display data under the second operating system, and performing display based on the display data.

[0069] The processing of the synthesized layer data refers to processing the synthesized layer data into display data that can be supported by the display screen of the display terminal.

[0070] There are many ways to display based on display data. For example, the display data is passed to the display driver through the second operating system calling interface. The display driver is responsible for transmitting the display data to the hardware screen (actual display screen) of the display terminal. The display driver controls the display data to be displayed on the display screen of the display terminal. For another example, through the second operating system, each synthesized layer data is processed separately to obtain at least one display data under the second operating system; the display data is controlled to be displayed on the screen indicated by the corresponding screen identifier.

[0071] In the embodiment of the present application, at least one first layer data of the interface that the first operating system needs to display is generated in the first operating system; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; through the second operating system, the synthesized layer data is processed into display data under the second operating system, and display is performed based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience.

[0072] Specifically, Figure 2 The flowchart of data display processing based on Android system or Linux system for existing display terminals. Figure 2It can be seen that on the display terminal, the Android system involves components such as WMS (Window Manager Service), SurfaceFlinger, HWC (Hardware Composer), and DRM (Digital Rights Management), which jointly participate in the data display process. The data display logic of the Android system is: applications (such as navigation applications, entertainment applications, etc.) generate graphic data (such as application interfaces, images, texts, or other visual elements) in the Android system of the display terminal. WMS is responsible for managing the application windows and determining the position and display order of the application windows on the hardware screen. The layer data of the application window is determined based on WMS. Through HWC and SurfaceFlinger collaboration, the hardware acceleration capability is used to synthesize and render layer data more efficiently. HWC passes the layer data synthesized by SurfaceFlinger to the physical display driver. The physical display driver receives the layer data from HWC and transmits it to the hardware screen (actual display) of the display terminal. The driver interprets the data, controls the brightness and color of the pixels, and displays the image correctly on the hardware screen. On the display terminal, the DRM module can be used to ensure the security and legality of graphic data to prevent unauthorized use. DRM restricts the output and copying of layer data according to specific licenses or policies. Figure 2It can be seen that on the display terminal, the Linux system involves components such as KWin (KDE UserBase Wiki, window manager), Wayland compositor (synthesizer based on the Wayland protocol), and DRM (Direct Rendering Manager, digital rights management technology), which jointly participate in the data display process. The data display logic of the Linux system is: applications (such as navigation applications, entertainment applications, etc.) generate graphic data (such as application interfaces, images, texts or other visual elements) in the Linux system of the display terminal. KWin is responsible for managing the application windows and determining the position and display order of the application windows on the hardware screen. The layer data of the application window is determined based on KWin. The Wayland compositor receives the layer data from the application and interacts with the display hardware to perform image synthesis and rendering. DRM is a subsystem in the Linux kernel responsible for graphics display and hardware acceleration. It interacts with the graphics driver, manages display hardware resources, and provides hardware acceleration functions. The layer data processed by the Wayland compositor is passed to the physical display driver through DRM. The physical display driver is responsible for transmitting the layer data to the hardware screen (actual display) of the display terminal. The driver interprets the data, controls the brightness and color of the pixels, and displays the image correctly on the hardware screen.

[0073] Specifically, Figure 3 The flowchart of an embodiment of a display processing method provided by the present application, the operating system of the display terminal used by the display processing method includes an Android system and a Linux system, wherein the first operating system is an Android system, the second operating system is a Linux system, and Figure 3 It can be seen that the Linux system is the main operating system of the display terminal, and the Android system is the auxiliary operating system of the display terminal. Figure 3It can be seen that the embodiment of the present application establishes a communication connection between the Android system and the Linux system by connecting the graphics overlay (i.e., HWC) of the Android system to the Wayland Client constructed by the Linux system for the layer data generated by the Android system. That is, the layer data generated by the Android system received by the graphics overlay of the Android system can be sent to the Wayland Client constructed by the Linux system for the Android system through VSock, so as to achieve the purpose of using the Android system as a display window of the Linux system. At the same time, the data display logic of the Linux system remains unchanged, so that it is convenient for the Linux system to perform unified window management on the layer data of the Android system, so as to realize a cross-system display mode. That is, the layer data of multiple operating systems are displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, and the user is not aware of multiple operating systems during use, thereby improving the user experience.

[0074] Compared with the prior art, the solution provided by the present application enables the display terminal to be compatible with multiple operating systems at the same time, and display the layer data of multiple operating systems on the same physical screen, so that the display terminal applying the solution of the present application can not only ensure safe and stable movement, but also has a rich application ecology, which can provide users with a richer, more diverse and personalized graphical interface, thereby improving the user experience.

[0075] Specifically, Figure 4 This is a flowchart of an embodiment of a display processing method provided by the present application. The operating systems of the display terminal used in the display processing method include an Android system and a Linux system, wherein the first operating system is an Android system, the second operating system is a Linux system, the Linux system is the main operating system of the display terminal, and the Android system is the auxiliary operating system of the display terminal. Figure 4 It can be seen that the embodiment of the display processing method includes:

[0076] S201. Obtain an application interface Surface1 of an application in the Android system.

[0077] S202. Obtain another application interface Surface2 of the application in the Android system.

[0078] S203, obtaining the status bar interface Surface3 of the application or all applications integrated in the Android system.

[0079] S204: Determine the first layer data Layer1 corresponding to the application interface Surface1 in SurfaceFlinger.

[0080] Among them, SurfaceFlinger is the core process of Android system rendering, responsible for managing and rendering all surfaces of graphical interfaces in the Android system (i.e., Surface).

[0081] S205. Determine the first layer data Layer2 corresponding to the application interface Surface2 in SurfaceFlinger.

[0082] S206. Determine the first layer data Layer3 corresponding to the status bar interface Surface3 in SurfaceFlinger.

[0083] S207 , using a GPU synthesis method to synthesize the first layer data Layer1 and the first layer data Layer2 in a GPU (Graphics Processing Unit).

[0084] Among them, other methods can also be used to merge layer data, such as DPU (Data Processing Unit) synthesis method.

[0085] S208 , the first layer data Layer1 and the second layer data Layer2 are synthesized by GPU synthesis and stored in the Target graphics buffer.

[0086] S209: Construct an HWC Display object in the graphics overlay HWC.

[0087] S210: Under the HWC Display object of the Android system, create a client proxy object Proxy Client1 for the Target graphics buffer. The client proxy object Proxy Client1 is connected to the HWC Display object in S209 to receive the first layer data in the Target graphics buffer.

[0088] S211. Under the HWC Display object of the Android system, create a client proxy object Proxy Client 2 for the first layer data Layer 3. The client proxy object Proxy Client 2 is connected to the HWC Display object in S209 to receive the first layer data Layer 3.

[0089] S212. In the server proxy object Proxy Server of the Linux system, create a target client WaylandClient1 for the client proxy object Wayland Client1 (that is, the client proxy object corresponding to the Target graphics buffer).

[0090] In the server-side proxy object Proxy Server on the Linux system side, before creating the client proxy object, it is also necessary to create a server-side proxy object Proxy Server based on the Wayland protocol on the Linux system side.

[0091] S213. In the server proxy object Proxy Server of the Linux system, create a target client Wayland Client2 for the client proxy object Wayland Client2 (that is, the client proxy object corresponding to the first layer data Layer3).

[0092] S214. In the Wayland Client corresponding to the Linux system end, the second layer data generated by the Linux system end and needing to be displayed on the display screen is obtained.

[0093] S215. In the target server Wayland Server of the Linux system side, receive the second layer data from the Wayland Client of the Linux system side and the first layer data corresponding to each target client Wayland Client in the server proxy object Proxy Server.

[0094] S216. Through Libdrm, the kernel functions of the Linux system are encapsulated into a series of standard interfaces (such as open / close / ioctl), so that the target server Wayland Server of the Linux system performs interface calls based on Libdrm. By calling the interface, the layer data from the Wayland Client of the Linux system and the layer data corresponding to each target client Wayland Client in the server proxy object Proxy Server are further layer synthesized and processed in other ways to obtain display data.

[0095] S217: Send display data to the display driver.

[0096] S218. Send display data to the hardware screen via the display driver for display.

[0097] Through the above steps, the display terminal can be compatible with multiple operating systems at the same time, and can display the layer data of multiple operating systems on the same physical screen, so that the display terminal using the solution of the present application can not only ensure safe and stable movement, but also has a rich application ecology, and can provide users with a richer, more diverse and personalized graphical interface, thereby improving the user experience.

[0098] Further, in Figure 4 On the basis of, if the display screen of the display terminal is provided with multiple types of screens, then in S209, instance objects equal to the number of screen types may be provided in the graphic overlay, for details, see Figure 5 , Figure 5 This is a flowchart of another embodiment of a display processing method provided by the present application, wherein the first layer data carries a screen identifier, and the second layer data also carries a screen identifier, and the screen identifier is used to identify the screen on which the corresponding layer data needs to be displayed. Figure 5 It can be seen that the number of screen types is 2, assuming that the screen identifier is 1 for the main screen and the screen identifier is 0 for the virtual screen. The embodiment of the display processing method also includes:

[0099] S201. Obtain an application interface Surface1 of application 1 in the Android system, where the application interface Surface1 carries a screen identifier of 0.

[0100] S202. Obtain another application interface Surface2 of the application 1 in the Android system, where the application interface Surface2 carries a screen identifier of 0.

[0101] S203, obtaining the status bar interface Surface3 of the application 1 in the Android system, where the application interface Surface3 carries a screen identifier of 0.

[0102] S204: Determine the first layer data Layer1 corresponding to the application interface Surface1 in SurfaceFlinger.

[0103] S205. Determine the first layer data Layer2 corresponding to the application interface Surface2 in SurfaceFlinger.

[0104] S206. Determine the first layer data Layer3 corresponding to the status bar interface Surface3 in SurfaceFlinger.

[0105] S219. Obtain an application interface Surface4 of application 2 in the Android system, where the application interface Surface4 carries a screen identifier 1.

[0106] S220. Obtain another application interface Surface5 of application 2 in the Android system, where the application interface Surface5 carries a screen identifier 1.

[0107] S221. Obtain another application interface Surface6 of application 2 in the Android system, where the application interface Surface6 carries a screen identifier 1.

[0108] S222. Determine the first layer data Layer4 corresponding to the application interface Surface4 in SurfaceFlinger.

[0109] S223. Determine the first layer data Layer5 corresponding to the application interface Surface5 in SurfaceFlinger.

[0110] S224. Determine the first layer data Layer6 corresponding to the application interface Surface6 in SurfaceFlinger.

[0111] S207, using a GPU synthesis method, synthesizing the first layer data Layer 1 and the first layer data Layer 2 in a GPU (Graphics Processing Unit) to obtain application layer data corresponding to application 1. And using a GPU synthesis method, synthesizing the first layer data Layer 4, the first layer data Layer 5 and the first layer data Layer 6 in a GPU (Graphics Processing Unit) to obtain application layer data corresponding to application 2.

[0112] S208. Store the application layer data corresponding to application 1 and the application layer data corresponding to application 2 into the Target graphics buffer.

[0113] S209. Create an HWC Display1 object in the graphics overlay HWC.

[0114] S225. Create an HWC Display2 object in the graphics overlay HWC.

[0115] S210. Under the HWC Display1 object on the Android system side, create a client proxy object Proxy Client1 for the Target graphics buffer.

[0116] The client proxy object Proxy Client1 is connected to the HWC Display1 object in S209 and is used to receive the application layer data corresponding to the application 1 in the Target graphics buffer.

[0117] S211. Under the HWC Display1 object of the Android system, create a client proxy object Proxy Client2 for the first layer data Layer3. The client proxy object Proxy Client2 is connected to the HWC Display1 object in S209 to receive the first layer data Layer3.

[0118] S226. Under the HWC Display2 object on the Android system side, create a client proxy object Proxy Client3 for the Target graphics buffer.

[0119] The client proxy object Proxy Client3 is connected to the HWC Display2 object in S225 to receive the application layer data corresponding to the application 2 in the Target graphics buffer.

[0120] S212. In the server proxy object Proxy Server of the Linux system, a target client Wayland Client1 is created for the client proxy object Wayland Client1 (that is, the client proxy object corresponding to the application layer data corresponding to the application 1 in the Target graphics buffer).

[0121] S213. In the server proxy object Proxy Server of the Linux system, create a target client Wayland Client2 for the client proxy object Wayland Client2 (that is, the client proxy object corresponding to the first layer data Layer3).

[0122] S227. In the server proxy object Proxy Server of the Linux system, create a target client Wayland Client3 for the client proxy object Wayland Client3 (that is, the client proxy object corresponding to the application layer data corresponding to the application 2 in the Target graphics buffer).

[0123] S214. In the Wayland Client corresponding to the Linux system end, the second layer data generated by the Linux system end and needing to be displayed on the display screen is obtained.

[0124] S215. In the target server Wayland Server of the Linux system side, receive the second layer data from the Wayland Client of the Linux system side and the first layer data corresponding to each target client Wayland Client in the server proxy object Proxy Server.

[0125] S216. Through Libdrm, the kernel functions of the Linux system are encapsulated into a series of standard interfaces (such as open / close / ioctl), so that the target server Wayland Server of the Linux system performs interface calls based on Libdrm. By calling the interface, the layer data from the Wayland Client of the Linux system and the layer data corresponding to each target client Wayland Client in the server proxy object Proxy Server are further layer synthesized and processed in other ways to obtain display data.

[0126] S217: Send display data to the display driver.

[0127] S218. Send display data to the hardware screen via the display driver for display.

[0128] Through the above steps, the display terminal can be compatible with the advantages of multiple operating systems at the same time. When facing multiple screen types, the layer data of multiple operating systems can still be displayed on the same physical screen, so that the display terminal using the solution of this application can not only ensure safe and stable movement, but also has a rich application ecology, which can provide users with richer, more diverse and personalized graphical interfaces, thereby improving the user experience.

[0129] In order to better implement the display processing method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the above display processing method. The meanings of the terms are the same as those in the above display processing method, and the specific implementation details can refer to the description in the method embodiment.

[0130] For example, Figure 6 As shown, the display processing device may include a first layer data generating unit 301, a data sending unit 302, a synthesis unit 303 and a display unit 304. The display processing device is applied to a display terminal, and the operating system of the display terminal includes a first operating system and a second operating system, as follows:

[0131] The first layer data generating unit 301 is used to generate at least one first layer data of an interface that needs to be displayed by the first operating system in the first operating system.

[0132] The data sending unit 302 is used to send the first layer data to the second operating system based on the communication connection between the first operating system and the second operating system.

[0133] The synthesis unit 303 is used to perform layer synthesis processing based on the first layer data through the second operating system to obtain synthesized layer data.

[0134] The display unit 304 is used to process the synthesized layer data through the second operating system to obtain display data under the second operating system, and to display based on the display data.

[0135] In an embodiment of the present application, the data sending unit 302 includes:

[0136] The first data sending subunit is used to send the first layer data to the first target client in the second operating system through the client proxy object set in the first operating system, wherein the client proxy object is a proxy object of the first target client;

[0137] The second data sending subunit is used to send the first layer data to the target server set in the second operating system through the first target client, and the first target client is set in the server proxy object of the target server;

[0138] In this embodiment, the synthesis unit 303 includes:

[0139] The synthesis subunit is used to perform layer synthesis processing based on the first layer data through the target server in the second operating system to obtain synthesized layer data.

[0140] In an embodiment of the present application, before the data is sent to the second subunit, the method further includes:

[0141] A first creation subunit is used to create a client proxy object for each first layer data based on a predetermined display protocol in the first operating system;

[0142] The second creation subunit is used to create a server proxy object of the target server in the second operating system based on a predetermined display protocol, and to create a first target client corresponding to each client proxy object in the server proxy object.

[0143] In one embodiment of the present application, the client proxy object is connected to a graphics overlay in the first operating system;

[0144] The data sending first subunit includes:

[0145] A first receiving subunit, configured to receive at least one first layer data generated by the first operating system through a graphics overlay of the first operating system;

[0146] The third data sending subunit is used to send each first layer data to the first target client in the second operating system through a client proxy object through the graphics overlay.

[0147] In an embodiment of the present application, the first layer data carries a screen identifier, and the screen identifier is used to indicate the screen on which the first layer data is displayed; at least one instance object is set in the graphic overlay, and each instance object corresponds to a screen identifier;

[0148] The data sending third subunit includes:

[0149] The data acquisition subunit is used to acquire the first layer data under the screen identifier corresponding to each instance object through each instance object in the graphic overlay;

[0150] The fourth data sending subunit is used to send the first layer data to the first target client in the second operating system through at least one client proxy object connected to each instance object.

[0151] In one embodiment of the present application, the synthesis unit 303 includes:

[0152] A second receiving subunit is used to receive, through the target server, second layer data sent by a second target client of a second operating system, where the second layer data is generated by the second operating system;

[0153] The synthesis subunit is used to perform layer synthesis on the first layer data and the second layer data through the target server to obtain synthesized layer data.

[0154] In one embodiment of the present application, the second layer data carries a screen identifier, and the above-mentioned synthesis subunit includes:

[0155] The layer synthesis subunit is used to perform layer synthesis on the first layer data and the second layer data carrying the same screen identifier through the target server to obtain synthesized layer data corresponding to at least one screen identifier;

[0156] The display unit 304 includes:

[0157] A processing subunit, used to process each synthesized layer data respectively through the second operating system to obtain at least one display data under the second operating system;

[0158] The display subunit is used to control the display data to be displayed on the screen indicated by the corresponding screen identifier.

[0159] In the embodiment of the present application, at least one first layer data of the interface that the first operating system needs to display is generated in the first operating system by the first layer data generating unit 301; the data sending unit 302 sends the first layer data to the second operating system based on the communication connection between the first operating system and the second operating system; the synthesis unit 303 performs layer synthesis processing based on the first layer data through the second operating system to obtain synthesized layer data; the display unit 304 processes the synthesized layer data into display data under the second operating system through the second operating system, and displays based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience.

[0160] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation methods and corresponding beneficial effects of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0161] The embodiment of the present application also provides a display terminal, wherein the operating system of the display terminal includes a first operating system and a second operating system. Figure 7 As shown, it shows a schematic diagram of the structure of the display terminal involved in the embodiment of the present application, specifically:

[0162] The display terminal may include one or more processors 401 of processing cores, one or more computer-readable storage media memories 402, a power supply 403, an input unit 404 and other components. Those skilled in the art will appreciate that Figure 7 The display terminal structure shown in the figure does not constitute a limitation on the display terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0163] The processor 401 is the control center of the display terminal. It uses various interfaces and lines to connect various parts of the entire display terminal. It executes various functions of the display terminal and processes data by running or executing computer programs and / or modules stored in the memory 402, and calling data stored in the memory 402. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.

[0164] The memory 402 can be used to store computer programs and modules. The processor 401 executes various functional applications and data processing by running the computer programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, a computer program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the display terminal, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0165] The display terminal also includes a power supply 403 for supplying power to each component. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, power consumption management and other functions through the power management system. The power supply 403 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0166] The display terminal may further include an input unit 404, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0167] Although not shown, the display terminal may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 401 in the display terminal will load the executable files corresponding to the processes of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 will run the computer programs stored in the memory 402, thereby realizing various functions, such as:

[0168] In a first operating system, at least one first layer data of an interface that needs to be displayed by the first operating system is generated; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; the synthesized layer data is processed by the second operating system to obtain display data under the second operating system, and display is performed based on the display data.

[0169] It can be seen that the display terminal provided in the embodiment of the present application generates at least one first layer data of the interface that the first operating system needs to display in the first operating system; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; through the second operating system, the synthesized layer data is processed into display data under the second operating system, and displayed based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience.

[0170] The specific implementation methods and corresponding beneficial effects of the above operations can be found in the detailed description of the display processing method above, which will not be elaborated here.

[0171] The embodiment of the present application also provides a vehicle, which includes the above-mentioned display terminal, and the specific structure of the vehicle is not limited in this application. The specific implementation methods and corresponding beneficial effects of the above-mentioned operations of the display terminal are also applicable to the vehicle, and the details can be found in the detailed description of the display processing method above, which will not be repeated here.

[0172] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0173] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program can be loaded by a processor to execute the steps in any display processing method provided in the embodiment of the present application. For example, the computer program can execute the following steps:

[0174] In a first operating system, at least one first layer data of an interface that needs to be displayed by the first operating system is generated; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; the synthesized layer data is processed by the second operating system to obtain display data under the second operating system, and display is performed based on the display data.

[0175] It can be seen that the computer-readable storage medium provided in the embodiment of the present application generates at least one first layer data of the interface that the first operating system needs to display in the first operating system; based on the communication connection between the first operating system and the second operating system, the first layer data is sent to the second operating system; through the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; through the second operating system, the synthesized layer data is processed into display data under the second operating system, and displayed based on the display data. The operating system of the display terminal includes the first operating system and the second operating system. Through the above steps, the layer data of multiple operating systems can be displayed on the same physical screen, so that the display terminal is compatible with the advantages of multiple operating systems, thereby improving the user experience.

[0176] The specific implementation methods and corresponding beneficial effects of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0177] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0178] Since the computer program stored in the computer-readable storage medium can execute the steps in any display processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any display processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0179] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned display processing method.

[0180] The above is a detailed introduction to a display processing method, device, computer-readable storage medium, display terminal and vehicle provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A display processing method, characterized in that: Applied to a display terminal, the operating system of the display terminal includes a first operating system and a second operating system, including: In the first operating system, generating at least one first layer data of an interface that needs to be displayed by the first operating system; In the first operating system, based on a predetermined display protocol, a client proxy object is created for each first layer data; In the second operating system, based on the predetermined display protocol, a server proxy object of a target server is created, and a first target client corresponding to each of the client proxy objects is created in the server proxy object; Sending the first layer data to a first target client in the second operating system through a client proxy object set in the first operating system, wherein the client proxy object is a proxy object of the first target client; Sending the first layer data to a target server set in the second operating system through the first target client, wherein the first target client is set in a server proxy object of the target server; By means of the target server in the second operating system, layer synthesis processing is performed based on the first layer data to obtain synthesized layer data; The synthesized layer data is processed by the second operating system to obtain display data under the second operating system, and display is performed based on the display data.

2. The display processing method according to claim 1, characterized in that: The client proxy object is connected to the graphics overlay in the first operating system; The sending the first layer data to the first target client in the second operating system through the client proxy object set in the first operating system includes: receiving, through the graphic overlay of the first operating system, at least one first layer data generated by the first operating system; Each of the first layer data is sent to the first target client in the second operating system through the graphic overlay and through one of the client proxy objects.

3. The display processing method according to claim 2, characterized in that: The first layer data carries a screen identifier, and the screen identifier is used to indicate the screen on which the first layer data is displayed; at least one instance object is set in the graphic overlay, and each instance object corresponds to a screen identifier; The step of sending each of the first layer data through the graphics overlay to the first target client in the second operating system through the client proxy object respectively includes: Obtaining the first layer data under the screen identifier corresponding to the instance object through each instance object in the graphic overlay; The first layer data is sent to the first target client in the second operating system through at least one of the client proxy objects connected to each of the instance objects.

4. The display processing method according to claim 3, characterized in that: The target server in the second operating system performs layer synthesis processing based on the first layer data to obtain synthesized layer data, including: Receiving, through the target server, second layer data sent by a second target client of the second operating system, where the second layer data is generated by the second operating system; The first layer data and the second layer data are layer synthesized through the target server to obtain synthesized layer data.

5. The display processing method according to claim 4, characterized in that: The second layer data carries a screen identifier, and the target server performs layer synthesis on the first layer data and the second layer data to obtain synthesized layer data, including: By means of the target server, the first layer data and the second layer data carrying the same screen identifier are layer synthesized to obtain synthesized layer data corresponding to at least one screen identifier; The step of processing the synthesized layer data by the second operating system to obtain display data under the second operating system, and performing display based on the display data, includes: Processing each of the synthesized layer data respectively through the second operating system to obtain at least one display data under the second operating system; The display data is controlled to be displayed on the screen indicated by the corresponding screen identifier.

6. A storage medium, characterized in that: The invention comprises a computer program, and when the computer program is run on a display terminal, the computer program is used to make the display terminal execute the steps of the display processing method according to any one of claims 1 to 5.

7. A display terminal, characterized in that: The device comprises one or more processors and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of the display processing method according to any one of claims 1 to 5.

8. A vehicle, characterized in that: The vehicle includes the display terminal according to claim 7.