Data display method and system, vehicle machine and storage medium

Abstract

The invention provides a data display method and system, a vehicle machine and a storage medium, and relates to the technical field of intelligent automobiles. And the main operating system can determine a target application program associated with the display data on the uppermost layer of the coordinates receiving the trigger operation from the M first application programs and the N second application programs according to the stacking relationship, the display positions of the preset M paths of display data and the display positions of the N paths of display data. It can be understood that the display data at the uppermost layer of the coordinates where the trigger operation is received is usually data required to be updated by the user. Furthermore, in the main operating system, the M paths of display data corresponding to the M first application programs and the N paths of display data corresponding to the N second application programs are synthesized into updated fusion data, and the updated fusion data comprise the updated display data corresponding to the target application program.

Description

Technical Field

[0001] The present application relates to the field of intelligent automobile technology, and in particular to a data display method, system, vehicle computer and storage medium. Background Art

[0002] With the development of science and technology, the functions of automobiles are showing a trend of diversification. For example, a physical screen can be installed on the main driver's seat, the co-driver's seat and the back row of the car. The physical screen installed on the main driver's seat can display the instrument information of the instrument application, the control information of the intelligent control application (such as window adjustment buttons, sunroof adjustment buttons, etc.), the music information of the music application, the web page information of the browser application, etc.; the physical screen installed on the co-driver's seat or the back row can display the web page information of the browser application, the music information of the music application, the control information of the intelligent control application, etc. Usually, due to the large number of applications installed in the car computer, more computing resources are required. In order to avoid the car computer crashing during operation, the main operating system (i.e. HostVM) and the host operating system (i.e. GuestVM) can be run on the virtual machine of the car computer. The main operating system is used to install applications related to driving functions (such as navigation applications, instrument applications, intelligent control applications), and the host operating system is used to install applications related to entertainment functions (such as music applications, browser applications, etc.).

[0003] At present, when the display data of the first application in the main operating system (the instrument data of the instrument application) and the display data of the second application in the host operating system (such as the navigation data of the navigation application) are overlapped on the vehicle-mounted physical screen installed in the main driving seat, if a certain position in the vehicle-mounted physical screen of the main driving seat is triggered by the user (the user only wants to update the display data at the top layer of the coordinates that received the trigger operation), the main operating system and the host operating system will both receive a trigger signal carrying the trigger coordinates, and the first application in the main operating system will update the corresponding display data according to the trigger signal and the second application in the host operating system will update the corresponding display data according to the trigger signal. In this way, the updated display data will not meet the needs of the user and the reliability is low. Summary of the invention

[0004] The present application provides a data display method, system, vehicle computer and storage medium for solving the problem in the prior art that the updated display data does not meet the needs of users and has low reliability.

[0005] The present application provides a data display method, which is applied to a data display system, wherein the data display system includes a main operating system and a host operating system, and the data display system is used to output fused data to a vehicle-mounted physical screen display of a vehicle computer, wherein the fused data includes M channels of display data corresponding to M first application programs of the main operating system that have a stacking relationship when displayed, and N channels of display data corresponding to N second application programs of the host operating system, wherein M and N are both positive integers, and the method provided by the present application includes:

[0006] The main operating system generates a trigger signal in response to a user's trigger operation on the vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation;

[0007] The main operating system determines, from the M first applications and the N second applications, a target application associated with the display data at the top layer of the coordinates receiving the trigger operation according to the stacking relationship, the preset display positions of the M display data and the display positions of the N display data;

[0008] The main operating system transmits the trigger signal to the target application to update the display data output by the target application;

[0009] In the main operating system, M channels of display data corresponding to the M first applications and N channels of display data corresponding to the N second applications are synthesized into updated fused data, wherein the updated fused data includes updated display data corresponding to the target application;

[0010] The main operating system transmits the updated fusion data to the in-vehicle physical screen for display.

[0011] In some implementations, the trigger signal generated by the virtual display manager of the main operating system, transmitting the trigger signal to the target application, includes:

[0012] The virtual display manager determines the type of operating system on which the target application is installed;

[0013] When the operating system on which the target application is installed is the host operating system, the trigger signal is transmitted to the virtual graphics processing front end of the host operating system via the virtual graphics processing back end of the host operating system;

[0014] Transmits trigger signals from the host operating system's virtual graphics processing front end to the target application.

[0015] In some implementations, in the main operating system, M channels of display data corresponding to the M first applications and N channels of display data corresponding to the N second applications are synthesized into updated fused data, including:

[0016] The virtual graphics processing front end of the host operating system writes N display data corresponding to the N second applications into the virtual screen cache, wherein the N display data include updated display data corresponding to the target application;

[0017] The virtual graphics processing backend of the host operating system reads N display data corresponding to the N second applications from the virtual screen, and transmits the N display data corresponding to the N second applications to the graphics synthesizer of the main operating system;

[0018] The graphics synthesizer of the main operating system synthesizes the M channels of display data corresponding to the M first application programs and the N channels of display data corresponding to the N second application programs into updated fusion data.

[0019] In some implementations, the trigger signal generated by the virtual display manager of the main operating system, transmitting the trigger signal to the target application, includes:

[0020] determining, at the virtual display manager, a type of operating system on which the target application is installed;

[0021] When the operating system in which the target application is installed is the main operating system, a trigger signal is transmitted from the virtual display manager to the target application.

[0022] In some implementations, each channel of display data is associated with at least a display position, a display size, a display color, and a stacking relationship with other display data, and M channels of display data corresponding to M first applications and N channels of display data corresponding to N second applications are synthesized into updated fused data, including:

[0023] According to the display position, display size, display color associated with each display data and the overlapping relationship with other display data, N display data corresponding to the N second applications and M display data corresponding to the M first applications are synthesized into updated fused data.

[0024] In some embodiments, the data display system is loaded on a cockpit control chip, which includes a central processing unit and a graphics processing unit in communication connection, and synthesizes updated fusion data by combining M display data corresponding to M first applications and N display data corresponding to N second applications, including:

[0025] The central processing unit converts the M-channel display data and the N-channel display data into M+N layer data in the main operating system;

[0026] The central processing unit and the graphics processing unit synthesize the M+N layer data into updated fused data.

[0027] In some embodiments, the data display system is loaded on a cockpit control chip, and the cockpit control chip includes a central processor, a physical transmission channel, and a display processor that are communicatively connected in sequence. The central processor is communicatively connected to the display processor through the physical transmission channel, and M channels of display data corresponding to M first applications and N channels of display data corresponding to N second applications are synthesized into updated fusion data, including:

[0028] In the main operating system, the central processing unit converts M channels of display data into M first handles and converts N channels of display data into N second handles;

[0029] The central processing unit transmits the M first handles and the N second handles to the display processor through a physical transmission channel;

[0030] The display processor synthesizes updated fusion data according to the M first handles and the N second handles.

[0031] In a second aspect, the present application provides a data display system, including a main operating system and a host operating system, wherein the data display system is used to output fused data to a vehicle-mounted physical screen display of a vehicle computer, wherein the fused data includes, when displayed, M channels of display data corresponding to M first applications of the main operating system that have a stacked relationship, and N channels of display data corresponding to N second applications of the host operating system, wherein M and N are both positive integers, wherein,

[0032] A main operating system is used to generate a trigger signal in response to a user's trigger operation on a vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation; determine, from M first applications and N second applications, a target application associated with the display data at the top layer of the coordinates receiving the trigger operation based on a stacking relationship, a preset display position of M display data, and a display position of N display data; transmit the trigger signal to the target application to update the display data output by the target application; in the main operating system, synthesize updated fused data from the M display data corresponding to the M first applications and the N display data corresponding to the N second applications, wherein the updated fused data includes the updated display data corresponding to the target application; and transmit the updated fused data to the vehicle-mounted physical screen for display.

[0033] In a third aspect, the present application further provides a vehicle computer, including:

[0034] processor;

[0035] a memory for storing processor-executable instructions;

[0036] Among them, the processor is configured to execute instructions to implement the data display method provided in the first aspect of this application.

[0037] In a fourth aspect, the present application further provides a storage medium. When the instructions in the storage medium are executed by the processor of the vehicle computer, the vehicle computer can execute the data display method provided in the first aspect of the present application.

[0038] The present application provides a data display method, system, vehicle computer and storage medium, wherein the main operating system can determine the target application associated with the display data at the top layer of the coordinates receiving the trigger operation from M first applications and N second applications according to the stacking relationship, the display position of the preset M display data and the display position of the N display data. It can be understood that the display data at the top layer of the coordinates receiving the trigger operation is usually the data that the user needs to update.

[0039] In this way, the main operating system can transmit a trigger signal to the target application to update the display data output by the target application. Further, in the main operating system, the M channels of display data corresponding to the M first applications and the N channels of display data corresponding to the N second applications are synthesized into updated fusion data, wherein the updated fusion data includes the updated display data corresponding to the target application. It can be understood that since the updated display data of the target application meets the needs of the user, the updated fusion data displayed on the vehicle-mounted physical screen also meets the needs of the user and has high reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 A software architecture block diagram of the vehicle computer provided in the embodiment of the present application;

[0042] Figure 2 A flowchart of a data display method provided in an embodiment of the present application;

[0043] Figure 3 A functional module block diagram of a data display device provided in an embodiment of the present application;

[0044] Figure 4 This is a block diagram of the circuit module connection of the vehicle computer provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0046] Various structural schematic diagrams according to embodiments of the present disclosure are shown in the accompanying drawings. These figures are not drawn to scale, and some details are magnified and some details may be omitted for the purpose of clear expression. The shapes of various regions and layers shown in the figures and the relative sizes and positional relationships therebetween are only exemplary, and may deviate in practice due to manufacturing tolerances or technical limitations, and those skilled in the art may further design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0047] In the context of the present disclosure, when a layer / element is referred to as being "on" another layer / element, the layer / element may be directly on the other layer / element or an intervening layer / element may exist therebetween. In addition, if a layer / element is "on" another layer / element in one orientation, the layer / element may be "below" the other layer / element when the orientation is reversed.

[0048] First, the terms involved in this application are explained:

[0049] The host virtual machine (HVM) runs on the virtual machine, and most of the vehicle's hardware resources are allocated to the host operating system. The host operating system is used to install applications related to driving functions (such as navigation applications, instrument applications, and intelligent control applications).

[0050] The guest virtual machine (GVM) runs on the virtual machine, and a small part of the vehicle's hardware resources are allocated to the main operating system. The host operating system is used to install applications related to entertainment functions (such as music applications, browser applications, etc.).

[0051] The following is a detailed description of the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0052] An embodiment of the present application provides a data display method, which is applied to a data display system. The data display system includes a main operating system and a host operating system. The main operating system and the host operating system are loaded on a cockpit control chip, and the cockpit control chip is communicatively connected to a vehicle-mounted physical screen.

[0053] The main operating system may be, but is not limited to, a Linux operating system, and the host operating system may be, but is not limited to, an Android operating system. The main operating system and the host operating system are divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the main operating system may be divided into four layers, namely, application layer, framework layer, hardware abstract layer (HAL), and kernel layer.

[0054] Among them, Figure 1 As shown, the application layer of the main operating system is installed with multiple applications related to driving functions (such as instrument applications and intelligent control applications). For example, the instrument application can be used to display vehicle speed information, fuel information, vehicle acceleration information, etc., and the intelligent control application can be used to display window control buttons, door control buttons, seat control buttons, etc. The framework layer of the main operating system includes a graphics synthesizer, a virtual display manager, and a virtual display manager backend Virtio-gpubackend. The graphics synthesizer is used to synthesize the display data of different applications. For example, when the host operating system is an Android operating system, the graphics synthesizer is weston; the hardware abstraction layer of the main operating system includes a direct rendering manager DRM (Direct rendering mananger, DRM); the kernel layer of the main operating system includes a direct rendering manager driver DRMdrvier.

[0055] Still Figure 1 As shown, the application layer of the host operating system is used to install applications associated with entertainment functions (such as navigation applications, music applications, browser applications, etc.), and the framework layer of the host operating system includes a graphics synthesizer, which is used to synthesize the data to be displayed from each application in the application layer. For example, when the host operating system is an Android operating system, the graphics synthesizer is SurfaceFlinger. When the host operating system is other operating systems, the graphics synthesizer can also be other types of graphics synthesizers, which are not limited here. The kernel layer of the host operating system includes a virtual graphics processing front-end Virtio-gpu Fontend driver, which is used to transfer multi-channel display data in the host operating system to the virtual screen.

[0056] The cockpit control chip displays fused data, which includes M display data corresponding to M first applications of the main operating system in a stacked relationship and N display data corresponding to N second applications of the host operating system, where M and N are both positive integers. For example, M and N can be equal to 1, 2, 3, etc., which are not limited here. For example, the M display data corresponding to the M first applications can be one channel of instrument data of the instrument application, and the N display data corresponding to the N second applications can be one channel of navigation data of the navigation application, and the navigation data is located above a part of the instrument data area of ​​the instrument application.

[0057] Specifically, Figure 2 As shown, the method provided in the embodiment of the present application includes:

[0058] S201: The main operating system generates a trigger signal in response to a user's trigger operation on the vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation.

[0059] For example, when the fused data displayed on the vehicle physical screen includes the instrument data of the instrument application and the navigation data, and the navigation data is located above a portion of the instrument data of the instrument application, the user can trigger the navigation data to enlarge the navigation data. At this time, the main operating system generates a trigger signal in response to the user's trigger operation on the vehicle physical screen.

[0060] S202: The main operating system determines, from the M first applications and the N second applications, a target application associated with the display data at the top layer of the coordinates receiving the trigger operation based on the stacking relationship, the preset display positions of the M display data, and the display positions of the N display data.

[0061] Exemplarily, when the fused data displayed on the on-board physical screen includes instrument data and navigation data of an instrument application, if the coordinates of the trigger operation received by the on-board physical screen are (x, y), and the coordinate position (x, y) corresponds to the instrument data and navigation data, and the navigation data is located above a partial area of ​​the instrument data of the instrument application (i.e., a stacking relationship), then the target application associated with the display data at the top layer of the coordinates that receive the trigger operation is the navigation application.

[0062] S203: The main operating system transmits a trigger signal to the target application to update display data output by the target application.

[0063] In some embodiments, S203 may be specifically implemented as follows: the virtual display manager determines the type of operating system in which the target application is installed; when the operating system in which the target application is installed is a host operating system, the trigger signal is transmitted to the virtual graphics processing front end of the host operating system via the virtual graphics processing back end of the host operating system; the trigger signal is transmitted from the virtual graphics processing front end of the host operating system to the target application (such as a navigation application). The target application may update the output display data (such as the enlarged navigation data) according to the trigger signal.

[0064] Specifically, the vehicle-mounted physical screen can transmit the trigger signal to the touch driver, the touch driver transmits the trigger signal to the graphics synthesizer, the graphics synthesizer transmits the trigger signal to the virtual display manager, the virtual display manager transmits the trigger signal to the virtual graphics processing backend, the virtual graphics processing backend transmits the trigger signal to the virtual graphics processing front end of the host operating system, and the virtual graphics processing front end transmits the touch signal to the target application.

[0065] In some other embodiments, S203 may also be specifically implemented as follows: the virtual display manager determines the type of the operating system on which the target application is installed; when the operating system on which the target application is installed is the main operating system, a trigger signal is transmitted from the virtual display manager to the target application (such as a navigation application). The target application may update the output display data (such as the enlarged navigation data) according to the trigger signal.

[0066] S204: In the main operating system, M channels of display data corresponding to the M first applications and N channels of display data corresponding to the N second applications are synthesized into updated fused data, wherein the updated fused data includes updated display data corresponding to the target application.

[0067] Specifically, each channel of display data is associated with at least a display position, a display size, a display color, and a stacking relationship with other display data. Based on the display position, display size, display color, and stacking relationship with other display data associated with each channel of display data, the N channels of display data corresponding to the N second applications and the M channels of display data corresponding to the M first applications are synthesized into updated fused data.

[0068] Exemplarily, when the M display data corresponding to the M first applications are the instrument data of the instrument application, the N display data corresponding to the N second applications are the navigation data of the navigation application, and the updated display data corresponding to the target application is the enlarged navigation data, then the updated fusion data includes the instrument data of the instrument application and the enlarged navigation data, and the enlarged navigation data is located above the instrument data of the instrument application.

[0069] Specifically, the cockpit control chip is pre-configured with a virtual screen corresponding to the on-board physical screen. The virtual graphics processing front end of the host operating system writes the N display data corresponding to the N second applications into the virtual screen cache. Specifically, the N channels of to-be-displayed data of the N second applications can be sequentially transmitted through the graphics synthesizer SurfaceFlinger, the hardware abstraction layer, and the virtual graphics processing front end Virtio-gpu Fontend driver, and then transferred to the virtual screen cache corresponding to the on-board physical screen. Among them, the virtual screen can be understood as a memory.

[0070] The N channels of display data include updated display data corresponding to the target application. The virtual graphics processing backend of the host operating system reads the N channels of display data corresponding to the N second applications from the virtual screen, and transmits the N channels of display data corresponding to the N second applications to the graphics synthesizer of the main operating system. The graphics synthesizer of the main operating system synthesizes the M channels of display data corresponding to the M first applications and the N channels of display data corresponding to the N second applications into updated fusion data.

[0071] S205: Transmitting the updated fusion data to the vehicle-mounted physical screen for display.

[0072] In summary, a data display method provided in an embodiment of the present application can determine the target application associated with the display data at the top layer of the coordinates receiving the trigger operation from the M first applications and the N second applications according to the stacking relationship, the preset display position of the M-channel display data and the display position of the N-channel display data. It can be understood that the display data at the top layer of the coordinates receiving the trigger operation is usually the data that the user needs to update. In this way, the trigger signal can be transmitted to the target application based on the main operating system to update the display data output by the target application. Furthermore, in the main operating system, the M-channel display data corresponding to the M first applications and the N-channel display data corresponding to the N second applications are synthesized into updated fusion data, wherein the updated fusion data includes the updated display data corresponding to the target application. It can be understood that since the display data of the updated target application meets the needs of the user, the updated fusion data displayed on the vehicle-mounted physical screen also meets the needs of the user and has high reliability.

[0073] In addition, in some embodiments, the cockpit control chip includes a central processing unit and a graphics processing unit that are communicatively connected. The above S204 can be specifically implemented as follows: the central processing unit converts M display data and N display data into M+N layer data in the main operating system; the central processing unit and the graphics processing unit synthesize the M+N layer data into updated fusion data. It can be understood that during the operation of the vehicle computer, the central processing unit and the graphics processing unit are relatively busy, and in the above process, the central processing unit and the graphics processing unit only need to synthesize the M+N layer data once to obtain the fusion data to be displayed, saving computing resources.

[0074] In other embodiments, the cockpit control chip includes a central processing unit, a physical transmission channel, and a display processor that are sequentially communicatively connected. The above S204 can also be specifically implemented as follows: in the main operating system, the central processing unit converts M display data into M first handles, and converts N display data into N second handles; the central processing unit transmits the M first handles and the N second handles to the display processor through the physical transmission channel; the display processor synthesizes the updated fusion data based on the M first handles and the N second handles. In this way, the M+N layer data are synthesized on the display processor, without the need for the graphics processor and the central processing unit to synthesize the M+N layer data, without occupying the computing resources of the graphics processor and the central processing unit, and the efficiency of synthesizing the M+N layer data is high.

[0075] In addition, an embodiment of the present application provides a data display system, including a main operating system and a host operating system, wherein the data display system is used to output fused data to a vehicle-mounted physical screen display of a vehicle computer, wherein the fused data includes, when displayed, M channels of display data corresponding to M first application programs of the main operating system that have a stacked relationship, and N channels of display data corresponding to N second application programs of the host operating system, wherein M and N are both positive integers, wherein,

[0076] A main operating system is used to generate a trigger signal in response to a user's trigger operation on a vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation; determine, from M first applications and N second applications, a target application associated with the display data at the top layer of the coordinates receiving the trigger operation based on a stacking relationship, a preset display position of M display data, and a display position of N display data; transmit the trigger signal to the target application to update the display data output by the target application; in the main operating system, synthesize updated fused data from the M display data corresponding to the M first applications and the N display data corresponding to the N second applications, wherein the updated fused data includes the updated display data corresponding to the target application; and transmit the updated fused data to the vehicle-mounted physical screen for display.

[0077] In addition, if Figure 3 As shown, the embodiment of the present application also provides a data display device 300, which is configured in the cockpit control chip. The cockpit control chip is communicatively connected to the on-board physical screen. The cockpit control chip is installed with a main operating system and a host operating system running in a virtual machine. The cockpit control chip is used to output fused data. The fused data includes M channels of display data corresponding to M first applications of the main operating system that have a stacked relationship when displayed, and N channels of display data corresponding to N second applications of the host operating system, wherein M and N are both positive integers. It should be noted that the basic principles and technical effects of the data display device 300 provided in the embodiment of the present application are the same as those in the above-mentioned embodiment. For the sake of brief description, for matters not mentioned in the embodiment of the present application, reference may be made to the corresponding contents in the above-mentioned embodiment. Specifically, as Figure 3 As shown, the apparatus 300 provided in the embodiment of the present application includes a signal generating unit 301, a program determining unit 302, a data updating unit 303, a data synthesizing unit 304, and a data display unit 305, wherein:

[0078] The signal generating unit 301 is used to generate a trigger signal based on the main operating system in response to the user's trigger operation on the vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation.

[0079] The program determination unit 302 is used to determine the target application associated with the display data at the top layer of the coordinates that receive the trigger operation from M first applications and N second applications based on the main operating system according to the stacking relationship, the preset display position of M display data and the display position of N display data.

[0080] The data updating unit 303 is used to transmit a trigger signal to the target application based on the main operating system to update the display data output by the target application.

[0081] The data synthesis unit 304 is used to synthesize the M display data corresponding to the M first applications and the N display data corresponding to the N second applications into updated fused data in the main operating system, wherein the updated fused data includes the updated display data corresponding to the target application.

[0082] The data display unit 305 is used to transmit the updated fusion data to the vehicle-mounted physical screen for display.

[0083] In one possible implementation, the data update unit 303 is specifically used to determine the type of operating system on which the target application is installed in the virtual display manager; when the operating system on which the target application is installed is the host operating system, a trigger signal is transmitted to the virtual graphics processing front end of the host operating system via the virtual graphics processing back end of the host operating system; and the trigger signal is transmitted from the virtual graphics processing front end of the host operating system to the target application.

[0084] Furthermore, the cockpit control chip is pre-configured with a virtual screen corresponding to the vehicle-mounted physical screen. The data synthesis unit 304 is specifically used to write N display data corresponding to N second applications into the virtual screen cache based on the virtual graphics processing front end of the host operating system, wherein the N display data includes the updated display data corresponding to the target application; based on the virtual graphics processing back end of the host operating system, read the N display data corresponding to N second applications from the virtual screen, and transmit the N display data corresponding to the N second applications to the graphics synthesizer of the main operating system; based on the graphics synthesizer of the main operating system, synthesize the M display data corresponding to the M first applications and the N display data corresponding to the N second applications into updated fusion data.

[0085] In a possible implementation, the data updating unit 303 is used to determine the type of the operating system in which the target application is installed in the virtual display manager; when the operating system in which the target application is installed is the main operating system, transmit a trigger signal from the virtual display manager to the target application.

[0086] Furthermore, each channel of display data is at least associated with a display position, a display size, a display color, and a stacking relationship with other display data. The data synthesis unit 304 is specifically configured to synthesize N channels of display data corresponding to the N second applications and M channels of display data corresponding to the M first applications into updated fused data according to the display position, display size, display color, and stacking relationship with other display data associated with each channel of display data.

[0087] Figure 4 4 is a block diagram of a vehicle computer according to an exemplary embodiment. The vehicle computer may include one or more of the following components: a cabin control chip 402, a memory 404, a power component 406, a multimedia component 408, an audio component 410, an input / output (I / O) interface 412, a sensor component 414, and a communication component 416.

[0088] The cockpit control chip 402 generally controls the overall operation of the device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The cockpit control chip 402 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above method. For example, the cockpit control chip may include a central processing unit CPU, a graphics processing unit GPU, and a display processor DPU. In addition, the cockpit control chip 402 may include one or more modules (such as a physical transmission channel) to facilitate the interaction between the cockpit control chip 402 and other components. For example, the cockpit control chip 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the cockpit control chip 402.

[0089] The memory 404 is configured to store various types of data to support operations on the device 400. Examples of such data include instructions for any application or method operating on the device 400, data to be displayed, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0090] The power supply component 406 provides power to the various components of the device 400. The power supply component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 400.

[0091] The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In an embodiment of the present application, the screen includes multiple in-vehicle physical screens. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0092] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the device 400 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0093] The I / O interface 412 provides an interface between the cockpit control chip 402 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0094] Sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for device 400. For example, sensor assembly 414 can detect the open / closed state of device 400, the relative positioning of components, such as a display and a keypad of device 400, sensor assembly 414 can also detect changes in the position of device 400 or a component of device 400, the presence or absence of user contact with device 400, the orientation or acceleration / deceleration of device 400, and temperature changes of device 400.

[0095] The communication component 416 is configured to facilitate wired or wireless communication between the apparatus 400 and other devices. The apparatus 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel.

[0096] In an exemplary embodiment, the apparatus 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.

[0097] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the instructions can be executed by the cockpit control chip of the device to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk, and an optical data storage device. The non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the vehicle computer, enables the vehicle computer to execute Figure 2 The data display method shown.

[0098] The present application also provides a computer program product, including a computer program, which, when executed by a processor, Figure 2 The data display method shown.

[0099] In the above description, the technical details such as the patterning of each layer are not described in detail. However, those skilled in the art should understand that various technical means can be used to form layers, regions, etc. of desired shapes. In addition, in order to form the same structure, those skilled in the art can also design methods that are not completely the same as the methods described above. In addition, although the various embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage.

[0100] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0101] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A data display method, characterized in that: The method is applied to a data display system, the data display system includes a main operating system and a host operating system, the data display system is used to output fused data to a vehicle-mounted physical screen display of a vehicle computer, the fused data includes M display data corresponding to M first application programs of the main operating system in a stacked relationship when displayed, and N display data corresponding to N second application programs of the host operating system, wherein M and N are both positive integers, and the method includes: The main operating system generates a trigger signal in response to a user's trigger operation on the vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation; The main operating system determines, from the M first applications and the N second applications, a target application associated with the display data at the top layer of the coordinates receiving the trigger operation according to the stacking relationship, the preset display positions of the M display data, and the display positions of the N display data; The main operating system transmits the trigger signal to the target application to update display data output by the target application; In the main operating system, the M display data corresponding to the M first applications and the N display data corresponding to the N second applications are synthesized into updated fused data, wherein the updated fused data includes the updated display data corresponding to the target application; The main operating system transmits the updated fusion data to the vehicle-mounted physical screen for display.

2. The method according to claim 1, characterized in that The trigger signal generated by the virtual display manager of the main operating system, transmitting the trigger signal to the target application, comprises: The virtual display manager determines the type of operating system on which the target application is installed; When the operating system on which the target application is installed is the host operating system, the trigger signal is transmitted to the virtual graphics processing front end of the host operating system via the virtual graphics processing back end of the host operating system; The trigger signal is transmitted from the virtual graphics processing front end of the host operating system to the target application.

3. The method according to claim 2, characterized in that The method of synthesizing, in the main operating system, the M display data corresponding to the M first application programs and the N display data corresponding to the N second application programs into updated fusion data includes: The virtual graphics processing front end of the host operating system writes N display data corresponding to the N second applications into a virtual screen cache, wherein the N display data include updated display data corresponding to the target application; The virtual graphics processing backend of the host operating system reads N display data corresponding to the N second applications from the virtual screen, and transmits the N display data corresponding to the N second applications to the graphics synthesizer of the main operating system; The graphics synthesizer of the main operating system synthesizes the M display data corresponding to the M first application programs and the N display data corresponding to the N second application programs into updated fusion data.

4. The method according to claim 1, characterized in that: The trigger signal generated by the virtual display manager of the main operating system, transmitting the trigger signal to the target application, comprises: Determining, at the virtual display manager, a type of an operating system on which the target application is installed; When the operating system on which the target application is installed is the main operating system, the trigger signal is transmitted from the virtual display manager to the target application.

5. The method according to claim 1, characterized in that Each channel of display data is at least associated with a display position, a display size, a display color, and a stacking relationship with other display data. The method of synthesizing the updated fused data by synthesizing the M channels of display data corresponding to the M first applications and the N channels of display data corresponding to the N second applications includes: According to the display position, display size, display color associated with each display data and the overlapping relationship with other display data, the N display data corresponding to the N second applications and the M display data corresponding to the M first applications are synthesized into updated fused data.

6. The method according to claim 1, characterized in that The data display system is loaded on a cockpit control chip, the cockpit control chip includes a central processing unit and a graphics processing unit that are communicatively connected, and the M channels of display data corresponding to the M first applications and the N channels of display data corresponding to the N second applications are synthesized into updated fusion data, including: The central processor converts the M channels of display data into M+N layers of data and the N channels of display data into M+N layers of data in the main operating system; The central processing unit and the graphics processing unit synthesize the M+N layer data into updated fusion data.

7. The method according to claim 1, characterized in that The data display system is loaded on a cockpit control chip, the cockpit control chip includes a central processor, a physical transmission channel, and a display processor that are sequentially communicatively connected, the central processor is communicatively connected to the display processor via the physical transmission channel, and the M channels of display data corresponding to the M first applications and the N channels of display data corresponding to the N second applications are synthesized into updated fusion data, including: In the main operating system, the central processing unit converts the M channels of display data into M first handles, and converts the N channels of display data into N second handles; The central processing unit transmits the M first handles and the N second handles to the display processor through the physical transmission channel; The display processor synthesizes updated fusion data according to the M first handles and the N second handles.

8. A data display system, characterized in that: It includes a main operating system and a host operating system, the data display system is used to output fusion data to the vehicle-mounted physical screen display of the vehicle computer, the fusion data includes M display data corresponding to M first applications of the main operating system in a stacked relationship when displayed, and N display data corresponding to N second applications of the host operating system, wherein M and N are both positive integers, wherein, The main operating system is used to generate a trigger signal in response to a user's trigger operation on the vehicle-mounted physical screen, wherein the trigger signal carries the coordinates of the vehicle-mounted physical screen receiving the trigger operation; determine, from the M first applications and the N second applications, a target application associated with the display data at the top layer of the coordinates that received the trigger operation according to the stacking relationship, the preset display positions of the M display data, and the display positions of the N display data; transmit the trigger signal to the target application to update the display data output by the target application; in the main operating system, synthesize updated fused data with the M display data corresponding to the M first applications and the N display data corresponding to the N second applications, wherein the updated fused data includes the updated display data corresponding to the target application; and transmit the updated fused data to the vehicle-mounted physical screen for display.

9. A vehicle computer, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the data display method according to any one of claims 1 to 7. 10 . A storage medium, when instructions in the storage medium are executed by a processor of a vehicle computer, the vehicle computer can execute the data display method according to any one of claims 1 to 7.

Images