Vehicle-mounted display method, vehicle-mounted display device, vehicle-mounted display system, storage medium, and computer program product

Abstract

Embodiments of the present disclosure provide a vehicle-mounted display method, applied to a vehicle-mounted display system. The method comprises: monitoring an input operation, and determining a target application corresponding to input information; determining a target first layer of the target application and layer parameters, wherein the target first layer is a first layer corresponding to the target application among a plurality of first layers, the plurality of first layers are layers provided by a first operating system for applications, first images of the applications are drawn in the first layers, and the layer parameters comprise a drawing state and a level of the target first layer; adjusting the target first layer to a target level on the basis of the drawing state and the level of the target first layer; outputting the target first layer at the target level to a position under a second layer provided by a second operating system, wherein a second image is drawn in the second layer; and on the basis of the target first layer and configuration information of the target application as well as the second layer, displaying the second image and / or the first image of the target application on a dashboard screen corresponding to the second operating system.

Description

A vehicle display method, vehicle display device, vehicle display system, storage medium and computer program product

[0001] Cross-reference to Related Applications

[0002] The present disclosure claims priority to the Chinese patent application No. 202411081353.9, filed on August 7, 2024, entitled "A vehicle display method, vehicle display system and storage medium", the entire content of which is incorporated herein by reference. TECHNICAL FIELD

[0003] The present disclosure relates to, but is not limited to, the field of automobiles, and in particular, to a vehicle display method, vehicle display device, vehicle display system, storage medium and computer program product. BACKGROUND

[0004] With the increasing use of automobiles, the requirements for instrument screens and central control display screens (hereinafter referred to as "central control screens") as important components of automobiles are also increasing. The instrument screen is generally installed in front of the steering wheel and is used to display corresponding running parameters of the automobile, such as vehicle speed, fuel tank temperature, and door lock status, etc. The central control screen is generally installed on the right side of the steering wheel and is used to display information of various applications in the vehicle entertainment information system, such as vehicle navigation, multimedia video and audio, Bluetooth phone, time, and weather.

[0005] Therefore, in order to integrate the advantages of both and realize information intercommunication between the central control screen and the instrument panel, such as integrating key information such as vehicle navigation, multimedia, Bluetooth call, and weather forecast into the instrument display screen, it has become an urgent need to improve driving convenience and safety. Therefore, it is urgent to provide a vehicle display method for information interaction between the instrument screen and the central control screen.

[0006] SUMMARY

[0007] One embodiment of the present disclosure is to provide at least one vehicle display method, vehicle display device, vehicle display system, storage medium and computer program product, which has the advantages that, in the embodiment of the present disclosure, the system can quickly respond and improve the sensitivity and accuracy of user interaction by first monitoring the input operation of the vehicle user in real time and quickly identifying the target application corresponding to the operation. Then the system can intelligently identify the first layer of the target application and its layer parameters, including the drawing state and the hierarchical position. In order to automatically adjust the layer order and ensure that the key information or the content of interest to the user can always be visually presented first. Further, the first layer of the target application is adjusted to the top layer of all levels to ensure its content is displayed first on the instrument screen, improving driving safety. At the same time, by placing it below the second layer, the order of information superimposition is realized, which neither blocks important driving information nor effectively utilizes screen space. Finally, through efficient cooperation between the first operating system and the second operating system, seamless integration and display of images from different sources are ensured. Through the understanding and application of the target application configuration information by the second operating system, the display content on the instrument screen can be customized to improve the consistency and personalization level of user experience; at the same time, the risk of distracting the driver is reduced, thereby improving the driving safety and the convenience of user operation.

[0008] To achieve the above object, the technical scheme of the embodiment of the present disclosure is as follows:

[0009] The embodiment of the present disclosure provides a vehicle display method applied to a vehicle display system, wherein the vehicle display system runs a first operating system and a second operating system, and the method comprises the following steps:

[0010] Monitoring the input operation of the vehicle user and determining the target application corresponding to the input information of the vehicle user;

[0011] Determining the target first layer of the target application and the layer parameters of the target first layer through the first operating system; wherein the target first layer is the first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws the first image of the application, and the layer parameters include the drawing state and the hierarchical position of the target first layer;

[0012] Adjusting the target first layer to the target level according to the drawing state and the hierarchical position of the target first layer through the first operating system; wherein the target level is the first level of all levels corresponding to the plurality of first layers arranged in order;

[0013] The first operating system is configured to output a target first layer at the target level to below a second layer provided by the second operating system, wherein the second layer is drawn with a second image.

[0014] The second operating system is configured to display the second image and / or a first image of the target application on an instrument screen corresponding to the second operating system according to configuration information of the target application and the target first layer, and the second layer.

[0015] Embodiments of the present disclosure provide a vehicle-mounted display device, the device comprising:

[0016] A monitoring module configured to monitor input operations of a vehicle user;

[0017] A determining module configured to determine a target application corresponding to input information of the vehicle user;

[0018] The determining module is further configured to determine, by the first operating system, a target first layer of the target application and layer parameters of the target first layer, wherein the target first layer is a first layer of the target application in a plurality of first layers provided by the first operating system for each application, the plurality of first layers are layers provided by the first operating system for each application, the first layer is drawn with a first image of the application, and the layer parameters include a drawing state and a level of the target first layer.

[0019] A processing module configured to adjust, by the first operating system, the target first layer to a target level according to the drawing state and the level of the target first layer, wherein the target level is a first level in order of all levels corresponding to the plurality of first layers.

[0020] An output module configured to output, by the first operating system, the target first layer at the target level to below a second layer provided by the second operating system, wherein the second layer is drawn with a second image.

[0021] A display module configured to display, by the second operating system, the second image and / or a first image of the target application on an instrument screen corresponding to the second operating system according to configuration information of the target application and the target first layer, and the second layer.

[0022] Embodiments of the present disclosure provide a vehicle-mounted display system, comprising a processor and a memory, wherein the memory stores a computer program capable of running on the processor, and the processor executes the computer program to implement part or all of the steps in the above method.

[0023] The embodiment of the present disclosure provides a storage medium, which stores one or more computer programs, and the one or more computer programs can be executed by one or more processors to implement part or all of the steps in the method.

[0024] The embodiment of the present disclosure provides a computer program product, which comprises a computer program or instructions, and the computer program or instructions are executed by a processor to implement part or all of the steps in the method.

[0025] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, but not limiting the technical solutions of the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0026] The accompanying drawings incorporated in the specification and forming a part of the specification illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure.

[0027] FIG. 1A is a schematic diagram of an application scenario of a vehicle display method according to an embodiment of the present disclosure;

[0028] FIG. 1B is a schematic diagram of another application scenario of a vehicle display method according to an embodiment of the present disclosure;

[0029] FIG. 2 is a schematic diagram of a flow of a vehicle display method according to an embodiment of the present disclosure;

[0030] FIG. 3 is a schematic diagram of layers between different operating systems according to an embodiment of the present disclosure;

[0031] FIG. 4 is a schematic diagram of one or more target first layers according to an embodiment of the present disclosure;

[0032] FIG. 5 is a schematic diagram of a flow of another vehicle display method according to an embodiment of the present disclosure;

[0033] FIG. 6 is a schematic diagram of a relationship between drawing areas of layers according to an embodiment of the present disclosure;

[0034] FIG. 7 is a schematic diagram of a flow of still another vehicle display method according to an embodiment of the present disclosure;

[0035] FIG. 8 is a schematic diagram of a relationship between drawing areas of layers according to an embodiment of the present disclosure;

[0036] FIG. 9 is a schematic diagram of a flow of a vehicle display method according to another embodiment of the present disclosure;

[0037] FIG. 10 is a system block diagram of a vehicle display system according to an embodiment of the present disclosure;

[0038] Fig. 11 is a flow diagram of another vehicle display method according to another embodiment of the present disclosure;

[0039] Fig. 12 is a structural diagram of a vehicle display device according to an embodiment of the present disclosure;

[0040] Fig. 13 is a hardware entity diagram of a vehicle display system according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0041] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure are further described in detail below in combination with the drawings and embodiments, and the described embodiments should not be regarded as limiting the present disclosure. All other embodiments obtained by those of ordinary skill in the art without making creative labor fall within the scope of protection of the present disclosure.

[0042] In the following description, "some embodiments" are referred to, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict. The term "first / second / third" referred to is only to distinguish similar objects, and does not represent a specific order of the objects. It can be understood that "first / second / third" can be interchanged in a specific order or sequence as allowed, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein.

[0043] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present disclosure belongs. The terms used herein are only for the purpose of describing the present disclosure and are not intended to limit the present disclosure.

[0044] In order to better understand the technical solutions of the present disclosure, some related technologies are described below.

[0045] With the more and more extensive use of automobiles, as an important part of the automobile, the requirements for the instrument screen and the central control screen are also getting higher and higher. Among them, the instrument screen is generally installed in front of the steering wheel, i.e. directly in front of the driver, for displaying corresponding running parameters of the automobile, such as vehicle speed, fuel tank temperature, and door lock status, etc. The central control screen is generally installed on the right side of the steering wheel, i.e. on the right side of the driver, for displaying various application contents, such as navigation maps.

[0046] When the driver opens the application of the center screen, the application content is displayed on the center screen, for example, a navigation map; during driving, the driver not only needs to observe the road ahead, but also needs to frequently turn his eyes to the right to observe the navigation map of the center screen, and such behavior during driving has certain safety hazards. Therefore, in order to realize the information intercommunication between the center screen and the instrument panel, such as integrating key information such as vehicle navigation, multimedia, Bluetooth call and weather forecast into the instrument display screen, it has become an urgent need to improve the driving convenience and safety.

[0047] In order to better understand the technical solutions of the present disclosure, the application scenarios of the present disclosure are described below.

[0048] The vehicle display method of the present disclosure can be applied to the field of automobiles. Referring to FIG. 1, a schematic diagram of an application scenario of an optional vehicle display method provided by an embodiment of the present disclosure is shown. Here, the vehicle display system can be equipped with multiple screens, such as multiple display screens arranged in the cabin of the automobile, which are used to display the instrument content corresponding to the digital instrument panel, and the content of the vehicle entertainment audio system and the vehicle control content. As shown in FIG. 1A, multiple display screens are arranged in the cabin, such as a center screen 101 on the center console and an instrument screen 102 on the instrument panel. It can be understood that other display screens can also be included in the cabin, such as a display screen (which can be referred to as a co-driver screen 103) in front of the passenger (also referred to as the front passenger) on the co-driver seat, a rear headrest screen on the back of the seat of the driver seat and the co-driver seat, etc.

[0049] Here, referring to FIG. 1B, the vehicle display system 100 runs a first operating system 10 and a second operating system 20, the first operating system 10 and the second operating system 20 are two different operating systems from each other, and the first operating system 10 and the second operating system 20 can communicate through an instrument service 30 in the first operating system 10. Among them, the first operating system can be a mobile operating system, including but not limited to Android system, Linux system, Windows system and Harmony system; the second operating system can be a real-time operating system with high security. Among them, the second operating system includes but is not limited to QNX system, RTOS system, QNX system or Linux system. Among them, the RTOS system can adopt FreeRTOS system (small real-time operating system).

[0050] Here, the first operating system can enjoy a screen alone, such as a central control screen, a co-driver screen, or a rear seat screen, to display vehicle control content and vehicle entertainment video content on the screen, and the first operating system can also enjoy multiple screens, such as multiple ones of the central control screen, the co-driver screen, and the rear seat screen. The present disclosure does not limit this. Here, the first operating system is described as being able to enjoy the central control screen alone, which can be used to display applications installed in the vehicle machine. A user can use the applications by operating the central control screen. The second operating system can enjoy a screen alone, such as an instrument screen, to display instrument content on the screen. The instrument content relates to functions related to safe driving, and can include, but is not limited to, vehicle speed, engine speed dial, oil level, temperature, vehicle light indication, engine state, driving distance, and information related to an advanced driving assistance system (ADAS).

[0051] In the embodiments of the present disclosure, the first operating system and the second operating system can interact with each other through an instrument service to implement corresponding operations. For example, when the vehicle display system receives a screen projection operation, such as a screen projection operation of projecting content in the central control screen, the co-driver screen, or the rear seat screen onto the instrument screen, or a screen projection operation of projecting content in the instrument screen onto the central control screen, the co-driver screen, or the rear seat screen, at this time, the first operating system and the second operating system can interact with each other through the instrument service to project and display vehicle entertainment video content in the first operating system on the instrument screen corresponding to the second operating system, or to project and display instrument content in the second operating system on one or more of the central control screen, the co-driver screen, or the rear seat screen corresponding to the first operating system.

[0052] FIG. 2 illustrates a vehicle display method according to an embodiment of the present disclosure, which specifically includes steps 201 to 205.

[0053] In step 201, an input operation of a vehicle user is monitored to determine a target application corresponding to input information of the vehicle user.

[0054] In the embodiments of the present disclosure, the input operation can be an operation for projecting an application, and the input manner of the input operation includes, but is not limited to, voice input, gesture input operation, touch input operation, and steering wheel control input.

[0055] In the embodiments of the present disclosure, the input information of the vehicle user includes an application identifier, an operation type, an operation time, and an operation source device identifier, so that the vehicle display system determines a target application corresponding to the input operation according to the application identifier. The application identifier includes but is not limited to an application name and an application image; the operation type includes but is not limited to starting screen projection and stopping screen projection; and the operation source device identifier can be a gesture input, a voice input, and a touch input for the first operating system, a device identifier of a center control screen corresponding to the first operating system, a steering wheel control input for the second operating system, and a device identifier of an instrument screen corresponding to the second operating system.

[0056] In the embodiments of the present disclosure, the target application is one or more applications corresponding to the input information of the vehicle user. It should be noted that if the target application is installed in the first operating system, and the first operating system is equipped with one or more of the center control screen, the co-driver screen, and the rear seat screen, therefore, the content of the target application in the center control screen, the co-driver screen, or the rear seat screen can be subsequently projected and displayed on the instrument screen corresponding to the second operating system. If the target application is installed in the second operating system, and the second operating system is equipped with the instrument screen, therefore, the content of the target application in the instrument screen can be subsequently projected and displayed on the center control screen, the co-driver screen, or the rear seat screen corresponding to the first operating system.

[0057] In one implementation manner, the vehicle display system monitors the input operation of the vehicle user on the vehicle display system, analyzes the detected input operation, extracts the input information in the input operation, such as the application identifier, the operation type, the operation time, and the operation source device identifier, and further determines one or more target applications in the first operating system corresponding to the application identifier according to the application identifier.

[0058] In another implementation manner, the vehicle-mounted display system monitors input operations of the vehicle user on the vehicle-mounted display system, analyzes the detected input operations to extract input information in the input operations, such as an application identifier, an operation type, an operation time, and an operation source device identifier, and the like; then, the vehicle-mounted display system determines one or more first applications in the first operating system corresponding to the application identifier according to the application identifier. Further, the vehicle-mounted display system performs state analysis on the one or more first applications in the first operating system to obtain a state analysis result. Here, the state of the application includes but is not limited to the running state, the foreground / background state, and whether there is a permission or setting related to screen projection of each application. Further, the vehicle-mounted display system determines a target application from the one or more first applications according to the state analysis result. Step 202, determining, by the first operating system, a target first layer of the target application and a layer parameter of the target first layer; wherein the target first layer is a first layer corresponding to the target application in the plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws a first image of the application, and the layer parameter includes a drawing state and a level of the target first layer.

[0059] In the embodiments of the present disclosure, the first layer is a corresponding layer provided by the first operating system for each application in part or all of the applications. The plurality of first layers are a plurality of layers provided by the first operating system for different categories of applications, and the plurality of first layers are arranged in a hierarchical order, so that the first layers of different applications are located in different levels. For example, the first operating system provides a corresponding first layer for n applications. Referring to FIG. 3, for n applications, the first operating system provides a first layer for each application, thereby providing n first layers, such as layer 1-1, layer 1-2, …, layer 1-n, and the n first layers are arranged in a hierarchical order.

[0060] In the embodiments of the present disclosure, the first layer draws a first image of the corresponding application, and the first image can include the vehicle control content described above. The first image can include the vehicle-mounted entertainment video content described above. It should be noted that the content of the first image in the first layer corresponding to each application can be fixed or real-time updated, and the present disclosure does not make specific limitations.

[0061] In the embodiments of the present disclosure, the layer parameter includes a drawing state and a level of the target first layer of the target application. The drawing state of the target first layer includes drawing a first image in the target first layer and having drawn the first image in the target first layer. The level of the target first layer is the level of the target first layer in the n first layers. It should be noted that the level of the target first layer can be dynamically changed.

[0062] In the embodiments of the present disclosure, the first operating system provides a corresponding first layer for each of the part or all of the applications in the system, thereby obtaining a plurality of first layers corresponding to the part or all of the applications. Further, in the first operating system environment, after determining the target application corresponding to the input information of the vehicle user, the target first layer corresponding to the target application is determined from the plurality of first layers through the first operating system, that is, the target first layer is accurately distinguished from the first layers corresponding to the plurality of applications managed by the first operating system. The first layer of each application represents a dedicated display interface allocated by the first operating system for an independent application program, and carries and draws the first image of the respective application. Further, it is also necessary to determine the drawing state (whether being drawn or drawn) of the first image in the target first layer and the level at which the target first layer is located, thereby accurately defining the interface state and level relationship of the target application.

[0063] In step 203, the target first layer is adjusted to the target level according to the drawing state and the level of the target first layer through the first operating system; wherein the target level is the first level in which all levels corresponding to the plurality of first layers are arranged in order.

[0064] In the embodiments of the present disclosure, the target level can be understood as the first level in which all levels corresponding to the plurality of first layers are arranged in order. For example, referring to FIG. 3, the target level is the first level in which all levels corresponding to the plurality of first layers provided by the first operating system are arranged in order, such as the level at which the layer identified as 1-1 is located.

[0065] In the embodiments of the present disclosure, the target application can be one or more, and the target first layer corresponding to the target application can also be one or more.

[0066] In one case, if the target application is one, that is, the target first layer is also one, referring to the left drawing in FIGS. 3 and 4, the layer corresponding to the target first layer identified as 1-3. The vehicle-mounted display system adjusts the target first layer such as layer 1-3 from the current level such as the third level to the first level, that is, the target level, through the first operating system according to the drawing state and the level of the target first layer such as layer 1-3. The layers located before the target first layer, that is, layer 1-3, are all adjusted one level down according to the level order, such as layer 1-1 adjusted from the first level to the second level and layer 1-2 adjusted from the second level to the third level.

[0067] In another case, if the target application is multiple, that is, the target first layer is also multiple, referring to the right part of FIG. 3 and FIG. 4, the layers corresponding to the target first layer with the identifiers 1-2 and 1-3 are taken as examples. The vehicle-mounted display system adjusts the target first layer from the current layer to the first layer, that is, the target layer, according to the drawing state and the layer level of each target first layer, through the first operating system, so as to adjust multiple target first layers to the first layer, such as adjusting the first target first layer, that is, the layer 1-2, from the second layer to the first layer, and adjusting the second target first layer, that is, the layer 1-3, from the third layer to the first layer. The layers before the target first layer, that is, the layers 1-2 and 1-3, are all adjusted downward by one layer according to the layer level order, such as adjusting the layer 1-1 from the first layer to the second layer. The layers after the target first layer, that is, the layers 1-2 and 1-3, are all adjusted upward by one layer according to the layer level order, such as adjusting the layer 1-n from the n-th layer to the (n-1)-th layer. Further, the multiple target first layers are arranged, such as adjusting the sizes of the layers 1-2 and 1-3, so as to place the first layers of multiple applications in the first layer at the same time, so as to synchronously display the first images corresponding to each application on the instrument screen subsequently. In this way, by finely controlling the display order and position of the layers, it can be ensured that the information seen by the user on the instrument screen is the latest and the layout is reasonable. This helps to improve the visual experience and operation fluency of the user, so that important information can be presented to the user immediately and clearly.

[0068] In step 204, the target first layer in the target layer is output to the lower side of the second layer provided by the second operating system through the first operating system, wherein the second layer draws a second image.

[0069] In the embodiments of the present disclosure, the second layer is a layer provided by the second operating system for instrument content, the second layer draws a second image, and the second image can include the instrument content described above. For example, referring to FIG. 3 and FIG. 4, the second layer provided by the second operating system for instrument content is, for example, the layer 2.

[0070] In the embodiments of the present disclosure, the target first layer in the target layer is output to the lower side of the second layer provided by the second operating system through the first operating system, so as to cover the second layer on the multiple first layers.

[0071] In an implementable scenario, for the target first layer in the first operating system, the target first layer in the first operating system can be distributed and set through a digital signal processing (DSP) module in the first operating system. The DSP module can transmit the target first layer in the first operating system to the lower side of the second layer provided by the second operating system, as shown in FIG. 3.

[0072] Step 205, displaying the second image and / or the first image of the target application on the instrument screen corresponding to the second operating system according to the configuration information of the target application and the target first layer and the second layer by the second operating system.

[0073] In the embodiments of the present disclosure, the configuration information of the target application is used to indicate the display size and display position of the first image corresponding to the target application in the first operating system, so as to display the first image and / or the second image corresponding to the target application on the instrument screen according to the configuration information.

[0074] In the embodiments of the present disclosure, the vehicle display system outputs the target first layer in the target layer level to the lower of the second layer provided by the second operating system through the first operating system, and in the case that the second image is drawn on the second layer by the second operating system, the target first layer and the second layer are fused according to the configuration information of the target application by the second operating system, so as to display the second image and / or the first image of the target application on the display interface of the instrument screen corresponding to the second operating system. In this way, through the integrated display across the operating systems, the user can see important information from different sources on the instrument screen at the same time, that is, the superimposed display of the first image and the second image, so that the driver does not need to frequently check the information displayed on the two screens, improving the convenience and safety during driving. Secondly, the linkage between the two operating systems shows a high degree of system integration, making the infotainment system of the vehicle more unified and coordinated, providing a seamless driving and entertainment environment for the user. Further, the preset configuration information allows the system to automatically adjust the display content and layout according to user preferences, driving scenarios or vehicle status, enhancing the flexibility and personalized setting ability of the interface. Finally, the hierarchical architecture design is conducive to isolating different functional modules, so that even if a certain operating system or application has a problem, it will not affect the normal operation of the entire vehicle display system, increasing the robustness and safety of the system.

[0075] In other embodiments of the present disclosure, step 201 of monitoring the input operation of the vehicle user and determining the target application corresponding to the input information of the vehicle user can be achieved by the following steps,

[0076] Step A1, monitoring the input operation.

[0077] Step A2, if the input operation is a voice operation or a touch operation performed on the first operating system, determining the target application corresponding to the input information by the first operating system.

[0078] In the embodiments of the present disclosure, if the vehicle display system monitors the input operation of the vehicle user, if the input operation is a voice operation or a touch operation on the first operating system, the vehicle display system can respond to the voice operation or the touch operation of the user, and the vehicle display system can determine the target application by identifying the input information through the first operating system. In this way, the user directly interacts with the vehicle system through voice or touch, which can quickly trigger the corresponding function or application, reduce the operation steps, and improve the immediacy and smoothness of the user experience.

[0079] Step A3, if the input operation is a touch operation on the second operating system, determining the target application based on the input information through the second operating system, and sending a second message to the first operating system; determining the target application based on the second message through the first operating system, wherein the second message is used to notify the target application in the first operating system to be displayed.

[0080] In the embodiments of the present disclosure, if the vehicle display system monitors the input operation of the vehicle user, if the input operation is a touch operation on the second operating system, determining the target application based on the input information through the second operating system, and sending a second message to the first operating system; determining the target application based on the second message through the first operating system, wherein the second message is used to notify the target application in the first operating system to be displayed.

[0081] In other embodiments of the present disclosure, referring to FIG. 5, in the case of one target application, step 205 displays the second image and / or the first image of the target application on the instrument screen corresponding to the second operating system according to the preset configuration information, the target first layer, and the second layer through the second operating system, which is specifically described in steps 301 to 303.

[0082] Step 301, performing hole digging and hollowing on the first display area in the second layer through the second operating system.

[0083] The first display area includes the corresponding area in the second layer determined based on the image display size and the image display position of the first image corresponding to the target application in the target first layer, and the configuration information includes the image display size and the image display position.

[0084] In the embodiments of the present disclosure, the first display area corresponding to the first image can be a fixed display area, or the first display area corresponding to the first image can be a non-fixed and variable display area, and the present disclosure does not make specific limitations.

[0085] In the embodiments of the present disclosure, the configuration information of the target application includes the image display size and the image display position of the first image corresponding to the target application. The image display size and the image display position can be set by default by the second operating system, or the image display size and the image display position can be determined according to the user's settings by the second operating system. The present disclosure does not make specific limitations in this regard. It should be noted that the image display size of the first image is smaller than the size of the second layer, and the image display size of the first image is smaller than the size of the standard display area of the instrument screen.

[0086] In the embodiments of the present disclosure, the vehicle-mounted display system determines the first display area in the second layer according to the image display size and the image display position of the first image corresponding to the target application in the target first layer through the second operating system, and further performs hole digging or hollowing or transparent processing on the first display area in the second layer through the second operating system, so as to display the first image of the target application on the display interface of the instrument screen corresponding to the second operating system. In this way, by performing hole digging or hollowing processing on a specific area in the second layer, seamless integration of the first image and the original content of the second layer can be achieved, and the overall visual effect and information integration of the instrument screen can be improved. This design makes the first image of the target application like a direct "inlay" in the instrument screen interface, reduces visual interference, and enables the driver to more intuitively and quickly obtain key information. Further, the clearly defined first display area helps to distinguish the priority and relevance of information from different sources, ensuring that important information such as navigation instructions and warning signals is not blocked by other interface elements, and maintaining the clarity and efficiency of information transmission.

[0087] In some embodiments, step 301 of performing hole digging or hollowing on the first display area in the second layer through the second operating system can be implemented by the following steps,

[0088] Step B1, determining a plurality of first sub-images corresponding to a plurality of functions of the target application in the first image through the second operating system, thereby determining the plurality of first sub-images.

[0089] In the embodiments of the present disclosure, the plurality of functions of the target application can be the functions set by default by the application, or the plurality of functions customized by the user, or the functions frequently used by the user in the target application according to the user's usage habits, and the present disclosure does not make specific limitations in this regard.

[0090] In the case where the target application is one, the first sub-images corresponding to the multiple functions of the target application in the first image are accurately identified and separated through the second operating system, thereby obtaining the multiple first sub-images.

[0091] Step B2, the multiple first sub-images are segmented, and the image display size and the image display position of each first sub-image are determined.

[0092] Step B3, the multiple first display areas in the second layer are determined according to the image display size and the image display position of each first sub-image, and each first display area is hollowed out.

[0093] In the embodiments of the present disclosure, after the multiple first sub-images corresponding to the multiple functions of the target application in the first image are identified through the second operating system, the multiple first sub-images are accurately segmented, and the image display size and the image display position of each first sub-image are determined; further, the multiple first display areas in the second layer are determined according to the image display size and the image display position of each first sub-image, and each first display area is hollowed out.

[0094] As can be seen from the above, the embodiments of the present disclosure identify and distinguish the sub-images of different functions of the target application through the second operating system, and the system can more effectively manage and allocate display resources. For example, for important or high-frequency functions, higher display priority or better display effect can be given. At the same time, the separate processing of the sub-images simplifies the image processing process, so that the system can respond more quickly to the processing of the sub-images when the user switches or operates each function, reduces the delay, and improves the overall fluency.

[0095] In some embodiments, step 301, through the second operating system, hollowing out the first display area in the second layer, can be implemented by the following steps,

[0096] Step C1, through the second operating system, based on the display size of the second layer, determining whether the image display size and / or the image display position of the first image in the target first layer need to be adjusted.

[0097] In the embodiments of the present disclosure, the determination result includes a result that the image display size and / or the image display position of the first image in the target first layer need to be adjusted, and a result that the image display size and / or the image display position of the first image in the target first layer do not need to be adjusted.

[0098] In the embodiments of the present disclosure, the display size of the second layer can be the same as or different from the display size of the first layer. If the display size of the second layer is greater than the image display size of the first image in the target first layer, a determination result that the image display size and / or the image display position of the first image in the target first layer does not need to be adjusted is obtained. If the display size of the second layer is less than or equal to the image display size of the first image in the target first layer, a determination result that the image display size and / or the image display position of the first image in the target first layer needs to be adjusted is obtained. Of course, whether the image display size and / or the image display position of the first image in the target first layer needs to be adjusted can also be determined according to the user's eye line habits.

[0099] In step C2, the first display area in the second layer is determined according to the determination result, and the first display area is hollowed out. The first display area includes a region corresponding to the display size and display position of the first image without adjustment in the second layer, and a region corresponding to the display size and display position of the first image after adjustment in the second layer.

[0100] In the embodiments of the present disclosure, the first display area can be a region corresponding to the display size and display position of the first image without adjustment in the second layer, and the second display area can be a region corresponding to the display size and display position of the first image after adjustment in the second layer.

[0101] In the embodiments of the present disclosure, the second operating system determines the determination result of whether the image display size and / or the image display position of the first image in the target first layer needs to be adjusted based on the display size of the second layer. Further, the first display area in the second layer is determined according to the determination result, and the first display area is hollowed out. In this way, through the intelligent adaptive adjustment of the display size and image position by the second operating system, it can be ensured that the display of the first image on the second layer not only conforms to the physical size limitation of the second layer, but also maintains the best visual proportion and clarity, improving the overall visual experience and readability. By dynamically adjusting the size and position of the first image, it coexists harmoniously with other elements (i.e., the second image) on the second layer, avoiding picture congestion or important content being blocked, and maintaining the neatness and coordination of the instrument panel interface. Finally, reasonable image size and position layout reduces the eye movement range and cognitive load of the driver when viewing information, which helps to maintain the driver's attention during driving, thereby improving driving safety.

[0102] In step 302, the second image generated by the second operating system is re-rendered in the second display area of the second layer.

[0103] The second display area is a remaining area in the second layer except the first display area, and the second display area and the first display area do not overlap each other.

[0104] In the embodiments of the present disclosure, since the second image has been drawn in the second layer by the second operating system, after the first display area in the second layer is dug and hollowed by the second operating system, the second display area in the second layer except the first display area needs to be determined by the second operating system, and the second display area and the first display area do not overlap each other; further, the second image is redrawn in the second display area of the second layer by the second operating system. In this way, the integrity of the original information or background image of the second layer is not affected even after the first image is displayed. This helps to properly display the necessary vehicle control information and interface elements, and maintains the integrity of the content of the instrument panel interface. Further, the second image is rearranged and redrawn to ensure the visual continuity of the interface and avoid the interface fragmentation caused by the digging operation.

[0105] In step 303, the second layer and the target first layer are superimposed, so that the second image and / or the first image of the target application are displayed in partitions on the instrument panel.

[0106] In the embodiments of the present disclosure, after the second image generated by the second operating system is rendered in the second display area of the second layer, when the target first layer and the second layer are superimposed and displayed, the second layer can be superimposed on the target first layer, and the first image of the target first layer in the lower layer can be displayed through the first display area of the second layer, so that the second image and / or the first image of the target application are displayed in partitions on the instrument panel. In this way, the screen space of the instrument panel is effectively utilized, the key information from the target application is displayed, and the functional interface of the original instrument panel is maximally reserved, that is, by dynamically adjusting and optimizing the display area, the resource utilization rate is improved.

[0107] In other embodiments of the present disclosure, the first display area corresponding to the first image can be a fixed display area, and then the second display area in the second layer except the first display area can also be a fixed display area. At this time, the second image generated by the second operating system is rendered in the second display area of the second layer. After the first display area in the second layer is dug and hollowed by the second operating system in step 301, the second layer and the target first layer are directly superimposed. At this time, the first image corresponding to the target first layer can be displayed through the first display area of the instrument screen, and the second image can be displayed in the second display area, so as to display the second image and / or the first image of the target application in the instrument screen in a partitioned manner. In this way, the second image generated by the second operating system does not need to be re-rendered in the second display area of the second layer, which reduces the calculation burden of the second operating system on graphics processing and improves the overall performance of the system. At the same time, the screen space of the instrument screen is effectively utilized, the key information from the target application is displayed, and the functional interface of the original instrument screen is maximally reserved, thereby improving resource utilization.

[0108] In a realizable scenario, taking a target application as an example, referring to FIG. 6, wherein the left drawing is a schematic diagram of the display content of each area of the instrument screen, and the right drawing is a layer schematic diagram of the second layer and the target first layer involved in display on the instrument screen. As shown in FIG. 6, the vehicle-mounted display system draws the instrument content in the drawing area 611 of the second layer 610 and draws the first image corresponding to the target application in the drawing area 621 of the target first layer 620. Then, the first display area 61 in the second layer 610 corresponding to the drawing area 621 is dug and hollowed by the second operating system, so that the first image corresponding to the target application is displayed on the instrument screen through the first display area 61 in the second layer 610, and / or the second image is displayed on the instrument screen through the second display area 62 in the second layer 610. In this way, the application on other display screens is projected and displayed on the instrument screen, the screen space of the instrument screen is effectively utilized, the key information from the target application is displayed, and the functional interface of the original instrument screen is maximally reserved, thereby improving resource utilization.

[0109] In other embodiments of the present disclosure, referring to FIG. 7, in the case where the target application is multiple, step 205 displays the second image and / or the first image of the target application on the instrument screen corresponding to the second operating system according to the preset configuration information, the target first layer, and the second layer, which specifically includes steps 401 to 404.

[0110] Step 401: Adjusting, by the second operating system, the image display size and / or the image display position of the first image in each target first layer based on the display size of the second layer.

[0111] In the embodiments of the present disclosure, since the target applications are multiple and the target first layers located in the target level are also multiple, at this time, the image display size and / or the image display position of the first image in each target first layer are adjusted based on the display size of the second layer by the second operating system, so that the first images corresponding to the multiple target applications can be displayed on the instrument screen.

[0112] In a realizable scenario, taking two target applications as an example, refer to FIG. 8, wherein the left drawing is a schematic diagram of the display content of each region of the instrument screen, and the right drawing is a layer schematic diagram of the second layer and two target first layers involved in the display on the instrument screen. As shown in FIG. 8, the layer size of the target first layer 620 is adjusted, and / or the image display size and / or the image display position of the first image in the target first layer 620 is adjusted, and the layer size of the target first layer 630 is adjusted, and / or the image display size and / or the image display position of the first image in the target first layer 630 is adjusted, based on the display size of the second layer 610 by the second operating system, so as to arrange and arrange the multiple target first layers.

[0113] From the above, the embodiments of the present disclosure adjust the image display size and position in the first layer by the second operating system to adapt to the display size requirement of the second layer, especially to simultaneously display the first images of multiple applications on the instrument screen, that is, more application information can be integrated in the limited instrument screen space, so that the driver or user can quickly browse multiple key data or function interfaces without switching interfaces, thereby improving the information acquisition efficiency. Further, automatically adjusting the image size and position ensures that different applications can be well presented on the instrument screen with different sizes and resolutions, enhances the compatibility and adaptive ability of the system, and improves the consistency of user experience. At the same time, automatically adjusting the image size and position to realize reasonable layout of each application image, avoiding information overload and visual dispersion, helping the driver to keep attention on the road, reducing the safety risk caused by distraction due to operating the instrument panel. Intelligent adjustment avoids waste of screen resources, ensures that each application image is effectively displayed, and at the same time, enough space is reserved for emergency or high-priority information prompts such as warning signs.

[0114] Step 402, performing hole digging and hollowing on the multiple third display regions in the second layer.

[0115] Each third display region includes a corresponding region in the second layer determined based on the image display size and the image display position of the first image corresponding to the target application in the target first layer, and the configuration information includes the image display size and the image display position.

[0116] In the embodiments of the present disclosure, the configuration information of the target application includes the image display size and the image display position of the first image corresponding to the target application. The image display size and the image display position can be set by default by the second operating system, or can be determined by the second operating system according to the user's settings. The present disclosure does not make specific limitations in this regard. It should be noted that the image display size of the first image is smaller than the size of the second layer, and the image display size of the first image is smaller than the standard display area size of the instrument screen.

[0117] In the embodiments of the present disclosure, the vehicle-mounted display system determines, through the second operating system, the third display area of each target application in the second layer according to the image display size and the image display position of the first image corresponding to the target application in the target first layer, so as to obtain a plurality of third display areas corresponding to the target applications. Further, the second operating system performs hole digging and / or transparent processing on the plurality of third display areas in the second layer, so as to simultaneously display the first images of the plurality of target applications on the display interface of the instrument screen corresponding to the second operating system.

[0118] Step 403, re-rendering the second image generated by the second operating system in the second display area of the second layer.

[0119] The second display area is the remaining area of the second layer except the plurality of third display areas, and the second display area and each third display area do not overlap with each other.

[0120] In the embodiments of the present disclosure, since the second operating system has drawn the second image on the second layer, after the hole digging and / or transparent processing on each third display area in the second layer by the second operating system, the second operating system needs to determine the second display area in the second layer except each third display area, and the second display area and each third display area do not overlap with each other. Further, the second operating system redraws the second image in the second display area of the second layer. In this way, the integrity of the original information or background image of the second layer is not affected even after the first image is displayed. This helps to properly display all necessary driving information and interface elements, and maintains the integrity of the content of the instrument screen interface. Further, the re-layout and redrawing of the second image can ensure the continuity of the interface in the visual aspect, and avoid the interface fragmentation caused by the hole digging operation.

[0121] Step 404, superimposing the second layer and the plurality of target first layers, so as to display the second image and / or the first images of the plurality of target applications on the instrument screen in a partitioned manner.

[0122] In the embodiments of the present disclosure, after the second image generated by the second operating system is re-rendered in the second display area of the second layer, when the plurality of target first layers and the second layer are superimposed and displayed, the second layer can be superimposed on the plurality of target first layers, and the first images of each target first layer in the lower layer can be displayed through each third display area of the second layer, so that the second image and / or the plurality of first images of the plurality of target applications are displayed in partitions on the instrument screen. In this way, the screen space of the instrument screen is effectively utilized, the key information from the plurality of target applications is displayed, and the functional interface of the original instrument screen is maximally reserved, that is, the resource utilization is improved by dynamically adjusting and optimizing the display area.

[0123] In an implementable scenario, the target applications are two, and continuing to refer to FIG. 8, the vehicle-mounted display system draws the instrument content on the drawing area 611 of the second layer 610, draws the first image corresponding to the first target application on the drawing area 621 of the target first layer 620, and draws the first image corresponding to the second target application on the drawing area 631 of the target first layer 630. Then, the first display area 61 corresponding to the drawing area 621 and the first display area 61 corresponding to the drawing area 631 in the second layer 610 are hollowed out by the second operating system, so that the first images corresponding to the two target applications are respectively displayed on the instrument screen through the corresponding first display area 61 in the second layer 610, and / or the second image is displayed on the instrument screen through the second display area 62 in the second layer 610. In this way, the applications on the other display screens are projected and displayed on the instrument screen, the screen space of the instrument screen is effectively utilized, the key information from the target applications is displayed, the functional interface of the original instrument screen is maximally reserved, and the resource utilization is improved.

[0124] In other embodiments of the present disclosure, referring to FIG. 9, FIG. 9 shows a vehicle-mounted display method in the embodiments of the present disclosure, based on FIG. 2, before the step 202 of determining the target first layer of the target application and the layer parameter of the target first layer by the first operating system, steps 501 to 503 can also be performed,

[0125] In step 501, the instrument service in the first operating system and all applications are initialized.

[0126] In the embodiments of the present disclosure, the instrument service in the first operating system refers to a service responsible for managing and coordinating information interaction between the system and the second operating system, and here the instrument service can be InstrumentClusterService service.

[0127] In the embodiments of the present disclosure, all applications include currently running applications and unstarted applications in the first operating system.

[0128] In the embodiments of the present disclosure, when the vehicle is powered on, the instrument service and all applications in the first operating system can be initialized to determine that the system is in a known and operable state, which lays a foundation for subsequent interface creation and content rendering.

[0129] In an implementable scenario, referring to FIG. 6, which is a system block diagram of an optional vehicle display system provided by the embodiments of the present disclosure, the built-in application program (application, APP) in the application layer of the first operating system such as the Android operating system, or the third-party APP such as navigation, multimedia, telephone and weather. The framework layer Framwork of the first operating system is a core component of the first operating system, which provides a series of application programming interfaces (Application Programming Interface, API) such as QGAPI.jar and system services, so that developers can build application programs and interact with the operating system and other applications. Framework plays the role of a bridge, connecting the underlying hardware such as the service layer and the upper layer such as the application program in the application layer, which encapsulates complex underlying details and provides a high-level abstraction layer, so that developers can more easily use hardware resources and system services to create feature-rich applications. The service layer Service in the first operating system is used to process background tasks, provide system services or functions, and a component set of services that interact with other operating systems such as the QNX operating system. Here, the service layer Service and the framework layer Framework can communicate through Binder, and the instrument service InstrumentClusterService can interact with other operating systems such as the QNX operating system through socket communication. It should be noted that these services do not directly interact with the user, but run in the background.

[0130] Step 502, creating, through the instrument service, an activity component nested with at least two fragment page components.

[0131] Each of the at least two fragment page components corresponds to an application.

[0132] In the embodiments of the present disclosure, the activity component, that is, Activity, is a user interface program, which will provide an interactive interface function to the user in principle, and is a basic functional unit of the Android application program, which represents the interface and the corresponding business logic centered on the interface in Android, including display, user interaction, etc.

[0133] In the embodiments of the present disclosure, the fragment page component, that is, Fragment, is a fragment page, a component that can split an activity into several completely independent encapsulated reusable components, each Fragment component has its own life cycle and UI layout.

[0134] In the embodiments of the present disclosure, the activity component is created by the instrument service, and the activity component is nested with at least two fragment page components, the modular design of the interface is realized, so that each fragment page component can independently process the application logic and UI display related thereto, and the code reusability and maintainability are improved; each fragment page component corresponds to each application that needs to be projected, so that the core function of each application can be realized by an independent fragment, and it is easy to manage and update. Each fragment focuses on its own business logic and UI display, which promotes the decoupling of the code. For example, an activity component Activity is created by the instrument service InstrumentClusterService, a plurality of fragment page components Fragment are created in the activity component Activity, and each fragment page component Fragment corresponds to each application that needs to be projected, so that the activity component Activity is nested with at least two fragment page components Fragment.

[0135] In step 503, a drawing view component corresponding to each application is created in each fragment page component, and a virtual display corresponding to the application is created in the fragment page component based on the drawing view component.

[0136] The virtual display is used to capture the content of the application to render to the first layer.

[0137] In the embodiments of the present disclosure, the drawing view component, that is, SurfaceView, is the most commonly used view container, which is a block-level container component, and the drawing view component is responsible for specific UI element rendering, that is, it is mainly used for layout display, and is the most basic UI component in the layout.

[0138] In the embodiments of the present disclosure, the virtual display, that is, VirtualDisplay, simulates the creation of one or more logical display devices, and these devices do not directly correspond to the physical display. The core role of the virtual display is that it can make the operating system and application program believe that there is one or more additional screens, even if these screens do not actually exist in the hardware layer. It should be noted that the virtual display acts as an intermediate layer, captures the application content and prepares to render it to a specific layer (the first layer), thereby allowing efficient management of graphical output.

[0139] In the embodiments of the present disclosure, a drawing view component corresponding to each application is created in each fragment page component, and a virtual display corresponding to the application is created in the fragment page component based on the drawing view component. For example, after a plurality of fragment page components Fragment are created, a drawing view component SurfaceView is created in each fragment page component Fragment, and each fragment page component Fragment is bound with a virtual display VirtualDisplay through the drawing view component SurfaceView.

[0140] As can be seen from the above, in the embodiments of the present disclosure, by dynamically loading and managing UI components, the application can respond to user operations more quickly, while maintaining smooth interface transition and high-quality visual presentation; the modularized fragment design makes it easier to add new functions, modify existing functions or optimize the UI structure, which is helpful for long-term project maintenance and development.

[0141] In some embodiments, after the step 503 of creating a drawing view component corresponding to each application in each fragment page component and creating a virtual display corresponding to the application in the fragment page component based on the drawing view component is performed, the following steps can also be performed,

[0142] Step D1, binding each application with a meter service in the first operating system through an interface provided by a general interface package in the first operating system.

[0143] Step D2, sending meter display request information to the meter service by the application, wherein the meter display request information is used to request to start an activity component of the application on a corresponding virtual display.

[0144] In the embodiments of the present disclosure, each application requiring screen projection can bind with the instrument service InstrumentClusterService in the first operating system through the interface provided by the general interface package QGAPI.jar in the first operating system; further, the vehicle-mounted display system sends instrument display request information to the instrument service through the application, and the instrument display request information is used to request to start the activity component Activity of the application on the corresponding virtual display VirtualDisplay. In this way, the interface provided by the general interface package is bound, so that different applications can interact with the first operating system according to a unified standard, which greatly enhances the flexibility and compatibility of the system. The newly developed application only needs to be designed according to the standard interface specification, and can easily integrate into the existing system, reducing the adaptation cost. The direct binding of the application and the instrument service simplifies the information flow path, so that the data transmission is more efficient and the system response is faster. This integration helps to build a unified and coordinated operating environment, and improves the consistency of user experience. The application starts its activity component on the virtual display by sending specific instrument display request information, which can realize on-demand allocation of system resources. This means that only when display is needed, the relevant application component will be activated, which helps to reduce unnecessary system load and optimize resource use efficiency.

[0145] With reference back to FIG. 9, based on FIG. 2, step 203 in FIG. 2 can be updated to steps 504-505.

[0146] Step 504, in a case where the drawing state of the target first layer is that the first image drawing is completed, adjusting the target first layer from the current level to the target level;

[0147] Step 505, sending first information to the second operating system through the instrument service in the first operating system.

[0148] The first information is used to prompt that the target application of the first operating system is ready to be displayed in the instrument screen.

[0149] In the embodiments of the present disclosure, in a case where the drawing state of the target first layer is that the first image drawing is completed, the target first layer is adjusted from the current level to the target level; further, the first information for prompting the target application of the first operating system that is ready to be displayed in the instrument screen is sent to the second operating system through the instrument service in the first operating system. In this way, the layer adjustment and information notification are performed only after it is determined that the image drawing is completed, which can effectively avoid unnecessary calculation and rendering resource waste. Secondly, the first operating system communicates with the second operating system through the instrument service, which indicates the close integration and cooperation between different system components. This cross-system message passing mechanism can promote the efficient operation of applications and services in a multi-platform environment, and improve the overall response speed and interaction ability of the system. Through the timely notification mechanism, the second operating system can respond quickly and make preparations in advance (such as performing hollowing out processing in advance) to display the application content from the first operating system. In this way, the user waiting time can be reduced, and the application switching or content updating can be more rapid and seamless.

[0150] Next, the implementation process of the embodiments of the present disclosure in an implementable application scenario is introduced.

[0151] In the era of intelligent cockpit, the vehicle-mounted entertainment information system is mostly developed based on the Android system, and the instrument is mostly developed based on the QNX system. The Android system has a rich and diverse ecology and can provide users with a more colorful driving experience. Therefore, it is urgently needed to link the vehicle-mounted entertainment information system and the instrument to provide users with information such as vehicle navigation, multimedia video, Bluetooth phone, time, weather, etc. on the instrument screen. At present, related patents focus on solving instrument hardware resource consumption or improving development efficiency, but do not provide a specific interconnection scheme that is mature in technology and high in implementability.

[0152] To solve the above technical problems, the embodiments of the present disclosure provide a specific interconnection scheme that is mature in technology, high in implementability, and can facilitate third-party applications to quickly access the instrument interconnection function. This scheme can enable the driver to operate the vehicle-mounted entertainment information system through voice, side control, or touch screen during driving, display the navigation, multimedia video, Bluetooth phone, time, weather, etc. in the instrument screen area for easy viewing, thereby facilitating the driver to observe the information needed and improving driving safety.

[0153] Referring to FIG. 7, FIG. 7 is a vehicle display method provided by an embodiment of the present disclosure. The method comprises the following steps:

[0154] In step 701, after the vehicle is powered on, the QNX system and the Android system are initialized, and the instrument service InstrumentClusterService and each application in the Android system are initialized.

[0155] Here, in the initialization process, an activity window Activity is started in the instrument service InstrumentClusterService, wherein the Activity is created with multiple fragments Fragment, and each fragment Fragment corresponds to each application that needs to be projected. Further, a drawing view SurfaceView is created in each fragment Fragment, each fragment Fragment is bound with a virtual screen VirtualDisplay (corresponding to the first layer described above) through the drawing view SurfaceView, and all layers corresponding to the multiple virtual screens VirtualDisplay are arranged in order of the hierarchical order.

[0156] Step 702, in the case where each application is started, each application is bound to the instrument service InstrumentClusterService through the interface provided by QGAPI.jar.

[0157] Here, the binding of each application to the instrument service through the interface provided by QGAPI.jar can be understood as the registration of the projection function of the application. If the application is successfully bound to the instrument service InstrumentClusterService through the interface provided by QGAPI.jar, it indicates that the application has successfully registered the projection function; on the contrary, if the application is not successfully bound to the instrument service InstrumentClusterService through the interface provided by QGAPI.jar, it indicates that the application fails to register the projection function.

[0158] Step 703, in the case where each application is successfully bound to the instrument service, each application sends a projection request to the instrument service InstrumentClusterService through the interface startActivity provided by QGAPI.jar.

[0159] The projection request is used to request that the Activity of the application be started into the corresponding virtual screen VirtualDisplay.

[0160] Step 704, the instrument service InstrumentClusterService starts the Activity of each application into the corresponding virtual screen VirtualDisplay based on each projection request.

[0161] Step 705, after the application executes the resume function onResume in startActivity, the instrument service InstrumentClusterService is notified that the last frame drawing is completed.

[0162] Step 706: The InstrumentClusterService notifies the QNX system that the application is ready for screen mirroring.

[0163] Step 707: If the user performs screen mirroring operation by operating the in-vehicle infotainment system through voice, touch, or other means, the InstrumentClusterService determines the target application that needs to be mirrored.

[0164] Here, the screen casting information corresponding to the screen casting operation includes the application identifier.

[0165] Step 708: If the user performs screen projection via the control panel, the QNX system identifies the target application and notifies the InstrumentClusterService that the target application needs to be projected.

[0166] Here, the screen casting information corresponding to the screen casting operation includes the application identifier.

[0167] Step 709: InstrumentClusterService checks whether the target application meets the projection requirements.

[0168] Here, the conditions for screen mirroring include: the target application output has completed the rendering of the application image in the corresponding target virtual screen (VirtualDisplay).

[0169] Here, if the target application meets the screen casting conditions, step 710 is executed; if the target application does not meet the screen casting conditions, step 711 is executed.

[0170] Step 710: The InstrumentClusterService adjusts the VirtualDisplay corresponding to the target application from the current level to the first level of all VirtualDisplays arranged in order, and notifies the QNX system that the target application needs to be projected. The QNX system then cuts out the projection area of ​​the target application, and the target application is displayed on the instrument screen.

[0171] Here, the second layer provided by the QNX system covers all virtual screens (VirtualDisplay). The QNX system determines the display area of ​​the target application on the virtual screen (VirtualDisplay) based on the target application's configuration information, such as display position and display size. Furthermore, a cutout is made in the area directly above this display area in the second layer provided by the QNX system to make room for this area on the instrument panel, thereby enabling the target application to be successfully projected onto the instrument panel.

[0172] Step 711, the InstrumentClusterService notifies the QNX system that the target application cannot be projected, and the QNX system displays a default page on the instrument screen to prompt the user that the projection fails.

[0173] As can be seen from the above, the embodiments of the present disclosure uniformly control the interlocking function of the in-vehicle infotainment system and the instrument by the instrument service, provide a standard JAR package to the outside, facilitate the third-party APP to access the interlocking function, make the interaction between the in-vehicle infotainment system and the instrument more diverse, and at the same time, realize the projection of the rich and diverse navigation, multimedia, telephone, weather and other functions in the in-vehicle infotainment Android system to the instrument screen to display to the user.

[0174] Referring to FIG. 8, FIG. 8 is a structural schematic diagram of an optional vehicle display device provided by the embodiments of the present disclosure. The vehicle display device 8 comprises:

[0175] The monitoring module 801 is configured to monitor the input operation of the vehicle user;

[0176] The determining module 802 is configured to determine the target application corresponding to the input information of the vehicle user;

[0177] The determining module 802 is further configured to determine, by the first operating system, a target first layer of the target application and a layer parameter of the target first layer, wherein the target first layer is a first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer is drawn with a first image of the application, and the layer parameter comprises a drawing state and a level of the target first layer;

[0178] The processing module 803 is configured to adjust, by the first operating system, the target first layer to a target level according to the drawing state and the level of the target first layer, wherein the target level is a first level arranged in order according to all levels corresponding to the plurality of first layers;

[0179] The output module 804 is configured to output, by the first operating system, the target first layer at the target level to below a second layer provided by the second operating system, wherein the second layer is drawn with a second image;

[0180] The display module 805 is configured to display, by the second operating system, the second image and / or the first image of the target application on the instrument screen corresponding to the second operating system according to the configuration information of the target application, the target first layer and the second layer.

[0181] This disclosure provides an in-vehicle display system, including a memory and a processor. The memory stores a computer program that can run on the processor, and the processor executes the program to implement some or all of the steps in the above-described method.

[0182] This disclosure provides a storage medium storing one or more computer programs, which can be executed by one or more processors to implement some or all of the steps in the above-described method. The storage medium can be transient or non-transient.

[0183] This disclosure provides a computer program including computer-readable code, wherein when the computer-readable code runs in an in-vehicle display system, a processor in the in-vehicle display system performs some or all of the steps in the above-described method.

[0184] This disclosure provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, it implements some or all of the steps in the above-described method. This computer program product can be implemented specifically through hardware, software, or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium; in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc.

[0185] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between them, while their similarities or commonalities can be referenced interchangeably. The descriptions of the above embodiments of the device, storage medium, computer program, and computer program product are similar to the descriptions of the above method embodiments and have similar beneficial effects. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this disclosure, please refer to the descriptions of the method embodiments of this disclosure for understanding.

[0186] Figure 9 is a schematic diagram of the hardware entity of an in-vehicle display system provided in an embodiment of this disclosure. As shown in Figure 9, the hardware entity of the in-vehicle display system 9 includes a processor 901 and a memory 902. The memory 902 stores a computer program that can run on the processor 901. When the processor 901 executes the computer program, it performs the following steps.

[0187] Monitor vehicle users' input operations to determine the target application corresponding to the vehicle user's input information;

[0188] Determine, by the first operating system, a target first layer of the target application and layer parameters of the target first layer; the target first layer is a first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws a first image of the application, and the layer parameters include a drawing state and a level of the target first layer.

[0189] Adjust, by the first operating system, the target first layer to a target level according to the drawing state and the level of the target first layer; the target level is a first level in a sequence of all levels corresponding to the plurality of first layers.

[0190] Output, by the first operating system, the target first layer at the target level to below a second layer provided by the second operating system; the second layer draws a second image.

[0191] Display, by the second operating system, the second image and / or the first image of the target application on an instrument screen corresponding to the second operating system according to the configuration information of the target application, the target first layer, and the second layer.

[0192] The memory 902 stores computer programs executable on the processor, and is configured to store instructions executable by the processor 901 and applications, and can also cache data to be processed by the processor 901 and modules in the vehicle display system 9 (for example, image data, audio data, voice communication data and video communication data) that have been processed, which can be realized by FLASH or RAM.

[0193] The processor 901 executes the program to implement the steps of the vehicle display method of any one of the above embodiments. The processor 901 generally controls the overall operation of the vehicle display system 9.

[0194] The computer storage medium stores one or more programs executable by one or more processors to implement the steps of the vehicle display method of any one of the above embodiments.

[0195] It should be noted that the above description of the storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects to the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present disclosure, please refer to the description of the method embodiments of the present disclosure.

[0196] The processor can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, or a microprocessor. It can be understood that the electronic device for implementing the functions of the processor can also be other devices, and the embodiments of the present disclosure are not limited in this regard.

[0197] The computer storage medium / memory can be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Ferromagnetic Random Access Memory (FRAM), a Flash Memory, a magnetic surface memory, an optical disc, a Compact Disc Read-Only Memory (CD-ROM), or the like. It can also be various terminals including one or any combination of the above memories, such as a mobile phone, a computer, a tablet device, a personal digital assistant, and the like.

[0198] It should be understood that every feature, structure, or characteristic described above in relation to one or more embodiments is included in at least one embodiment of the present disclosure. Therefore, the appearances of "in one embodiment" or "in an embodiment" at various places in the specification do not necessarily refer to the same embodiment. Furthermore, various features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that the sequence of the steps / processes described above in various embodiments of the present disclosure does not mean the order of execution, and the order of execution of the steps / processes should be determined according to their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure. The sequence numbers of the above embodiments of the present disclosure are only for description, and do not represent the advantages or disadvantages of the embodiments.

[0199] It should be noted that the terms "comprising", "including", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements recited, but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the phrase "comprising a" does not exclude the existence of additional identical elements in the process, method, article, or apparatus including the element.

[0200] In several embodiments provided by the present disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. The above-described device embodiments are only illustrative, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the various components shown or discussed can be through some interface, indirect coupling or communication connection between devices or units, which can be electrical, mechanical or other forms.

[0201] The units described above as separate components can or can not be physically separate, and the components shown as units can or can not be physical units; they can be located in one place or distributed on multiple network units; and some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0202] In addition, each functional unit in each embodiment of the present disclosure can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or hardware plus software functional unit.

[0203] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware, and the foregoing program can be stored in a computer readable storage medium, and the program executes the steps of the above-mentioned method embodiments when executed; and the foregoing storage medium includes a mobile storage device, a read only memory (ROM), a magnetic disc or an optical disc and various storage medium capable of storing program codes.

[0204] Alternatively, the integrated units of the present disclosure can be stored in a computer readable storage medium if they are realized in the form of software function modules and sold or used as independent products. Based on such understanding, the technical solutions of the present disclosure can be embodied in the form of a software product, and the computer software product is stored in a storage medium, includes a plurality of instructions for causing a vehicle terminal (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the various embodiments of the present disclosure. The foregoing storage medium includes a mobile storage device, a ROM, a magnetic disc or an optical disc and various storage medium capable of storing program codes.

[0205] The above is only an embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present disclosure, which should be covered by the protection scope of the present disclosure. Industrial applicability

[0206] The embodiment of the disclosure provides a vehicle display method, a vehicle display device, a vehicle display system, a storage medium and a computer program product, which are applied to a vehicle display system, the vehicle display system runs a first operating system and a second operating system, and the method comprises the following steps: monitoring an input operation of a vehicle user, and determining a target application corresponding to input information of the vehicle user; determining, by the first operating system, a target first layer of the target application and layer parameters of the target first layer; wherein the target first layer is a first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws a first image of the application, and the layer parameters comprise a drawing state and a level of the target first layer; adjusting, by the first operating system, the target first layer to a target level according to the drawing state and the level of the target first layer; wherein the target level is a first level arranged in order according to all levels corresponding to the plurality of first layers; outputting, by the first operating system, the target first layer in the target level to below a second layer provided by the second operating system; wherein the second layer draws a second image; and displaying, by the second operating system, the second image and / or the first image of the target application on an instrument screen corresponding to the second operating system according to configuration information of the target application, the target first layer and the second layer. In this way, through integrated display across operating systems, a user can see important information from different sources on the instrument screen at the same time, that is, the superimposed display of the first image and the second image, so that the driver does not need to frequently check the information displayed on the two screens, and the convenience and safety during driving are improved. Secondly, the linkage between the two operating systems shows high system integration, so that the infotainment system of the vehicle is more unified and coordinated, and a seamless driving and entertainment environment is provided for the user. Further, the preset configuration information allows the system to automatically adjust the display content and layout according to user preferences, driving scenarios or vehicle states, thereby enhancing the flexibility and personalized setting ability of the interface. Finally, the hierarchical architecture design is conducive to isolating different functional modules, so that even if a certain operating system or application has a problem, the normal operation of the entire vehicle display system will not be affected, thereby increasing the robustness and safety of the system.

Claims

1. A vehicle display method applied to a vehicle display system, wherein the vehicle display system runs a first operating system and a second operating system, and the method comprises: monitoring an input operation of a vehicle user, and determining a target application corresponding to input information of the vehicle user; determining, by the first operating system, a target first layer of the target application and a layer parameter of the target first layer, wherein the target first layer is a first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws a first image of the application, and the layer parameter comprises a drawing state and a level of the target first layer; adjusting, by the first operating system, the target first layer to a target level according to the drawing state and the level of the target first layer, wherein the target level is a first level in a sequence of all levels corresponding to the plurality of first layers; outputting, by the first operating system, the target first layer at the target level to below a second layer provided by the second operating system, wherein the second layer draws a second image; and displaying, by the second operating system, the second image and / or the first image of the target application on an instrument screen corresponding to the second operating system according to configuration information of the target application, the target first layer and the second layer. The target application is one, and the displaying, by the second operating system, the second image and the first image of the target application on the instrument screen corresponding to the second operating system according to the configuration information of the target application, the target first layer and the second layer comprises: performing, by the second operating system, hole digging on a first display area in the second layer, wherein the first display area comprises a corresponding area in the second layer determined based on an image display size and an image display position of the first image of the target application in the target first layer, and the configuration information comprises the image display size and the image display position; re-rendering, by the second operating system, a second image generated by the second operating system in a second display area of the second layer, wherein the second display area is a remaining area of the second layer except the first display area, and the second display area and the first display area do not overlap with each other; and superimposing the second layer and the target first layer, so as to display the second image and the first image of the target application in a partition on the instrument screen. The hole digging, by the second operating system, on the first display area in the second layer comprises: determining, by the second operating system, a plurality of first sub-images corresponding to a plurality of functions of the target application in the first image, so as to determine a plurality of first sub-images; segmenting the plurality of first sub-images, and determining an image display size and an image display position of each first sub-image. ​ ​ ​ ​ ​ 2. The method of claim 1, wherein, ​ ​ ​ ​ 3. The method of claim 2, wherein, ​ ​ ​ According to the image display size and the image display position of each first sub-image, a plurality of first display regions in the second layer are determined, and each first display region is hollowed and engraved.

4. The method of claim 2, wherein, The hollowing and engraving of the first display region in the second layer by the second operating system comprises: Based on the display size of the second layer, the second operating system determines whether the image display size and / or the image display position of the first image in the target first layer need to be adjusted; According to the determination result, the first display region in the second layer is determined, and the first display region is hollowed and engraved; wherein the first display region includes the region corresponding to the display size and display position of the first image in the second layer without adjustment, and the region corresponding to the display size and display position of the first image in the second layer after adjustment. The target application is multiple, and the second operating system displays the second image and the first image of the target application on the instrument screen corresponding to the second operating system according to the configuration information of the target application, the target first layer, and the second layer, which comprises:

5. The method of claim 1, wherein, Based on the display size of the second layer, the second operating system adjusts the image display size and / or the image display position of the first image in each target first layer; Hollowing and engraving a plurality of third display regions in the second layer; wherein each third display region includes a corresponding region in the second layer determined based on the image display size and the image display position of the corresponding first image of the target application in the target first layer, and the configuration information includes the image display size and the image display position; The second image generated by the second operating system is re-rendered in the second display region of the second layer; wherein the second display region is the remaining region of the second layer except the plurality of third display regions, and the second display region and each third display region do not overlap with each other; Superimpose the second layer and the plurality of target first layers, so as to display the second image and the first images of the plurality of target applications in the upper partition of the instrument screen. The method comprises:

6. The method according to any one of claims 1 to 5, wherein, Initializing the instrument service and all applications in the first operating system; Creating an active component with at least two fragment page components nested by the instrument service; wherein each fragment page component in the at least two fragment page components corresponds to each application; Creating a drawing view component corresponding to each application in each fragment page component, and creating a virtual display corresponding to the application in the fragment page component based on the drawing view component; the virtual display is used to capture the content of the application for rendering to the first layer. The method further comprises:

7. The method of claim 6, wherein, Binding each application to the instrument service in the first operating system through the interface provided by the general interface package in the first operating system; ​ The application sends instrument display request information to the instrument service of the instrument, wherein the instrument display request information is used to request to start the active component of the application on the corresponding virtual display.

8. The method of claim 6, wherein, The first operating system adjusts the target first layer to a target level according to the drawing state of the target first layer and the level thereof. In a case where the drawing state of the target first layer is a completed first image drawing, the target first layer is adjusted from a current level to the target level. The first operating system sends first information to the second operating system through an instrument service, wherein the first information is used to prompt the target application of the first operating system to be ready for display in the instrument screen.

9. The method according to any one of claims 1 to 5, wherein, The input operation of the vehicle user is monitored to determine the target application corresponding to the input information of the vehicle user. The input operation is monitored. If the input operation is a voice operation or a touch operation on the first operating system, the target application corresponding to the input information is determined through the first operating system. If the input operation is a touch operation on the second operating system, the target application is determined through the second operating system based on the input information, and a second message is sent to the first operating system; the target application is determined through the first operating system based on the second message, wherein the second message is used to notify the target application in the first operating system to be displayed.

10. The method according to any one of claims 1 to 5, wherein, The first operating system is a mobile operating system, and the second operating system is a real-time operating system.

11. A vehicle-mounted display device, the device comprising: a monitoring module configured to monitor an input operation of a vehicle user; a determination module configured to determine a target application corresponding to input information of the vehicle user; the determination module is further configured to determine, through the first operating system, a target first layer of the target application and layer parameters of the target first layer; wherein the target first layer is a first layer corresponding to the target application in a plurality of first layers, the plurality of first layers are layers provided by the first operating system for each application, the first layer draws a first image of the application, and the layer parameters include a drawing state and a level of the target first layer; a processing module configured to adjust, through the first operating system, the target first layer to a target level according to the drawing state of the target first layer and the level thereof; wherein the target level is the first level in the order of arrangement of all levels corresponding to the plurality of first layers; an output module configured to output, through the first operating system, the target first layer in the target level to below a second layer provided by the second operating system; wherein the second layer draws a second image. The display module is configured to display the second image and / or the first image of the target application on the instrument panel corresponding to the second operating system according to the configuration information of the target application, the target first layer, and the second layer through the second operating system.

12. A vehicle display system, comprising a processor and a memory, wherein the memory stores a computer program capable of running on the processor, and the processor executes the computer program to implement the vehicle display method according to any one of claims 1 to 10.

13. A storage medium, wherein the storage medium stores one or more computer programs capable of being executed by one or more processors to implement the vehicle display method according to any one of claims 1 to 10.

14. A computer program product, comprising a computer program or instructions, wherein the computer program or instructions are executed by a processor to implement the vehicle display method according to any one of claims 1 to 10.

Images