Screen interface display processing method and device, electronic equipment and medium

Abstract

The application discloses a screen interface display processing method and device, electronic equipment and medium, and relates to the technical field of vehicle-mounted systems. The method comprises the following steps: setting a second operating system as a first mode, wherein the first mode indicates that the second operating system supports multiple target units to run and display on a screen, and supports dynamically adjusting the size and position of a display window of the multiple target units displayed on the screen; the target unit comprises an image generated by the first operating system and the second operating system; in response to a starting instruction, starting the first operating system and the second operating system; and displaying the image generated by the first operating system and the image generated by the second operating system on the screen according to the size and position of the display window indicated by configuration information. The embodiment can customize the size, position and quantity of the display window on the screen, can display the image generated by the first operating system and the image generated by the second operating system on the screen together, is convenient for users to find, and improves the user experience.

Description

Technical Field

[0001] This invention relates to the field of vehicle system technology, and in particular to a screen interface display processing method, apparatus, electronic device, and medium. Background Technology

[0002] With the rapid development of the automotive industry, the number of screens in cars is increasing, and the demand for integrated front-row infotainment screens is also growing. Automakers are gradually increasing the display size of these screens. In related technologies, instrument cluster information and the infotainment screen's desktop display typically run on two separate operating systems. For example, instrument cluster information is displayed via the QNX operating system on the dashboard, while the infotainment screen's desktop display runs on the Android operating system and is displayed on the infotainment screen. This means that the technology struggles to display images from different operating systems simultaneously on a single screen. As a result, drivers need to frequently check both screens to stay informed and react quickly. This frequent switching between screens leads to a poor user experience and poses safety risks. Furthermore, the infotainment screen only displays an application list or a widget of a specific application, showing only one currently active application. It cannot simultaneously display multiple applications or dynamically adjust the display windows of those applications, resulting in a poor user experience. Summary of the Invention

[0003] To solve the above-mentioned technical problems, or at least partially solve the above-mentioned technical problems, embodiments of the present invention provide a screen interface display processing method, apparatus, electronic device, and medium.

[0004] According to a first aspect of the present invention, a screen interface display processing method is provided, applied to an in-vehicle terminal, wherein the in-vehicle terminal runs a first operating system and a second operating system, the method comprising:

[0005] The second operating system is set to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support the dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system;

[0006] In response to the startup command, the first operating system and the second operating system are started;

[0007] According to preset configuration information, the images generated by the first operating system and the second operating system are displayed on the screen, wherein the preset configuration information is used to indicate the size and position of the display windows for the images generated by the first operating system and the second operating system.

[0008] According to a second aspect of the present invention, a screen interface display processing apparatus is provided, applied to an in-vehicle terminal, the in-vehicle terminal running a first operating system and a second operating system, the apparatus comprising:

[0009] The setting module is used to set the second operating system to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system;

[0010] A startup module is used to sequentially start the first operating system and the second operating system in response to a startup command;

[0011] The display module is used to display images generated by the first operating system and images generated by the second operating system on the screen according to preset configuration information, wherein the preset configuration information is used to indicate the size and position of the display windows of the images generated by the first operating system and the images generated by the second operating system.

[0012] According to a third aspect of the present invention, an electronic device is provided, comprising: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the screen interface display processing method of the first aspect of the present invention.

[0013] According to a fourth aspect of the present invention, a computer-readable medium is provided having a computer program stored thereon, which, when executed by a processor, implements the screen interface display processing method of the first aspect of the present invention.

[0014] One embodiment of the above invention has the following advantages or beneficial effects:

[0015] This invention, through setting a second operating system to a first mode, instructs the second operating system to support the operation and display of multiple target units on the screen, and supports dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen. This enables customization of the number, size, and position of the display windows on the screen, and allows for dynamic adjustment of the number, size, and position of the display windows, thereby allowing users to personalize the display content on the screen as needed, improving the user experience. In response to a startup command, this invention starts both the first and second operating systems. According to preset configuration information, images generated by the first and second operating systems are displayed on the screen. The preset configuration information instructs the size and position of the display windows for the images generated by the first and second operating systems, enabling simultaneous display of images generated by the first and second operating systems on the same screen. This facilitates user search, making operation more convenient while driving. Users can obtain all the necessary information through a single screen, improving the user experience while reducing costs and security risks.

[0016] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0017] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein:

[0018] Figure 1 A flowchart illustrating a screen interface display processing method according to an embodiment of the present invention is shown schematically.

[0019] Figure 2 The illustration schematically shows the content displayed on a screen according to an embodiment of the present invention;

[0020] Figure 3 A flowchart illustrating a screen interface display processing method according to an embodiment of the present invention is shown schematically.

[0021] Figure 4 This illustration schematically shows the method of displaying the default desktop in the screen interface display processing method of this embodiment of the invention;

[0022] Figure 5 A flowchart illustrating another embodiment of the screen interface display processing method of the present invention is shown schematically.

[0023] Figure 6 This schematic diagram illustrates the structure of a screen interface display processing device according to an embodiment of the present invention.

[0024] Figure 7A flowchart illustrating another embodiment of the screen interface display processing method of the present invention is shown schematically.

[0025] Figure 8 A flowchart illustrating another embodiment of the screen interface display processing apparatus of the present invention is shown schematically.

[0026] Figure 9 This is a schematic diagram illustrating the structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0027] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0028] To facilitate understanding of the technical solutions of the embodiments of the present invention, the relevant technical terms will be explained below.

[0029] The Framework layer is primarily used to provide various development interfaces for Android system applications.

[0030] WMS (WindowManagerService) is used to manage the creation, addition, deletion, size, hierarchy, and so on of windows.

[0031] AMS (ActivityManagerService) is the core service in Android, mainly responsible for the startup, switching, scheduling of the four major components in the system, as well as the management and scheduling of application processes.

[0032] Activity is a system's visual interactive component.

[0033] ActivityRecord is a class that manages application activities and is used to describe an Activity.

[0034] ActivityStack is a management class used to manage all Activities.

[0035] ActivityState is an enumeration class used to store all the states of an Activity.

[0036] Activitystarter represents the class that controls the actual startup of an Activity.

[0037] Task: In Android, the task stack is implemented using a stack structure and has a Last-In-First-Out (LIFO) characteristic. When an Activity is created, an Activity is pushed onto the Task. When an Activity is destroyed, it is removed from the Task. The Activity at the top of the Task is the Activity that is currently interactive. A Task can store Activities from multiple applications, and Activities from the same application can also be stored in different Tasks.

[0038] An ActivityStack contains multiple Tasks, and a Task record contains multiple ActivityRecords.

[0039] Figure 1 A flowchart illustrating a screen interface display processing method according to an embodiment of the present invention is shown. This screen interface display processing method can be applied to an in-vehicle terminal running a first operating system and a second operating system. The first operating system can be a highly secure real-time operating system, such as the QNX system, and the second operating system can be a mobile operating system, such as the Android system. The first and second operating systems share the same screen to simultaneously display instrument panel content, vehicle control content, and entertainment content. The instrument panel content relates to functions related to safe driving, and may include, but is not limited to, speedometer, engine tachometer, fuel level, temperature, headlight indicators, engine status, mileage, and ADAS (Advanced Driving Assistance System) related information. The vehicle control content relates to vehicle status and functions related to overall vehicle control. Vehicle status may include, but is not limited to, controlling the car's air conditioning, audio system, door and window controls, and trunk opening / closing. Functions related to overall vehicle control include, but are not limited to, navigation, driving recording, music control, air conditioning control, and Bluetooth phone control. Entertainment video content has a lower security level and is mainly designed to meet users' entertainment needs. This includes, but is not limited to, third-party applications downloaded from the Internet, such as audio applications, video applications, and instant messaging applications.

[0040] In this embodiment of the invention, the screen may be a touch LCD screen, an LED screen, or an OLED screen, etc., and the invention does not impose any limitations on this.

[0041] like Figure 1 As shown, the screen interface display processing method of this invention includes:

[0042] Step 101: Set the second operating system to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support the dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system.

[0043] In this embodiment, dynamically adjusting the size of the display windows of multiple target units displayed on the screen means that the display windows of multiple target units can be scaled down and zoomed in. Dynamically adjusting the position of the display windows of multiple target units displayed on the screen means that the display windows of multiple target units can be moved from one position to another on the screen. The target units include images generated by a first operating system, such as instrument panel images, and images generated by a second operating system, such as central control images, application lists, and in-vehicle virtual personal assistant images. In this embodiment of the invention, by setting the second operating system to a first mode, it is possible to support the operation and display of multiple instrument panel images, multiple central control images, and multiple application lists on the screen, and the size and position of the display windows of these multiple instrument panel images, multiple central control images, and multiple application lists can be dynamically adjusted.

[0044] In the native Android system, the Android system can be set to freeform mode (free window mode). Freeform mode is a native Android application display method that allows an application (APP) to be displayed freely on the main screen in a form window format. The native freeform mode only supports displaying one window and one application in the system, and it is not possible to launch other applications within this window for a stacked launch display. However, in the first mode of this embodiment, multiple display windows can be customized on the screen to display multiple target units, such as displaying one or more instrument panel images, one or more central control images, or one or more application lists on the screen. It also supports launching other applications within the application list display window to achieve a stacked launch display. As an example, after setting the second operating system to the first mode, as shown... Figure 2 As shown, the system can support displaying one instrument panel image in display area 21, one central control panel image in display area 22, and three application lists in display areas 23, 24, and 25 respectively. In this embodiment of the invention, after displaying one instrument panel image, one central control panel image, and three application lists on the screen, the display windows of the instrument panel image, central control panel image, and application lists can be dynamically adjusted, for example, by shrinking, enlarging, or moving the display windows of the instrument panel image, central control panel image, and application lists.

[0045] In this embodiment, the second operating system can be set to the first mode by modifying the ActivityManagerService and WindowManagerService in the Framework layer of the second operating system. In the first mode, the display window of the target unit supports scaling and repositioning. The principle is to continuously change the boundary of the Task (represented by Rect), and then resize the Task according to the boundary of the Task, thereby achieving the effect of scaling and moving the display window.

[0046] Step 102: In response to the startup command, start the first operating system and the second operating system.

[0047] In this embodiment, the first operating system and the second operating system are run on a multi-core heterogeneous system chip via virtual machine technology. The first operating system runs directly on the system chip, while the second operating system, as a virtual machine on the first operating system, is started as a virtual machine process. Upon receiving a startup command, such as detecting a user's ignition operation, the first operating system is started, and the second operating system is started as a virtual machine process. The first operating system is a real-time operating system, and the second operating system is a mobile operating system. The startup time of the first operating system is shorter than that of the second operating system. Therefore, the first startup animation of the first operating system is played on the screen first, and after the first startup animation finishes playing, the second startup animation of the second operating system is played.

[0048] In an optional embodiment, the second boot animation of the second operating system is a static image, the content of which is consistent with the content of the default desktop. Since the content displayed in the second boot animation is consistent with the content displayed on the default desktop, from a user experience perspective, after the second boot animation finishes playing, the user directly enters the default desktop, ensuring a unified display of the entire system and effectively improving the user experience.

[0049] Step 103: According to the preset configuration information, display the image generated by the first operating system and the image generated by the second operating system on the screen, wherein the preset configuration information is used to indicate the size and position of the display window of the image generated by the first operating system and the image generated by the second operating system.

[0050] The images generated by the first operating system may include, but are not limited to, instrument panel images, while the images generated by the second operating system may include, but are not limited to, central control panel images and application lists. Instrument panel images include the instrument panel content described above, central control panel images include the central control panel content described above, and application lists include the applications for the entertainment and multimedia content described above.

[0051] As an example, the process of displaying the image generated by the first operating system and the image generated by the second operating system on the screen according to preset configuration information is as follows: Figure 3 As shown, it includes:

[0052] Step 301: Render the image generated by the first operating system in the first preset area of ​​the first layer, and render the image generated by the second operating system in the second preset area of ​​the second layer; wherein, the first preset area corresponds to the first display area of ​​the screen, the second preset area corresponds to the second display area of ​​the screen, the first display area and the second display area do not overlap, wherein, when the first layer and the second layer are superimposed, the preset area of ​​the lower layer can be displayed through the upper layer.

[0053] Step 302: Overlay the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen.

[0054] This embodiment uses two layers: a first layer (Display-Highlayer) and a second layer (Display-Lowlayer). The coordinates of the first and second layers correspond one-to-one. An image generated by a first operating system is rendered in a first preset area of ​​the first layer, and an image generated by a second operating system is rendered in a second preset area of ​​the second layer. The first and second preset areas correspond to non-overlapping first and second display areas on the screen. When displaying the first and second layers simultaneously, the first layer can be superimposed on the second layer, and the preset area of ​​the lower second layer can be displayed through the upper first layer. In optional embodiments, the areas of the first and second display areas can be the same or different; this invention does not impose any limitations on this.

[0055] When the first layer and the second layer are displayed overlaid on the screen, the image generated by the first operating system and the image generated by the second operating system displayed on the screen can be used as the default desktop of the screen.

[0056] The screen interface display processing method of this invention, through the above technical solution, by simultaneously displaying images generated by the first operating system and images generated by the second operating system on different display areas of the screen, facilitates user search, makes operation more convenient for users while driving, allows users to obtain all the necessary information through a single screen, improves user experience, and reduces costs and security risks.

[0057] In an optional embodiment, the method further includes turning off the second boot animation of the second operating system after rendering the image generated by the first operating system on the first layer and the image generated by the second operating system on the second layer.

[0058] In an optional embodiment, step 301 may further include:

[0059] The image generated by the first operating system is rendered in a first preset area of ​​the first layer, the image generated by the second operating system is rendered in a second preset area of ​​the second layer, and the application list of the second operating system is rendered in a third preset area of ​​the second layer; the third preset area corresponds to the third display area of ​​the screen, and the first display area, the second display area and the third display area do not overlap with each other, wherein when the first layer and the second layer are superimposed, each preset area of ​​the lower layer can be displayed through the upper layer.

[0060] In this embodiment, the image generated by the first operating system is rendered in the first preset area of ​​the first layer, and the image and application list generated by the second operating system are rendered in the second preset area and the third preset area of ​​the second layer, respectively. The first preset area, the second preset area, and the third preset area correspond to the first display area, the second display area, and the third display area on the screen that do not overlap. In optional embodiments, the areas of the first display area, the second display area, and the third display area may be the same or different, and this invention does not impose any limitations on this. As an example, such as Figure 4 As shown, the first display area 41, the second display area 42, and the third display area 43 on the screen have the same area. Figure 4 In this embodiment, the screen is rectangular in shape. In optional embodiments, the screen may be square, curved, or other shapes. This invention does not impose any limitations on these shapes.

[0061] In an optional embodiment, the image generated by the first operating system is an instrument panel image, and the image generated by the second operating system is a central control image. Therefore, step 302 may further include:

[0062] The first layer and the second layer are overlaid on the screen to display the instrument image, the central control image, and the application list on the screen;

[0063] The instrument panel image, the central control panel image, and the application list displayed on the screen will be used as the default desktop of the screen.

[0064] The screen interface display processing method of this invention, through the above technical solution, displays instrument images, central control images, and application lists on different display areas of the screen. This allows the instrument images, central control images, and application lists to be displayed on the same screen simultaneously, making it convenient for users to find information and making it more convenient for users to operate while driving. All the necessary information can be obtained through a single screen, improving the user experience while reducing costs and safety risks.

[0065] In an optional embodiment, the second operating system may further generate an in-vehicle virtual personal assistant image. Rendering the image generated by the second operating system in a second preset area of ​​the second layer includes: rendering the in-vehicle virtual personal assistant image generated by the second operating system in a fourth preset area of ​​the second layer, wherein the fourth preset area corresponds to the fourth display area; the fourth display area does not overlap with the first display area, the second display area, and the third display area; and the instrument panel image, the central control image, the application list, and the in-vehicle virtual personal assistant image displayed on the screen are used as the default desktop of the screen.

[0066] In an optional embodiment, the second operating system may also generate a system status bar. Rendering the image generated by the second operating system into the second preset area of ​​the second layer may include rendering both the image generated by the second operating system and the system status bar in the second preset area. Wherein, the image generated by the second operating system may be a central control image, in which case both the central control image and the system status bar can be rendered in the second preset area. The system status bar can display various system status information, such as time, network status, Bluetooth, etc., and this invention does not impose any limitations on this.

[0067] When rendering the image generated by the second operating system and the system status bar in a second preset area, the method further includes: binding the system status bar and the central control image so that the state of the system status bar is consistent with the state of the central control image. Consistently ensuring the state of the system status bar is consistent with the state of the image generated by the second operating system includes:

[0068] In response to a hiding operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are hidden based on the hiding operation; or, in response to an editing operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are edited based on the editing operation. The editing operation includes zooming out, zooming in, and moving.

[0069] As an example, the process from receiving the startup command to displaying the default desktop on the screen includes:

[0070] Step 1: In response to the startup command, start the QNX system and the Android system, and set the Android system to the first mode.

[0071] Step 2: Play the first boot animation of the QNX system. After the first boot animation finishes playing, play the second boot animation of the Android system.

[0072] Step 3: Initialize WMS in system_server.

[0073] Step 4: After system_server initialization is complete, a request to start the default desktop is initiated;

[0074] Step 5: Call ActivityStarter and, based on the request to launch the default desktop, determine whether to create a Task to display the Activity. In this step, the type and packagename parameters included in the request to launch the default desktop can be used to determine whether to create a new Task to display the Activity.

[0075] Step 6: If you decide to create a new Task to display the Activity, create the Task.

[0076] Step 7: After creating the Task, if the Task's configuration determines that the launch mode for the applications in the application list is set to the second mode, then set the Task's window configuration to the second mode.

[0077] Step 8: Based on the preset configuration information, set the size and position of the display windows for the instrument panel image, central control image, application list, and in-vehicle virtual personal assistant image.

[0078] Step 9: In the stage of adding the window of the central control image, modify the postwindowremovecleanuplocked property of the window of the central control image to bind the system status bar and the central control image.

[0079] In an optional embodiment, after displaying the images generated by the first operating system and the second operating system on the screen, the screen interface display processing method, such as... Figure 5 As shown, it may also include:

[0080] Step 501: In response to the edit trigger operation of the touch body, set the first operating system and the second operating system to edit mode. The edit mode is used to indicate that multiple target units displayed on the screen are editable units. In this edit mode, the images generated by the first operating system and the images generated by the second operating system can be edited.

[0081] Step 502: In the editing mode, in response to the editing operation on the target unit to be edited, the target unit to be edited is edited accordingly, the editing operation including zooming in, zooming out or moving.

[0082] The touch object can be a finger, stylus, etc., and this invention does not limit this. The editing trigger operation can be a pre-set operation, such as a three-finger long press. After detecting that the user has pressed and released three fingers, the editing module is entered. In editing mode, images generated by the first control system, such as instrument panel images, and images generated by the second control system, such as central control images, application lists, and in-vehicle virtual personal assistant images, can be zoomed in, zoomed out, or moved. In this embodiment, the user's operation can be detected by the second operating system.

[0083] In an optional embodiment, when the editing operation is a move operation, editing the target unit to be edited includes: moving the target unit to be edited to a target position, and moving the original target unit at the target position to the initial position of the target unit to be edited. While moving the original target unit at the target position, an animation of moving the original target unit can be played on the screen.

[0084] When the editing operation is a zoom-out operation, the corresponding editing of the target unit to be edited includes: zooming out the display window of the target unit to be edited, determining the empty area at the initial position of the target unit to be edited, and filling the empty area according to a preset fill mode. The fill mode specifies the content to be filled in the empty area. For example, the fill mode specifies that the empty area can be filled with an application list, an image, etc.

[0085] When the editing operation is a zoom-in operation, the corresponding editing of the target unit to be edited includes: zooming in on the display window of the target unit to be edited, determining the coverage area of ​​the zoomed-in target unit to be edited, determining the original target unit on the coverage area, and closing the original target unit on the coverage area.

[0086] For example, when a user long-presses and raises their finger on the screen with three fingers, they enter edit mode. In this mode, they can drag, scale, or move various editable target units. When the user taps the screen again, the system determines the target unit to be edited based on the tap coordinates and decides whether to move or scale it. Subsequent finger movements, if the target unit is to be moved, continuously update its position based on the transmitted movement coordinates until the user raises their finger. At this point, the system determines the finger-raising coordinates (i.e., the target position), places the target unit in the target position, and moves the original target unit at that target position to the initial position of the target unit while simultaneously playing a movement animation. This ensures smooth operation. Specifically, after placing the target unit in the target position, the window of the target unit is set according to the size of the window of the original target unit at that position; similarly, after placing the original target unit in the initial position, the window of the original target unit is set according to the size of the window of the target unit at the initial position. For example, consider two editable units, A and B, with window sizes SA and SB respectively. The user moves unit A from its position PA to B's position PB. After releasing the finger, A is at position PB, with a size of SB, while B needs to move to position PA, with a size of SA. If the editable unit is being scaled, it is scaled proportionally according to the finger movement direction to ensure content integrity until the finger is released. Then, the entire screen content is calculated. If the editable unit is being shrunk, a gap will be created, which needs to be filled. If the editable unit is being enlarged, an overlay area will be created, which needs to be closed. The gap and overlay areas are determined based on the boundaries of all current tasks (bounds, containing four values ​​corresponding to the window's left, top, right, and bottom, forming a rectangular area).

[0087] In this embodiment of the invention, since the instrument image is generated by the first operating system, when the target unit is the instrument image, the process of editing the instrument image is as follows: the second operating system responds to the editing operation on the instrument image, generates editing data, and sends the editing data to the first operating system so that the first operating system can edit the instrument image according to the editing data.

[0088] As an example, scaling or moving the target cell to be edited can be achieved using the following process:

[0089] Step 1: After the user touches the screen, the second operating system will execute a series of logic until the touch event is dispatched to TaskTapPointerEventListener. In onPointEvent, TaskTapPointerEventListener determines whether it is a three-finger long press. If it is a three-finger long press, it will enter the edit mode after receiving the raise event.

[0090] Step 2: After entering edit mode, call DecorCaptionView and set its background resource to indicate that the system has entered edit mode.

[0091] Step 3: After entering edit mode, the system will send touch events again.

[0092] Step 4: Pass the click coordinates and screen ID to TaskPositioningController.

[0093] Step 5: TaskPositioningController sends the click coordinates and screen ID to DisplayContent. DisplayContent determines the target unit to be edited based on the click coordinates and screen ID.

[0094] Step 6: DisplayContent passes information about the target cell to be edited to TaskPositioningController.

[0095] Step 7: After the TaskPositioningController determines the target cell to be edited, it determines whether the editing operation is a zoom-in operation, a zoom-out operation, and / or a move operation.

[0096] Step 8: The TaskPositioningController passes the parameters of the target cell to be edited to the TaskPointer.

[0097] Step 9: TaskPointer modifies the window bounds of the target unit to be edited based on the coordinates of the user's finger touch during movement, ensuring that the target unit to be edited follows the finger's movement, enlargement, or scaling until a finger lift event is received.

[0098] Step 10: AMS calculates whether editing the target cell will create empty or covered areas. If so, it fills the empty areas or closes the original target cells of the covered areas according to the preset fill mode.

[0099] In this embodiment of the invention, setting the second operating system to a first mode includes setting the launch mode of applications in the application list to a second mode, which may be a freeform mode. Therefore, the screen display processing method further includes: in response to a launch operation of an application in the application list, determining the launch mode of the application; if the launch mode of the application is determined to be the second mode, setting the size and position of the application's display window to be consistent with the size and position of the application list's display window. That is, in this embodiment, if the user launches an application in the application list, the size and position of the application's display window are consistent with the size and position of the application list's display window. As an example, such as... Figure 2 As shown, if a user launches an application from the application list displayed in display area 25, that application will be displayed within display area 25. Figure 4 As shown, if a user launches an application from the application list displayed in display area 43, that application will be displayed within display area 43.

[0100] In an optional embodiment, when the second operating system is set to the first mode, multiple application lists can be displayed on the screen, meaning multiple identical applications can be displayed on the screen. When multiple identical applications are displayed on the screen, in response to a launch operation for the multiple identical applications, the output content of the multiple identical applications is synchronized.

[0101] Wherein, assuming multiple identical applications include a first application and a second application; then, in response to a launch operation for the multiple identical applications, the output content of the multiple identical applications is synchronized, including:

[0102] In response to a launch operation for the first application, display the output of the first application;

[0103] In response to a launch operation for the second application, a confirmation pop-up is displayed, the confirmation pop-up including a confirmation control for determining whether to project the playback content of the first application;

[0104] In response to a selection operation on the confirmation control, the output of the second application is synchronized to make the output of the second application consistent with the output of the first application.

[0105] As an example, suppose two identical video applications, APP1 and APP2, are displayed on different areas of the screen. When APP1 is playing a video, APP2 can be opened for projection, allowing APP2 to play the content played by APP1. When switching to the video played by APP1, APP2 will synchronously track and display it.

[0106] In an optional embodiment, synchronizing the output of the second application includes:

[0107] Register a monitoring service, which is used to monitor whether the output content of the first application changes and, if the output content of the first application changes, determine the changed output content of the first application.

[0108] When the monitoring service detects a change in the output content of the first application, it synchronizes the output content of the second application according to the changed output content of the first application.

[0109] Furthermore, the output of the first application and the second application can be synchronized according to the following process:

[0110] A stack is created based on the package name of the first application, and the surface control of the first application is stored in the stack.

[0111] In response to a selection operation on the confirmation control, the surface control of the first application is obtained based on the package name of the second application;

[0112] Adjust the surface control of the first application to fill the display window of the second application, based on the size of the display windows of the first application and the second application.

[0113] Register a listening service, which is used to receive a callback when the stack corresponding to the first application changes;

[0114] In response to a change operation on the output content of the first application, update the stack corresponding to the first application;

[0115] Upon receiving the callback, the listening service determines the stack corresponding to the updated first application.

[0116] The updated stack corresponding to the first application synchronizes the output of the second application.

[0117] In this embodiment of the invention, by synchronizing the output content of the same application in different display areas on the screen, people in different positions in the cockpit can view the same content, thus improving the user experience.

[0118] Figure 6 The diagram illustrates the structure of a screen interface display processing device 600 according to an embodiment of the present invention. This device is applied to an in-vehicle terminal, which runs a first operating system and a second operating system. The first operating system can be a highly secure real-time operating system, such as the QNX system, and the second operating system can be a mobile operating system, such as the Android system. The first and second operating systems share the same screen to simultaneously display instrument panel content, vehicle control content, and entertainment / audio-visual content.

[0119] like Figure 6 As shown, the screen interface display processing device 600 includes:

[0120] Setting module 601 is used to set the second operating system to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system;

[0121] The startup module 602 is used to sequentially start the first operating system and the second operating system in response to a startup command;

[0122] Display module 603 is used to display images generated by the first operating system and images generated by the second operating system on the screen according to preset configuration information, wherein the preset configuration information is used to indicate the size and position of the display windows of the images generated by the first operating system and the images generated by the second operating system.

[0123] In an optional embodiment, the setting module is further configured to enable the second operating system to support zooming in, zooming out, and moving operations on the display windows of multiple target units displayed on the screen.

[0124] In an optional embodiment, the device further includes an editing module for setting the first operating system and the second operating system to an editing mode in response to an editing trigger operation of the touch body. The editing mode is used to indicate that a plurality of target units displayed on the screen are editable units. In the editing mode, in response to an editing operation on the target unit to be edited, the target unit to be edited is edited accordingly. The editing operation includes a zoom-in operation, a zoom-out operation, or a move operation.

[0125] In an optional embodiment, the editing module is further configured to:

[0126] In the editing mode, in response to a movement operation on the target unit to be edited, the target unit to be edited is moved to a target position, and the original target unit at the target position is moved to the initial position of the target unit to be edited;

[0127] or

[0128] In the editing mode, in response to a zoom-out operation on the target unit to be edited, the display window of the target unit to be edited is zoomed out, and a blank area at the initial position of the target unit to be edited is determined. The blank area is then filled according to a preset filling pattern.

[0129] or

[0130] In the editing mode, in response to a zoom operation on the target unit to be edited, the display window of the target unit to be edited is zoomed in, the coverage area of ​​the zoomed-in target unit to be edited is determined, the original target unit on the coverage area is determined, and the original target unit on the coverage area is closed.

[0131] In an optional embodiment, the editing module is further configured to: in the editing mode, in response to an editing operation on an image generated by the first operating system, control the second operating system to generate editing data, and send the editing data to the first operating system, so that the first operating system can perform corresponding editing on the image generated by the first operating system according to the editing data.

[0132] In an optional embodiment, the display module is further configured to: render an image generated by the first operating system in a first preset area of ​​a first layer, and render an image generated by the second operating system in a second preset area of ​​a second layer; wherein the first preset area corresponds to a first display area of ​​the screen, the second preset area corresponds to a second display area of ​​the screen, the first display area and the second display area do not overlap, wherein when the first layer and the second layer are superimposed, the preset area of ​​the lower layer can be displayed through the upper layer; and superimpose the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen.

[0133] In an optional embodiment, the display module is further configured to: render an image generated by the first operating system in a first preset area of ​​a first layer, render an image generated by the second operating system in a second preset area of ​​a second layer, and render an application list of the second operating system in a third preset area of ​​the second layer; the third preset area corresponds to a third display area of ​​the screen, and the first display area, the second display area, and the third display area do not overlap with each other, wherein when the first layer and the second layer are superimposed, each preset area of ​​the lower layer can be displayed through the upper layer.

[0134] In an optional embodiment, the image generated by the first operating system is an instrument image, and the image generated by the second operating system is a central control image;

[0135] The display module is further configured to: overlay the first layer and the second layer on the screen to display the instrument image, the central control image and the application list on the screen; and use the instrument image, the central control image and the application list displayed on the screen as the default desktop of the screen.

[0136] In an optional embodiment, the display module is further configured to: render the in-vehicle virtual personal assistant image generated by the second operating system in a fourth preset area of ​​the second layer, wherein the fourth preset area corresponds to the fourth display area; the fourth display area does not overlap with the first display area, the second display area, and the third display area; and use the instrument panel image, the central control image, the application list, and the in-vehicle virtual personal assistant image displayed on the screen as the default desktop of the screen.

[0137] In an optional embodiment, the display module is further configured to: render the image generated by the second operating system and the system status bar in the second preset area.

[0138] In an optional embodiment, the device further includes a binding module for binding the image generated by the second operating system and the system status bar so that the state of the system status bar is consistent with the state of the image generated by the second operating system.

[0139] In an optional embodiment, the binding module is further configured to: in response to a hiding operation on an image generated by the second operating system, hide the image generated by the second operating system and the system status bar based on the hiding operation; or, in response to an editing operation on an image generated by the second operating system, edit the image generated by the second operating system and the system status bar based on the editing operation.

[0140] In an optional embodiment, the setting module is further configured to: set the launch mode of the applications in the application list to a second mode;

[0141] The startup module is further configured to: in response to a startup operation on an application in the application list, determine the startup mode of the application; if the startup mode of the application is determined to be the second mode, set the size and position of the application's display window to be consistent with the size and position of the application list's display window.

[0142] In an optional embodiment, the apparatus further includes a synchronization module for synchronizing the output content of the multiple identical applications in response to a launch operation for the multiple identical applications when multiple identical applications are displayed on the screen.

[0143] In an optional embodiment, the plurality of identical applications include a first application and a second application;

[0144] The synchronization module is further configured to: display the output content of the first application in response to a launch operation for the first application; display a confirmation pop-up window in response to a launch operation for the second application, the confirmation pop-up window including a confirmation control, the confirmation control being used to determine whether to project the playback content of the first application; and synchronize the output content of the second application in response to a selection operation of the confirmation control, so that the output content of the second application is consistent with the output content of the first application.

[0145] In an optional embodiment, the synchronization module is further configured to: register a monitoring service, the monitoring service being configured to monitor whether the output content of the first application changes and, if the output content of the first application changes, determine the changed output content of the first application; and, if the monitoring service detects that the output content of the first application has changed, synchronize the output content of the second application according to the changed output content of the first application.

[0146] In an optional embodiment, the synchronization module is further configured to: create a stack based on the package name of the first application, and store the surface control of the first application in the stack; in response to a selection operation of the confirmation control, obtain the surface control of the first application based on the package name of the second application; adjust the surface control of the first application to fill the display window of the second application based on the size of the display windows of the first application and the second application; register a listening service, the listening service being configured to listen to the stack corresponding to the first application, determine that the output content of the first application has changed and determine the changed output content of the first application when the stack corresponding to the first application changes; in response to a change operation of the output content of the first application, update the stack corresponding to the first application; when the listening service detects a change in the stack corresponding to the first application, determine the updated stack of the first application; and synchronize the output content of the second application based on the updated stack of the first application.

[0147] In an optional embodiment, the first operating system is a real-time operating system, and the second operating system is a mobile operating system;

[0148] The startup module is further configured to: in response to the startup instruction, start the first operating system and start the second operating system in the form of a virtual machine process.

[0149] The above-described apparatus can execute the method provided in the embodiments of the present invention, and has the corresponding functional modules and beneficial effects for executing the method. Technical details not described in detail in this embodiment can be found in the method provided in the embodiments of the present invention.

[0150] In another embodiment of the present invention, a screen interface display processing method is also provided. This method is applied to an in-vehicle terminal, on which a first operating system and a second operating system run. The first operating system can be a highly secure real-time operating system, such as the QNX system, and the second operating system can be a mobile operating system, such as the Android system. The first and second operating systems share the same screen to simultaneously display instrument panel content, vehicle control content, and entertainment content. The instrument panel content relates to functions related to safe driving, and may include, but is not limited to, speedometer, engine tachometer, fuel level, temperature, headlight indicators, engine status, mileage, and ADAS (Advanced Driving Assistance System) related information. The vehicle control content relates to vehicle status and functions related to overall vehicle control. Vehicle status may include, but is not limited to, controlling the car's air conditioning, audio system, door and window controls, and trunk opening / closing. Functions related to overall vehicle control include, but are not limited to, navigation, driving recording, music control, air conditioning control, and Bluetooth phone control. Entertainment video content has a lower security level and is mainly designed to meet users' entertainment needs. This includes, but is not limited to, third-party applications downloaded from the Internet, such as audio applications, video applications, and instant messaging applications.

[0151] like Figure 7 As shown, the screen interface display processing method includes:

[0152] Step 701: In response to the startup command, start the first operating system and the second operating system.

[0153] In this embodiment, the first operating system and the second operating system are run on a multi-core heterogeneous system chip via virtual machine technology. The first operating system runs directly on the system chip, while the second operating system, as a virtual machine on the first operating system, is started as a virtual machine process. Upon receiving a startup command, such as detecting a user's ignition operation, the first operating system is started, and the second operating system is started as a virtual machine process. The first operating system is a real-time operating system, and the second operating system is a mobile operating system. The startup time of the first operating system is shorter than that of the second operating system. Therefore, the first startup animation of the first operating system is played on the screen first, and after the first startup animation finishes playing, the second startup animation of the second operating system is played.

[0154] In an optional embodiment, the second boot animation of the second operating system is a static image, the content of which is consistent with the content of the default desktop. Since the content displayed in the second boot animation is consistent with the content displayed on the default desktop, from a user experience perspective, after the second boot animation finishes playing, the user directly enters the default desktop, ensuring a unified display of the entire system and effectively improving the user experience.

[0155] Step 702: Render the image generated by the first operating system in the first preset area of ​​the first layer, and render the image generated by the second operating system in the second preset area of ​​the second layer; wherein, the first preset area corresponds to the first display area of ​​the screen, the second preset area corresponds to the second display area of ​​the screen, the first display area and the second display area do not overlap, wherein, when the first layer and the second layer are superimposed, the preset area of ​​the lower layer can be displayed through the upper layer.

[0156] This embodiment uses two layers: a first layer (Display-Highlayer) and a second layer (Display-Lowlayer). The coordinates of the first and second layers correspond one-to-one. An image generated by a first operating system is rendered in a first preset area of ​​the first layer, and an image generated by a second operating system is rendered in a second preset area of ​​the second layer. The first and second preset areas correspond to non-overlapping first and second display areas on the screen. When displaying the first and second layers simultaneously, the first layer can be superimposed on the second layer, and the preset area of ​​the lower second layer can be displayed through the upper first layer. In optional embodiments, the areas of the first and second display areas can be the same or different; this invention does not impose any limitations on this.

[0157] The images generated by the first operating system may include, but are not limited to, instrument panel images, while the images generated by the second operating system may include, but are not limited to, central control panel images and application lists. Instrument panel images include the instrument panel content described above, central control panel images include the central control panel content described above, and application lists include the applications for the entertainment and multimedia content described above.

[0158] Step 703: Overlay the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen.

[0159] When the first layer and the second layer are displayed overlaid on the screen, the image generated by the first operating system and the image generated by the second operating system displayed on the screen can be used as the default desktop of the screen.

[0160] The screen interface display processing method of this invention, through the above technical solution, by simultaneously displaying images generated by the first operating system and images generated by the second operating system on different display areas of the screen, facilitates user search, makes operation more convenient for users while driving, allows users to obtain all the necessary information through a single screen, improves user experience, and reduces costs and security risks.

[0161] In an optional embodiment, the step of rendering the image generated by the first operating system in a first preset area of ​​a first layer and rendering the image generated by the second operating system in a second preset area of ​​a second layer includes:

[0162] The image generated by the first operating system is rendered in a first preset area of ​​the first layer, the image generated by the second operating system is rendered in a second preset area of ​​the second layer, and the application list of the second operating system is rendered in a third preset area of ​​the second layer; the third preset area corresponds to the third display area of ​​the screen, and the first display area, the second display area and the third display area do not overlap with each other, wherein when the first layer and the second layer are superimposed, each preset area of ​​the lower layer can be displayed through the upper layer.

[0163] In this embodiment, the image generated by the first operating system is rendered in a first preset area of ​​the first layer, and the image and application list generated by the second operating system are rendered in a second preset area and a third preset area of ​​the second layer, respectively. The first preset area, the second preset area, and the third preset area correspond to a first display area, a second display area, and a third display area on the screen that do not overlap. In optional embodiments, the areas of the first display area, the second display area, and the third display area may be the same or different, and this invention does not impose any limitations on this.

[0164] In an optional embodiment, the image generated by the first operating system is an instrument panel image, and the image generated by the second operating system is a central control panel image. The step of overlaying the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen includes:

[0165] The first layer and the second layer are overlaid on the screen to display the instrument image, the central control image, and the application list on the screen;

[0166] The instrument panel image, the central control panel image, and the application list displayed on the screen will be used as the default desktop of the screen.

[0167] The screen interface display processing method of this invention, through the above technical solution, displays instrument images, central control images, and application lists on different display areas of the screen. This allows the instrument images, central control images, and application lists to be displayed on the same screen simultaneously, making it convenient for users to find information and making it more convenient for users to operate while driving. All the necessary information can be obtained through a single screen, improving the user experience while reducing costs and safety risks.

[0168] In an optional embodiment, the step of rendering the image generated by the second operating system to a second preset area of ​​the second layer includes:

[0169] The image of the in-vehicle virtual personal assistant generated by the second operating system is rendered in the fourth preset area of ​​the second layer, wherein the fourth preset area corresponds to the fourth display area; the fourth display area does not overlap with the first display area, the second display area, and the third display area.

[0170] The instrument panel image, the central control image, the application list, and the in-vehicle virtual personal assistant image displayed on the screen will be used as the default desktop of the screen.

[0171] In an optional embodiment, the second operating system may also generate a system status bar. The step of rendering the image generated by the second operating system into the second preset area of ​​the second layer then includes: rendering the image generated by the second operating system and the system status bar into the second preset area. Wherein, the image generated by the second operating system can be a central control image, in which case the central control image and the system status bar can be rendered into the second preset area. The system status bar can display various system status information, such as time, network status, Bluetooth, etc., and this invention does not impose any limitations on this.

[0172] In an optional embodiment, when rendering the image generated by the second operating system and the system status bar in a second preset area, the method further includes: binding the system status bar and the central control image so that the state of the system status bar is consistent with the state of the central control image.

[0173] This includes ensuring that the status of the system status bar is consistent with the status of the image generated by the second operating system, including:

[0174] In response to a hiding operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are hidden based on the hiding operation; or, in response to an editing operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are edited based on the editing operation. The editing operation includes zooming out, zooming in, and moving.

[0175] In another embodiment of the present invention, a screen interface display processing device 800 is also provided. This device 800 is applied to an in-vehicle terminal, on which a first operating system and a second operating system run. The device 800 can perform operations such as... Figure 7 The screen interface display processing method shown.

[0176] like Figure 8 As shown, the screen interface display processing device 800 includes:

[0177] The startup module 801 is used to start the first operating system and the second operating system in response to a startup command.

[0178] Display module 802 is used to render an image generated by the first operating system in a first preset area of ​​a first layer, and to render an image generated by the second operating system in a second preset area of ​​a second layer; to overlay the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen; wherein, the first preset area corresponds to the first display area of ​​the screen, the second preset area corresponds to the second display area of ​​the screen, the first display area and the second display area do not overlap, and wherein, when the first layer and the second layer are overlaid, the preset area of ​​the lower layer can be displayed through the upper layer.

[0179] In an optional embodiment, the display module 802 is further configured to: render an image generated by the first operating system in a first preset area of ​​a first layer, render an image generated by the second operating system in a second preset area of ​​a second layer, and render the application list of the second operating system in a third preset area of ​​the second layer; the third preset area corresponds to a third display area of ​​the screen, and the first display area, the second display area, and the third display area do not overlap with each other, wherein when the first layer and the second layer are superimposed, each preset area of ​​the lower layer can be displayed through the upper layer.

[0180] In an optional embodiment, the image generated by the first operating system is an instrument image, and the image generated by the second operating system is a central control image;

[0181] The display module 802 is further configured to: overlay the first layer and the second layer on the screen to display the instrument image, the central control image and the application list on the screen; and use the instrument image, the central control image and the application list displayed on the screen as the default desktop of the screen.

[0182] In an optional embodiment, the display module 802 is further configured to: render the in-vehicle virtual personal assistant image generated by the second operating system in a fourth preset area of ​​the second layer, wherein the fourth preset area corresponds to the fourth display area; the fourth display area does not overlap with the first display area, the second display area, and the third display area; and use the instrument panel image, the central control image, the application list, and the in-vehicle virtual personal assistant image displayed on the screen as the default desktop of the screen.

[0183] In an optional embodiment, the display module 802 is further configured to: render the image generated by the second operating system and the system status bar in the second preset area.

[0184] In an optional embodiment, the device 800 further includes a binding module for binding the image generated by the second operating system to the system status bar so that the status of the system status bar is consistent with the status of the image generated by the second operating system.

[0185] In an optional embodiment, the binding module is further configured to: in response to a hiding operation on an image generated by the second operating system, hide the image generated by the second operating system and the system status bar based on the hiding operation; or, in response to an editing operation on an image generated by the second operating system, edit the image generated by the second operating system and the system status bar based on the editing operation.

[0186] In another embodiment of the present invention, an electronic device is also provided. The electronic device may include: a processor, a memory, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the various processes of the above-described screen interface display processing method embodiment and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0187] For example, such as Figure 9 As shown, the electronic device includes a processor 901, a communication interface 902, a memory 903, and a communication bus 904. The processor 901, the communication interface 902, and the memory 903 communicate with each other through the communication bus 904. The memory 903 is used to store computer programs. When the processor 901 executes the program stored in the memory 903, it implements any of the screen interface display processing methods described in the above embodiments.

[0188] In another embodiment of the present invention, a computer-readable storage medium is also provided, which stores instructions that, when executed on a computer, cause the computer to perform any of the screen interface display processing methods described in the above embodiments.

[0189] In another embodiment of the present invention, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to execute any of the screen interface display processing methods described in the above embodiments.

[0190] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0191] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0192] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause an in-vehicle terminal to execute the methods described in the various embodiments of the present invention.

[0193] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of the present invention.

[0194] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this invention can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0195] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0196] In the embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0197] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0198] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0199] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0200] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A screen interface display processing method, characterized in that, Applied to an in-vehicle terminal, wherein the in-vehicle terminal runs a first operating system and a second operating system, the method includes: The second operating system is set to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support the dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system; In response to the startup command, the first operating system and the second operating system are started; According to preset configuration information, the images generated by the first operating system and the images generated by the second operating system are displayed on the screen, wherein the preset configuration information is used to indicate the size and position of the display windows of the images generated by the first operating system and the images generated by the second operating system; The method further includes: When multiple identical applications are displayed on the screen, in response to a launch operation for the multiple identical applications, the output content of the multiple identical applications is synchronized; The multiple identical applications include a first application and a second application; The step of synchronizing the output of the multiple identical applications in response to a launch operation includes: In response to a launch operation for the second application, a confirmation pop-up is displayed, the confirmation pop-up including a confirmation control for determining whether to project the playback content of the first application; In response to a selection operation on the confirmation control, the output of the second application is synchronized to make the output of the second application consistent with the output of the first application; The synchronization of the output of the second application includes: A stack is created based on the package name of the first application, and the surface control of the first application is stored in the stack. In response to a selection operation on the confirmation control, the surface control of the first application is obtained based on the package name of the second application; Adjust the surface control of the first application to fill the display window of the second application, based on the size of the display windows of the first application and the second application. Register a listening service, which is used to listen to the stack corresponding to the first application, and determine when the stack corresponding to the first application changes, and determine the output content of the first application changes and the output content of the first application after the change when the stack of the first application changes. In response to a change operation on the output content of the first application, the stack corresponding to the first application is updated; The monitoring service detects a change in the stack corresponding to the first application and determines the updated stack of the first application. The output of the second application is synchronized based on the updated stack of the first application.

2. The method according to claim 1, characterized in that, The provision supporting dynamic adjustment of the display window size of multiple target units displayed on the screen includes: supporting zooming in and zooming out of the display window of multiple target units displayed on the screen; The provision supporting dynamic adjustment of the position of the display windows of multiple target units displayed on the screen includes: supporting the movement operation of the display windows of multiple target units displayed on the screen.

3. The method according to claim 2, characterized in that, The method further includes: In response to an edit trigger operation of a touch object, the first operating system and the second operating system are set to edit mode, wherein the edit mode is used to indicate that multiple target units displayed on the screen are editable units; In the editing mode, in response to an editing operation on the target unit to be edited, the target unit to be edited is edited accordingly, including zooming in, zooming out, or moving.

4. The method according to claim 3, characterized in that, In the editing mode, in response to an editing operation on the target unit to be edited, the target unit to be edited is edited accordingly, including: In the editing mode, in response to a movement operation on the target unit to be edited, the target unit to be edited is moved to a target position, and the original target unit at the target position is moved to the initial position of the target unit to be edited; or In the editing mode, in response to a zoom-out operation on the target unit to be edited, the display window of the target unit to be edited is zoomed out, and a blank area at the initial position of the target unit to be edited is determined. The blank area is then filled according to a preset filling pattern. or In the editing mode, in response to a zoom operation on the target unit to be edited, the display window of the target unit to be edited is zoomed in, the coverage area of ​​the zoomed-in target unit to be edited is determined, the original target unit on the coverage area is determined, and the original target unit on the coverage area is closed.

5. The method according to claim 4, characterized in that, In the editing mode, in response to an editing operation on the target unit to be edited, the target unit to be edited is edited accordingly, including: In the editing mode, in response to an editing operation on an image generated by the first operating system, the second operating system generates editing data and sends the editing data to the first operating system, so that the first operating system can edit the image generated by the first operating system accordingly based on the editing data.

6. The method according to any one of claims 1-5, characterized in that, The step of displaying the images generated by the first operating system and the second operating system on the screen according to preset configuration information includes: The image generated by the first operating system is rendered in the first preset area of ​​the first layer, and the image generated by the second operating system is rendered in the second preset area of ​​the second layer; wherein, the first preset area corresponds to the first display area of ​​the screen, the second preset area corresponds to the second display area of ​​the screen, the first display area and the second display area do not overlap, and wherein, when the first layer and the second layer are superimposed, the preset area of ​​the lower layer can be displayed through the upper layer. The first layer and the second layer are overlaid on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen.

7. The method according to claim 6, characterized in that, The step of rendering the image generated by the first operating system in a first preset area of ​​a first layer and rendering the image generated by the second operating system in a second preset area of ​​a second layer includes: The image generated by the first operating system is rendered in a first preset area of ​​the first layer, the image generated by the second operating system is rendered in a second preset area of ​​the second layer, and the application list of the second operating system is rendered in a third preset area of ​​the second layer; the third preset area corresponds to the third display area of ​​the screen, and the first display area, the second display area and the third display area do not overlap with each other, wherein when the first layer and the second layer are superimposed, each preset area of ​​the lower layer can be displayed through the upper layer.

8. The method according to claim 7, characterized in that, The image generated by the first operating system is an instrument panel image, and the image generated by the second operating system is a central control panel image; The step of overlaying the first layer and the second layer on the screen to display the image generated by the first operating system and the image generated by the second operating system on the screen includes: The first layer and the second layer are overlaid on the screen to display the instrument image, the central control image, and the application list on the screen; The instrument panel image, the central control panel image, and the application list displayed on the screen will be used as the default desktop of the screen.

9. The method according to claim 8, characterized in that, The step of rendering the image generated by the second operating system into the second preset area of ​​the second layer includes: The image of the in-vehicle virtual personal assistant generated by the second operating system is rendered in the fourth preset area of ​​the second layer, wherein the fourth preset area corresponds to the fourth display area; the fourth display area does not overlap with the first display area, the second display area and the third display area. The instrument panel image, the central control image, the application list, and the in-vehicle virtual personal assistant image displayed on the screen will be used as the default desktop of the screen.

10. The method according to claim 6, characterized in that, The step of rendering the image generated by the second operating system into the second preset area of ​​the second layer includes: The image and system status bar generated by the second operating system are rendered in the second preset area.

11. The method according to claim 10, characterized in that, The method further includes: The image generated by the second operating system is bound to the system status bar so that the state of the system status bar is consistent with the state of the image generated by the second operating system.

12. The method according to claim 11, characterized in that, Binding the image generated by the second operating system to the system status bar, so that the state of the system status bar is consistent with the state of the image generated by the second operating system, includes: In response to a hiding operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are hidden based on the hiding operation; or In response to an editing operation on an image generated by the second operating system, the image generated by the second operating system and the system status bar are edited based on the editing operation.

13. The method according to claim 7, characterized in that, Setting the second operating system to the first mode includes: setting the launch mode of the applications in the application list to the second mode; The method further includes: in response to a launch operation on an application in the application list, determining the launch mode of the application; If the application is determined to launch in the second mode, the size and position of the application's display window are set to match the size and position of the application list's display window.

14. The method according to claim 1, characterized in that, The step of synchronizing the output of the multiple identical applications in response to a launch operation includes: In response to a launch operation for the first application, the output of the first application is displayed.

15. The method according to claim 8 or 9, characterized in that, The first operating system is a real-time operating system, and the second operating system is a mobile operating system; The step of responding to a startup command and starting the first operating system and the second operating system includes: In response to the startup command, the first operating system is started and the second operating system is started as a virtual machine process; The first boot animation of the first operating system is played on the screen. After the first boot animation finishes playing, the second boot animation of the second operating system is played.

16. The method according to claim 15, characterized in that, The second boot animation is a static image, and the content of the static image is the same as the content of the default desktop.

17. A screen interface display processing device, characterized in that, Applied to an in-vehicle terminal, the in-vehicle terminal running a first operating system and a second operating system, the device includes: The setting module is used to set the second operating system to a first mode, wherein the first mode is used to instruct the second operating system to support the operation and display of multiple target units on the screen, and to support dynamic adjustment of the size and position of the display windows of the multiple target units displayed on the screen; the target units include images generated by the first operating system and images generated by the second operating system; A startup module is used to sequentially start the first operating system and the second operating system in response to a startup command; The display module is used to display images generated by the first operating system and images generated by the second operating system on the screen according to preset configuration information, wherein the preset configuration information is used to indicate the size and position of the display windows of the images generated by the first operating system and the images generated by the second operating system; The device further includes a synchronization module for synchronizing the output content of the multiple identical applications in response to a launch operation for the multiple identical applications when multiple identical applications are displayed on the screen; The multiple identical applications include a first application and a second application; The synchronization module is further configured to: in response to a launch operation for the second application, display a confirmation pop-up window, the confirmation pop-up window including a confirmation control, the confirmation control being used to determine to project the playback content of the first application; and in response to a selection operation of the confirmation control, synchronize the output content of the second application so that the output content of the second application is consistent with the output content of the first application. The synchronization module is further configured to: create a stack based on the package name of the first application, and store the surface control of the first application in the stack; in response to a selection operation of the confirmation control, obtain the surface control of the first application based on the package name of the second application; adjust the surface control of the first application according to the size of the display windows of the first application and the second application so that it fills the display window of the second application; register a listening service, the listening service being configured to listen to the stack corresponding to the first application, determine that the output content of the first application has changed and determine the changed output content of the first application when the stack corresponding to the first application changes; in response to a change operation of the output content of the first application, update the stack corresponding to the first application; when the listening service detects a change in the stack corresponding to the first application, determine the updated stack of the first application; and synchronize the output content of the second application based on the updated stack of the first application.

18. An electronic device, characterized in that, include: One or more processors; A storage device for storing one or more programs that, when executed by one or more processors, cause the one or more processors to perform the method as described in any one of claims 1-16.

19. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-16.

Images