Multi-screen display method, terminal equipment, electronic equipment and storage medium

Abstract

The invention relates to the technical field of display, particularly provides a multi-screen display method, terminal equipment, electronic equipment and a storage medium, and aims to solve the technical problem that the personalized customization demand of a user cannot be met when the terminal equipment projects a screen to a vehicle machine. In order to achieve the purpose, the method comprises the steps that an identifier and display configuration information of an entity display screen of the electronic equipment are obtained; creating a virtual screen of the same identifier based on the identifier, and setting display configuration information of the virtual screen based on the display configuration information; the virtual screen is sent to the electronic equipment, so that the display content of the virtual screen is displayed on an entity display screen of the electronic equipment; and obtaining an application program starting instruction, and displaying a display interface of the application program on an entity display screen or a virtual screen of the terminal equipment based on the application program starting instruction. Through the above implementation mode, the configuration information between the entity display screen of the terminal equipment and the plurality of virtual screens does not interfere with each other, and smooth, consistent and personalized interaction experience is provided for a user.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a multi-screen display method, a terminal device, an electronic device and a storage medium. Background Art

[0002] Currently, in the Android native system, the device configuration information is globally unique. When the configuration information of an Android device changes, it will be fully updated so that the display content of all screens will change synchronously.

[0003] With the development of the interconnection between car computers and mobile phones, the virtual screen of Android phones is generally used to project the screen onto the car computer, allowing the car computer to share the rich functions of the mobile phone, which has prompted users to generate more personalized customization needs. Users expect that some configuration information on the virtual screen of the Android phone can be consistent with that of the car computer, such as the dark and light color mode, text size, language, resolution, etc. of the mobile phone virtual screen can be consistent with the car computer. However, due to the global uniqueness of the Android system configuration information and the full update mechanism, the further optimization and improvement of the interconnection experience between the car computer and the mobile phone is limited, and it is difficult to provide users with a smoother, consistent and personalized interactive experience. Summary of the invention

[0004] In order to overcome the above-mentioned defects, the present application is proposed to provide a multi-screen display method, terminal device, electronic device and storage medium that solve or at least partially solve the technical problem that when the terminal device is projected onto the vehicle computer, the personalized customization needs of the user cannot be met.

[0005] In a first aspect, a multi-screen display method is provided, which is applied to a terminal device, wherein the terminal device is communicatively connected to at least one electronic device, and both the terminal device and the electronic device include a physical display screen, and the method includes:

[0006] Acquire an identifier and display configuration information of a physical display screen of the electronic device; the display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution;

[0007] Creating a virtual screen with the same identifier based on the identifier, and setting display configuration information of the virtual screen based on the display configuration information;

[0008] Sending the virtual screen to the electronic device so that the display content of the virtual screen is displayed on the physical display screen of the electronic device;

[0009] An application startup instruction is obtained, and a display interface of the application is displayed on the physical display screen of the terminal device or the virtual screen based on the application startup instruction.

[0010] In a technical solution of the above-mentioned multi-screen display method, the terminal device includes a plurality of applications, and the application has a first display interface corresponding to a physical display screen of the terminal device and a second display interface corresponding to the virtual screen; after setting the display configuration information of the virtual screen based on the display configuration information, the method further includes:

[0011] Based on the identifier and display configuration information of the virtual screen, the second display interface corresponding to the application and the virtual screen is constructed.

[0012] In a technical solution of the above-mentioned multi-screen display method, the terminal device includes a first user interface and a second user interface, the first user interface is an interactive interface corresponding to the physical display screen of the terminal device, and the second user interface is an interactive interface corresponding to the virtual screen; the obtaining application startup instruction includes:

[0013] Acquire a first application startup instruction based on the first user interface;

[0014] Or, obtaining a second application startup instruction based on the second user interface;

[0015] Among them, the first application startup instruction includes the identifier and display configuration information of the physical display screen of the terminal device; the second application startup instruction includes the identifier and display configuration information of the virtual screen.

[0016] In a technical solution of the above-mentioned multi-screen display method, displaying the display interface of the application on the physical display screen or the virtual screen of the terminal device based on the application startup instruction includes:

[0017] When the first application startup instruction is acquired based on the first user interface, the first display interface of the application is displayed on the physical display screen of the terminal device based on the identifier and display configuration information of the physical display screen of the terminal device;

[0018] When the second application startup instruction is acquired based on the second user interface, the second display interface of the application is displayed on the corresponding virtual screen based on the identifier and display configuration information of the virtual screen.

[0019] In a technical solution of the above-mentioned multi-screen display method, the setting of the display configuration information of the virtual screen based on the display configuration information includes:

[0020] Based on the display configuration information, setting the display configuration information of all window containers corresponding to the virtual screen;

[0021] The window container includes a plurality of windows, and each of the windows includes a display interface and / or a navigation function bar of at least one of the applications.

[0022] In a technical solution of the above multi-screen display method, the method further includes:

[0023] Receiving an update instruction from the electronic device; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information, the update instruction is triggered based on a user's change operation, or is triggered based on the electronic device satisfying a preset condition; acquiring a virtual screen to be updated based on the identifier of the physical display screen of the electronic device;

[0024] The display configuration information of the virtual screen to be updated is updated based on the display configuration update information.

[0025] In a technical solution of the above multi-screen display method, after obtaining the identifier and display configuration information of the physical display screen of the electronic device, the method further includes:

[0026] Determining whether historical connection information is obtained based on the identifier;

[0027] If the historical connection information is acquired, the historically created virtual screen is sent to the electronic device based on the historical connection information, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

[0028] In a technical solution of the above multi-screen display method, the method further includes:

[0029] If the historical connection information is not obtained, a virtual screen with the same identifier is created based on the identifier, and display configuration information of the virtual screen is set based on the display configuration information.

[0030] In a second aspect, the present application provides a multi-screen display method, which is applied to an electronic device, characterized in that the electronic device is communicatively connected to a terminal device, and the electronic device includes a physical display screen, and the method includes:

[0031] Sending an identifier and display configuration information of the physical display screen of the electronic device to the terminal device, so that the terminal device creates a virtual screen based on the identifier and the display configuration information;

[0032] Receiving the virtual screen created by the terminal device, and displaying the display content of the virtual screen on the physical display screen of the electronic device;

[0033] The display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution.

[0034] In a technical solution of the above multi-screen display method, the method further includes:

[0035] In response to a user's change operation or the electronic device meeting a preset condition, acquiring an update instruction; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information;

[0036] In a third aspect, a terminal device is provided, which includes a processor, a memory and a physical display screen, wherein the memory is suitable for storing multiple program codes, and the program codes are suitable for being loaded and run by the processor to execute the multi-screen display method described in any one of the technical solutions of the multi-screen display method applied to the terminal device.

[0037] In a fourth aspect, an electronic device is provided, comprising a processor, a memory and a physical display screen, wherein the memory is suitable for storing multiple program codes, and the program codes are suitable for being loaded and run by the processor to execute the multi-screen display method described in any one of the technical solutions of the multi-screen display method applied to the electronic device.

[0038] In a fifth aspect, a computer-readable storage medium is provided, in which a plurality of program codes are stored, wherein the program codes are suitable for being loaded and run by a processor to execute the multi-screen display method described in any one of the technical solutions of the multi-screen display method applied to a terminal device or an electronic device.

[0039] Solution 1. A multi-screen display method, applied to a terminal device, characterized in that the terminal device is communicatively connected to at least one electronic device, and both the terminal device and the electronic device include a physical display screen, and the method includes:

[0040] Acquire an identifier and display configuration information of a physical display screen of the electronic device; the display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution;

[0041] Creating a virtual screen with the same identifier based on the identifier, and setting display configuration information of the virtual screen based on the display configuration information;

[0042] Sending the virtual screen to the electronic device so that the display content of the virtual screen is displayed on the physical display screen of the electronic device;

[0043] An application startup instruction is obtained, and a display interface of the application is displayed on the physical display screen of the terminal device or the virtual screen based on the application startup instruction.

[0044] Solution 2. The multi-screen display method according to Solution 1 is characterized in that the terminal device includes a plurality of applications, and the application has a first display interface corresponding to a physical display screen of the terminal device and a second display interface corresponding to the virtual screen; after setting the display configuration information of the virtual screen based on the display configuration information, the method further includes:

[0045] Based on the identifier and display configuration information of the virtual screen, the second display interface corresponding to the application and the virtual screen is constructed.

[0046] Solution 3. The multi-screen display method according to Solution 2 is characterized in that the terminal device includes a first user interface and a second user interface, the first user interface is an interactive interface corresponding to the physical display screen of the terminal device, and the second user interface is an interactive interface corresponding to the virtual screen; the obtaining of the application startup instruction includes:

[0047] Acquire a first application startup instruction based on the first user interface;

[0048] Or, obtaining a second application startup instruction based on the second user interface;

[0049] Among them, the first application startup instruction includes the identifier and display configuration information of the physical display screen of the terminal device; the second application startup instruction includes the identifier and display configuration information of the virtual screen.

[0050] Solution 4. The multi-screen display method according to Solution 3 is characterized in that displaying the display interface of the application on the physical display screen of the terminal device or the virtual screen based on the application startup instruction includes:

[0051] When the first application startup instruction is acquired based on the first user interface, the first display interface of the application is displayed on the physical display screen of the terminal device based on the identifier and display configuration information of the physical display screen of the terminal device;

[0052] When the second application startup instruction is acquired based on the second user interface, the second display interface of the application is displayed on the corresponding virtual screen based on the identifier and display configuration information of the virtual screen.

[0053] Solution 5. The multi-screen display method according to Solution 1, characterized in that the display configuration information of the virtual screen is set based on the display configuration information, comprising:

[0054] Based on the display configuration information, setting the display configuration information of all window containers corresponding to the virtual screen;

[0055] The window container includes a plurality of windows, and each of the windows includes a display interface and / or a navigation function bar of at least one of the applications.

[0056] Solution 6. The multi-screen display method according to Solution 1, characterized in that the method further comprises:

[0057] Receiving an update instruction from the electronic device; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information, and the update instruction is triggered based on a user's change operation or based on the electronic device satisfying a preset condition;

[0058] Acquire a virtual screen to be updated based on the identifier of the physical display screen of the electronic device;

[0059] The display configuration information of the virtual screen to be updated is updated based on the display configuration update information.

[0060] Solution 7. The multi-screen display method according to Solution 1 is characterized in that after obtaining the identifier and display configuration information of the physical display screen of the electronic device, the method further comprises:

[0061] Determining whether historical connection information is obtained based on the identifier;

[0062] If the historical connection information is acquired, the historically created virtual screen is sent to the electronic device based on the historical connection information, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

[0063] Solution 8. The multi-screen display method according to Solution 7, characterized in that the method further comprises:

[0064] If the historical connection information is not obtained, a virtual screen with the same identifier is created based on the identifier, and display configuration information of the virtual screen is set based on the display configuration information.

[0065] Solution 9. A multi-screen display method, applied to an electronic device, characterized in that the electronic device is communicatively connected to a terminal device, the electronic device includes a physical display screen, and the method includes:

[0066] Sending an identifier and display configuration information of the physical display screen of the electronic device to the terminal device, so that the terminal device creates a virtual screen based on the identifier and the display configuration information;

[0067] Receiving the virtual screen created by the terminal device, and displaying the display content of the virtual screen on the physical display screen of the electronic device;

[0068] The display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution.

[0069] Solution 10. The multi-screen display method according to Solution 9, characterized in that the method further comprises:

[0070] In response to a user's change operation or the electronic device meeting a preset condition, acquiring an update instruction; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information;

[0071] The update instruction is sent to the terminal device, so that the terminal device updates the display configuration information of the virtual screen to be updated.

[0072] Solution 11. A terminal device comprises a processor, a memory and a physical display screen, wherein the memory is suitable for storing multiple program codes, and is characterized in that the program codes are suitable for being loaded and run by the processor to execute the multi-screen display method described in any one of Solutions 1 to 8.

[0073] Solution 12. An electronic device comprising a processor, a memory and a physical display screen, wherein the memory is suitable for storing multiple program codes, and wherein the program codes are suitable for being loaded and run by the processor to execute the multi-screen display method described in any one of Solutions 9 to 10.

[0074] Solution 13. A computer-readable storage medium storing a plurality of program codes, wherein the program codes are suitable for being loaded and run by a processor to execute the multi-screen display method described in any one of Solutions 1 to 8 or Solutions 9 to 10.

[0075] The above one or more technical solutions of this application have at least one or more of the following Beneficial effects:

[0076] In the technical solution for implementing the present application, a terminal device is communicated with at least one electronic device, and the terminal device can obtain an identifier and display configuration information of a physical display screen of the electronic device, thereby creating a corresponding virtual screen under a root window container that manages the window screen, and setting the display configuration information of all window containers under the virtual screen according to the identifier and display configuration information of the physical display screen of each electronic device, thereby independently controlling the display configuration of each virtual screen, and removing the restriction that the virtual screen in the Android system is subject to global updates of native configuration information, so that the configuration information of the physical display screen of the terminal device and multiple virtual screens do not interfere with each other. For the scenario in which the virtual screen of a mobile phone is remotely projected to a car computer, the display configuration information of the virtual screen can be personalized so that the parameters such as the dark and light color mode, text size, language, and resolution of the virtual screen are consistent with the car computer system, providing users with a smoother, consistent and personalized interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] The disclosure of the present application will become easier to understand with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present application. Among them:

[0078] Figure 1 This is a schematic flow chart of the main steps of a multi-screen display method according to an embodiment of the present application;

[0079] Figure 2 is a schematic diagram of a root window container according to an embodiment of the present application;

[0080] Figure 3 is a schematic diagram of a multi-screen main process display method according to an embodiment of the present application;

[0081] Figure 4 is a flowchart of main steps of a multi-screen display method according to another embodiment of the present application;

[0082] Figure 5 is a schematic flow chart of main steps of a multi-screen display method according to another embodiment of the present application;

[0083] Figure 6 It is a schematic diagram of the main structure of a terminal device according to an embodiment of the present application. DETAILED DESCRIPTION

[0084] Some embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application and are not intended to limit the protection scope of the present application.

[0085] In the description of the present application, the term "A and / or B" means all possible combinations of A and B, such as only A, only B, or A and B. The term "at least one of A or B" or "at least one of A and B" has a similar meaning to "A and / or B" and may include only A, only B, or A and B. The singular terms "a", "the" and "the" may also include plural forms.

[0086] As described in the background art, in the Android native system, the configuration information of the device is globally unique. When the configuration information of the Android device changes, a full update will be performed so that the display content of all screens will change synchronously.

[0087] With the development of the interconnection between car computers and mobile phones, the virtual screen of Android phones is generally used to project the screen onto the car computer, allowing the car computer to share the rich functions of the mobile phone, which has prompted users to generate more personalized customization needs. Users expect that some configuration information on the virtual screen of the Android phone can be consistent with that of the car computer, such as the dark and light color mode, text size, language, resolution, etc. of the mobile phone virtual screen can be consistent with the car computer. However, due to the global uniqueness of the Android system configuration information and the full update mechanism, the further optimization and improvement of the interconnection experience between the car computer and the mobile phone is limited, and it is difficult to provide users with a smoother, consistent and personalized interactive experience.

[0088] In order to solve the above problems, the present application provides a multi-screen display method, a terminal device, an electronic device and a storage medium.

[0089] The multi-screen display method provided in the present application can be applied to terminal devices, specifically mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), netbooks, etc., without limitation here.

[0090] Furthermore, the terminal device is communicatively connected with at least one electronic device so that the terminal device and the electronic device can exchange information. The electronic device can be an in-vehicle device, a smart TV, a wearable device, an augmented reality (AR) device, a virtual reality (VR) device, a robot, etc. The communication connection includes a wired connection (such as a wide area network, a metropolitan area network, a local area network, etc.) and a wireless connection (such as WIFI, Bluetooth, etc.), which is not limited here.

[0091] Among them, both the terminal device and the electronic device include a physical display screen, which can present the information processed by the terminal device or the electronic device in a visual form, so that the user can directly see the information. It can display information in various forms such as text, pictures, and videos. At the same time, the user can control the terminal device or the electronic device by touching or clicking the icons, buttons, and menus on the physical display screen.

[0092] For details, see the attached Figure 1 , Figure 1 This is a schematic diagram of the main steps of a multi-screen display method according to an embodiment of the present application, which is applied to a terminal device. Figure 1 As shown, the multi-screen display method in the embodiment of the present application mainly includes the following steps S101 to S104.

[0093] Step S101: obtaining an identifier and display configuration information of a physical display screen of an electronic device;

[0094] In some application scenarios of terminal devices, such as vehicle-machine interconnection application scenarios, in order to enhance convenience, users can send the content of the terminal device to the display screen of the vehicle-mounted device for display.

[0095] The identifier of the physical display screen of the electronic device is a code or number used to identify the physical display screen of each electronic device, such as the code or number corresponding to the display ID. In the scenario where the terminal device is connected to multiple electronic communications, by obtaining the identifier of the physical display screen of each electronic device, different electronic devices can be accurately distinguished.

[0096] The display configuration information may include at least one of a system light / dark color mode (uimode), a system language (locale), a system font size (Font Scale), and a resolution (Resolution).

[0097] Step S102: creating a virtual screen with the same identifier based on the identifier, and setting display configuration information of the virtual screen based on the display configuration information;

[0098] Among them, the virtual screen is a "virtual display space" simulated by the terminal device at the software level. It allows applications or system services to create a virtual display to carry the image output without being directly associated with the physical display.

[0099] Specifically, the terminal device can create a virtual screen with the same identifier in the root window container (Root Window Container) used by the terminal device to manage window screens based on the identifier of the physical display screen of the electronic device, and set the display configuration information of the virtual screen based on the display configuration information of the physical display screen of the electronic device.

[0100] In this application, a corresponding virtual screen is created on the terminal device according to the identifier of the physical display screen of the electronic device, and a one-to-one correspondence between each physical display screen of the electronic device and the virtual screen can be established to ensure the synchronization of display configuration information. For example, in the application scenario of vehicle-machine interconnection, there are multiple different vehicle screens connected to the mobile phone, and each vehicle screen has its own identifier. After the mobile phone creates a virtual screen with the same identifier for each vehicle screen, the system can clearly identify which virtual screen corresponds to which vehicle screen. In this way, when the display content of the mobile phone virtual screen is presented on the vehicle screen, it can bring a coherent and consistent visual experience to the user.

[0101] Step S103: sending the virtual screen to the electronic device so that the display content of the virtual screen is displayed on the physical display screen of the electronic device;

[0102] The virtual screen created by the terminal device is sent to the electronic device, so that the display content of the virtual screen can be displayed on the physical display screen of the electronic device, so that the user can operate and view on the physical display screen of the electronic device.

[0103] Step S104: Obtain an application startup instruction, and display the display interface of the application on the physical display screen or virtual screen of the terminal device based on the application startup instruction.

[0104] The application in the terminal device can receive an application startup instruction issued by the user. This instruction may include an identifier of a physical display screen or a virtual screen of the terminal device and display configuration information, so that the display interface of the application is displayed on the physical display screen or virtual screen of the terminal device according to the display configuration information.

[0105] Based on the methods described in steps S101 to S104 above, the terminal device can obtain the identifier and display configuration information of the physical display screen of the electronic device, thereby creating a corresponding virtual screen under the root window container of the management window screen, and setting the display configuration information of all window containers under the virtual screen according to the identifier and display configuration information of the physical display screen of each electronic device, thereby independently controlling the display configuration of each virtual screen, and removing the restriction that the virtual screen in the Android system is subject to the global update of native configuration information, so that the configuration information of the physical display screen of the terminal device and multiple virtual screens do not interfere with each other. For the scenario where the virtual screen of the mobile phone is remotely projected to the car computer, the display configuration information of the virtual screen can be personalized so that the parameters such as the dark and light color mode, text size, language, resolution, etc. of the virtual screen are consistent with the car computer system, providing users with a smoother, consistent and personalized interactive experience.

[0106] The above steps S101 to S104 are further explained below.

[0107] In some implementations of the above step S101, when the user needs to display the content of the terminal device through the physical display screen of other electronic devices, the terminal device can establish a communication connection with the other electronic devices, and send an acquisition instruction to the electronic device to obtain the identifier and display configuration information of the physical display screen of the electronic device.

[0108] Specifically, the acquisition instruction can be triggered by establishing a connection between other electronic devices and the terminal device, such as when the terminal device and the vehicle-mounted electronic device are connected via NearBy. The acquisition instruction can also be triggered by starting other electronic devices when other electronic devices are already connected to the terminal device, thereby acquiring the identifier and display configuration information of the physical display screen of the electronic device via NioLink.

[0109] Among them, NearBy is used to discover the networking between devices, that is, to help terminal devices find and identify other connectable electronic devices, and then build a network connection relationship between terminal devices and electronic devices. NioLink is used to realize data transmission, resource sharing and collaborative work between devices in the scenario of vehicle-machine interconnection.

[0110] Furthermore, the system dark and light color mode in the display configuration information is used to switch the overall color tone style of the system interface, which can include dark mode and light mode. In dark mode, the background of the display is mostly black or dark, and the text and icons are lighter in color, which can reduce eye fatigue in low-light environments. The light mode uses white or light colors as the background, and the text and icons are darker in color, which is more readable in strong light environments. Users can switch according to the scene and personal preferences, such as selecting dark mode at night and light mode during the day.

[0111] The system language determines the display language of the system interface and text in applications. Different languages ​​differ in length, typesetting direction (such as Arabic is written from right to left), etc. Changing the system language can adapt to the needs of users in different regions, and users can also switch the system language according to their own needs.

[0112] The system text size is the display size of all text on the display. You can adjust the system text size to suit different vision needs. Larger text is easier for users with poor vision to read, but it may cause some content to be incompletely displayed, and the application needs to adjust the layout, such as wrapping or reducing the size of other elements. Smaller text can display more content in a limited display space.

[0113] Resolution is the precision of displayed images, that is, the number of pixels that the display can display. It is expressed as the product of the number of pixels in the horizontal and vertical directions, such as the common 1920×1080, 3840×2160, etc. The higher the resolution, the clearer and more delicate the displayed images and texts.

[0114] It should be pointed out that the above examples of display configuration information of electronic device display screens are only for illustrative purposes. In practical applications, those skilled in the art may make settings according to specific scenarios, which are not limited here.

[0115] The above is a further description of step S101 , and the following is a further description of step S102 .

[0116] In some implementations of the above step S102, the terminal device may create a virtual screen with the same identifier in the virtual screen list of the root window container according to the identifier of the physical display screen of the electronic device.

[0117] The root window container is the core component of the window management system. All window containers are its child containers. It allocates display space and system resources, such as memory and graphics processing capabilities. It determines the window hierarchy and specifies which windows are displayed in the foreground and which are in the background. It is also responsible for passing display configuration information to each child window container to ensure that each window can adjust its display accordingly.

[0118] See attached Figure 2 , Figure 2 FIG. 1 is a schematic diagram of a root window container according to an embodiment of the present application. Figure 2 As shown, the root window container stores identifiers and display configuration information of a physical display screen and multiple virtual screens of the terminal device.

[0119] The terminal device can set the display configuration information of all window containers corresponding to the virtual screen based on the display configuration information of the physical display screen of the electronic device.

[0120] Specifically, after the terminal device obtains the display configuration information, the information may be synchronized to all window containers included in the virtual screen.

[0121] For example, if the display configuration information obtained indicates that the system is in dark mode and the resolution is a specific value, then after the virtual screen is created, the various window containers inside it will be adjusted. For example, the background color of the window container used to display video playback will be adapted to the dark mode, and may change from light to dark to match the overall system style; at the same time, the window container will adjust the size and display ratio of the internal video screen according to the resolution to ensure that the video can be displayed completely and clearly on the virtual screen.

[0122] The window container includes multiple windows, and each window includes a display interface and / or a navigation function bar of at least one application.

[0123] For example, the window container of an application may include multiple windows such as the main interface window, the setting window, and the pop-up prompt window. Each window includes at least one display interface and / or navigation function bar of the application, that is, the window can be the main display interface of the application, such as the playback interface of a video player, the chat interface of a social software, etc.; it can also be a navigation function bar for auxiliary operations, such as a floating window, a status bar, etc., to facilitate users to perform various operations. The different components of these windows together constitute the interface for users to interact with the application.

[0124] The above is the description of step S102.

[0125] Furthermore, the terminal device includes multiple applications (Application Program, APP), mainly including system applications (such as text messages, calendars, settings, etc.) and third-party applications (such as navigation, short video applications, social applications, etc.).

[0126] Among them, each APP has a first display interface (Activity) corresponding to the physical display screen of the terminal device, that is, a first display interface that matches the display configuration information of the physical display screen of the terminal device. Specifically, the APP will adjust the layout, element size, color matching, etc. of its own interface according to the characteristics of the physical display screen of the terminal device, such as resolution, system light and dark color mode, system language, text size and other display configuration information, to ensure that it can provide good visual effects and user experience on the physical display screen of the terminal device.

[0127] For example, when the physical display screen of the terminal device is set to light mode, the first display interface of the application will be mainly based on a light background, with appropriate text and icon colors to facilitate user viewing and operation.

[0128] Furthermore, each APP also has a second display interface corresponding to the virtual screen. Specifically, after executing the above step S102, the terminal device can construct a second display interface corresponding to the application program and the virtual screen based on the identifier and display configuration information of the virtual screen.

[0129] After the terminal device obtains the display configuration information of the physical display screen of the electronic device and completes setting the display configuration information of the virtual screen, the virtual screen already has a display environment similar to the physical display screen of the electronic device with the same identifier.

[0130] Next, based on the identifier and display configuration information of the virtual screen, a second display interface corresponding to the virtual screen can be constructed for the APP. This is because the display characteristics of the virtual screen may be different from the physical screen of the terminal device, and the APP needs a new display interface to adapt to the virtual screen.

[0131] For example, the resolution of the virtual screen may be different from that of the physical screen of the terminal device, or the system language setting may be different. In order to display the APP content normally and optimally on the virtual screen, it is necessary to rebuild a special display interface (i.e., the second display interface) based on the display configuration information of the virtual screen. The second display interface will be adjusted according to the characteristics of the virtual screen, such as rearranging interface elements to adapt to different resolutions, or displaying text content in the corresponding language according to the system language setting of the virtual screen. By constructing a second display interface, the APP can present an interface on the virtual screen that matches the virtual screen display environment, ensuring that users have a good user experience when using the APP on the virtual screen.

[0132] Among them, the multiple second display interfaces corresponding to the multiple virtual screens can be the same or different. In actual applications, they can be set according to the display configuration information of the physical display screen of the electronic device corresponding to each virtual screen, which is not limited here.

[0133] Furthermore, in some implementations of the above step S103, the terminal device may send the created virtual screen to an electronic device with the same identifier, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

[0134] For example, in the scenario of car-machine interconnection, the user can create a virtual screen with the same identifier as the car screen on the mobile phone, set the display configuration information of the virtual screen according to the display configuration information of the car screen, and send the created virtual screen to the car screen to display the display content of the virtual screen through the car screen, such as navigation application, so that users can view maps and route planning more conveniently and avoid being distracted while driving when viewing the mobile phone screen.

[0135] Furthermore, in some implementations of the above step S104, the terminal device may obtain an application startup instruction, and display a display interface of the application on a physical display screen or a virtual screen of the terminal device based on the application startup instruction.

[0136] Specifically, the terminal device includes a first user interface (Launcher) and a second user interface (SecondLauncher), wherein Launcher is an interactive interface corresponding to a physical display screen of the terminal device, and Second Launcher is an interactive interface corresponding to a virtual screen.

[0137] For terminal devices, Launcher is a core component of the operating system that is used to manage and display application icons, desktop widgets, and provide an interactive interface between users and terminal devices. Second Launcher is an interface provided by the terminal device operating system. It is an interactive interface for the virtual screen (the in-vehicle screen created through vehicle-machine interconnection, such as the virtual screen corresponding to the sky window), which is similar to the desktop function of the terminal device. By distinguishing between Launcher and Second Launcher, users have corresponding operation entrances in different screen scenarios. Among them, the sky window is a physical display screen provided by the vehicle-machine end, which is used to display the display content of the virtual screen of the terminal device and interact with the user.

[0138] Specifically, a first application startup instruction may be obtained based on the first user interface, or a second application startup instruction may be obtained based on the second user interface, wherein the first application startup instruction includes an identifier and display configuration information of a physical display screen of the terminal device, and the second application startup instruction includes an identifier and display configuration information of a virtual screen.

[0139] When the user operates on the Launcher corresponding to the physical display screen of the terminal device, such as clicking on the application icon on the physical display screen of the terminal device, the terminal device will obtain the first application startup instruction. This instruction contains the identifier of the physical display screen of the terminal device (the identifier of the physical display screen of the terminal device is usually 0) and the display configuration information. Among them, the identifier is used to determine the physical display screen of the terminal device, and the display configuration information determines the display method of the application on the physical display screen of the terminal device, such as screen resolution, system dark and light color mode, etc.

[0140] When the user operates on the Second Launcher corresponding to the virtual screen (physical display screen of the electronic device), for example, when clicking the navigation application icon on the car screen, the terminal device will obtain the second application startup instruction. The instruction contains the virtual screen identifier (used to determine which virtual screen it is, such as virtual screen 1, virtual screen 2, etc.) and the corresponding display configuration information.

[0141] Further, when the first application startup instruction is obtained based on the first user interface, the first display interface of the application can be displayed on the physical display screen of the terminal device based on the identifier and display configuration information of the physical display screen of the terminal device;

[0142] For example, when a user clicks on a social application icon on the physical display screen of a mobile phone, the social application can display a first display interface corresponding to the physical display screen of the mobile phone on the physical display screen of the mobile phone.

[0143] When the second application startup instruction is acquired based on the second user interface, the second display interface of the application may be displayed on the corresponding virtual screen based on the identifier and display configuration information of the virtual screen.

[0144] For example, the user clicks on the navigation application icon on the vehicle screen, and the navigation application can display a second display interface corresponding to the vehicle screen on the vehicle screen.

[0145] Through the above implementation, the physical display screen of the terminal device and the display configuration of each virtual screen can be independently controlled, so that the configuration information between the main screen and multiple virtual screens does not interfere with each other, providing users with a personalized interactive experience.

[0146] The above is the description of step S104.

[0147] Furthermore, in some embodiments, since the display configuration information of the physical display screen of the electronic device may change, the terminal device can receive an update instruction from the electronic device, and the update instruction includes an identifier of the physical display screen of the electronic device and display configuration update information; thereby enabling the terminal device to obtain the virtual screen to be updated based on the identifier of the physical display screen of the electronic device, and update the display configuration information of the virtual screen to be updated based on the display configuration update information.

[0148] Among them, the update instruction can be triggered based on the user's change operation, that is, when the user actively changes certain display configurations on the electronic device, it will trigger the electronic device to send an update instruction to the terminal device.

[0149] For example, the user feels that the current light color mode of the car screen is too dazzling when used at night, so he adjusts the system dark-light mode from light to dark. At this time, the car computer detects the user's change operation and generates an update instruction, which contains the identifier of the car screen (used for the terminal device to accurately identify which car screen issued the instruction) and the display configuration update information (that is, the dark-light mode changes from light to dark), and sends the update instruction to the mobile phone connected to it. After receiving the update instruction, the mobile phone can quickly locate the virtual screen to be updated according to the identifier, and update the virtual screen to be updated according to the display configuration update information, so that the virtual screen is also switched to dark mode to ensure consistency with the display mode of the car computer system.

[0150] In some embodiments, the update instruction can also be triggered based on the electronic device meeting preset conditions, that is, some specific conditions are pre-set inside the electronic device system. When the operating status, environmental factors or time of the electronic device reaches these preset conditions, the update instruction will be automatically triggered and sent to the terminal device.

[0151] For example, the car screen sets a preset condition of a time threshold, and automatically switches to dark mode after 7 pm to adapt to the night environment. When the time reaches 7 pm, the car screen meets this preset condition, and it will automatically generate an update instruction, including the identifier of the physical display screen of the car screen and the display configuration update information, and send it to the mobile phone connected to it. After receiving the update instruction, the mobile phone can quickly locate the virtual screen to be updated according to the identifier, and update the virtual screen to be updated according to the display configuration update information to ensure that the display mode of the virtual screen is switched to dark mode synchronously with the car screen. For another example, some electronic devices are preset to automatically switch to dark mode and trigger the update instruction when the ambient light sensor detects that the ambient light intensity is lower than a certain value, and so on.

[0152] Through such update operations, the virtual screen can always keep in sync with the display configuration information of the physical display screen of the electronic device, providing an accurate simulation environment for subsequent content display and interaction.

[0153] Further, in some implementations, after the terminal device establishes a communication connection with the electronic device and obtains the identifier and display configuration information of the physical display screen of the electronic device, it can be determined whether historical connection information is obtained based on the identifier.

[0154] In a multi-device interaction scenario, the terminal device and the electronic device may have previously established a communication connection and completed operations such as data transmission and display configuration information synchronization. Therefore, when the terminal device establishes a communication connection with the electronic device, the terminal device can determine whether to obtain historical connection information through the identifier.

[0155] The historical connection information is the data recorded by the terminal device during the previous connection with the electronic device, which may include the relevant parameters for creating the virtual screen, display configuration information, and some settings for the interaction between the two parties. By determining whether the historical connection information is obtained, the terminal device can decide what actions to take next.

[0156] Furthermore, if the historical connection information is obtained, the historically created virtual screen can be sent to the electronic device based on the historical connection information, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

[0157] Specifically, if the historical connection information is obtained, the terminal device can quickly find and reuse the previously created virtual screen based on the historical connection information, and then execute the above step S103 to send the historically created virtual screen to the electronic device, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device. This can save time and resources for operations such as recreating the virtual screen and adapting the display, improve display efficiency, and provide users with a smoother multi-device interactive experience.

[0158] On the contrary, if the terminal device does not obtain the historical connection information, the above step S102 can be executed, that is, a virtual screen with the same identifier is created based on the identifier, and the display configuration information of the virtual screen is set based on the display configuration information, and then the above step S103 is executed to send it to the electronic device so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

[0159] In some embodiments, see Appendix Figure 3 , Figure 3 It is a schematic diagram of a multi-screen main process display method according to an embodiment of the present application.

[0160] like Figure 3 As shown, the root window container 31 of the terminal device includes identifiers and display configuration information of the physical display screen and multiple virtual screens of the terminal device, through which the display configuration information of all window containers corresponding to the physical display screen 32 of the terminal device and each virtual screen 33 can be set or updated;

[0161] Furthermore, the first display interface 34 and the second display interface 35 corresponding to the application can be updated or constructed based on the identifier and display configuration information of the physical display screen or virtual screen of the terminal device, so as to display the first display interface 34 of the application on the physical display screen 32 of the terminal device, or display the second display interface 35 of the application on the physical display screen 36 of the electronic device corresponding to the virtual screen 33.

[0162] The above is an explanation of the multi-screen display method applied to a terminal device provided in this application.

[0163] Furthermore, the present application also provides a multi-screen display method applied to an electronic device, wherein the electronic device is communicatively connected with a terminal device.

[0164] For details, see the attached Figure 4 , Figure 4 FIG. 1 is a flowchart of the main steps of a multi-screen display method according to another embodiment of the present application, which is applied to an electronic device. Figure 4 As shown, it mainly includes the following steps S401 to S402.

[0165] Step S401: sending the identifier and display configuration information of the physical display screen of the electronic device to the terminal device, so that the terminal device creates a virtual screen based on the identifier and the display configuration information;

[0166] The display configuration information includes at least one of system dark and light color modes, system language, system text size and resolution.

[0167] Step S402: receiving a virtual screen created by a terminal device, and displaying the display content of the virtual screen on a physical display screen of the electronic device.

[0168] Through the above implementation, the electronic device can provide the identifier and display configuration information to the terminal device, so that the terminal device creates a virtual screen and finally presents the display content of the virtual screen on the display screen of the electronic device.

[0169] Furthermore, in some embodiments, the electronic device may obtain an update instruction in response to a user's change operation or the electronic device meeting a preset condition; and send the update instruction to the terminal device so that the terminal device updates the display configuration information of the virtual screen to be updated.

[0170] The update instruction includes an identifier of the physical display screen of the electronic device and display configuration update information.

[0171] Specifically, the electronic device will continuously monitor its own display configuration information to determine whether the display configuration information has been updated. When the user's change operation is obtained or it is determined that the electronic device meets the preset conditions, it will trigger the update instruction and obtain detailed display configuration update information. The display configuration update information specifically describes the changes in the display configuration information. For example, if it was originally a light mode and is now updated to a dark mode, the update information will clearly indicate the mode change; or if the resolution changes from 1920×1080 to 2560×1440, the update information will include the new resolution value.

[0172] Furthermore, the electronic device can send update instructions to the terminal device connected to it for communication, so that the terminal device updates the virtual screen corresponding to the physical display screen of the electronic device, thereby ensuring the consistency and stability of the display effect and improving the user experience during multi-screen interaction.

[0173] The above is an explanation of the multi-screen display method applied to an electronic device provided by the present application.

[0174] The following takes the example of projecting the virtual screen of the mobile phone to the sky window of the car computer to further illustrate the multi-screen display method provided by this application.

[0175] For details, see the attached Figure 5 , Figure 5 FIG. 1 is a flowchart of the main steps of a multi-screen display method according to another embodiment of the present application. Figure 5 As shown, it mainly includes the following steps S501 to S508.

[0176] Step S501: The mobile phone and the vehicle computer establish a communication connection through NearBy, and the sky window of the vehicle computer is started through NioLink;

[0177] Step S502: The mobile phone obtains the identifier and display configuration information of the Sky Window through NioLink;

[0178] Step S503: the mobile phone creates a virtual screen with the same identifier in the root window container based on the identifier, and sets the display configuration information of the virtual screen based on the display configuration information;

[0179] Step S504: the mobile phone sends the created virtual screen to the vehicle computer via NioLink, so that the display content of the virtual screen is displayed on the sky window;

[0180] Furthermore, the user can start the application through the Secondary Launcher of the Sky Window or the Launcher of the physical display screen of the mobile phone. Among them, starting the application through the Secondary Launcher of the Sky Window includes the following steps S505 to S505; starting the application through the Launcher of the physical display screen of the mobile phone includes the following steps S507 to S508.

[0181] Step S505: NioLink starts the Secondary Launcher of Sky Window, starts the application through the SecondaryLauncher, and sends a second application startup instruction to the mobile phone;

[0182] Step S506: the application obtains the identifier and display configuration information of the virtual screen corresponding to the sky window through the second application startup instruction, and displays the second display interface of the application on the virtual screen;

[0183] Step S507: starting the application through the Launcher of the physical display screen of the mobile phone, and sending a first application starting instruction to the application;

[0184] Step S508: The application obtains the identifier and display configuration information of the physical display screen of the mobile phone through the first application startup instruction, and displays the first display interface of the application on the physical display screen of the mobile phone.

[0185] Through the above implementation, the applications on the Sky Window can be displayed according to the display configuration information of the vehicle computer, and the applications on the mobile phone can be displayed according to the display configuration information of the physical display screen of the mobile phone, thereby realizing independent control of the physical display screen of the mobile phone and the display configuration information of each virtual screen, so that the dark and light color mode, text size, language, resolution and other parameters of the virtual screen are consistent with the vehicle computer system, providing users with a smoother, consistent and personalized interactive experience.

[0186] The above is an explanation of the multi-screen display method provided by this application.

[0187] It should be pointed out that although the various steps in the above embodiments are described in a specific order, those skilled in the art can understand that in order to achieve the effect of the present application, different steps do not have to be executed in such an order. They can be executed simultaneously (in parallel) or in other orders. These changes are within the scope of protection of the present application.

[0188] Furthermore, the present application also provides a terminal device. Figure 6 , Figure 6 FIG. 1 is a schematic diagram of the main structure of a terminal device according to an embodiment of the present application. Figure 6 As shown, the terminal device in the embodiment of the present application mainly includes a processor 61, a memory 62 and a physical display screen 63.

[0189] Among them, the processor 61 may include hardware, software or a combination of the two. The processor 61 may be a central processing unit, a microprocessor, an image processor, a digital signal processor or any other suitable processor. The processor 61 has data and / or signal processing functions, which can be implemented in software, hardware or a combination of the two. The memory 62 can be configured to store a program for executing the multi-screen display method applied to the terminal device in the above-mentioned method embodiment, and the processor 61 can be configured to execute the program in the memory 62, which includes but is not limited to executing the program for the multi-screen display method applied to the terminal device in the above-mentioned method embodiment. For ease of explanation, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application.

[0190] In some possible implementations of the present application, the terminal device may include multiple processors 61 and multiple memories 62. The program for executing the multi-screen display method applied to the terminal device of the above method embodiment may be divided into multiple subprograms, each of which may be loaded and run by the processor 61 to execute different steps of the multi-screen display method applied to the terminal device of the above method embodiment. Specifically, each subprogram may be stored in different memories 62, and each processor 61 may be configured to execute the programs in one or more memories 62 to jointly implement the multi-screen display method applied to the terminal device of the above method embodiment.

[0191] Furthermore, the present application also provides an electronic device. In an embodiment of an electronic device according to the present application, the electronic device mainly includes a processor, a memory, and a physical display screen. The electronic device is used to execute the multi-screen display method applied to the electronic device of the above method embodiment.

[0192] For the convenience and simplicity of description, for the description of the processor, memory and physical display screen of the electronic device, reference can be made to the description of the above-mentioned terminal device embodiment, which will not be repeated here.

[0193] Furthermore, the present application also provides a computer-readable storage medium. In a computer-readable storage medium embodiment according to the present application, the computer-readable storage medium can be configured to store a program for executing the multi-screen display method applied to a terminal device or a multi-screen display method applied to an electronic device in the above-mentioned method embodiment, and the program can be loaded and run by a processor to implement the multi-screen display method applied to a terminal device or a multi-screen display method applied to an electronic device. Optionally, the computer-readable storage medium in the embodiment of the present application is a non-temporary computer-readable storage medium, including any entity or device, medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory, random access memory, electrical carrier signal, telecommunication signal, and software distribution medium, etc. that can carry a computer program.

[0194] It should be noted that the relevant user personal information that may be involved in the various embodiments of the present application is strictly in accordance with the requirements of laws and regulations, following the principles of legality, legitimacy and necessity, based on the reasonable purposes of business scenarios, to process the personal information that users actively provide during the use of products / services or generated due to the use of products / services, as well as the personal information obtained with the user's authorization.

[0195] The user personal information processed by this application will vary depending on the specific product / service scenario, and shall be based on the specific scenario in which the user uses the product / service, and may involve the user's account information, device information, driving information, vehicle information or other related information. This application will treat the user's personal information and its processing with a high degree of diligence.

[0196] This application attaches great importance to the security of user personal information and has taken reasonable and feasible security protection measures that meet industry standards to protect user information and prevent personal information from being accessed, disclosed, used, modified, damaged or lost without authorization.

[0197] So far, the technical solution of the present application has been described in conjunction with an embodiment shown in the accompanying drawings, but it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments. Without departing from the principles of the present application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present application.

Claims

1. A multi-screen display method, applied to a terminal device, characterized in that: The terminal device is communicatively connected to at least one electronic device, the terminal device and the electronic device both include a physical display screen, and the method includes: Acquire an identifier and display configuration information of a physical display screen of the electronic device; the display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution; Creating a virtual screen with the same identifier based on the identifier, and setting display configuration information of the virtual screen based on the display configuration information; Sending the virtual screen to the electronic device so that the display content of the virtual screen is displayed on the physical display screen of the electronic device; An application startup instruction is obtained, and a display interface of the application is displayed on the physical display screen of the terminal device or the virtual screen based on the application startup instruction.

2. The multi-screen display method according to claim 1, characterized in that: The terminal device includes a plurality of applications, each of which has a first display interface corresponding to a physical display screen of the terminal device and a second display interface corresponding to the virtual screen; After setting the display configuration information of the virtual screen based on the display configuration information, the method further includes: Based on the identifier and display configuration information of the virtual screen, the second display interface corresponding to the application and the virtual screen is constructed.

3. The multi-screen display method according to claim 2, characterized in that: The terminal device comprises a first user interface and a second user interface, the first user interface being an interactive interface corresponding to a physical display screen of the terminal device, and the second user interface being an interactive interface corresponding to the virtual screen; The obtaining of the application startup instruction comprises: Acquire a first application startup instruction based on the first user interface; Or, obtaining a second application startup instruction based on the second user interface; Among them, the first application startup instruction includes the identifier and display configuration information of the physical display screen of the terminal device; the second application startup instruction includes the identifier and display configuration information of the virtual screen.

4. The multi-screen display method according to claim 3, characterized in that: The display interface of the application program is displayed on the physical display screen or the virtual screen of the terminal device based on the application program startup instruction, comprising: When the first application startup instruction is acquired based on the first user interface, the first display interface of the application is displayed on the physical display screen of the terminal device based on the identifier and display configuration information of the physical display screen of the terminal device; When the second application startup instruction is acquired based on the second user interface, the second display interface of the application is displayed on the corresponding virtual screen based on the identifier and display configuration information of the virtual screen.

5. The multi-screen display method according to claim 1, characterized in that: The step of setting the display configuration information of the virtual screen based on the display configuration information includes: Based on the display configuration information, setting the display configuration information of all window containers corresponding to the virtual screen; The window container includes a plurality of windows, and each of the windows includes a display interface and / or a navigation function bar of at least one of the applications.

6. The multi-screen display method according to claim 1, characterized in that: The method further comprises: Receiving an update instruction from the electronic device; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information, and the update instruction is triggered based on a user's change operation or based on the electronic device satisfying a preset condition; Acquire a virtual screen to be updated based on the identifier of the physical display screen of the electronic device; The display configuration information of the virtual screen to be updated is updated based on the display configuration update information.

7. The multi-screen display method according to claim 1, characterized in that: After obtaining the identifier and display configuration information of the physical display screen of the electronic device, the method further includes: Determining whether historical connection information is obtained based on the identifier; If the historical connection information is acquired, the historically created virtual screen is sent to the electronic device based on the historical connection information, so that the display content of the virtual screen is displayed on the physical display screen of the electronic device.

8. The multi-screen display method according to claim 7, characterized in that: The method further comprises: If the historical connection information is not obtained, a virtual screen with the same identifier is created based on the identifier, and display configuration information of the virtual screen is set based on the display configuration information.

9. A multi-screen display method, applied to an electronic device, characterized in that: The electronic device is communicatively connected with a terminal device, the electronic device includes a physical display screen, and the method includes: Sending an identifier and display configuration information of the physical display screen of the electronic device to the terminal device, so that the terminal device creates a virtual screen based on the identifier and the display configuration information; Receiving the virtual screen created by the terminal device, and displaying the display content of the virtual screen on the physical display screen of the electronic device; The display configuration information includes at least one of a system dark and light color mode, a system language, a system text size, and a resolution.

10. The multi-screen display method according to claim 9, characterized in that: The method further comprises: In response to a user's change operation or the electronic device meeting a preset condition, acquiring an update instruction; the update instruction includes the identifier of the physical display screen of the electronic device and display configuration update information; The update instruction is sent to the terminal device, so that the terminal device updates the display configuration information of the virtual screen to be updated.

Images