Multi-screen display method and system

Abstract

This invention provides a multi-screen display method and system, relating to the field of virtual machine technology. The multi-screen display method is applied to virtual devices deployed in the cloud. Each virtual device includes N virtual displays, where N ≥ 2. Each of the N virtual displays is used to display different applications provided by the virtual device. The N virtual displays correspond to M physical displays, wherein each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display. The method includes synchronizing the interface of a first virtual display to a first physical display. The first physical display is any one of the M physical displays, and the first virtual display is the virtual display corresponding to the first physical display. This invention solves the problem of how to display applications provided by a virtual device on different physical displays.

Description

Technical Field

[0001] This invention relates to the field of virtual machine technology, and more specifically, to a multi-screen display method and system. Background Technology

[0002] With the development of technology, virtual devices can be deployed in the cloud, and the computing power originally deployed on physical terminal devices can be migrated to virtual devices. This reduces the computing power requirements of physical terminal devices, realizes the release of computing power of physical terminal devices, and makes up for the problem of insufficient computing power of physical terminal devices.

[0003] Currently, to meet users' diverse needs for accessing virtual devices, it is possible to allow physical terminal devices, including multiple physical displays, to log in to the virtual device, or to allow multiple physical terminal devices to log in to the same virtual device simultaneously. In other words, multiple physical displays can be allowed to log in to the same virtual device at the same time. Therefore, how to display the applications provided by the virtual device on different physical displays is a problem that urgently needs to be solved. Summary of the Invention

[0004] This invention provides a multi-screen display method and system that can solve the problem of how to display applications provided by virtual devices on different physical displays.

[0005] In a first aspect, this application provides a multi-screen display method applied to a virtual device, the virtual device being deployed in the cloud, the virtual device comprising N virtual displays, where N≥2; each of the N virtual displays is used to display different applications provided by the virtual device; the N virtual displays correspond to M physical displays, wherein each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display; the method includes: synchronizing the interface of a first virtual display to a first physical display; wherein the first physical display is any one of the M physical displays, and the first virtual display is a virtual display corresponding to the first physical display.

[0006] Optionally, the method further includes: receiving a first interaction instruction; wherein the first interaction instruction is sent by a first user to the virtual device through the first physical display screen; in response to the first interaction instruction, synchronizing the interface corresponding to the first interaction instruction to the first physical display screen by displaying an interface corresponding to the first interaction instruction on the first virtual display screen.

[0007] Optionally, responding to the first interaction instruction includes: responding to the first interaction instruction according to its priority.

[0008] Optionally, the method further includes: receiving a first switching instruction; wherein the first switching instruction is sent by a first user to the virtual device through the first physical display screen; the first switching instruction is used to instruct the virtual display screen corresponding to the first physical display screen to be switched to a second virtual display screen; the second virtual display screen is any one of the N virtual display screens other than the first virtual display screen; in response to the first switching instruction, stopping the synchronization of the interface of the first virtual display screen to the first physical display screen, and synchronizing the interface of the second virtual display screen to the first physical display screen.

[0009] Optionally, the third virtual display screen is any one of the N virtual display screens other than the first virtual display screen; the third physical display screen is the physical display screen corresponding to the third virtual display screen and in an online state; the method further includes: receiving a first movement instruction; wherein the first movement instruction is sent by a first user to the virtual device through the first physical display screen; the first movement instruction is used to instruct a first application to be moved from the first physical display screen to the third physical display screen; the first application is any application displayed in the first physical display screen; in response to the first movement instruction, the first application is moved from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

[0010] Optionally, the third virtual display screen is any one of the N virtual display screens other than the first virtual display screen; the third physical display screen is the physical display screen corresponding to the third virtual display screen; the third physical display screen is in an offline state; the method further includes: receiving a first movement instruction; wherein the first movement instruction is sent by a first user to the virtual device through the first physical display screen; the first movement instruction is used to instruct a first application to be moved from the first physical display screen to at least one of the third physical display screens; the first application is any application displayed in the first physical display screen; in response to the first movement instruction, saving the current state of the first application, moving the first application from the first virtual display screen to the third virtual display screen, and maintaining the current state of the first application in the third virtual display screen; monitoring whether a target physical display screen exists, wherein the target physical display screen is the third physical display screen that changes from the offline state to the online state; when the target physical display screen is detected, synchronizing the interface of the third virtual display screen to the target physical display screen.

[0011] Optionally, the step of moving the first application from the first virtual display screen to the third virtual display screen in response to the first movement instruction, and moving the first application from the first physical display screen to the third physical display screen, includes: displaying a query message on the interface of the third virtual display screen and displaying the query message on the interface of the third physical display screen in response to the first movement instruction; wherein the query message is used to ask the second user whether he / she agrees to move the first application to the third physical display screen; receiving a first affirmative instruction; wherein the first affirmative instruction is sent by the second user to the virtual device through the third physical display screen; the first affirmative instruction is used to instruct the second user to agree to move the first application to the third physical display screen; and moving the first application from the first physical display screen to the third physical display screen in response to the first affirmative instruction.

[0012] Optionally, moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: when the first application is in a closed state, moving the first application from the interface of the first virtual display screen to the interface of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

[0013] Optionally, moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: removing the first application from the first virtual display screen and displaying the desktop on the first virtual display screen when the first application is running in the foreground and there are no background applications running on the first virtual display screen and no foreground applications running on the third virtual display screen; and running the first application in the foreground on the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0014] Optionally, moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: removing the first application from the first virtual display screen and displaying the desktop on the first virtual display screen when the first application is in a foreground running state and there is no application running in the background on the first virtual display screen but there is an application running in the foreground on the third virtual display screen; and controlling the application running in the foreground on the third virtual display screen to run in the background and running the first application in the foreground on the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

[0015] Optionally, moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: removing the first application from the first virtual display screen when the first application is running in the foreground and the first virtual display screen has an application running in the background and the third virtual display screen does not have an application running in the foreground, and controlling a background program in the first virtual display screen to run in the foreground, and running the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0016] Optionally, moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: when the first application is running in the foreground and there is an application running in the background on the first virtual display screen and an application running in the foreground on the third virtual display screen, removing the first application from the first virtual display screen, controlling a background program in the first virtual display screen to run in the foreground, and controlling the application running in the foreground on the third virtual display screen to run in the background, and running the first application in the foreground on the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

[0017] Optionally, synchronizing the interface of the first virtual display screen to the first physical display screen includes: receiving a first login request sent by the first physical display screen; responding to the first login request, determining the first virtual display screen according to a preset allocation strategy, and establishing a communication link between the virtual device and the first physical display screen; synchronizing the interface of the first virtual display screen to the first physical display screen through the communication link; wherein, the preset allocation strategy is used to indicate the correspondence between the N virtual display screens and the M physical display screens.

[0018] Secondly, this application provides a multi-screen display system, comprising: a virtual device and M physical displays, wherein: the virtual device is deployed in the cloud, the virtual device includes N virtual displays, N≥2, each of the N virtual displays is used to display different applications provided by the virtual device; the N virtual displays correspond to the M physical displays; wherein each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display; the virtual device is used to perform the method described in any one of the first aspects.

[0019] The beneficial effects of the multi-screen display method of the present invention are:

[0020] Since each virtual display can show different applications provided by the virtual device, and since each virtual display corresponds to at least one physical display, and each physical display corresponds to only one virtual display, and since the first physical display is any one of the M physical displays, and the first virtual display is the virtual display corresponding to the first physical display, the virtual device can synchronize the application displayed in the first virtual display to the first physical display by synchronizing the interface of the first virtual display to the first physical display. In other words, the virtual device can solve the problem of how to display the applications provided by the virtual device on different physical displays by synchronizing the interface of each virtual display to the physical display corresponding to each virtual display, and synchronizing the application displayed in each virtual display to the physical display corresponding to each virtual display.

[0021] Furthermore, since each virtual display can show different applications provided by the virtual device, different applications are displayed on different physical displays when different physical displays correspond to different virtual displays. This achieves application isolation between different physical displays, allowing different physical displays to simultaneously provide different applications to the user, and also enables the expansion of physical displays. When different physical displays correspond to the same virtual display, the same applications are displayed on different physical displays, achieving application sharing between different physical displays, and also enabling the replication of physical displays. Attached Figure Description

[0022] Figure 1 This is a schematic diagram illustrating an application scenario of a virtual device provided in an embodiment of this application;

[0023] Figure 2 This is a schematic diagram illustrating another application scenario of a virtual device provided in an embodiment of this application;

[0024] Figure 3 This is a schematic diagram of the structure of a multi-screen display system provided in an embodiment of this application;

[0025] Figure 4 This is a schematic diagram of another multi-screen display system provided in an embodiment of this application;

[0026] Figure 5 This is a schematic diagram of another multi-screen display system provided in an embodiment of this application;

[0027] Figure 6 This is a schematic diagram of another multi-screen display system provided in an embodiment of this application;

[0028] Figure 7 A flowchart illustrating a multi-screen display method provided in an embodiment of this application;

[0029] Figure 8 This is a schematic diagram of the structure of a cloud server provided in an embodiment of this application. Detailed Implementation

[0030] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Although some embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the accompanying drawings and embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of protection of the present invention.

[0031] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0032] The term "comprising" and its variations as used herein are open-ended, meaning "including but not limited to"; the term "based on" means "at least partially based on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments"; and the term "optionally" means "optional embodiments". Definitions of other terms will be given in the following description. It should be noted that the concepts of "first," "second," etc., mentioned in this invention are used only to distinguish different devices, modules, or units, and are not intended to limit the order of functions performed by these devices, modules, or units or their interdependencies.

[0033] It should be noted that the terms "a" and "a plurality of" used in this invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0034] The names of the messages or information exchanged between the multiple devices in the embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0035] To address the issue of insufficient computing power in physical terminal devices, a virtual device can be deployed in the cloud. By migrating the computation of physical terminal devices to the virtual device, the computing power requirements of physical terminal devices are reduced, thereby releasing the computing power of physical terminal devices and compensating for their insufficient computing power.

[0036] For example, Figure 1 This is a schematic diagram illustrating an application scenario of a virtual device provided in an embodiment of this application. For example... Figure 1 As shown, this application scenario may include: cloud 110, virtual device 120, and physical terminal device 130. Among them:

[0037] Cloud 110 can be understood as a collection of at least multiple cloud servers. Virtual device 120 is deployed on cloud 110. Cloud 110 provides resources to virtual device 120 to enable virtual device 120 to have processing capabilities. The resources provided by cloud 110 to virtual device include, but are not limited to, processor cores and storage.

[0038] Physical terminal device 130 can be understood as the physical terminal device used by the user. The physical terminal device used by the user includes, but is not limited to, mobile phones, tablets, in-vehicle systems, laptops, and e-readers.

[0039] Each user corresponds to a virtual device 120. Users can access the services provided by the virtual device 120 through the physical terminal device 130.

[0040] Specifically, the virtual device 120 may have applications installed, including but not limited to video playback applications, audio playback applications, photo album applications, game applications, image processing applications, and text editing applications. The services provided by the virtual device 120 include, but are not limited to, those provided by the applications installed on the virtual device 120. Users can send requests to the virtual device 120 through the physical terminal device 130, causing the virtual device 120 to respond to the request and provide corresponding services to the user through the physical terminal device 130.

[0041] The system assigns each user an account and password. Users can log in to the virtual device 120 by entering their account and password on the physical terminal device 130. After successful login, the virtual device 120 establishes a link with the physical terminal device 130, enabling information exchange between the two devices.

[0042] For example, Figure 2 This is a schematic diagram illustrating another application scenario of a virtual device provided in an embodiment of this application. Figure 2 and Figure 1 The difference is: Figure 2 The application scenarios also include the Middle Platform 140. The Middle Platform 140 can be understood as a collection of at least one server.

[0043] The cloud 110, virtual device 120, and physical terminal device 130 have been described above and will not be repeated here.

[0044] Based on the above structural differences Figure 2 and Figure 1 The difference in operation is: the process of physical terminal device 130 logging into virtual device 120 and the process of physical terminal device 130 accessing services provided by virtual device 120.

[0045] The login process can be described as follows:

[0046] The system assigns each user an account and password, and the middleware 140 stores each user's account and password in advance. Thus, the first user can enter their account and password on the physical terminal device 130 and click the login control. The physical terminal device 130 responds to the click operation by generating a first login request based on the first user's account and password, and sends the first login request to the middleware 140. The middleware 140 receives and responds to the first login request, authenticating the first login request based on the first user's account and password in the first login request, combined with the pre-stored account and password information for each user in the middleware 140. Upon successful authentication, the middleware 140 sends the identification information of the virtual device corresponding to the first user to the physical terminal device 130. The physical terminal device 130 directly accesses the virtual device 120 based on the virtual device's identification information, and the virtual device 120 establishes a link with the physical terminal device 130, enabling the virtual device 120 to provide services to the physical terminal device 130 through this link.

[0047] It should be noted that if authentication fails, the middleware 140 sends a login failure receipt to the physical terminal device 130, so that the physical terminal device 130 displays a login failure message to the first user, thereby prompting the first user to respond accordingly.

[0048] The process by which physical terminal device 130 accesses the services provided by virtual device 120 can be described as follows:

[0049] The first user sends a request to access the virtual device 120 to the middleware 140 via the physical terminal device 130. The middleware 140 receives the request and authenticates it. After successful authentication, the middleware 140 forwards the request to the virtual device 120. The virtual device 120 receives and responds to the request, providing the corresponding service to the physical terminal device 130 via the link.

[0050] It should be noted that when authentication fails, the middleware 140 sends an authentication failure receipt to the physical terminal device 130, so that the physical terminal device 130 can display a request failure message to the first user based on the authentication failure receipt.

[0051] Obviously, in Figure 2Since the middleware 140 authenticates login or access requests sent by the physical terminal device 130, it is only necessary to store authentication-related information in the middleware 140, eliminating the need to store it in the cloud 110. This reduces the computing and storage requirements on the virtual device 120 to some extent. Furthermore, because authentication-related information is only stored in the middleware 140, and the cloud 110 does not store such information, the security of user accounts, passwords, and other authentication-related information is ensured to a certain extent.

[0052] Currently, in order to meet users' diverse needs for accessing virtual devices, it is possible to allow physical terminal devices, including multiple physical displays, to log in to the virtual device, or to allow multiple physical terminal devices to log in to the same virtual device simultaneously. In other words, it is possible to allow multiple physical displays to log in to the same virtual device at the same time. Thus, how to display the applications provided by the virtual device on different physical displays is an urgent problem to be solved.

[0053] To address the aforementioned technical problems, embodiments of this application provide a multi-screen display system, such as... Figure 3 As shown, the multi-screen display system may include: a virtual device 320 and M physical displays 330. Wherein:

[0054] Virtual device 320 is deployed on cloud 310. It should be noted that relevant information about cloud 310 can be found above, and will not be repeated here.

[0055] The virtual device 320 may include N virtual displays, which can be designated as virtual display 1 to virtual display N, where N ≥ 2. For example, ... Figure 3 As shown, the virtual device 320 includes four virtual displays, namely: virtual display 1 to virtual display 4.

[0056] Each of the N virtual displays can display different applications provided by the virtual device 320. The virtual device 320 can have various applications installed, such as video playback applications, audio playback applications, photo album applications, game applications, image processing applications, text editing applications, navigation applications, etc. The virtual device 320 can provide different applications to different virtual displays for display on those displays.

[0057] Different virtual displays show different applications. The applications displayed on each virtual display can be determined according to preset display rules. These preset display rules can be based on, for example, the application scenario of the physical display screen corresponding to each virtual display. For instance, if the physical display screen corresponding to a virtual display is the central control screen of a vehicle's infotainment system, navigation software, voice call software, etc., can be displayed on that virtual display. If the physical display screen corresponding to a virtual display is the rear entertainment screen of a vehicle's infotainment system, entertainment applications, such as video playback applications, game applications, audio playback applications, etc., can be displayed on that virtual display.

[0058] It should be noted that the above description of the preset display rules is merely illustrative and is not intended to limit the preset display rules in the application.

[0059] The M physical displays 330 may include physical displays 1 to physical displays M. For example, as shown... Figure 3 As shown, M is 4, which means there are 4 physical displays, namely physical display 1 to physical display 4.

[0060] The M physical displays 330 can be the displays of all physical terminal devices that are allowed to log in to the virtual device 320 simultaneously. For example, if the physical terminal device allowed to log in to the virtual device 320 is a vehicle infotainment system, then the M physical displays 330 can include the central control screen of the vehicle infotainment system and multiple rear entertainment screens of the vehicle infotainment system. If the physical terminal devices allowed to log in to the virtual device 320 simultaneously include mobile phones, tablets, and e-readers, then the M physical displays 330 can include the displays of mobile phones, tablets, and e-readers. If the physical terminal devices allowed to log in to the virtual device 320 simultaneously include vehicle infotainment systems, mobile phones, tablets, and laptops, then the M physical displays 330 can include the central control screen of the vehicle infotainment system, multiple rear entertainment screens of the vehicle infotainment system, the displays of mobile phones, tablets, and laptops.

[0061] A username and password can be assigned to the virtual device 320, allowing all physical displays that are simultaneously logged into the virtual device 320 to use the same username and password. Upon successful login, the virtual device 320 establishes a communication link with the physical display to enable information exchange between them.

[0062] It should be noted that when all the physical displays corresponding to the virtual displays in the virtual device 320 are offline, the resources allocated to the virtual device 320 can be released, freeing the virtual device 320 from resource occupation, so that the released resources can be allocated to other virtual devices in the cloud 310, thereby improving resource utilization.

[0063] There are N virtual displays corresponding to M physical displays. Each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display.

[0064] The number of physical displays corresponding to different virtual displays may be the same or different, and this application does not impose any special limitation on this.

[0065] The number of virtual displays can be the same as the number of physical displays, i.e., N and M are equal. The number of virtual displays can also be less than the number of physical displays, i.e., N is less than M. This application does not impose any special limitations on this.

[0066] When N and M are the same, there is a one-to-one correspondence between the N virtual displays and the M physical displays. The correspondence between virtual and physical displays can be determined based on the application scenario of the physical displays and the applications displayed on the virtual displays. For example, if the physical display is a central control screen, it corresponds to a virtual display showing vehicle driving-related applications. If the physical display is a rear-seat entertainment screen, it corresponds to a virtual display showing entertainment-related applications.

[0067] For example, such as Figure 3 As shown, the number of virtual displays and the number of physical displays are both 4, that is, N and M are both 4. Among them, the 4 virtual displays are virtual displays 1 to 4, and the 4 physical displays are physical displays 1 to 4.

[0068] See Figure 3 The correspondence between the four virtual displays and the four physical displays can be as follows: virtual display 1 corresponds to physical display 1, virtual display 2 corresponds to physical display 2, virtual display 3 corresponds to physical display 3, and virtual display 4 corresponds to physical display 4.

[0069] When N is less than M, there are N virtual displays corresponding to M physical displays. Each virtual display corresponds to at least one physical display, and each physical display corresponds to only one virtual display. The determination of the correspondence between virtual and physical displays can be found in the description above, and will not be repeated here.

[0070] For example, such as Figure 4 As shown, the number of virtual displays is 2, i.e., N is 2, and the number of physical displays is 4, i.e., M is 4. The 2 virtual displays are designated as virtual displays 1 to 2, and the 4 physical displays are designated as physical displays 1 to 4.

[0071] See Figure 4The correspondence between the two virtual displays and the four physical displays can be as follows: Virtual display 1 corresponds to physical display 1, and virtual display 2 corresponds to physical display 2, physical display 3, and physical display 4. In other words, virtual display 1 corresponds to one physical display, and virtual display 2 corresponds to three physical displays.

[0072] The virtual device 320 can execute the multi-screen display method provided in the embodiments of this application. This method can synchronously display different applications provided by the virtual device 320 to each virtual display on the physical display corresponding to each virtual display when multiple physical displays are allowed to log in to the same virtual device 320 at the same time, thus solving the problem of how to display the applications provided by the virtual device on different physical displays.

[0073] Figure 5 This is a schematic diagram of another multi-screen display system provided in an embodiment of this application. Figure 5 and Figure 3 The difference between the multi-screen display systems provided in China and those in other countries is that: Figure 5 It also includes the middle platform 340.

[0074] The composition of the 340 middle platform can be seen above, and will not be repeated here.

[0075] Based on the above structural differences Figure 5 and Figure 3 The difference in operation is as follows:

[0076] Users send requests or instructions to the middleware 340 through the physical display screen. The middleware 340 authenticates the requests and instructions sent by the physical display screen 340 and responds accordingly based on the authentication results.

[0077] Specifically, the requests or instructions sent by the physical display screen can refer to the requests and instructions sent by the physical display screen to the virtual device 320, such as requests to log in to the virtual device 320, instructions to use mobile applications, instructions to switch the virtual display screen corresponding to the physical display screen, and instructions to interact with applications provided by the virtual device 320.

[0078] The middle platform 340 stores the information required for authentication. The authentication process of the middle platform 340 and the post-authentication processing will be explained in the following text and will not be repeated here.

[0079] It should be noted that, for example, in Figure 5 In this system, the number of virtual displays and physical displays is the same, that is, N equals M. The correspondence between virtual displays and physical displays can be found in [reference needed]. Figure 3 The relevant explanations will not be repeated here.

[0080] For example, Figure 6 This is a schematic diagram of another multi-screen display system provided in an embodiment of this application. Figure 6 and Figure 5 The difference is: in Figure 6 It includes 2 virtual displays and 4 physical displays. The correspondence between the 2 virtual displays and 4 physical displays can be found in [link to relevant documentation]. Figure 4 The relevant explanations will not be repeated here.

[0081] The following is a detailed explanation of the multi-screen display method executed by the virtual device 320.

[0082] In some embodiments, such as Figure 7 As shown, multi-screen display methods may include:

[0083] 710. The virtual device synchronizes the interface of the first virtual display screen to the first physical display screen. The first physical display screen is any one of M physical display screens, and the first virtual display screen is the virtual display screen corresponding to the first physical display screen.

[0084] As can be seen from the above, each virtual display screen can display different applications provided by the virtual device. Therefore, by synchronizing the interface of the first virtual display screen to the first physical display screen, the virtual device can synchronize the applications provided by the virtual device displayed on the first virtual display screen to the first physical display screen.

[0085] As can be seen from the above, by synchronizing the interface of each virtual display screen to the physical display screen corresponding to each virtual display screen, the applications provided by the virtual devices displayed on each virtual display screen can be synchronized to the physical display screen corresponding to each virtual display screen.

[0086] Because each virtual display can show different applications provided by the virtual device, if two physical displays correspond to different virtual displays, then the two physical displays will show different applications, thus achieving application isolation between different physical displays. If two physical displays correspond to the same virtual display, then the two physical displays will show the same application, thus achieving application sharing between different physical displays.

[0087] For example, such as Figure 3 As shown, physical display screen 1 synchronously displays the interface of virtual display screen 1, physical display screen 2 synchronously displays the interface of virtual display screen 2, physical display screen 3 synchronously displays the interface of virtual display screen 3, and physical display screen 4 synchronously displays the interface of virtual display screen 4. Since each virtual display screen displays a different application, each physical display screen displays a different application.

[0088] For example, such as Figure 4As shown, physical display screen 1 synchronously displays the interface of virtual display screen 1, and physical display screens 2, 3, and 4 synchronously display the interface of virtual display screen 2.

[0089] Since each virtual display screen shows a different application, the physical display screen 1 displays a different application than the physical display screens 2-4, while the physical display screens 2-4 display the same application.

[0090] Obviously, since each virtual display screen can display different applications provided by the virtual device, and since each virtual display screen corresponds to at least one physical display screen, and each physical display screen corresponds to only one virtual display screen, and since the first physical display screen is any one of the M physical display screens, and the first virtual display screen is the virtual display screen corresponding to the first physical display screen, the virtual device 320 can synchronize the application displayed in the first virtual display screen to the first physical display screen by synchronizing the interface of the first virtual display screen to the first physical display screen. In other words, the virtual device 320 can solve the problem of how to display the applications provided by the virtual device 320 on different physical display screens by synchronizing the interface of each virtual display screen to the physical display screen corresponding to each virtual display screen, and synchronizing the application displayed in each virtual display screen to the physical display screen corresponding to each virtual display screen.

[0091] Furthermore, since each virtual display can show different applications provided by the virtual device 320, when different physical displays correspond to different virtual displays, the applications displayed on different physical displays are different, achieving application isolation between different physical displays. This allows different physical displays to simultaneously provide different applications to the user, and also enables the expansion of physical displays. When different physical displays correspond to the same virtual display, the applications displayed on different physical displays are the same, achieving application sharing between different physical displays, and also enabling the replication of physical displays.

[0092] It should be noted that physical display extension refers to different physical displays showing different applications, while physical display duplication refers to different physical displays showing the same application.

[0093] In some embodiments, the specific process by which the virtual device 320 synchronizes the interface of the first virtual display screen to the first physical display screen may be as follows:

[0094] First, the virtual device 320 receives the first login request sent by the first physical display screen.

[0095] For example, in Figure 3 or Figure 4In the multi-screen display system shown, the first physical display screen sends a first login request to the virtual device 320. The first login request may include at least a username and password.

[0096] For example, in Figure 5 or Figure 6 In the multi-screen display system shown, each virtual device is pre-assigned an account and password, which are stored in the central platform 340. The mapping between the identification information of each virtual device and its account is also stored in the central platform 340. Thus, when logging into virtual device 320 on the first physical display screen, the first user enters the account and password of virtual device 320 on the interface of the first physical display screen and clicks the login control. The first physical display screen responds to the click operation of the login control, obtains the account and password of virtual device 320 entered by the first user, generates a second login request based on the entered account and password, and sends the second login request to the central platform 340. The central platform 340 authenticates the first login request. Specifically, the central platform 340 compares the account and password carried in the first login request with the pre-stored account and password of each virtual device. If an account and password identical to those carried in the first login request exists, the identification information of the virtual device 320 corresponding to the account in the first login request, which is pre-stored in the central platform 340, is sent to the first physical display screen. The first physical display screen sends a first login request to the virtual device 320 based on the identification information of the virtual device 320, wherein the first login request may carry the identification information of the first physical display screen.

[0097] Then, in response to the first login request, the virtual device 320 determines the first virtual display screen according to the preset allocation strategy and establishes a communication link between the virtual device 320 and the first physical display screen.

[0098] The preset allocation strategy is used to indicate the correspondence between N virtual displays and M physical displays.

[0099] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, when the virtual device 320 receives the first login request sent by the first physical display screen, it can first authenticate the first login request. After the authentication is successful, it determines the virtual display screen corresponding to the first physical display screen according to the preset allocation strategy and the identification information of the first physical display screen, that is, determines the first virtual display screen, and establishes a communication link between the virtual device 320 and the first physical display screen.

[0100] For example, in Figure 5 or Figure 6In the multi-screen display system shown, when the virtual device 320 receives the first login request sent by the first physical display screen, it determines the virtual display screen corresponding to the first physical display screen according to the identification information of the first physical display screen and the preset allocation strategy carried in the first login request, that is, determines the first virtual display screen, and establishes a communication link between the virtual device 320 and the first physical display screen.

[0101] Finally, the virtual device 320 synchronizes the interface of the first virtual display screen to the first physical display screen via the communication link.

[0102] In some embodiments, the multi-screen display method may further include:

[0103] First, the virtual device 320 receives the first interactive command.

[0104] The first interactive command is sent by the first user to the virtual device 320 through the first physical display screen.

[0105] Specifically, in Figure 3 or Figure 4 In the multi-screen display system shown, the first interactive command can be sent directly from the first user to the virtual device 320 through the first physical display screen.

[0106] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first interactive command can be sent by the first user to the middle platform 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle platform 340.

[0107] For example, when a first user interacts with an application on the first physical display screen, the first physical display screen responds to the interaction and generates a corresponding first interaction command using an encryption algorithm (e.g., a hash algorithm), and sends the first interaction command to the middleware 340. The first interaction command corresponds to the first user's interaction with the application on the first physical display screen. For instance, if the user clicks the application icon on the first physical display screen, the generated first interaction command is to open the application. If the user triggers the playback control of an audio playback application on the first physical display screen, the generated first interaction command is to play audio. The middleware 340 receives and responds to the first interaction command, authenticates the first interaction command using the same encryption algorithm, and if authentication is successful (i.e., the first interaction command has not been tampered with), forwards the first interaction command to the virtual device 320. If authentication fails, an interaction error message is sent to the first physical display screen, causing the first physical display screen to display the interaction error message to the first user, enabling the first user to take appropriate action.

[0108] Then, in response to the first interaction command, the virtual device 320 displays the interface corresponding to the first interaction command on the first virtual display screen and synchronizes the interface corresponding to the first interaction command to the first physical display screen.

[0109] For example, if the first interaction instruction is to open an application, then the interface corresponding to the first interaction instruction is the interface after the application is opened. If the first interaction instruction is to play the first audio, then the interface corresponding to the first interaction instruction is the interface for playing the first audio. If the first interaction instruction is to display an image, then the interface corresponding to the first interaction instruction is the interface for displaying the image.

[0110] It should be noted that the above description of the interface corresponding to the first interactive command is merely illustrative and will not be repeated here.

[0111] Since the virtual device 320 can synchronize the interface of the first virtual display screen to the first physical display screen, when the virtual device 320 displays the interface corresponding to the first interaction command on the first virtual display screen, the interface corresponding to the first interaction command will also be synchronized to the first physical display screen.

[0112] Obviously, since the virtual device 320 can synchronize the interface of the first virtual display screen to the first physical display screen, and since the first interaction command is sent by the first user to the virtual device 320 through the first physical display screen, when the virtual device 320 receives the first interaction command, it responds to the first interaction command by displaying the interface corresponding to the first interaction command on the first virtual display screen, thus synchronizing the interface corresponding to the first interaction command to the first physical display screen and realizing human-computer interaction.

[0113] In some embodiments, the virtual device 320 may respond to the first interaction instruction in the following manner: the virtual device 320 responds to the first interaction instruction according to the priority of the first interaction instruction.

[0114] Specifically, when the virtual device 320 needs to process multiple interactive commands, it can process them according to the priority of each interactive command.

[0115] Multiple interactive commands can be understood as: multiple interactive commands sent by a single physical display screen, and / or multiple interactive commands sent by multiple physical display screens when multiple physical display screens are online.

[0116] The plurality of physical displays include a first physical display, and the plurality of physical displays are at least a portion of M physical displays, and the plurality of interactive instructions include the first interactive instruction.

[0117] Specifically, a priority determination strategy can be preset. When the first interaction instruction is received, the priority relationship between the first interaction instruction and the interaction instruction currently pending to be processed by the virtual device 320 can be determined based on the first interaction instruction and the interaction instruction currently pending to be processed by the virtual device 320, combined with the priority determination strategy. Based on the priority relationship, all interaction instructions (i.e., the first interaction instruction and the interaction instruction currently pending to be processed) are sorted in descending order of priority, so that the interaction instructions are processed sequentially according to the sorting result.

[0118] The rules for setting the priority determination strategy can be as follows:

[0119] For interactive commands sent from different physical displays, the priority of the interactive commands sent by each physical display can be determined based on the function of each physical display. For example, if multiple physical displays include the vehicle's central control screen and the rear entertainment screen, the interactive commands sent by the central control screen have a higher priority than those sent by the rear entertainment screen.

[0120] For multiple interactive commands sent from the same physical display screen, the priority of the different interactive commands can be determined based on the application scenario of the physical display screen. For example, if the physical display screen is mainly used for navigation, then navigation-related interactive commands sent by the physical display screen have a higher priority than non-navigation-related interactive commands. If the physical display screen is mainly used for entertainment, then entertainment-related interactive commands sent by the physical display screen have a higher priority than non-entertainment-related interactive commands.

[0121] For different physical displays sending different interactive commands for the same application, where each physical display corresponds to the same virtual display, the priority of the different interactive commands can be determined based on their different functions for the same application. For example, when the virtual display is showing an audio playback interface, if it receives interactive commands to close audio playback and open the playlist from different physical displays, the interactive command to close audio playback is processed first, followed by the interactive command to open the playlist.

[0122] Clearly, the virtual device 320 responds to the first interactive instruction according to its processing priority, ensuring that when multiple interactive instructions are queued, they can be processed in order of priority, thus improving the rationality of the processing.

[0123] Based on this, if the first physical display screen is the vehicle's central control screen, then the first interaction command has the highest priority. Therefore, when the virtual device 320 receives the first interaction command, it prioritizes processing it.

[0124] Since the first physical display screen is the vehicle's central control screen, which means that the current scenario is driving a vehicle and the central control screen mainly provides navigation and other services to the driver, in order to ensure driving safety, the priority of the interactive commands sent by the central control screen (i.e., the first interactive command) should be set to the highest. In this way, the interactive commands sent by the central control screen can be processed first to improve driving safety.

[0125] In some embodiments, the multi-screen display method may further include:

[0126] First, the virtual device 320 receives the first switching command.

[0127] The first switching instruction is used to instruct the virtual display screen corresponding to the first physical display screen to be switched to the second virtual display screen. The second virtual display screen is any one of the N virtual display screens other than the first virtual display screen.

[0128] The first switching command can be sent by the first user to the virtual device 320 through the first physical display screen.

[0129] Specifically, in Figure 3 or Figure 4 In the multi-screen display system shown, the first switching command can be sent directly from the first user to the virtual device 320 through the first physical display screen.

[0130] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first switching command can be sent by the first user to the middle platform 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle platform 340.

[0131] For example, a switching interface can be provided on a first virtual display screen to provide a switching interface on a first physical display screen. The switching interface can display each of the N virtual display screens except the first virtual display screen. Thus, a first user can open the switching interface on the first physical display screen, select a second virtual display screen, and click the switching control on the switching interface. When the first physical display screen receives the click operation of the switching control, it obtains the identification information of the second virtual display screen selected by the first user, generates a first switching instruction based on the identification information of the second virtual display screen and an encryption algorithm, and sends the first switching instruction to the middle platform 340. The middle platform 340 receives and responds to the first switching instruction, authenticates the first switching instruction using the same encryption algorithm, and, if authentication is successful (i.e., if it is determined that the first switching instruction has not been tampered with), forwards the first switching instruction to the virtual device 320. If authentication fails (i.e., if it is determined that the first switching instruction has been tampered with), it sends an operation error prompt message to the first physical display screen. The first physical display screen displays the operation error prompt message so that the first user can take appropriate countermeasures.

[0132] Then, in response to the first switching command, the virtual device 320 stops synchronizing the interface of the first virtual display screen to the first physical display screen and synchronizes the interface of the second virtual display screen to the first physical display screen, so as to switch the virtual display screen corresponding to the first physical display screen from the first virtual display screen to the second virtual display screen, thereby realizing the switching of the virtual display screen corresponding to the first physical display screen.

[0133] For example, such as Figure 5 As shown, the virtual display screen corresponding to physical display screen 3 can be switched to virtual display screen 2 through the above process. In this way, both physical display screen 3 and physical display screen 2 synchronize the interface of virtual display screen 2 to achieve the sharing of the interface of virtual display screen 2, and at the same time, the physical display screen corresponding to virtual display screen 2 is copied.

[0134] For example, such as Figure 6 As shown, the virtual display screen corresponding to physical display screen 1 can be switched to virtual display screen 2 through the above process. In this way, physical display screens 1 to 4 synchronize the interface of virtual display screen 2 to achieve the sharing of the interface of virtual display screen 2, and at the same time, the physical display screen corresponding to virtual display screen 2 is copied.

[0135] Clearly, since the first switching instruction is sent by the first user to the virtual device 320 through the first physical display screen, and since the first switching instruction is used to instruct the virtual display screen corresponding to the first physical display screen to be switched to the second virtual display screen, and the second virtual display screen is any one of the N virtual display screens other than the first virtual display screen, when the virtual device 320 receives the first switching instruction, it stops synchronizing the interface of the first virtual display screen to the first physical display screen and synchronizes the interface of the second virtual display screen to the first physical display screen. This switches the virtual display screen corresponding to the first physical display screen from the first virtual display screen to the second virtual display screen, thus realizing the switching of the virtual display screen corresponding to the first physical display screen. This allows the first user to freely switch the virtual display screen corresponding to the first physical display screen according to their needs, improving the user experience.

[0136] In some embodiments, the third virtual display screen is any one of the N virtual display screens other than the first virtual display screen. The third physical display screen is the physical display screen corresponding to the third virtual display screen and which is online.

[0137] Based on this, the multi-screen display method may also include the following steps:

[0138] First, the virtual device 320 receives the first movement command.

[0139] The first move command instructs the first application to be moved from the first physical display screen to the third physical display screen. The first application is any application displayed on the first physical display screen.

[0140] The first movement command can be sent by the first user to the virtual device 320 through the first physical display screen.

[0141] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first movement command can be sent directly from the first user to the virtual device 320 through the first physical display screen.

[0142] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first movement command can be sent by the first user to the middle platform 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle platform 340.

[0143] For example, a first user can bring up the application's mobile interface by long-pressing the first application on the first physical display screen. The mobile interface displays each of the M physical display screens except the first physical display screen. The first user selects a physical display screen displayed on the mobile interface to designate it as a third physical display screen, and then clicks a movement control on the mobile interface while the third physical display screen is selected. In response to the click operation of the movement control, the first physical display screen obtains the identification information of the third physical display screen, generates a first movement command based on the identification information and an encryption algorithm, and sends the first movement command to the middleware 340. In response to the first movement command, the middleware 340 authenticates the first movement command using the same encryption algorithm, and after successful authentication, forwards the first movement command to the virtual device 320.

[0144] Then, in response to the first movement command, the virtual device 320 moves the first application from the first virtual display screen to the third virtual display screen, and then moves the first application from the first physical display screen to the third physical display screen.

[0145] Clearly, through the above process, the first user can move the first application to the third physical display screen as needed, thus realizing the sharing and rearrangement of the first application.

[0146] In some embodiments, the virtual device 320, in response to a first movement command, moves the first application from a first virtual display screen to a third virtual display screen, and the process of moving the first application from a first physical display screen to a third physical display screen can be as follows:

[0147] First, in response to the first movement command, the virtual device 320 displays the query information on the interface of the third physical display screen by providing the query information on the interface of the third virtual display screen.

[0148] The query message can be used to ask a second user whether they agree to move the first application to a third physical display screen. The query message can be displayed in various ways, including but not limited to pop-up queries and animated queries.

[0149] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the second user can give an affirmative or negative response based on the query information. When the second user gives an affirmative response based on the query information, the third physical display screen generates a first affirmative instruction based on the affirmative response and sends the first affirmative instruction to the virtual device 320.

[0150] exist Figure 5 or Figure 6In the multi-screen display system shown, the second user can respond with an affirmative or negative answer based on the query information. When the second user responds with an affirmative answer, the third physical display generates a first affirmative command based on the affirmative answer and an encryption algorithm, and sends the first affirmative command to the central platform 340. The central platform 340 authenticates the first affirmative command using the same encryption algorithm, and after successful authentication, sends the first affirmative command to the virtual device 320.

[0151] Then, the virtual device 320 receives the first affirmative instruction.

[0152] The first affirmative instruction is used to instruct the second user to agree to move the first application to the third physical display screen.

[0153] The first affirmative instruction can be sent by the second user to the virtual device 320 via the third physical display screen.

[0154] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first affirmative instruction is sent directly from the second user to the virtual device 320 through the third physical display screen.

[0155] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first affirmative instruction is sent by the second user to the central platform 340 through the third physical display screen and is then forwarded to the virtual device 320 after being authenticated by the central platform 340.

[0156] Finally, in response to the first affirmative instruction, the virtual device 320 moves the first application from the first virtual display to the third virtual display, and then moves the first application from the first physical display to the third physical display.

[0157] Clearly, before moving the first application to the third physical display screen, the second user can be consulted using the aforementioned method. Only after obtaining the second user's consent can the first application be moved to the third physical display screen, thus improving the user experience. This is especially true when the third physical display screen is the central control screen, i.e., while the vehicle is in motion. Since the central control screen is primarily used for driver assistance, the aforementioned method allows for consultation with the second user (i.e., the driver) before moving the first application, improving driving safety to some extent.

[0158] In some embodiments, the virtual device 320 moves the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen, as shown below:

[0159] When the first application is closed, the virtual device 320 moves the first application from the interface of the first virtual display screen to the interface of the third virtual display screen, thereby moving the first application from the first physical display screen to the third physical display screen.

[0160] In other words, when the first application is closed, the virtual device 320 directly moves the icon of the first application from the first physical display screen to the third physical display screen in the manner described above.

[0161] When the first application is running in the foreground and there is no application running in the background on the first virtual display screen and no application running in the foreground on the third virtual display screen, the virtual device 320 removes the first application from the first virtual display screen and displays the desktop on the first virtual display screen, and runs the first application in the foreground on the third virtual display screen to move the first application from the first physical display screen to the third physical display screen, thereby causing the first physical display screen to display the desktop of the first virtual display screen and causing the third physical display screen to run the first application in the foreground.

[0162] When the first application is running in the foreground and there is no application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the virtual device 320 removes the first application from the first virtual display screen and displays the desktop on the first virtual display screen. It also controls the application running in the foreground on the third virtual display screen to run in the background and the first application to run in the foreground on the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen, thereby causing the first physical display screen to display the desktop of the first virtual display screen and causing the third physical display screen to run the first application in the foreground.

[0163] When the first application is running in the foreground and the first virtual display screen has an application running in the background and the third virtual display screen does not have an application running in the foreground, the virtual device 320 removes the first application from the first virtual display screen, controls a background program in the first virtual display screen to run in the foreground, and runs the first application in the foreground on the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen, thereby causing a background program in the first physical display screen to run in the foreground and causing the first application to run in the foreground on the third physical display screen.

[0164] When the first application is running in the foreground and the first virtual display screen has an application running in the background and the third virtual display screen has an application running in the foreground, the virtual device 320 removes the first application from the first virtual display screen, controls a background program in the first virtual display screen to run in the foreground, and controls the foreground application in the third virtual display screen to run in the background, and runs the first application in the foreground of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen, thereby causing a background program in the first physical display screen to run in the foreground and causing the first application to run in the foreground of the third physical display screen.

[0165] Clearly, by using the above method, the display mode of the first application, the first virtual display screen, and the third virtual display screen can be determined during the movement of the first application based on the running status of the first application and the running status of the applications in the first virtual display screen and the third virtual display screen, thus enriching the diversity of the display.

[0166] In some embodiments, the third virtual display screen is any one of the N virtual display screens other than the first virtual display screen. The third physical display screen is the physical display screen corresponding to the third virtual display screen. The number of third physical display screens can be one or more, which will not be elaborated here. The third physical display screen is in an offline state. The third physical display screen in the offline state does not synchronously display the interface of the third virtual display screen.

[0167] Based on this, multi-screen display methods may also include:

[0168] First, the virtual device 320 receives the first movement command.

[0169] The first move command instructs the first application to be moved from a first physical display screen to at least one third physical display screen. The first application is any application displayed on the first physical display screen.

[0170] The first movement command can be sent by the first user to the virtual device 320 through the first physical display screen.

[0171] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first movement command can be sent directly from the first user to the virtual device 320 through the first physical display screen.

[0172] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first movement command can be sent by the first user to the central platform 340 through the first physical display screen, and after being authenticated by the central platform 340, it is forwarded to the virtual device 320. It should be noted that the specific implementation process of this step can be found above, and will not be repeated here.

[0173] Then, in response to the first move command, the virtual device 320 saves the current state of the first application, moves the first application from the first virtual display screen to the third virtual display screen, and maintains the current state of the first application in the third virtual display screen.

[0174] The current state of the first application includes whether the first application is running, and the running progress of the first application when it is running.

[0175] Next, the virtual device 320 monitors for the presence of a target physical display screen. The target physical display screen is a third physical display screen that transitions from an offline state to an online state.

[0176] The process of monitoring the existence of the target physical display screen is as follows: monitor whether there is a third physical display screen that changes from offline to online at a preset frequency. If there is, the third physical display screen that changes from offline to online is identified as the target physical display screen.

[0177] Finally, when the virtual device 320 detects a target physical display screen, it synchronizes the interface of the third virtual display screen to the target physical display screen. In other words, when it detects that a third physical display screen has changed from an offline state to an online state, it synchronizes the interface of the third virtual display screen to the online third physical display screen.

[0178] For example, such as Figure 6 As shown, taking the first physical display screen as physical display screen 1, the first virtual display screen as virtual display screen 1, the third virtual display screen as virtual display screen 2, and the third physical display devices as physical display screens 2 to 4, and all physical display screens 2 to 4 being in an offline state as an example, the above process will be explained.

[0179] When moving a first application from physical display screen 1 to at least one of physical display screens 2 to 4, the virtual device 320 first moves the first application from virtual display screen 1 to virtual display screen 2 based on the steps described above. Then, when the virtual device 320 detects that physical display screens 2 and 4 have changed from an offline state to an online state, it synchronizes the interface of virtual display screen 2 to physical display screens 2 and 4, thereby realizing the movement of the first application from physical display screen 1 to physical display screens 2 and 4.

[0180] Clearly, since the third physical display screen is offline, the virtual device 320 receives and responds to the first movement command by saving the current state of the first application, moving the first application from the first virtual display screen to the third virtual display screen, and maintaining the current state of the first application in the third virtual display screen. This enables the first application to move from the first virtual display screen to the third virtual display screen when the third physical display screen is offline, thus preparing for the first application to move between physical display screens. Therefore, when a target physical display screen is detected, i.e., when a third physical display screen is detected to change from offline to online, the interface of the third virtual display screen is synchronized to the target physical display screen, enabling the first application to move from the first physical display screen to at least one third physical display screen.

[0181] like Figure 8 As shown, this embodiment of the invention provides a cloud server 800, which may include a memory 810 and a processor 820; a virtual device 830 is deployed on the cloud server 800, and the cloud server 800 can be used to allocate the memory 810 and the processor 820 to the virtual device 830 for use.

[0182] The virtual device 830 includes N virtual displays, where N ≥ 2. Each of the N virtual displays is used to display different applications provided by the virtual device 830. The N virtual displays correspond to M physical displays, where each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display.

[0183] The memory 810 can be used to store computer programs. The processor 820 can be used to enable the virtual device 830 to implement the multi-screen display method described above when the computer program is executed.

[0184] Alternatively, a cloud server 800 may include a memory 810 and a processor 820; a virtual device 830 is deployed on the cloud server 800, and the cloud server 800 may be used to allocate the memory 810 and the processor 820 to the virtual device 830 for use.

[0185] The virtual device 830 includes N virtual displays, where N ≥ 2. Each of the N virtual displays is used to display different applications provided by the virtual device 830. The N virtual displays correspond to M physical displays, where each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display.

[0186] The memory 810 is configured to store computer programs. The processor 820 is configured to cause the virtual device 830 to perform the following operations when the computer program is executed:

[0187] Synchronize the interface of the first virtual display screen to the first physical display screen;

[0188] The first physical display screen is any one of the M physical display screens, and the first virtual display screen is the virtual display screen corresponding to the first physical display screen.

[0189] This invention provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the multi-screen display method described above.

[0190] Alternatively, a non-volatile computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the following operations:

[0191] Synchronize the interface of the first virtual display screen to the first physical display screen;

[0192] Wherein, the first physical display screen is any one of the M physical display screens, and the first virtual display screen is the virtual display screen corresponding to the first physical display screen.

[0193] It should be noted that computer-readable storage media can achieve similar effects to multi-screen display methods, which will not be elaborated here.

[0194] This invention provides a computer program product, including computer instructions, which, when executed on a processor, implement the multi-screen display method described above.

[0195] It should be noted that computer program products can achieve similar effects to multi-screen display methods, which will not be elaborated here.

[0196] The cloud server 800 described herein is an example of a hardware device applicable to various aspects of the invention. The cloud server 800 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The cloud server 800 can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0197] The cloud server 800 includes a computing unit that can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) or loaded from a storage unit into random access memory (RAM). The RAM can also store various programs and data required for device operation. The computing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.

[0198] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc. In this application, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of the present invention according to actual needs. Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units can be implemented in hardware or as software functional units.

[0199] While the present invention has been disclosed above, its scope of protection is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, and all such changes and modifications will fall within the scope of protection of the present invention.

Claims

1. A multi-screen display method applied to a virtual device, wherein the virtual device is deployed in the cloud, characterized in that, The virtual device includes N virtual displays, where N ≥ 2; each of the N virtual displays is used to display different applications provided by the virtual device; the N virtual displays correspond to M physical displays, wherein each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display; the third virtual display is any one of the N virtual displays except the first virtual display; the third physical display is the physical display corresponding to the third virtual display. The method includes: Synchronize the interface of the first virtual display screen to the first physical display screen; Wherein, the first physical display screen is any one of the M physical display screens, and the first virtual display screen is the virtual display screen corresponding to the first physical display screen; Receive a first movement instruction; wherein the first movement instruction is sent by a first user to the virtual device through the first physical display screen; the first movement instruction is used to instruct a first application to be moved from the first physical display screen to the third physical display screen; the first application is any application displayed on the first physical display screen; If the third physical display screen is online, then in response to the first movement command, the first application is moved from the first virtual display screen to the third virtual display screen, and the first application is moved from the first physical display screen to the third physical display screen.

2. The method according to claim 1, characterized in that, The method further includes: Receive a first interaction instruction; wherein the first interaction instruction is sent by a first user to the virtual device through the first physical display screen; In response to the first interactive command, the interface corresponding to the first interactive command is displayed on the first virtual display screen, and the interface corresponding to the first interactive command is synchronized to the first physical display screen.

3. The method according to claim 2, characterized in that, The response to the first interactive instruction includes: Responding to the first interactive instruction according to its priority.

4. The method according to claim 1, characterized in that, The method further includes: Receive a first switching instruction; wherein the first switching instruction is sent by a first user to the virtual device through the first physical display screen; the first switching instruction is used to instruct the virtual display screen corresponding to the first physical display screen to be switched to a second virtual display screen; the second virtual display screen is any one of the N virtual display screens other than the first virtual display screen; In response to the first switching command, the synchronization of the interface of the first virtual display screen to the first physical display screen is stopped, and the interface of the second virtual display screen is synchronized to the first physical display screen.

5. The method according to claim 1, characterized in that, If the third physical display screen is offline, the step of responding to the first movement command by moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: In response to the first move command, the current state of the first application is saved, and the first application is moved from the first virtual display screen to the third virtual display screen, and the current state of the first application is maintained in the third virtual display screen; Monitor whether a target physical display screen exists, wherein the target physical display screen is the third physical display screen that changes from the offline state to the online state; When the target physical display screen is detected, the interface of the third virtual display screen is synchronized to the target physical display screen.

6. The method according to claim 1, characterized in that, In response to the first movement command, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: In response to the first movement command, the query information is displayed on the interface of the third virtual display screen and on the interface of the third physical display screen. The query information is used to ask the second user whether they agree to move the first application to the third physical display screen; Receive a first affirmative instruction; wherein the first affirmative instruction is sent by the second user to the virtual device through the third physical display screen; the first affirmative instruction is used to instruct the second user to agree to move the first application to the third physical display screen; In response to the first affirmative instruction, the first application is moved from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

7. The method according to claim 1 or 6, characterized in that, The step of moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: When the first application is closed, the first application is moved from the interface of the first virtual display screen to the interface of the third virtual display screen, thereby moving the first application from the first physical display screen to the third physical display screen.

8. The method according to claim 1 or 6, characterized in that, The step of moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: When the first application is running in the foreground and there are no applications running in the background on the first virtual display screen and no applications running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen and the desktop is displayed on the first virtual display screen. The first application is then run in the foreground on the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

9. The method according to claim 1 or 6, characterized in that, The step of moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: When the first application is running in the foreground and there is no application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen and the desktop is displayed on the first virtual display screen. In addition, the application running in the foreground on the third virtual display screen is controlled to run in the background, and the first application is run in the foreground on the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

10. The method according to claim 1 or 6, characterized in that, The step of moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: When the first application is running in the foreground and the first virtual display screen has an application running in the background and the third virtual display screen does not have an application running in the foreground, the first application is removed from the first virtual display screen, and a program running in the background of the first virtual display screen is controlled to run in the foreground, and the first application is run in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

11. The method according to claim 1 or 6, characterized in that, The step of moving the first application from the first virtual display screen to the third virtual display screen, and moving the first application from the first physical display screen to the third physical display screen, includes: When the first application is running in the foreground and the first virtual display screen has an application running in the background and the third virtual display screen has an application running in the foreground, the first application is removed from the first virtual display screen, and a program running in the background of the first virtual display screen is controlled to run in the foreground, and the application running in the foreground of the third virtual display screen is controlled to run in the background, and the first application is run in the foreground of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

12. The method according to claim 1, characterized in that, Synchronizing the interface of the first virtual display screen to the first physical display screen includes: Receive the first login request sent by the first physical display screen; In response to the first login request, the first virtual display screen is determined according to a preset allocation strategy, and a communication link is established between the virtual device and the first physical display screen; The interface of the first virtual display screen is synchronized to the first physical display screen via the communication link; The preset allocation strategy is used to indicate the correspondence between the N virtual displays and the M physical displays.

13. A multi-screen display system, characterized in that, include: The virtual device and M physical displays, of which: The virtual device is deployed in the cloud and includes N virtual displays, where N ≥ 2. Each of the N virtual displays is used to display different applications provided by the virtual device. The N virtual displays correspond to the M physical displays; wherein each virtual display corresponds to at least one physical display, and each of the M physical displays corresponds to only one virtual display; the third virtual display is any one of the N virtual displays except the first virtual display; the third physical display is the physical display corresponding to the third virtual display. The virtual device is used to perform the method according to any one of claims 1 to 12.

Images