Multi-screen display method and system

Abstract

The invention provides a multi-screen display method and system, and relates to the technical field of virtual machines, the multi-screen display method is applied to a virtual device, the virtual device is deployed at a cloud end, the virtual device comprises N virtual display screens, and N is greater than or equal to 2; each virtual display screen in the N virtual display screens is used for displaying different applications provided by the virtual equipment; the N virtual display screens correspond to the M physical display screens, each virtual display screen corresponds to at least one physical display screen, and each physical display screen in the M physical display screens only corresponds to one virtual display screen; the method comprises the following steps: synchronizing an interface of a first virtual display screen to a first physical display screen; wherein the first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen. According to the method and the device, the problem of how to display the applications provided by the virtual equipment in different physical display screens is solved.

Description

Technical Field

[0001] The present invention relates to the field of virtual machine technology, and in particular to a multi-screen display method and system. Background Art

[0002] With the development of technology, virtual devices can be deployed in the cloud, and the calculations originally deployed in physical terminal devices can be migrated to virtual devices to reduce the computing power requirements of physical terminal devices, thereby releasing the computing power of physical terminal devices and making up for the problem of insufficient computing power of physical terminal devices.

[0003] At present, in order to meet the diverse needs of users for accessing virtual devices, a physical terminal device including multiple physical display screens may be allowed to log in to a virtual device, or multiple physical terminal devices may be allowed to log in to the same virtual device at the same time, that is, multiple physical display screens may be allowed to log in to the same virtual device at the same time. Thus, how to display applications provided by virtual devices on different physical display screens is an urgent problem to be solved. Summary of the invention

[0004] The present invention provides a multi-screen display method and system, which can solve the problem of how to display applications provided by virtual devices on different physical display screens.

[0005] In a first aspect, the present application provides a multi-screen display method, which is applied to a virtual device, wherein the virtual device is deployed in the cloud, and the virtual device includes N virtual display screens, where N≥2; each of the N virtual display screens is used to display different applications provided by the virtual device; the N virtual display screens correspond to M physical display screens, wherein each virtual display screen corresponds to at least one physical display screen, and each of the M physical display screens corresponds to only one virtual display screen; the method includes: synchronizing an interface of a first virtual display screen to a first physical display screen; wherein the first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen.

[0006] Optionally, the method also includes: receiving a first interaction instruction; wherein the first interaction instruction is sent by a first user to the virtual device through the first physical display screen; in response to the first interaction instruction, by displaying an interface corresponding to the first interaction instruction on the first virtual display screen, synchronizing the interface corresponding to the first interaction instruction to the first physical display screen.

[0007] Optionally, responding to the first interaction instruction includes: responding to the first interaction instruction according to a priority of the first interaction instruction.

[0008] Optionally, the method also includes: receiving a first switching instruction; wherein, the first switching instruction is sent by a first user to the virtual device via the first physical display screen; the first switching instruction is used to instruct to switch the virtual display screen corresponding to the first physical display screen to a second virtual display screen; the second virtual display screen is any one of the N virtual display screens except the first virtual display screen; in response to the first switching instruction, stop synchronizing the interface of the first virtual display screen to the first physical display screen, and synchronize the interface of the second virtual display screen to the first physical display screen.

[0009] Optionally, the third virtual display screen is any one of the N virtual display screens except the first virtual display screen; the third physical display screen is a physical display screen corresponding to the third virtual display screen and in an online state; the method also includes: receiving a first move instruction; wherein the first move instruction is sent by a first user to the virtual device through the first physical display screen; the first move instruction is used to instruct to move a first application from the first physical display screen to the third physical display screen; the first application is any application displayed in the first physical display screen; in response to the first move instruction, the first application is moved from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

[0010] Optionally, the third virtual display screen is any one of the N virtual display screens except the first virtual display screen; the third physical display screen is the physical display screen corresponding to the third virtual display screen; the third physical display screen is in an offline state; the method also includes: receiving a first move instruction; wherein the first move instruction is sent by a first user to the virtual device through the first physical display screen; the first move instruction is used to instruct to move a first application from the first physical display screen to at least one of the third physical display screens; the first application is any application displayed in the first physical display screen; in response to the first move instruction, saving the current state of the first application, and moving the first application from the first virtual display screen to the third virtual display screen, and maintaining the current state of the first application in the third virtual display screen; monitoring whether there is a target physical display screen, wherein the target physical display screen is the third physical display screen that changes from the offline state to the online state; when the target physical display screen is monitored, synchronizing the interface of the third virtual display screen to the target physical display screen.

[0011] Optionally, in response to the first move instruction, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: in response to the first move instruction, displaying the inquiry information in the interface of the third physical display screen by displaying the inquiry information in the interface of the third virtual display screen; wherein the inquiry information is used to inquire whether the second user agrees to move the first application to the third physical display screen; receiving a first affirmative instruction; wherein the first affirmative instruction is sent by the second user to the virtual device via the third physical display screen; the first affirmative instruction is used to indicate that the second user agrees to move the first application to the third physical display screen; in response to the first affirmative instruction, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

[0012] Optionally, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: when the first application is in a closed state, moving the first application from the interface of the first virtual display screen to the interface of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

[0013] Optionally, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: when the first application is in the foreground running state and there is no application running in the background on the first virtual display screen and there is no application running in the foreground on the third virtual display screen, removing the first application from the first virtual display screen and displaying the desktop in the first virtual display screen, and running the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0014] Optionally, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: when the first application is in the foreground running state and there is no application running in the background on the first virtual display screen and there is an application running in the foreground on the third virtual display screen, removing the first application from the first virtual display screen and displaying the desktop in the first virtual display screen, and controlling the application running in the foreground of the third virtual display screen to run in the background and running the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0015] Optionally, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: when the first application is in the foreground running state and there is an application running in the background on the first virtual display screen and there is no application running in the foreground on the third virtual display screen, removing the first application from the first virtual display screen, controlling a background running program in the first virtual display screen to run in the foreground, and running the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0016] Optionally, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen includes: when the first application is in the foreground running state and there is an application running in the background on the first virtual display screen and there is an application running in the foreground on the third virtual display screen, removing the first application from the first virtual display screen and controlling a background-running program in the first virtual display screen to run in the foreground, and controlling the foreground-running application in the third virtual display screen to run in the background and running the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

[0017] Optionally, synchronizing the interface of the first virtual display screen to the first physical display screen includes: receiving a first login request sent by the first physical display screen; in response to the first login request, determining the first virtual display screen according to a preset allocation strategy, and establishing a communication link between the virtual device and the first physical display screen; synchronizing the interface of the first virtual display screen to the first physical display screen through the communication link; wherein the preset allocation strategy is used to indicate the correspondence between the N virtual display screens and the M physical display screens.

[0018] In a second aspect, the present application provides a multi-screen display system, comprising: a virtual device and M physical display screens, wherein: the virtual device is deployed in the cloud, the virtual device comprises N virtual display screens, N≥2, each of the N virtual display screens is used to display different applications provided by the virtual device; the N virtual display screens correspond to the M physical display screens; wherein each virtual display screen corresponds to at least one of the physical display screens, and each of the M physical display screens corresponds to only one virtual display screen; the virtual device is used to execute any of the methods described in the first aspect.

[0019] The beneficial effects of the multi-screen display method of the present invention are:

[0020] Since each virtual display screen can display different applications provided by the virtual device, and since each virtual display screen corresponds to at least one physical display screen, and each physical display screen only corresponds to one virtual display screen, and the first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen, the virtual device can synchronize the application displayed in the first virtual display screen to the first physical display screen by synchronizing the interface of the first virtual display screen to the first physical display screen. In other words, the virtual device can synchronize the application displayed in each virtual display screen to the physical display screen corresponding to each virtual display screen by synchronizing the interface of each virtual display screen to the physical display screen corresponding to each virtual display screen, thereby solving the problem of how to display applications provided by the virtual device on different physical display screens.

[0021] Furthermore, since each virtual display screen can display different applications provided by the virtual device, when different physical display screens correspond to different virtual display screens, different physical display screens display different applications, thereby realizing the isolation of applications between different physical display screens, so that the different physical display screens can provide different applications to users at the same time, and also realizing the expansion of physical display screens. When different physical display screens correspond to the same virtual display screens, the different physical display screens display the same applications, thereby realizing the sharing of applications between different physical display screens, and also realizing the replication of physical display screens. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A schematic diagram of an application scenario of a virtual device provided in an embodiment of the present application;

[0023] Figure 2 A schematic diagram of another application scenario of a virtual device provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the structure of a multi-screen display system provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of the structure of another multi-screen display system provided in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of the structure of another multi-screen display system provided in an embodiment of the present application;

[0027] Figure 6 A schematic diagram of the structure of another multi-screen display system provided in an embodiment of the present application;

[0028] Figure 7 A schematic diagram of a flow chart of a multi-screen display method provided in an embodiment of the present application;

[0029] Figure 8 A schematic diagram of the structure of a cloud server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be interpreted as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.

[0031] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0032] The term "including" and its variations used in this article are open inclusions, that is, "including but not limited to"; the term "based on" means "based at least in part on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments"; the term "optionally" means "optional embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts of "first", "second", etc. mentioned in the present invention are only used to distinguish different devices, modules or units, etc., and are not used to limit the order or interdependence of the functions performed by these devices, modules or units, etc.

[0033] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0034] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.

[0035] In order to solve the problem of insufficient computing power of physical terminal devices, a virtual device can be deployed in the cloud. By migrating the operations of the physical terminal device to the virtual device, the computing power requirements of the physical terminal device can be reduced, thereby releasing the computing power of the physical terminal device and making up for the problem of insufficient computing power of the physical terminal device.

[0036] For example, Figure 1 A schematic diagram of an application scenario of a virtual device provided in an embodiment of the present application. Figure 1 As shown, the application scenario may include: cloud 110, virtual device 120 and physical terminal device 130. Among them:

[0037] The cloud 110 can be understood as being composed of at least a plurality of cloud servers. The virtual device 120 is deployed on the cloud 110. The cloud 110 provides resources to the virtual device 120 so that the virtual device 120 has processing capabilities. The resources provided by the cloud 110 to the virtual device include, but are not limited to, processor cores and storage.

[0038] The physical terminal device 130 can be understood as a physical terminal device used by a user, including but not limited to a mobile phone, a tablet computer, a car computer, a laptop computer, and an e-reader.

[0039] Each user corresponds to a virtual device 120. The user can access the services provided by the virtual device 120 through the physical terminal device 130.

[0040] Specifically, the virtual device 120 may be installed with applications, including but not limited to video playback applications, audio playback applications, photo album applications, game applications, image processing applications, and text editing applications. The services provided by the virtual device 120 include but are not limited to the services provided by the applications installed in the virtual device 120. The user may send a request to the virtual device 120 through the physical terminal device 130, so that the virtual device 120 responds to the request and provides the corresponding service to the user through the physical terminal device 130.

[0041] The system assigns an account and password to each user, and the user can log in to the virtual device 120 by entering the account and password in the physical terminal device 130. After the login is successful, the virtual device 120 establishes a link with the physical terminal device 130, so that the physical terminal device 130 and the virtual device 120 can exchange information through the link.

[0042] For example, Figure 2 A schematic diagram of another application scenario of a virtual device provided in an embodiment of the present application. Figure 2 and Figure 1 The difference is: Figure 2 The application scenario in the embodiment also includes a middle station 140. Among them, the middle station 140 can be understood as being composed of at least one server set.

[0043] The cloud 110 , the virtual device 120 , and the physical terminal device 130 have been described above and will not be repeated here.

[0044] Based on the above structural differences, Figure 2 and Figure 1 The difference in the operation process lies in: the process of the physical terminal device 130 logging into the virtual device 120 and the process of the physical terminal device 130 accessing the service provided by the virtual device 120.

[0045] The login process can be as follows:

[0046] The system will assign an account and password to each user, and the middle station 140 will at least pre-store the account and password of each user. In this way, the first user can enter the account and password in the physical terminal device 130 and click the login control. In response to the click operation of the login control, the physical terminal device 130 generates a first login request according to the account and password of the first user, and sends the first login request to the middle station 140. The middle station 140 receives and responds to the first login request, authenticates the first login request according to the account and password of the first user in the first login request, and in combination with the account and password of each user pre-stored in the middle station 140, and, when the authentication is passed, sends the identification information of the virtual device corresponding to the first user to the physical terminal device 130. The physical terminal device 130 directly accesses the virtual device 120 according to the identification information of the virtual device, and the virtual device 120 establishes a link between it and the physical terminal device 130, so that the virtual device 120 provides services to the physical terminal device 130 through the link.

[0047] It should be noted that if the authentication fails, the middle station 140 sends a login failure receipt message to the physical terminal device 130, so that the physical terminal device 130 displays a login failure prompt message to the first user, so that the first user can make a corresponding response.

[0048] The process of the physical terminal device 130 accessing the service provided by the virtual device 120 may be as follows:

[0049] The first user sends a request to access the virtual device 120 to the middle station 140 through the physical terminal device 130. The middle station 140 receives the request to access the virtual device 120, authenticates the request to access the virtual device 120, and after the authentication is passed, sends the request to access the virtual device 120 to the virtual device 120. The virtual device 120 receives and responds to the request to access the virtual device 120, and provides corresponding services to the physical terminal device 130 through the link.

[0050] It should be noted that when the authentication fails, the middle station 140 sends a receipt message of the authentication failure to the physical terminal device 130, so that the physical terminal device 130 displays a prompt message of the request failure to the first user based on the receipt message of the authentication failure.

[0051] Obviously, in Figure 2In the example, since the middle station 140 authenticates the login request or access request sent by the physical terminal device 130, it is sufficient to store the authentication-related information in the middle station 140, and it is not necessary to store the authentication-related information in the cloud 110, which reduces the computing power and storage requirements of the virtual device 120 to a certain extent. In addition, since the authentication-related information is only stored in the middle station 140, the cloud 110 is not involved in the storage of the authentication-related information, which ensures the security of the user's account and password and other authentication-related information to a certain extent.

[0052] At present, in order to meet users' diverse needs for accessing virtual devices, physical terminal devices including multiple physical display screens can be allowed to log in to virtual devices, or multiple physical terminal devices can be allowed to log in to the same virtual device at the same time, that is, multiple physical display screens are allowed to log in to the same virtual device at the same time. In this way, how to display applications provided by virtual devices on different physical display screens is a problem that needs to be solved urgently.

[0053] In order to solve the above technical problems, the present application embodiment provides a multi-screen display system, such as Figure 3 As shown, the multi-screen display system may include: a virtual device 320 and M physical display screens 330. Among them:

[0054] The virtual device 320 is deployed in the cloud 310. It should be noted that the relevant description of the cloud 310 can be found above and will not be repeated here.

[0055] The virtual device 320 may include N virtual display screens, and the N virtual display screens may be virtual display screen 1 to virtual display screen N, where N≥2. For example, Figure 3 As shown, the virtual device 320 includes four virtual display screens, namely: virtual display screen 1 to virtual display screen 4.

[0056] Each of the N virtual display screens may display a different application provided by the virtual device 320. The virtual device 320 may be installed with various applications, such as a video playback application, an audio playback application, an album application, a game application, an image processing application, a text editing application, a navigation application, etc. The virtual device 320 may provide different applications to different virtual display screens for display by the different virtual display screens.

[0057] Different virtual display screens display different applications. The application displayed on each virtual display screen can be determined according to preset display rules. For the preset display rules, for example, the preset display rules can be determined according to the application scenarios of the physical display screens corresponding to each virtual display screen. Exemplarily, if the physical display screen corresponding to the virtual display screen is the central control screen of the vehicle computer, the navigation software, voice call software, etc. can be placed in the virtual display screen. If the physical display screen corresponding to the virtual display screen is the rear entertainment screen of the vehicle computer, entertainment applications, such as video playback applications, game applications, audio playback applications, etc. can be placed in the virtual display screen.

[0058] It should be noted that the above description of the preset display rules is only exemplary and is not used to limit the preset display rules in the application.

[0059] The M physical display screens 330 may include physical display screen 1 to physical display screen M. For example, Figure 3 As shown, M is 4, that is, 4 physical display screens, namely physical display screen 1 to physical display screen 4.

[0060] The M physical display screens 330 may be display screens of all physical terminal devices that are allowed to log in to the virtual device 320 at the same time. For example, if the physical terminal device that is allowed to log in to the virtual device 320 is a car computer, the M physical display screens 330 may include the central control screen of the car computer and multiple rear entertainment screens of the car computer. If the physical terminal devices that are allowed to log in to the virtual device 320 at the same time include mobile phones, tablet computers, and e-readers, the M physical display screens 330 may include the display screen of the mobile phone, the display screen of the tablet computer, and the display screen of the e-reader. If the physical terminal devices that are allowed to log in to the virtual device 320 at the same time include car computers, mobile phones, tablet computers, and laptop computers, the M physical display screens 330 may include the central control screen of the car computer, multiple rear entertainment screens of the car computer, the display screen of the mobile phone, the display screen of the tablet computer, and the display screen of the laptop computer.

[0061] An account and password may be assigned to the virtual device 320, so that all physical display screens that are allowed to log in to the virtual device 320 at the same time may log in to the virtual device 320 through the account and password of the virtual device 320. And, after the login is successful, the virtual device 320 establishes a communication link between the virtual device 320 and the physical display screen, so as to realize information exchange between the virtual device 320 and the physical display screen through the communication link.

[0062] It should be noted that when the physical display screens corresponding to all virtual display screens in the virtual device 320 are offline, the resources allocated to the virtual device 320 can be released, and the resources of the virtual device 320 can be released so that the released resources can be allocated to other virtual devices in the cloud 310 for use, thereby improving resource utilization.

[0063] The N virtual display screens correspond to the M physical display screens, wherein each virtual display screen corresponds to at least one physical display screen, and each of the M physical display screens corresponds to only one virtual display screen.

[0064] The number of physical display screens corresponding to different virtual display screens may be the same or different, and this embodiment of the present application does not impose any special limitation on this.

[0065] The number of virtual display screens may be the same as the number of physical display screens, that is, N is equal to M. The number of virtual display screens may also be less than the number of physical display screens, that is, N is less than M, which is not particularly limited in the embodiments of the present application.

[0066] When N is the same as M, the N virtual display screens correspond to the M physical display screens one-to-one. The correspondence between the virtual display screen and the physical display screen can be determined, for example, based on the application scenario of the physical display screen and the application in the virtual display screen. For example, if the physical display screen is a central control screen, the physical display screen corresponds to the virtual display screen that displays vehicle driving applications. If the physical display screen is a rear entertainment screen, the physical display screen corresponds to the virtual display screen that displays entertainment applications.

[0067] For example, Figure 3 As shown, the number of virtual display screens and the number of physical display screens are both 4, that is, N and M are both 4, wherein the 4 virtual display screens are virtual display screens 1 to 4, and the 4 physical display screens are physical display screens 1 to 4.

[0068] See also Figure 3 The correspondence between the four virtual display screens and the four physical display screens can be: virtual display screen 1 corresponds to physical display screen 1, virtual display screen 2 corresponds to physical display screen 2, virtual display screen 3 corresponds to physical display screen 3, and virtual display screen 4 corresponds to physical display screen 4.

[0069] When N is less than M, N virtual display screens correspond to M physical display screens, wherein each virtual display screen corresponds to at least one physical display screen and each physical display screen corresponds to only one virtual display screen. The determination of the correspondence between the virtual display screen and the physical display screen can be referred to the above description and will not be repeated here.

[0070] For example, Figure 4 As shown, the number of virtual display screens is 2, that is, N is 2, and the number of physical display screens is 4, that is, M is 4. The two virtual display screens are virtual display screens 1 to 2, and the four physical display screens are physical display screens 1 to 4.

[0071] See also Figure 4, the correspondence between the two virtual display screens and the four physical display screens can be: virtual display screen 1 corresponds to physical display screen 1, and virtual display screen 2 corresponds to physical display screen 2, physical display screen 3, and physical display screen 4. In other words, virtual display screen 1 corresponds to one physical display screen, and virtual display screen 2 corresponds to three physical display screens.

[0072] The virtual device 320 can execute the multi-screen display method provided in the embodiment of the present application. This method can synchronously display different applications provided by the virtual device 320 to each virtual display screen on the physical display screen corresponding to each virtual display screen while allowing multiple physical display screens to log in to the same virtual device 320 at the same time, thereby solving the problem of how to display applications provided by the virtual device on different physical display screens.

[0073] Figure 5 A schematic diagram of the structure of another multi-screen display system provided in an embodiment of the present application. Figure 5 and Figure 3 The differences between the multi-screen display systems provided in are: Figure 5 The Zhongtai 340 is also included.

[0074] The structure of the middle platform 340 can be seen from the above description and will not be described again here.

[0075] Based on the above structural differences, Figure 5 and Figure 3 The difference in the operation process is:

[0076] The user sends a request or instruction to the middle platform 340 through the physical display screen. The middle platform 340 authenticates the request and instruction sent by the physical display screen 340 and makes a corresponding response based on the authentication result.

[0077] Specifically, the request or instruction sent by the physical display may refer to the request and instruction sent by the physical display to the virtual device 320, such as a request to log in to the virtual device 320, an instruction to move an application, an instruction to switch the virtual display corresponding to the physical display, an instruction to interact with an application provided by the virtual device 320, etc.

[0078] The information required for authentication is stored in the middle station 340. The information required for authentication, the authentication process of the middle station 340, and the post-authentication processing process will be explained below and will not be repeated here.

[0079] It should be noted that, for example, Figure 5 In the example, the number of virtual displays is the same as that of physical displays, that is, N is equal to M. The correspondence between virtual displays and physical displays can be found in Figure 3 The relevant instructions in will not be repeated here.

[0080] For example, Figure 6 A schematic diagram of the structure of another multi-screen display system provided in an embodiment of the present application. Figure 6 and Figure 5 The difference is: Figure 6 There are 2 virtual displays and 4 physical displays. The corresponding relationship between the 2 virtual displays and the 4 physical displays can be found in Figure 4 The relevant instructions in will not be repeated here.

[0081] Next, the multi-screen display method executed by the virtual device 320 is described in detail.

[0082] In some embodiments, Figure 7 As shown, the multi-screen display method may include:

[0083] 710. The virtual device synchronizes the interface of the first virtual display screen to the first physical display screen, wherein the first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen.

[0084] As can be seen from the above, each virtual display screen can display different applications provided by the virtual device. Therefore, the virtual device can synchronize the application provided by the virtual device displayed on the first virtual display screen to the first physical display screen by synchronizing the interface of the first virtual display screen to the first physical display screen.

[0085] As can be seen from the above, by synchronizing the interface of each virtual display screen to the physical display screen corresponding to each virtual display screen, the application provided by the virtual device displayed on each virtual display screen can be synchronized to the physical display screen corresponding to each virtual display screen.

[0086] Since each virtual display screen can display different applications provided by the virtual device, if the two physical displays correspond to different virtual displays, the two physical displays display different applications, thus achieving the isolation of applications between different physical displays. If the two physical displays correspond to the same virtual displays, the two physical displays display the same applications, thus achieving the sharing of applications between different physical displays.

[0087] For example, Figure 3 As shown, physical display screen 1 synchronously displays the interface of virtual display screen 1, physical display screen 2 synchronously displays the interface of virtual display screen 2, physical display screen 3 synchronously displays the interface of virtual display screen 3, and physical display screen 4 synchronously displays the interface of virtual display screen 4. Since each virtual display screen displays a different application, each physical display screen displays a different application.

[0088] For example, Figure 4As shown, the physical display screen 1 synchronously displays the interface of the virtual display screen 1, and the physical display screens 2, 3, and 4 synchronously display the interface of the virtual display screen 2.

[0089] Since each virtual display screen displays a different application, the applications displayed on the physical display screen 1 and the physical display screens 2 to 4 are different, and the applications displayed on the physical display screens 2 to 4 are the same.

[0090] Obviously, since each virtual display screen can display different applications provided by the virtual device, and since each virtual display screen corresponds to at least one physical display screen, and each physical display screen only corresponds to one virtual display screen, and the first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen, the virtual device 320 can synchronize the application displayed in the first virtual display screen to the first physical display screen by synchronizing the interface of the first virtual display screen to the first physical display screen. In other words, the virtual device 320 can synchronize the application displayed in each virtual display screen to the physical display screen corresponding to each virtual display screen by synchronizing the interface of each virtual display screen to the physical display screen corresponding to each virtual display screen, thereby solving the problem of how to display the applications provided by the virtual device 320 on different physical display screens.

[0091] Furthermore, since each virtual display screen can display different applications provided by the virtual device 320, when different physical display screens correspond to different virtual display screens, different physical display screens display different applications, thereby realizing the isolation of applications between different physical display screens, so that the different physical display screens can provide different applications to users at the same time, and also realizing the expansion of the physical display screen. When different physical display screens correspond to the same virtual display screens, the different physical display screens display the same applications, thereby realizing the sharing of applications between different physical display screens, and also realizing the replication of physical display screens.

[0092] It should be noted that the extension of the physical display screen refers to different physical display screens displaying different applications, and the duplication of the physical display screen refers to different physical display screens displaying the same application.

[0093] In some embodiments, the specific process of the virtual device 320 synchronizing the interface of the first virtual display screen to the first physical display screen may be as follows:

[0094] First, the virtual device 320 receives a first login request sent by a first physical display screen.

[0095] For example, in Figure 3 or Figure 4In the multi-screen display system shown, the first physical display screen sends a first login request to the virtual device 320. The first login request may carry at least an account number and a password.

[0096] For example, in Figure 5 or Figure 6 In the multi-screen display system shown, an account and password are pre-assigned to each virtual device, and the account and password of each virtual device are stored in the middle station 340, and the corresponding relationship between the identification information of each virtual device and its account is also stored in the middle station 340. In this way, when the first physical display screen logs in to the virtual device 320, the first user enters the account and password of the virtual device 320 in the interface of the first physical display screen and clicks the login control. The first physical display screen responds to the click operation of the login control, obtains the account and password of the virtual device 320 entered by the first user, and generates a second login request according to the account and password of the virtual device 320 entered by the user, and sends the second login request to the middle station 340. The middle station 340 authenticates the first login request. Specifically, the middle station 340 compares the account and password carried by the first login request with the account and password of each virtual device stored in advance. If there is an account and password that is the same as the account and password carried by the first login request, the identification information of the virtual device 320 corresponding to the account of the first login request stored in the middle station 340 is sent to the first physical display screen. The first physical display screen sends a first login request to the virtual device 320 according to the identification information of the virtual device 320 , wherein the first login request may carry the identification information of the first physical display screen.

[0097] Then, the virtual device 320 responds to the first login request, determines the first virtual display screen according to a preset allocation strategy, and establishes a communication link between the virtual device 320 and the first physical display screen.

[0098] The preset allocation strategy is used to indicate the corresponding relationship between the N virtual display screens and the M physical display screens.

[0099] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, when the virtual device 320 receives a first login request sent by the first physical display screen, the first login request can be authenticated first, and after the authentication is passed, the virtual display screen corresponding to the first physical display screen is determined according to the preset allocation strategy and the identification information of the first physical display screen, that is, the first virtual display screen is determined, and a communication link between the virtual device 320 and the first physical display screen is established.

[0100] For example, in Figure 5 or Figure 6In the multi-screen display system shown, when the virtual device 320 receives a first login request sent by a first physical display screen, it determines the virtual display screen corresponding to the first physical display screen based on the identification information of the first physical display screen carried in the first login request and a preset allocation strategy, that is, determines the first virtual display screen, and establishes a communication link between the virtual device 320 and the first physical display screen.

[0101] Finally, the virtual device 320 synchronizes the interface of the first virtual display screen to the first physical display screen through the communication link.

[0102] In some embodiments, the multi-screen display method may further include:

[0103] First, the virtual device 320 receives a first interaction instruction.

[0104] The first interaction instruction is sent by the first user to the virtual device 320 through the first physical display screen.

[0105] Specifically, in Figure 3 or Figure 4 In the multi-screen display system shown, the first interaction instruction can be sent directly to the virtual device 320 by the first user through the first physical display screen.

[0106] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first interaction instruction can be sent by the first user to the middle station 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle station 340.

[0107] Exemplarily, when the first user operates the application in the first physical display screen, the first physical display screen generates a corresponding first interaction instruction in response to the operation and in combination with an encryption algorithm (e.g., a hash algorithm), and sends the first interaction instruction to the middle station 340. Among them, the first interaction instruction corresponds to the operation of the first user on the application in the first physical display screen. For example, if the user clicks on the icon of the application in the first physical display screen, the first interaction instruction generated is an instruction to open the application. If the user triggers the play control of the audio playback application in the first physical display screen, the first interaction instruction generated is an audio playback instruction. The middle station 340 receives and responds to the first interaction instruction, authenticates the first interaction instruction based on the same encryption algorithm, and forwards the first interaction instruction to the virtual device 320 when the authentication passes, that is, when it is determined that the first interaction instruction has not been tampered with. In the case of authentication failure, a prompt message of abnormal interaction is sent to the first physical display screen, so that the first physical display screen displays the prompt message of abnormal interaction to the first user, so that the first user can take corresponding measures.

[0108] Then, the virtual device 320 responds to the first interaction instruction by displaying the interface corresponding to the first interaction instruction on the first virtual display screen, and synchronizes the interface corresponding to the first interaction instruction to the first physical display screen.

[0109] For example, if the first interaction instruction is an instruction to open an application, the interface corresponding to the first interaction instruction is the interface after the application is opened. If the first interaction instruction is an instruction to play the first audio, the interface corresponding to the first interaction instruction is the interface for playing the first audio. If the first interaction instruction is an instruction to display a picture, the interface corresponding to the first interaction instruction is the interface for displaying the picture.

[0110] It should be noted that the above description of the interface corresponding to the first interaction instruction is only exemplary and will not be repeated here.

[0111] Since the virtual device 320 can synchronize the interface of the first virtual display screen to the first physical display screen, when the virtual device 320 displays the interface corresponding to the first interaction instruction on the first virtual display screen, the interface corresponding to the first interaction instruction will also be synchronized to the first physical display screen.

[0112] Obviously, since the virtual device 320 can synchronize the interface of the first virtual display screen to the first physical display screen, and since the first interaction instruction is sent by the first user to the virtual device 320 through the first physical display screen, when the virtual device 320 receives the first interaction instruction, it responds to the first interaction instruction and displays the interface corresponding to the first interaction instruction on the first virtual display screen. The interface corresponding to the first interaction instruction can be synchronized to the first physical display screen, thereby realizing human-computer interaction.

[0113] In some embodiments, the virtual device 320 may respond to the first interaction instruction in the following manner: the virtual device 320 responds to the first interaction instruction according to the priority of the first interaction instruction.

[0114] Specifically, when the virtual device 320 needs to process multiple interaction instructions, it can process them according to the priority of each interaction instruction.

[0115] The multiple interaction instructions may be understood as: multiple interaction instructions sent by one physical display screen, and / or multiple interaction instructions sent by multiple physical display screens when multiple physical display screens are online.

[0116] The multiple physical display screens include a first physical display screen, and the multiple physical display screens are at least a part of the M physical display screens, and the multiple interaction instructions include a first interaction instruction.

[0117] Specifically, a priority determination strategy can be set in advance. Thus, when a first interaction instruction is received, the priority relationship between the first interaction instruction and the interaction instruction currently to be processed by the virtual device 320 can be determined based on the first interaction instruction and the interaction instruction currently to be processed by the virtual device 320 and in combination with the priority determination strategy. Based on the priority relationship, all interaction instructions (i.e., the first interaction instruction and the interaction instruction currently to be processed) are sorted in order of high to low priority, so that the interaction instructions can be processed in sequence according to the sorting results.

[0118] The setting rules of the priority determination strategy may be, for example, as follows:

[0119] For interaction instructions sent by different physical display screens, the priority of interaction instructions sent by different physical display screens can be determined according to the function of each physical display screen. For example, if multiple physical display screens include the central control screen and the rear entertainment screen of the vehicle computer, the priority of interaction instructions sent by the central control screen is higher than the priority of interaction instructions sent by the rear entertainment screen.

[0120] For multiple interaction instructions sent by the same physical display screen, the priority of different interaction instructions sent by the physical display screen can be determined according to the application scenario of the physical display screen. For example, if the physical display screen is mainly used for navigation, the priority of navigation-related interaction instructions sent by the physical display screen is higher than the priority of non-navigation-related interaction instructions. If the physical display screen is mainly used for entertainment, the priority of entertainment-related interaction instructions sent by the physical display screen is higher than the priority of non-entertainment-related interaction instructions.

[0121] Different interaction instructions for the same application sent to different physical display screens, where different physical display screens correspond to the same virtual display screen, can determine the priority of the different interaction instructions for the same application according to the different functions of the different interaction instructions. For example, when the virtual display screen is displaying an audio playback interface, when receiving interaction instructions for closing audio playback and opening a playlist sent by different physical display screens, the interaction instruction for closing audio playback is processed first, and then the interaction instruction for opening the playlist is processed.

[0122] Obviously, the virtual device 320 responds to the first interaction instruction according to the processing priority of the first interaction instruction, which can ensure that when multiple interaction instructions are queued, they can be processed in order of priority, thereby improving the rationality of processing.

[0123] On this basis, if the first physical display screen is the central control screen of the vehicle computer, the first interaction instruction has the highest priority. Based on this, when the virtual device 320 receives the first interaction instruction, it processes the first interaction instruction first.

[0124] Since the first physical display screen is the central control screen of the vehicle, that is, the current scene is driving the vehicle, and the central control screen mainly provides navigation and other services for the driver, therefore, in order to ensure driving safety, the priority of the interactive instructions sent by the central control screen (ie, the first interactive instructions) needs to be set to the highest. In this way, the interactive instructions sent by the central control screen can be processed with priority to improve driving safety.

[0125] In some embodiments, the multi-screen display method may further include:

[0126] First, the virtual device 320 receives a first switching instruction.

[0127] The first switching instruction is used to instruct to switch the virtual display screen corresponding to the first physical display screen to a second virtual display screen. The second virtual display screen is any one of the N virtual display screens except the first virtual display screen.

[0128] The first switching instruction may be sent by the first user to the virtual device 320 via the first physical display screen.

[0129] Specifically, in Figure 3 or Figure 4 In the multi-screen display system shown, the first switching instruction can be sent directly to the virtual device 320 by the first user through the first physical display screen.

[0130] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first switching instruction can be sent by the first user to the middle station 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle station 340.

[0131] Exemplarily, a switching interface may be provided in the first virtual display screen to provide a switching interface in the first physical display screen. In the switching interface, each virtual display screen except the first virtual display screen may be displayed in the N virtual display screens. In this way, the first user may open the switching interface in the first physical display screen, select the second virtual display screen therein, and click the switching control in the switching interface. When the first physical display screen receives the click operation of the switching control, it obtains the identification information of the second virtual display screen selected by the first user, generates a first switching instruction according to the identification information of the second virtual display screen and in combination with the encryption algorithm, and sends the first switching instruction to the middle station 340. The middle station 340 receives and responds to the first switching instruction, authenticates the first switching instruction in combination with the same encryption algorithm, and, when the authentication passes, that is, when it is determined that the first switching instruction has not been tampered with, forwards the first switching instruction to the virtual device 320. And, when the authentication fails, that is, when it is determined that the first switching instruction has been tampered with, an abnormal operation prompt message is sent to the first physical display screen. The first physical display screen displays the abnormal operation prompt message so that the first user can take corresponding countermeasures.

[0132] Then, in response to the first switching instruction, the virtual device 320 stops synchronizing the interface of the first virtual display screen to the first physical display screen, and synchronizes the interface of the second virtual display screen to the first physical display screen, so as to switch the virtual display screen corresponding to the first physical display screen from the first virtual display screen to the second virtual display screen, thereby realizing the switching of the virtual display screen corresponding to the first physical display screen.

[0133] For example, Figure 5 As shown, through the above process, the virtual display screen corresponding to the physical display screen 3 can be switched to the virtual display screen 2. In this way, the physical display screen 3 and the physical display screen 2 both synchronize the interface of the virtual display screen 2 to achieve the sharing of the interface of the virtual display screen 2, and also achieve the replication of the physical display screen corresponding to the virtual display screen 2.

[0134] For example, Figure 6 As shown, through the above process, the virtual display screen corresponding to the physical display screen 1 can be switched to the virtual display screen 2. In this way, the physical display screens 1 to 4 all synchronize the interface of the virtual display screen 2 to achieve the sharing of the interface of the virtual display screen 2, and also achieve the replication of the physical display screen corresponding to the virtual display screen 2.

[0135] Obviously, since the first switching instruction is sent by the first user to the virtual device 320 through the first physical display screen. And since the first switching instruction is used to instruct the virtual display screen corresponding to the first physical display screen to be switched to the second virtual display screen, and the second virtual display screen is any one of the N virtual display screens except the first virtual display screen. Therefore, when the virtual device 320 receives the first switching instruction, it stops synchronizing the interface of the first virtual display screen to the first physical display screen and synchronizes the interface of the second virtual display screen to the first physical display screen in response to the first switching instruction, so as to switch the virtual display screen corresponding to the first physical display screen from the first virtual display screen to the second virtual display screen, thereby realizing the switching of the virtual display screen corresponding to the first physical display screen, and then the first user can freely switch the virtual display screen corresponding to the first physical display screen according to needs, thereby improving the user experience.

[0136] In some embodiments, the third virtual display screen is any one of the N virtual display screens except the first virtual display screen. The third physical display screen is a physical display screen that corresponds to the third virtual display screen and is in an online state.

[0137] Based on this, the multi-screen display method may further include the following steps:

[0138] First, the virtual device 320 receives a first movement instruction.

[0139] The first moving instruction is used to instruct to move the first application from the first physical display screen to the third physical display screen. The first application is any application displayed on the first physical display screen.

[0140] The first movement instruction may be sent by the first user to the virtual device 320 via the first physical display screen.

[0141] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first movement instruction can be sent directly to the virtual device 320 by the first user through the first physical display screen.

[0142] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first movement instruction can be sent by the first user to the middle station 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle station 340.

[0143] Exemplarily, the first user can call up the application mobile interface by long pressing the first application in the first physical display screen, wherein each physical display screen except the first physical display screen in the M physical display screens is displayed in the application mobile interface. The first user selects a physical display screen displayed in the application mobile interface to determine the selected physical display screen as the third physical display screen, and when the third physical display screen is selected, clicks the mobile control in the application mobile interface. In response to the click operation of the mobile control, the first physical display screen obtains the identification information of the third physical display screen, generates the first mobile instruction according to the identification information of the third physical display screen and in combination with the encryption algorithm, and sends the first mobile instruction to the middle station 340. In response to the first mobile instruction, the middle station 340 authenticates the first mobile instruction based on the same encryption algorithm, and forwards the first mobile instruction to the virtual device 320 after the authentication is passed.

[0144] Then, in response to the first move instruction, the virtual device 320 moves the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

[0145] Obviously, through the above process, the first user can move the first application to the third physical display screen as needed, thereby achieving the sharing and rearrangement of the first application.

[0146] In some embodiments, in response to the first move instruction, the virtual device 320 moves the first application from the first virtual display screen to the third virtual display screen, and the implementation process of moving the first application from the first physical display screen to the third physical display screen may be as follows:

[0147] First, the virtual device 320 responds to the first movement instruction by providing the query information in the interface of the third virtual display screen and displaying the query information in the interface of the third physical display screen.

[0148] The inquiry information may be used to inquire whether the second user agrees to move the first application to the third physical display screen. The inquiry information may be displayed in a manner including, but not limited to, a prompt box inquiry, an animation inquiry, and the like.

[0149] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the second user can make an affirmative response or a negative response based on the inquiry information. When the second user makes an affirmative response based on the inquiry information, the third physical display screen generates a first affirmative instruction based on the affirmative response and sends the first affirmative instruction to the virtual device 320.

[0150] exist Figure 5 or Figure 6In the multi-screen display system shown, the second user can make an affirmative response or a negative response based on the inquiry information. When the second user makes an affirmative response based on the inquiry information, the third physical display generates a first affirmative instruction based on the affirmative response and in combination with the encryption algorithm, and sends the first affirmative instruction to the middle station 340. The middle station 340 authenticates the first affirmative instruction according to the same encryption algorithm, and after the authentication is passed, sends the first affirmative instruction to the virtual device 320.

[0151] Then, the virtual device 320 receives the first affirmative instruction.

[0152] The first affirmative instruction is used to indicate that the second user agrees to move the first application to the third physical display screen.

[0153] The first affirmative instruction may be sent by the second user to the virtual device 320 via the third physical display screen.

[0154] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first affirmative instruction is sent directly to the virtual device 320 by the second user through the third physical display screen.

[0155] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first affirmative instruction is sent by the second user to the middle station 340 through the third physical display screen and is forwarded to the virtual device 320 after being authenticated by the middle station 340.

[0156] Finally, in response to the first affirmative instruction, the virtual device 320 moves the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

[0157] Obviously, before moving the first application to the third physical display screen, the second user can be asked in the above manner, and after obtaining the consent of the second user, the first application can be moved to the third physical display screen in the above manner to improve the user experience. Especially when the third physical display screen is the central control screen, that is, when the vehicle is currently being driven, since the central control screen is mainly used for auxiliary driving, therefore, through the above method, when moving the first application to the central control screen, the second user (ie, the driver) can be asked whether he agrees to move, so that the application can be moved after the second user agrees, thereby improving driving safety to a certain extent.

[0158] In some embodiments, the process of the virtual device 320 moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen may be as follows:

[0159] When the first application is in a closed state, the virtual device 320 moves the first application from the interface of the first virtual display screen to the interface of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

[0160] That is, when the first application is in a closed state, the virtual device 320 directly moves the icon of the first application from the first physical display screen to the third physical display screen in the above manner.

[0161] When the first application is in the foreground, there is no application running in the background on the first virtual display, and there is no application running in the foreground on the third virtual display, the virtual device 320 removes the first application from the first virtual display, displays the desktop on the first virtual display, and runs the first application in the foreground of the third virtual display to move the first application from the first physical display to the third physical display, so that the first physical display displays the desktop of the first virtual display and the third physical display runs the first application in the foreground.

[0162] When the first application is in the foreground running state, there is no application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the virtual device 320 removes the first application from the first virtual display screen and displays the desktop on the first virtual display screen, and controls the application running in the foreground of the third virtual display screen to run in the background, and runs the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen, so that the first physical display screen displays the desktop of the first virtual display screen, and the third physical display screen runs the first application in the foreground.

[0163] When the first application is in the foreground running state, there is an application running in the background on the first virtual display screen, and there is no application running in the foreground on the third virtual display screen, the virtual device 320 removes the first application from the first virtual display screen, controls a program running in the background in the first virtual display screen to run in the foreground, and runs the first application in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen, thereby making a program running in the background of the first physical display screen run in the foreground, and making the third physical display screen run the first application in the foreground.

[0164] When the first application is in the foreground running state, there is an application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the virtual device 320 removes the first application from the first virtual display screen, controls a program running in the background in the first virtual display screen to run in the foreground, and controls an application running in the foreground of the third virtual display screen to run in the background, and runs the first application in the foreground of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen, thereby making a program running in the background of the first physical display screen run in the foreground, and making the third physical display screen run the first application in the foreground.

[0165] Obviously, through the above method, the display mode of the first application and the first virtual display screen and the third virtual display screen can be determined according to the running status of the first application and the running status of the applications in the first virtual display screen and the third virtual display screen during the movement of the first application, thereby enriching the display diversity.

[0166] In some embodiments, the third virtual display screen is any one of the N virtual display screens except the first virtual display screen. The third physical display screen is a physical display screen corresponding to the third virtual display screen. The number of the third physical display screens may be one or more, which will not be described in detail here. The third physical display screen is in an offline state. The third physical display screen in an offline state does not synchronously display the interface of the third virtual display screen.

[0167] Based on this, the multi-screen display method may further include:

[0168] First, the virtual device 320 receives a first movement instruction.

[0169] The first moving instruction is used to instruct to move the first application from the first physical display screen to at least one third physical display screen. The first application is any application displayed on the first physical display screen.

[0170] The first movement instruction may be sent by the first user to the virtual device 320 via the first physical display screen.

[0171] For example, in Figure 3 or Figure 4 In the multi-screen display system shown, the first movement instruction can be sent directly to the virtual device 320 by the first user through the first physical display screen.

[0172] exist Figure 5 or Figure 6 In the multi-screen display system shown, the first movement instruction can be sent by the first user to the middle station 340 through the first physical display screen and forwarded to the virtual device 320 after being authenticated by the middle station 340. It should be noted that the specific implementation process of this step can be found above and will not be repeated here.

[0173] Then, in response to the first move instruction, the virtual device 320 saves the current state of the first application, moves the first application from the first virtual display screen to the third virtual display screen, and maintains the current state of the first application in the third virtual display screen.

[0174] The current state of the first application includes whether the first application is in a running state and the running progress of the first application when the first application is in a running state.

[0175] Next, the virtual device 320 monitors whether a target physical display screen exists, wherein the target physical display screen is a third physical display screen that changes from an offline state to an online state.

[0176] The process of monitoring whether there is a target physical display screen is specifically as follows: monitoring whether there is a third physical display screen that changes from an offline state to an online state at a preset frequency, and if so, determining the third physical display screen that changes from an offline state to an online state as the target physical display screen.

[0177] Finally, when the target physical display screen is detected, the virtual device 320 synchronizes the interface of the third virtual display screen to the target physical display screen. In other words, when the third physical display screen is detected to be changed from an offline state to an online state, the interface of the third virtual display screen is synchronized to the online third physical display screen.

[0178] For example, Figure 6 As shown, the above process is explained by taking the first physical display screen as physical display screen 1, the first virtual display screen as virtual display screen 1, the third virtual display screen as virtual display screen 2, the third physical display device as physical display screens 2 to 4, and the physical display screens 2 to 4 are all in an offline state as an example.

[0179] When moving the first application in the physical display screen 1 from the physical display screen 1 to at least one of the physical display screens 2 to 4, the virtual device 320 first moves the first application from the virtual display screen 1 to the virtual display screen 2 based on the above-mentioned partial steps, and then, when the virtual device 320 monitors that the physical display screen 2 and the physical display screen 4 change from offline to online, the virtual device 320 synchronizes the interface of the virtual display screen 2 to the physical display screen 2 and the physical display screen 4, so as to realize the movement of the first application from the physical display screen 1 to the physical display screen 2 and the physical display screen 4.

[0180] Obviously, when the third physical display screen is in an offline state, the virtual device 320 receives and responds to the first movement instruction, saves the current state of the first application, moves the first application from the first virtual display screen to the third virtual display screen, and maintains the current state of the first application in the third virtual display screen, so as to realize the movement of the first application from the first virtual display screen to the third virtual display screen when the third physical display screen is in an offline state, thereby preparing for the movement of the first application between physical display screens. In this way, when the target physical display screen is detected, that is, when the third physical display screen is detected to change from an offline state to an online state, the interface of the third virtual display screen is synchronized to the target physical display screen, so as to realize the movement of the first application from the first physical display screen to at least one third physical display screen.

[0181] like Figure 8 As shown, an embodiment of the present invention provides a cloud server 800, which may include a memory 810 and a processor 820; a virtual device 830 is deployed on the cloud server 800, and the cloud server 800 can be used to allocate the memory 810 and the processor 820 to the virtual device 830 for use.

[0182] The virtual device 830 includes N virtual display screens, where N≥2. Each of the N virtual display screens is used to display different applications provided by the virtual device 830. The N virtual display screens correspond to M physical display screens, wherein each virtual display screen corresponds to at least one physical display screen, and each of the M physical display screens corresponds to only one virtual display screen.

[0183] The memory 810 may be used to store a computer program. The processor 820 may be used to enable the virtual device 830 to implement the multi-screen display method as described above when executing the computer program.

[0184] In other words, a cloud server 800 may include a memory 810 and a processor 820; a virtual device 830 is deployed on the cloud server 800, and the cloud server 800 can be used to allocate the memory 810 and the processor 820 to the virtual device 830 for use.

[0185] The virtual device 830 includes N virtual display screens, where N≥2. Each of the N virtual display screens is used to display different applications provided by the virtual device 830. The N virtual display screens correspond to M physical display screens, wherein each virtual display screen corresponds to at least one physical display screen, and each of the M physical display screens corresponds to only one virtual display screen.

[0186] The memory 810 is configured to store a computer program. The processor 820 is configured to, when executing the computer program, cause the virtual device 830 to perform the following operations:

[0187] Synchronizing the interface of the first virtual display screen to the first physical display screen;

[0188] The first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen.

[0189] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the multi-screen display method as described above is implemented.

[0190] In other words, a non-volatile computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor performs the following operations:

[0191] Synchronizing the interface of the first virtual display screen to the first physical display screen;

[0192] The first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen.

[0193] It should be noted that the computer-readable storage medium can achieve similar effects as the multi-screen display method, which will not be described in detail here.

[0194] An embodiment of the present invention provides a computer program product, including computer instructions. When the computer instructions are executed on a processor, the multi-screen display method as described above is implemented.

[0195] It should be noted that the computer program product can achieve similar effects as the multi-screen display method, which will not be described in detail here.

[0196] Now will describe the cloud server 800 that can be used as the present invention, it is the example of the hardware device that can be applied to each aspect of the present invention.Cloud server 800 is intended to represent the computer equipment of various forms of digital electronics, such as, laptop computer, desktop computer, workbench, personal digital assistant, server, blade server, mainframe computer and other suitable computer.Cloud server 800 can also represent various forms of mobile device, such as, personal digital processing, cellular phone, smart phone, wearable device and other similar computing device.The components shown in this article, their connection and relationship and their functions are only as examples, and are not intended to limit the realization of the present invention described herein and / or required.

[0197] The cloud server 800 includes a computing unit, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) or a computer program loaded from a storage unit into a random access memory (RAM). In the RAM, various programs and data required for device operation can also be stored. The computing unit, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0198] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc. In the present application, the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be arranged on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment of the present invention. In addition, each functional unit in each embodiment of the present invention can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0199] Although the present invention is disclosed as above, the protection scope of the present invention is not limited thereto. Those skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention, and these changes and modifications will fall within the protection scope of the present invention.

Claims

1. A multi-screen display method, applied to a virtual device, wherein the virtual device is deployed in the cloud, characterized in that: The virtual device includes N virtual display screens, N≥2; each of the N virtual display screens is used to display different applications provided by the virtual device; the N virtual display screens correspond to M physical display screens, wherein each of the virtual display screens corresponds to at least one of the physical display screens, and each of the M physical display screens corresponds to only one of the virtual display screens; The method comprises: Synchronizing the interface of the first virtual display screen to the first physical display screen; The first physical display screen is any one of the M physical display screens, and the first virtual display screen is a virtual display screen corresponding to the first physical display screen.

2. The method according to claim 1, characterized in that The method further comprises: Receiving a first interaction instruction; wherein the first interaction instruction is sent by a first user to the virtual device through the first physical display screen; In response to the first interaction instruction, the interface corresponding to the first interaction instruction is synchronized to the first physical display screen by displaying the interface corresponding to the first interaction instruction on the first virtual display screen.

3. The method according to claim 2, characterized in that The responding to the first interaction instruction comprises: Respond to the first interaction instruction according to the priority of the first interaction instruction.

4. The method according to claim 1, characterized in that: The method further comprises: Receive a first switching instruction; wherein the first switching instruction is sent by a first user to the virtual device through the first physical display screen; the first switching instruction is used to instruct to switch the virtual display screen corresponding to the first physical display screen to a second virtual display screen; the second virtual display screen is any one of the N virtual display screens except the first virtual display screen; In response to the first switching instruction, synchronization of the interface of the first virtual display screen to the first physical display screen is stopped, and the interface of the second virtual display screen is synchronized to the first physical display screen.

5. The method according to claim 1, characterized in that The third virtual display screen is any one of the N virtual display screens except the first virtual display screen; the third physical display screen is a physical display screen corresponding to the third virtual display screen and in an online state; The method further comprises: Receive a first movement instruction; wherein the first movement instruction is sent by a first user to the virtual device through the first physical display screen; the first movement instruction is used to instruct to move a first application from the first physical display screen to the third physical display screen; the first application is any application displayed on the first physical display screen; In response to the first move instruction, the first application is moved from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

6. The method according to claim 1, characterized in that The third virtual display screen is any one of the N virtual display screens except the first virtual display screen; the third physical display screen is a physical display screen corresponding to the third virtual display screen; the third physical display screen is in an offline state; The method further comprises: Receive a first movement instruction; wherein the first movement instruction is sent by a first user to the virtual device through the first physical display screen; the first movement instruction is used to instruct to move a first application from the first physical display screen to at least one of the third physical display screens; the first application is any application displayed on the first physical display screen; In response to the first move instruction, save the current state of the first application, move the first application from the first virtual display screen to the third virtual display screen, and maintain the current state of the first application in the third virtual display screen; Monitoring whether a target physical display screen exists, wherein the target physical display screen is the third physical display screen that changes from the offline state to the online state; When the target physical display screen is monitored, the interface of the third virtual display screen is synchronized to the target physical display screen.

7. The method according to claim 5, characterized in that In response to the first move instruction, moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: In response to the first movement instruction, displaying the query information in an interface of the third virtual display screen, and displaying the query information in an interface of the third physical display screen; The inquiry information is used to inquire whether the second user agrees to move the first application to the third physical display screen; receiving a first affirmative instruction; wherein the first affirmative instruction is sent by the second user to the virtual device through the third physical display screen; the first affirmative instruction is used to indicate that the second user agrees to move the first application to the third physical display screen; In response to the first affirmative instruction, the first application is moved from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen.

8. The method according to claim 5 or 7, characterized in that: Moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: When the first application is in a closed state, the first application is moved from an interface of the first virtual display screen to an interface of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

9. The method according to claim 5 or 7, characterized in that: Moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: When the first application is in the foreground running state, there is no application running in the background on the first virtual display screen, and there is no application running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen, and the desktop is displayed in the first virtual display screen, and the first application is run in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

10. The method according to claim 5 or 7, characterized in that: Moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: When the first application is in the foreground running state, there is no application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen, and the desktop is displayed in the first virtual display screen; and, the application running in the foreground of the third virtual display screen is controlled to run in the background, and the first application is run in the foreground of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

11. The method according to claim 5 or 7, characterized in that: Moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: When the first application is in the foreground running state, there is an application running in the background on the first virtual display screen, and there is no application running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen, and a background running program in the first virtual display screen is controlled to run in the foreground, and the first application is run in the foreground of the third virtual display screen to move the first application from the first physical display screen to the third physical display screen.

12. The method according to claim 5 or 7, characterized in that: Moving the first application from the first physical display screen to the third physical display screen by moving the first application from the first virtual display screen to the third virtual display screen comprises: When the first application is in the foreground running state, there is an application running in the background on the first virtual display screen, and there is an application running in the foreground on the third virtual display screen, the first application is removed from the first virtual display screen, and a program running in the background in the first virtual display screen is controlled to run in the foreground, and, the application running in the foreground of the third virtual display screen is controlled to run in the background, and the first application is run in the foreground of the third virtual display screen, so as to move the first application from the first physical display screen to the third physical display screen.

13. The method according to claim 1, characterized in that The step of synchronizing the interface of the first virtual display screen to the first physical display screen includes: Receiving a first login request sent by the first physical display screen; In response to the first login request, determining the first virtual display screen according to a preset allocation strategy, and establishing a communication link between the virtual device and the first physical display screen; Synchronizing the interface of the first virtual display screen to the first physical display screen via the communication link; The preset allocation strategy is used to indicate the corresponding relationship between the N virtual display screens and the M physical display screens.

14. A multi-screen display system, characterized in that: include: Virtual devices and M physical displays, where: The virtual device is deployed in the cloud, and the virtual device includes N virtual display screens, where N≥2, and each of the N virtual display screens is used to display different applications provided by the virtual device; The N virtual display screens correspond to the M physical display screens; wherein each of the virtual display screens corresponds to at least one of the physical display screens, and each of the M physical display screens corresponds to only one of the virtual display screens; The virtual device is used to execute the method according to any one of claims 1 to 13.

Images