Multi-screen display method and device based on cloud computer, storage medium and electronic equipment
By rendering virtual screens matching the screen of the local terminal on the cloud server side, the problem of inefficiency of cloud computers in multi-screen display environments is solved, and adaptive multi-screen display and seamless docking are achieved.
Patent Information
- Application Number
- CN202410008366.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-03
- Publication Date
- 2025-07-04
AI Technical Summary
Existing cloud computers cannot adaptively adjust the virtual desktop in a multi-screen display environment, resulting in users needing to frequently manually switch local terminals or cloud computer environments, reducing the efficiency of multi-screen display.
Multi-screen information is sent to the cloud server through the local terminal. The cloud server renders the matching virtual screen based on the screen information and displays it on the corresponding display screen to realize adaptive adjustment of the virtual desktop.
Improves the efficiency of cloud computers in multi-screen display environments, and users do not need to manually adjust the virtual desktop, achieving seamless docking and efficient multi-screen operation experience.
Smart Images

Figure CN120255831A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computers, and in particular, to a multi-screen display method, device, storage medium, and electronic device based on a cloud computer. Background Art
[0002] As a remote desktop solution, cloud computers have been widely used in modern office environments. However, in the face of multiple display setups, the cloud computer experience of related technologies still has limitations. It is unable to adaptively adjust the virtual desktop of the cloud computer according to the display screens connected to the local terminal, resulting in difficulties for users to achieve seamless docking in a multi-screen environment. Instead, they need to frequently switch the environment of the local terminal or the cloud computer and manually complete the adaptation adjustment of the virtual desktop for multi-screen display. Therefore, there is a problem of low efficiency in multi-screen display based on cloud computers.
[0003] In response to the above problems, no effective solution has been proposed yet. Summary of the Invention
[0004] Embodiments of the present application provide a multi-screen display method, device, storage medium, and electronic device based on a cloud computer to at least solve the technical problem of low efficiency in multi-screen display based on cloud computers.
[0005] According to one aspect of the embodiments of the present application, a multi-screen display method based on a cloud computer is provided, including: in response to a multi-screen adaptation request triggered for the cloud computer, sending multi-screen information of the local terminal to the cloud server, where the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; obtaining at least two virtual images returned by the cloud server, where the at least two virtual images are the images corresponding to the virtual desktop rendered by the cloud server according to the screen information, the at least two virtual images include a first virtual image and a second virtual image, the first virtual image matches the first display screen, and the second virtual image matches the second display screen; displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen.
[0006] According to another aspect of the embodiments of the present application, another multi-screen display method based on a cloud computer is provided, including: obtaining multi-screen information sent by a local terminal, where the multi-screen information is information sent by the local terminal to a cloud server in response to a multi-screen adaptation request triggered for the cloud computer, and the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; rendering a picture corresponding to the virtual desktop according to the screen information to obtain at least two virtual pictures, where the at least two virtual pictures include a first virtual picture and a second virtual picture, the first virtual picture matches the first display screen, and the second virtual picture matches the second display screen; sending the at least two virtual pictures to the local terminal, where the first virtual picture is displayed on the first display screen and the second virtual picture is displayed on the second display screen.
[0007] According to another aspect of the embodiments of the present application, a multi-screen display device based on a cloud computer is further provided, including: a first sending unit, configured to send multi-screen information of a local terminal to a cloud server in response to a multi-screen adaptation request triggered for the cloud computer, where the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; a first obtaining unit, configured to obtain at least two virtual pictures returned by the cloud server, where the at least two virtual pictures are pictures corresponding to the virtual desktop rendered by the cloud server according to the screen information. The at least two virtual pictures include a first virtual picture and a second virtual picture, the first virtual picture matches the first display screen, and the second virtual picture matches the second display screen; a first display unit, configured to display the first virtual picture on the first display screen and display the second virtual picture on the second display screen.
[0008] As an alternative solution, the above-mentioned device further includes: a second display unit, configured to display the first virtual screen on the first display screen and display the operation identifier of the local terminal in the first virtual screen during the process of displaying the second virtual screen on the second display screen, where the operation identifier is used to represent the real-time operation performed on the local terminal; a third display unit, configured to display the first virtual screen on the first display screen and display the operation identifier in the second virtual screen in response to a first transition request triggered by the operation identifier during the process of displaying the second virtual screen on the second display screen; or, a fourth display unit, configured to display the operation identifier in the second virtual screen during the process of displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen; a fifth display unit, configured to display the operation identifier in the first virtual screen in response to a second transition request triggered by the operation identifier during the process of displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen.
[0009] As an alternative solution, the above-mentioned second display unit includes: a first edge module, configured to display the operation identifier at a position in the first virtual screen that is not at the screen edge; the above-mentioned third display unit includes: the device further includes: a first transition unit, configured to obtain the first transition request when the operation identifier is located at the first screen edge in the first virtual screen before displaying the operation identifier in the second virtual screen in response to the first transition request triggered by the operation identifier; a second edge module, configured to display the operation identifier in the second virtual screen in response to the first transition request, where the operation identifier located at the first screen edge is set to be transitioned to the second virtual screen for display, and the position in the first virtual screen that is not at the screen edge is the position outside the first screen edge in the first virtual screen; the above-mentioned fourth display unit includes: a third edge module, configured to display the operation identifier at a position in the second virtual screen that is not at the screen edge; the device further includes: a second transition unit, configured to obtain the second transition request when the operation identifier is located at the second screen edge in the second virtual screen before displaying the operation identifier in the first virtual screen in response to the second transition request triggered by the operation identifier; a fourth edge module, configured to display the operation identifier in the first virtual screen in response to the second transition request, where the operation identifier located at the second screen edge is set to be transitioned to the first virtual screen for display, and the position in the second virtual screen that is not at the screen edge is the position outside the second screen edge in the second virtual screen.
[0010] As an alternative solution, the above device further includes: a moving unit, configured to, after displaying the operation identifier of the local terminal at a position other than the edge of the first virtual screen, when obtaining a screen selection operation performed on the first virtual screen and the operation identifier moves from a position other than the edge of the first virtual screen to the edge of the first screen, display the second virtual screen on the first display screen and display the first virtual screen on the second display screen.
[0011] As an alternative solution, the above device further includes: a second obtaining unit, configured to obtain first screen information of the at least two display screens before sending the multi-screen information of the local terminal to the cloud server, where the first screen information includes first screen parameters of the first display screen and second screen parameters of the second display screen; a third obtaining unit, configured to obtain second screen information of the at least two display screens before sending the multi-screen information of the local terminal to the cloud server, where the second screen information includes information jointly associated between the first display screen and the second display screen.
[0012] As an alternative solution, the second obtaining unit includes: a first obtaining module, configured to obtain the screen resolution of the first display screen and the screen resolution of the second display screen, where the first screen parameters include the screen resolution of the first display screen and the second screen parameters include the screen resolution of the second display screen; the third obtaining unit includes: a second obtaining module, configured to obtain the positional relationship between the first display screen and the second display screen.
[0013] As an alternative solution, the above device further includes: a second sending unit, configured to display the first virtual screen on the first display screen and display the second virtual screen on the second display screen, and then, when a first operation instruction triggered by the first virtual screen is obtained, send the first operation instruction to the cloud server; a fourth obtaining unit, configured to, after displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen, obtain a new first virtual screen returned by the cloud server, where the new first virtual screen is a new screen corresponding to the virtual desktop rendered by the cloud server according to the first operation instruction; a sixth display unit, configured to, after displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen, display the new first virtual screen on the first display screen; or, a third sending unit, configured to display the first virtual screen on the first display screen and display the second virtual screen on the second display screen, and then, when a second operation instruction triggered by the second virtual screen is obtained, send the second operation instruction to the cloud server; a fifth obtaining unit, configured to, after displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen, obtain a new second virtual screen returned by the cloud server, where the new second virtual screen is a new screen corresponding to the virtual desktop rendered by the cloud server according to the second operation instruction; a seventh display unit, configured to, after displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen, display the new second virtual screen on the second display screen.
[0014] As an alternative solution, the above device further includes: a sixth acquisition unit, configured to, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, when a screen adjustment operation performed on the local terminal is acquired, acquire a new multi-screen adaptation request triggered for the cloud computer, where the screen adjustment operation is used to adjust the display screen connected to the local terminal; a determination unit, configured to, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, in response to the new multi-screen adaptation request, determine at least one display screen currently connected to the local terminal, and acquire the screen information of the at least one display screen; a fourth sending unit, configured to, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, send the at least one display screen to the cloud server; a seventh acquisition unit, configured to, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, acquire at least one virtual screen returned by the cloud server, where each virtual screen in the at least one virtual screen matches one by one with each display screen in the at least one display screen; an eighth display unit, configured to, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, respectively display the at least one matching virtual screen on the at least one display screen.
[0015] As an alternative solution, the above first sending unit includes: a first sending module, configured to send the multi-screen information to the client server, and the client server forwards the multi-screen information to the cloud server, where the client server is used to process the information interaction between the local terminal and the cloud server; the above first acquisition unit includes: a third acquisition module, configured to acquire the at least two virtual screens obtained by the client server receiving the return from the cloud server.
[0016] According to another aspect of the embodiments of the present application, another multi-screen display device based on a cloud computer is further provided, including: an eighth acquisition unit, configured to acquire multi-screen information sent by a local terminal, where the multi-screen information is information sent by the local terminal to a cloud server after the local terminal responds to a multi-screen adaptation request triggered by the cloud computer, and the multi-screen adaptation request is used to request to display a virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; a ninth acquisition unit, configured to render a picture corresponding to the virtual desktop according to the screen information to obtain at least two virtual pictures, where the at least two virtual pictures include a first virtual picture and a second virtual picture, the first virtual picture matches the first display screen, and the second virtual picture matches the second display screen; a fifth sending unit, configured to send the at least two virtual pictures to the local terminal, where the first virtual picture is displayed on the first display screen, and the second virtual picture is displayed on the second display screen.
[0017] As an optional solution, the ninth acquisition unit includes: a generation module, configured to generate a first screen window and a second screen window by using the screen information, where the first screen window corresponds to the screen information associated with the first display screen, and the second screen window corresponds to the screen information associated with the second display screen; a rendering module, configured to render a first picture of the virtual desktop into the first screen window and render a second picture of the virtual desktop into the second screen window to obtain the at least two virtual pictures, where the at least two virtual pictures include the picture rendered into the first screen window and the picture in the second screen window.
[0018] As an optional solution, the fifth sending unit includes: a second sending module, configured to send the at least two virtual pictures to a client server, and the client server matches each of the at least two virtual pictures with each of the at least two display screens one by one, and sends the at least two virtual pictures after being matched by the client server to the local terminal, where the client server is used to process information interaction between the local terminal and the cloud server, the picture rendered into the first screen window matches the first display screen, and the picture rendered into the second screen window matches the second display screen.
[0019] According to another aspect of the embodiments of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the multi-screen display method based on a cloud computer as described above.
[0020] According to another aspect of the embodiments of the present application, an electronic device is further provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor. The processor executes the above multi-screen display method based on a cloud computer through the computer program.
[0021] In the embodiments of the present application, the cloud server renders virtual desktops (pictures) that match each display screen connected to the local terminal one by one through the multi-screen information sent by the local terminal. The local terminal then displays the virtual desktops on the matching display screens, thereby achieving the purpose of adaptive adjustment of the virtual desktops during multi-screen display, thus realizing the technical effect of improving the multi-screen display efficiency based on a cloud computer, and further solving the technical problem of relatively low multi-screen display efficiency based on a cloud computer. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The drawings described herein are used to provide a further understanding of the present application, and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application, and do not constitute an improper limitation to the present application. In the drawings:
[0023] Figure 1 is a schematic diagram of an application environment of an optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0024] Figure 2 is a schematic diagram of a process of an optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0025] Figure 3 is a schematic diagram of an optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0026] Figure 4 is a schematic diagram of another optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0027] Figure 5 is a schematic diagram of another optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0028] Figure 6 is a schematic diagram of a process of another optional multi-screen display method based on a cloud computer according to the embodiments of the present application;
[0029] Figure 7 It is a schematic diagram of another alternative multi-screen display method based on cloud computer according to an embodiment of the present application;
[0030] Figure 8 It is a schematic diagram of another alternative multi-screen display method based on cloud computer according to an embodiment of the present application;
[0031] Figure 9 It is a schematic diagram of an alternative multi-screen display device based on cloud computer according to an embodiment of the present application;
[0032] Figure 10 It is a schematic diagram of another alternative multi-screen display device based on cloud computer according to an embodiment of the present application;
[0033] Figure 11 It is a schematic structural diagram of an alternative electronic device according to an embodiment of the present application. Detailed implementation manners
[0034] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
[0035] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.
[0036] For the convenience of understanding, the following terms are explained:
[0037] Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to achieve data calculation, storage, processing, and sharing.
[0038] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, be used as needed, and is flexible and convenient. Cloud computing technology will become an important support. The back-end services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark and needs to be transmitted to the back-end system for logical processing. Data at different levels will be processed separately, and various industry data requires the support of a powerful system. This can only be achieved through cloud computing.
[0039] According to one aspect of the embodiments of the present application, a multi-screen display method based on a cloud computer is provided. Optionally, as an alternative implementation, the above multi-screen display method based on a cloud computer can be but is not limited to being applied to an environment such as Figure 1 shown. It can but is not limited to include a user device 102 (such as a local terminal) and a server 112 (such as a cloud server). The user device 102 can but is not limited to include a display 104 (such as a first display screen and a second display screen), a processor 106, and a memory 108. The server 112 includes a database 114 and a processing engine 116.
[0040] In addition, the user device 102 can also be but is not limited to a handheld device (such as a mobile phone), a laptop computer, a tablet computer, a desktop computer, a vehicle-mounted device, a smart TV, etc. The present application does not limit the specific implementation manner of the user device 102. The server 112 can be a single cloud server or a cloud server cluster composed of multiple cloud servers.
[0041] The specific process can be as follows:
[0042] Step S102, the user device 102 responds to a multi-screen adaptation request triggered for the cloud computer and obtains multi-screen information;
[0043] Step S104, send the multi-screen information to the server 112 through the network 110;
[0044] Step S106, the server 112 processes the screen information through the processing engine 116 and further renders a virtual picture corresponding to the virtual desktop that matches the screen information;
[0045] Step S108, send the virtual picture to the user device 102 through the network 110. The user device 102 displays the virtual picture on the matching display 104 through the processor 106 and stores the above virtual picture in the memory 108.
[0046] Optionally, as an alternative implementation, as Figure 2 shown, the multi-screen display method based on cloud computer can be executed by an electronic device, which can be, for example, a user device or a server as Figure 1 shown. The specific steps include:
[0047] S202, in response to a multi-screen adaptation request triggered for the cloud computer, send the multi-screen information of the local terminal to the cloud server, where the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen, and the multi-screen information includes the screen information of the at least two display screens. The cloud server is used to support the operation of the cloud computer;
[0048] S204, obtain at least two virtual images returned by the cloud server, where the at least two virtual images are the images corresponding to the virtual desktop rendered by the cloud server according to the screen information. The at least two virtual images include a first virtual image and a second virtual image. The first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0049] S206, display the first virtual image on the first display screen and display the second virtual image on the second display screen.
[0050] Optionally, in this embodiment, the above multi-screen display method based on cloud computer can be but is not limited to being applied in a cloud computer client running on a local terminal. By reading the screen information of the local terminal, the virtual desktop of the cloud computer can adapt to different multi-screen environments, thereby enhancing the user experience. Meeting the requirements of the multi-screen application scenario, it solves the problem that the virtual desktop of the cloud computer cannot adapt to the multi-screen environment;
[0051] Among them, the virtual desktop can be but is not limited to a remote desktop service based on cloud computing technology, which allows users to access a unified desktop environment through the network on any device. The cloud server will render the corresponding virtual desktop image according to the user's configuration and requirements and transmit it to the user's local terminal for display. In this way, users can run application programs, access files and data, and perform various operations on the virtual desktop just like using a local terminal.
[0052] Optionally, in this embodiment, the cloud computer can be, but is not limited to, a remote computer service based on cloud computing technology, which allows users to connect to a remote server through the network and use the computing resources and applications on the remote server. The operation of the cloud computer usually depends on a cloud server. The above-mentioned remote server can be, but is not limited to, a cloud server. The cloud server has powerful computing, storage, and network capabilities and can run various operating systems and applications, thereby providing cloud computer services for users. When a user connects to the cloud server through the network, they can use the computing resources and applications on the cloud server just like using a local terminal.
[0053] Optionally, in this embodiment, the display screen connected to the local terminal can be, but is not limited to, a monitor connected to the local terminal or device, which can receive the images and data output by the local terminal and visually display them to the user. In the scenario of the cloud computer, the display screen connected to the local terminal can be used to display the virtual desktop of the cloud computer (which can also include the application interfaces and other graphical contents on the virtual desktop). Users can interact with the cloud computer through this display screen and operate the applications, files, and data on the cloud computer.
[0054] Optionally, in this embodiment, the first or second in the content such as the first display screen, the second display screen, the first virtual screen, the second virtual screen, etc. is only for illustration and does not limit the quantity. For example, the local terminal can be connected to multiple display screens, not limited to 2. Similarly, there can be multiple virtual screens, not limited to 2.
[0055] Optionally, the screen information of the display screen can be, but is not limited to, used to evaluate the performance and applicability of the display screen. In this embodiment, the screen information is used to provide a rendering basis for the virtual screen of the cloud server. The screen information can include, but is not limited to, at least one of the following: resolution, screen size, screen ratio, panel type, color depth, refresh rate, brightness, contrast ratio, response time, interface type. Among them, the resolution can be, but is not limited to, representing the number of pixels in the horizontal and vertical directions of the screen; the screen size can be, but is not limited to, referring to the length of the diagonal of the screen; the screen ratio can be, but is not limited to, referring to the ratio of the width to the height of the screen; the panel type can be, but is not limited to, referring to the differences in color, viewing angle, response speed, etc. among different types of panels; the color depth can be, but is not limited to, referring to the number of colors that the screen can display; the refresh rate can be, but is not limited to, referring to the number of times the screen is updated per second; the brightness can be, but is not limited to, referring to the brightness of the screen; the contrast ratio can be, but is not limited to, referring to the brightness ratio between the brightest and darkest parts of the screen; the response time can be, but is not limited to, referring to the time for a pixel to change from one color to another.
[0056] Optionally, in this embodiment, the virtual image rendered by the cloud server based on the screen information is the image corresponding to the virtual desktop. When the user uses the cloud computer service, the cloud server is responsible for running the operating system, application programs, and rendering the corresponding images. These rendered images will be transmitted to the local terminal and displayed on the display screen connected to the local terminal, forming the image corresponding to the virtual desktop.
[0057] Optionally, in this embodiment, at least two virtual images can be, but are not limited to, the same or different images. In different situations, different application interfaces running on the virtual desktop, or virtual sub-desktops attached to the virtual desktop, or the virtual desktop can be divided into multiple regions, and the multiple regions are respectively displayed by at least two virtual images.
[0058] Optionally, in this embodiment, when multiple display screens are involved, each display screen can be matched with a specific virtual image. For example, in this embodiment, there can be a first virtual image matched with the first display screen, and a second virtual image matched with the second display screen. Thus, each display screen can independently display different virtual desktops or application program interfaces, providing a more flexible and multi-task working environment.
[0059] In addition, this embodiment can also allocate different application programs or windows to different virtual images according to its own work process and requirements, and view and operate them through the corresponding display screens, thereby improving work efficiency and meeting the user's switching and management requirements between multiple tasks.
[0060] It should be noted that the cloud server renders virtual desktops (images) that are respectively matched with each display screen connected to the local terminal through the multi-screen information sent by the local terminal. The local terminal then displays the virtual desktops on the matched display screens, supporting the adaptive adjustment of the virtual desktop during multi-screen display. Thus, in a multi-screen environment, the user does not need to manually complete the adaptation adjustment of the virtual desktop during multi-screen display, and naturally does not need to frequently switch the environment of the local terminal or the cloud computer, thereby achieving the technical effect of improving the multi-screen display efficiency based on the cloud computer.
[0061] For further illustration, optionally, for example Figure 3As shown, in response to a multi-screen adaptation request triggered for the cloud computer 310, the multi-screen information 306 of the local terminal 302 is sent to the cloud server 308, where the multi-screen adaptation request is used to request that the virtual desktop 312 provided by the cloud computer 310 be displayed on at least two display screens connected to the local terminal 302. The at least two display screens include a first display screen 304-1 and a second display screen 304-2. The multi-screen information 306 includes the screen information of the at least two display screens. The cloud server 308 is used to support the operation of the cloud computer 310; at least two virtual images are obtained that are returned by the cloud server 308. The at least two virtual images are the images corresponding to the virtual desktop 312 rendered by the cloud server 308 according to the screen information. The at least two virtual images include a first virtual image 314-1 and a second virtual image 314-2. The first virtual image 314-1 matches the first display screen 304-1, and the second virtual image 314-2 matches the second display screen 304-2; the first virtual image 314-1 is displayed on the first display screen 304-1, and the second virtual image 314-2 is displayed on the second display screen 304-2.
[0062] Through the embodiments provided in this application, the cloud server renders virtual desktops (images) that match each display screen connected to the local terminal one by one based on the multi-screen information sent by the local terminal. Then, the local terminal displays the virtual desktops on the matching display screens, thereby achieving the purpose of adaptive adjustment of the virtual desktop during multi-screen display, and thus realizing the technical effect of improving the multi-screen display efficiency based on the cloud computer.
[0063] As an optional solution, during the process of displaying the first virtual image on the first display screen and the second virtual image on the second display screen, the method further includes:
[0064] S1-1, displaying an operation identifier of the local terminal in the first virtual image, where the operation identifier is used to represent real-time operations performed on the local terminal;
[0065] S1-2, in response to a first transition request triggered for the operation identifier, displaying the operation identifier in the second virtual image; or,
[0066] S2-1, displaying the operation identifier in the second virtual image;
[0067] S2-2, in response to a second transition request triggered for the operation identifier, displaying the operation identifier in the first virtual image.
[0068] Optionally, in this embodiment, the operation identifier of the local terminal may, but is not limited to, be a graphic, text, or symbol used to identify various operations or functions on the local terminal interface. These identifiers can help users identify different operation options, buttons, menus, etc. when performing various tasks on the local terminal. The design of the operation identifier usually takes into account usability and intuitiveness so that users can quickly understand and correctly execute the required operations. It may appear in the form of icons, buttons, labels, menu items, etc., and is distinguished and identified by colors, shapes, text, etc.;
[0069] For further illustration, optionally, for example, in a graphical user interface (GUI), common operation identifiers include text labels on buttons (such as "Save", "Delete"), icons (such as a save icon representing the save operation), menu items (such as "File", "Edit", etc.), and specific hotkey or shortcut identifiers, etc. The role of these operation identifiers is to prompt users of the executable operations and help users navigate and interact on the interface.
[0070] It should be noted that to improve the operation efficiency of virtual screens in a multi-screen environment, the operation identifier can be displayed in multiple virtual screens by means of a transition request triggered by the operation identifier, so as to ensure that the user can always clearly see the real-time operations performed on the local terminal.
[0071] Through the embodiment provided by this application, the operation identifier of the local terminal is displayed in the first virtual screen, where the operation identifier is used to represent the real-time operations performed on the local terminal; in response to a first transition request triggered by the operation identifier, the operation identifier is displayed in the second virtual screen; or, the operation identifier is displayed in the second virtual screen; in response to a second transition request triggered by the operation identifier, the operation identifier is displayed in the first virtual screen. Thus, by means of the transition request triggered by the operation identifier, the operation identifier can be displayed in multiple virtual screens, so as to ensure that the user can always clearly see the real-time operations performed on the local terminal, thereby achieving the purpose of improving the operation efficiency of virtual screens in a multi-screen environment and realizing the technical effect of improving the operation efficiency of virtual screens in a multi-screen environment.
[0072] As an alternative solution, an operation identifier of the local terminal is displayed in the first virtual screen, including: displaying the operation identifier at a position in the first virtual screen that is not at the screen edge; before displaying the operation identifier in the second virtual screen in response to a first transition request triggered by the operation identifier, the method further includes: obtaining the first transition request when the operation identifier is located at a first screen edge in the first virtual screen; and displaying the operation identifier in the second virtual screen in response to the first transition request triggered by the operation identifier, including: displaying the operation identifier in the second virtual screen in response to the first transition request, where the operation identifier located at the first screen edge is set to be transitioned to and displayed in the second virtual screen, and the position in the first virtual screen that is not at the screen edge is a position outside the first screen edge in the first virtual screen; or,
[0073] As an alternative solution, an operation identifier is displayed in the second virtual screen, including: displaying the operation identifier at a position in the second virtual screen that is not at the screen edge; before displaying the operation identifier in the first virtual screen in response to a second transition request triggered by the operation identifier, the method further includes: obtaining the second transition request when the operation identifier is located at a second screen edge in the second virtual screen; and displaying the operation identifier in the first virtual screen in response to the second transition request triggered by the operation identifier, including: displaying the operation identifier in the first virtual screen in response to the second transition request, where the operation identifier located at the second screen edge is set to be transitioned to and displayed in the first virtual screen, and the position in the second virtual screen that is not at the screen edge is a position outside the second screen edge in the second virtual screen.
[0074] Optionally, in this embodiment, the screen edge of the virtual screen can be, but is not limited to, understood as the boundary between the virtual screen and the area outside the screen. For example, Figure 4 as shown, the first screen edge 406 is the boundary between the first virtual screen 402 and the area outside the screen (the second virtual screen 404), and the second screen edge 408 is the boundary between the second virtual screen 404 and the area outside the screen (the first virtual screen 402).
[0075] Furthermore, the screen edge can also be, but is not limited to, a pre-set exclusive area. For example, if the first virtual screen is divided into multiple parts (assumed to be part A, part B, and part C), then the area in the first virtual screen that is close to the direction where the second virtual screen belongs (such as the area where part C is located) is used as the screen edge of the first virtual screen; or, other settings can be made according to the user's operation habits. For example, the area in the first virtual screen that is close to the opposite direction of the direction where the second virtual screen belongs (such as the area where part A is located) can be regarded as the screen edge of the first virtual screen.
[0076] Optionally, for the relevant attributes of the screen edge, such as the area of the region, the display mode, etc., custom settings can be made. For example, to avoid the problem that the transition request is accidentally triggered due to the overly large screen edge, the ratio of the screen edge in the virtual screen can be limited to below a preset ratio. In addition, to improve the intuitiveness of the screen edge, the screen edge can also be displayed in a gradient manner. If the user believes that the display of the screen edge is not conducive to the display of the virtual screen, then the user is also allowed to hide the screen edge.
[0077] It should be noted that to improve the operation efficiency of the virtual screen in a multi-screen environment, when the operation identifier moves to the edge of a certain virtual screen, it will automatically transition to another virtual screen for display, so as to ensure that the user can always clearly see the real-time operations performed on the local terminal.
[0078] For further illustration by example, optionally Figure 4 As shown, in the first virtual screen 402, if the operation identifier is displayed at a non-edge position of the screen, then this operation identifier represents the real-time operation performed on the local terminal. If this operation identifier moves to the first screen edge 406 in the first virtual screen 402, then the operation identifier will no longer be displayed in the first virtual screen 402, but will be displayed at a non-edge position in the second virtual screen 404. Similarly, in the second virtual screen 404, if the operation identifier is displayed at a non-edge position of the screen, then this operation identifier represents the real-time operation performed on the local terminal. If this operation identifier moves to the second screen edge 408 in the second virtual screen 404, then the operation identifier will no longer be displayed in the second virtual screen 404, but will be displayed at a non-edge position in the first virtual screen 402.
[0079] Through the embodiments provided in this application, an operation identifier of the local terminal is displayed at a position in the first virtual screen that is not at the screen edge, where the operation identifier is used to represent a real-time operation performed on the local terminal; when the operation identifier is located at the first screen edge in the first virtual screen, the operation identifier is displayed in the second virtual screen, where the operation identifier located at the first screen edge is set to transition to the second virtual screen for display, and the position in the first virtual screen that is not at the screen edge is the position outside the first screen edge in the first virtual screen; or, the operation identifier is displayed at a position in the second virtual screen that is not at the screen edge; when the operation identifier is located at the second screen edge in the second virtual screen, the operation identifier is displayed in the first virtual screen, where the operation identifier located at the second screen edge is set to transition to the first virtual screen for display, and the position in the second virtual screen that is not at the screen edge is the position outside the second screen edge in the second virtual screen. Thus, when the operation identifier moves to the edge of a certain virtual screen, it automatically transitions to be displayed on another virtual screen, thereby achieving the technical effect of improving the operation efficiency of virtual screens in a multi-screen environment.
[0080] As an alternative solution, after an operation identifier of the local terminal is displayed at a position in the first virtual screen that is not at the screen edge, the method further includes:
[0081] When a screen selection operation performed on the first virtual screen is obtained and the operation identifier moves from a position in the first virtual screen that is not at the screen edge to the first screen edge, the second virtual screen is displayed on the first display screen, and the first virtual screen is displayed on the second display screen.
[0082] Optionally, in this embodiment, to improve the execution accuracy of the screen selection operation, the movement of the operation identifier from a position in the first virtual screen that is not at the screen edge to the first screen edge can also be restricted to be performed during the continuous execution of the screen selection operation, or it can be understood that when a screen selection operation performed on the first virtual screen is obtained and the operation identifier moves from a position in the first virtual screen that is not at the screen edge to the first screen edge during the continuous execution of the screen selection operation, the second virtual screen is displayed on the first display screen, and the first virtual screen is displayed on the second display screen.
[0083] It should be noted that, to improve the operation efficiency of virtual screens in a multi-screen environment, when an operation moves from a non-edge position on the first virtual screen to the edge of the first screen, the first virtual screen will disappear on the first display screen and be replaced by the second virtual screen. At the same time, the content originally on the second virtual screen on the second display screen will be replaced by the first virtual screen, ensuring that the user can always pay attention to the selected virtual screen when performing a screen selection operation and can easily switch between the two virtual screens when needed, thereby enhancing the flexibility and user experience in a multi-screen environment. The user can easily manage the display and layout of virtual screens through screen selection operations and the movement of operation identifiers according to actual needs to adapt to different working scenarios and requirements.
[0084] For further illustration by way of example, optionally based on Figure 4 the scenario shown, continuing for example Figure 5 as shown in (a) of, a first virtual screen 402 is displayed on the first display screen 502, and a second virtual screen 404 is displayed on the second display screen 504, and a screen selection operation performed on the first virtual screen 402 is obtained, and the operation identifier moves from a non-edge position on the first virtual screen 402 to the first screen edge 406; further as Figure 5 shown in (b) of, a second virtual screen 404 is displayed on the first display screen 502, and a first virtual screen 402 is displayed on the second display screen 504.
[0085] Through the embodiments provided by the present application, in the case where a screen selection operation performed on the first virtual screen is obtained and the operation identifier moves from a non-edge position on the first virtual screen to the first screen edge, the second virtual screen is displayed on the first display screen, and the first virtual screen is displayed on the second display screen, thereby achieving the purpose that the user can easily switch between the two virtual screens when needed, and thus realizing the technical effect of improving the operation efficiency of virtual screens in a multi-screen environment.
[0086] As an optional solution, before sending the multi-screen information of the local terminal to the cloud server, the method further includes:
[0087] S3-1, obtaining first screen information of at least two display screens, where the first screen information includes first screen parameters of the first display screen and second screen parameters of the second display screen;
[0088] S3-2, obtaining second screen information of at least two display screens, where the second screen information includes information jointly associated between the first display screen and the second display screen.
[0089] Optionally, in this embodiment, the first screen information may but is not limited to include parameters specific to each display screen. For example, the resolution, screen size, screen ratio, etc. of the first / second display screen. Different from the first screen information, the second screen information mainly focuses on the common association information between at least two display screens, such as the connection method between the display screens (for example, whether they are connected through the same graphics card or video interface), relative position (for example, which is on the left and which is on the right), whether screen expansion or duplicate mode is performed, etc.
[0090] It should be noted that, to improve the matching accuracy between the virtual screen and the display screen in a multi-screen environment, the screen information in multiple dimensions is combined to perform the matching between the virtual screen and the display screen.
[0091] Through the embodiments provided in this application, the first screen information of at least two display screens is obtained, where the first screen information includes the first screen parameters of the first display screen and the second screen parameters of the second display screen; the second screen information of at least two display screens is obtained, where the second screen information includes the information commonly associated between the first display screen and the second display screen, thereby achieving the purpose of combining the screen information in multiple dimensions to perform the matching between the virtual screen and the display screen, and thus realizing the technical effect of improving the matching accuracy between the virtual screen and the display screen in a multi-screen environment.
[0092] As an alternative solution, obtaining the first screen information of at least two display screens includes: obtaining the screen resolution of the first display screen and the screen resolution of the second display screen, where the first screen parameters include the screen resolution of the first display screen, and the second screen parameters include the screen resolution of the second display screen;
[0093] As an alternative solution, obtaining the second screen information of at least two display screens includes: obtaining the positional relationship between the first display screen and the second display screen.
[0094] It should be noted that obtaining the resolution of each screen can ensure that the content is rendered correctly and clearly, and understanding the positional relationship between the screens in this embodiment helps to determine how to distribute and arrange windows and content on these screens, thereby optimizing the display content layout and multi-screen experience.
[0095] For further illustration by example, optionally, for example, after obtaining the resolutions of at least two display screens, this embodiment will also determine the positional relationship between at least two display screens. This usually involves detecting the physical positions, connection methods, and display arrangements set by the user of the two screens. For example, this embodiment may detect that the first display screen is on the left and the second display screen is on the right. Or, the user may manually specify the arrangement of the screens in the system settings.
[0096] Through the embodiments provided in this application, obtain the screen resolution of the first display screen and the screen resolution of the second display screen. Among them, the first screen parameter includes the screen resolution of the first display screen, and the second screen parameter includes the screen resolution of the second display screen; obtain the positional relationship between the first display screen and the second display screen, thereby achieving the purpose of optimizing the layout of the display content and the multi-screen experience, and thus realizing the technical effect of improving the matching accuracy between the virtual screen and the display screen in a multi-screen environment.
[0097] As an optional solution, after displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, the method further includes:
[0098] S4-1, when a first operation instruction triggered for the first virtual screen is obtained, send the first operation instruction to the cloud server;
[0099] S4-2, obtain the new first virtual screen returned by the cloud server, where the new first virtual screen is the new screen corresponding to the virtual desktop rendered by the cloud server according to the first operation instruction;
[0100] S4-3, display the new first virtual screen on the first display screen; or,
[0101] S5-1, when a second operation instruction triggered for the second virtual screen is obtained, send the second operation instruction to the cloud server;
[0102] S5-2, obtain the new second virtual screen returned by the cloud server, where the new second virtual screen is the new screen corresponding to the virtual desktop rendered by the cloud server according to the second operation instruction;
[0103] S5-3, display the new second virtual screen on the second display screen.
[0104] Optionally, in this embodiment, the operation instruction can be triggered but is not limited to when performing operations such as clicking, dragging, and zooming on the virtual screen.
[0105] It should be noted that to improve the timeliness of operations on virtual screens in a multi-screen environment, whether on the first virtual screen or the second virtual screen, the user's operations can be reflected on the corresponding display screen in a timely and accurate manner. At the same time, since the rendering process is completed on the cloud server, this greatly reduces the computing burden on local devices, making the entire system more efficient and smooth.
[0106] For further illustration, optionally, for example, when the user performs an operation on the first virtual screen, a first operation instruction is triggered. The system captures this first operation instruction and sends it to the cloud server. This ensures that the cloud server can understand the user's operation. After receiving the first operation instruction, the cloud server renders the virtual desktop according to this instruction to obtain a new first virtual screen. This new screen reflects the result after the user's operation. The system obtains the new first virtual screen returned by the cloud server and displays this new screen on the first display screen. In this way, the user can see the result of their operation. Similarly, when the user performs an operation on the second virtual screen, a second operation instruction is triggered. The system sends the second operation instruction to the cloud server. The cloud server renders a new second virtual screen according to the second operation instruction and returns it to the system. The system obtains the new second virtual screen and displays this new screen on the second display screen.
[0107] According to the embodiment provided by the present application, when a first operation instruction triggered for the first virtual screen is obtained, the first operation instruction is sent to the cloud server; the new first virtual screen returned by the cloud server is obtained, where the new first virtual screen is the new screen corresponding to the virtual desktop rendered by the cloud server according to the first operation instruction; the new first virtual screen is displayed on the first display screen; or, when a second operation instruction triggered for the second virtual screen is obtained, the second operation instruction is sent to the cloud server; the new second virtual screen returned by the cloud server is obtained, where the new second virtual screen is the new screen corresponding to the virtual desktop rendered by the cloud server according to the second operation instruction; the new second virtual screen is displayed on the second display screen, thereby achieving the purpose that the user's operations can be timely and accurately reflected on the corresponding display screen, and thus realizing the technical effect of improving the operation timeliness of virtual screens in a multi-screen environment.
[0108] As an optional solution, after the first virtual screen is displayed on the first display screen and the second virtual screen is displayed on the second display screen, the method further includes:
[0109] S6-1, when a screen adjustment operation performed on the local terminal is obtained, a new multi-screen adaptation request triggered for the cloud computer is obtained, where the screen adjustment operation is used to adjust the display screen connected to the local terminal;
[0110] S6-2, in response to the new multi-screen adaptation request, determine at least one display screen currently connected to the local terminal, and obtain the screen information of the at least one display screen;
[0111] S6-3, send the at least one display screen to the cloud server;
[0112] S6-4. Obtain at least one virtual screen returned by the cloud server, where each virtual screen in the at least one virtual screen matches one by one with each display screen in the at least one display screen;
[0113] S6-5. Display the at least one virtual screen that matches on the at least one display screen respectively.
[0114] It should be noted that in this embodiment, when the user adjusts the screen on the local terminal, the cloud computer can quickly adapt to and adjust the configuration of the virtual screen, so as to provide the user with the best multi-screen experience.
[0115] For further illustration by way of example, optionally, for example, when the user performs a screen adjustment operation on the local terminal (such as changing the layout, resolution, etc. of the display screen), this embodiment will detect this operation, and then obtain a new multi-screen adaptation request triggered for the cloud computer. This is a request sent from the local terminal to the cloud computer, aiming to make the cloud computer adapt to the new screen configuration. In order to respond to this request, this embodiment will first determine all the display screens currently connected to the local terminal and obtain the screen information, which may include parameters such as resolution and screen size. Further, this embodiment sends this information to the cloud server, so that the cloud server can know the specific configuration of each display screen. Furthermore, the cloud server will generate a virtual screen that matches according to this screen information. Ensure that each virtual screen corresponds to the configuration of the display screen to achieve the best display effect. And this embodiment finally obtains the virtual screen returned by the cloud server and displays these virtual screens on the corresponding display screens. Since the virtual screens and the display screens match one by one, each display screen will display a virtual screen that adapts to it.
[0116] Through the embodiment provided by the present application, in the case of obtaining a screen adjustment operation performed on the local terminal, obtain a new multi-screen adaptation request triggered for the cloud computer, where the screen adjustment operation is used to adjust the display screens connected to the local terminal; respond to the new multi-screen adaptation request, determine at least one display screen currently connected to the local terminal, and obtain the screen information of the at least one display screen; send the at least one display screen to the cloud server; obtain at least one virtual screen returned by the cloud server, where each virtual screen in the at least one virtual screen matches one by one with each display screen in the at least one display screen; display the at least one virtual screen that matches on the at least one display screen respectively, thereby achieving the purpose that when the user adjusts the screen on the local terminal, the cloud computer can quickly adapt to and adjust the configuration of the virtual screen, and thus realizing the technical effect of providing the user with the best multi-screen experience.
[0117] As an alternative solution, sending the multi-screen information of the local terminal to the cloud server includes: sending the multi-screen information to the client server, and the client server forwards the multi-screen information to the cloud server, where the client server is used to handle the information interaction between the local terminal and the cloud server;
[0118] As an alternative solution, obtaining at least two virtual screens returned by the cloud server includes: obtaining at least two virtual screens received by the client server from the cloud server.
[0119] Optionally, in this embodiment, the client server may but is not limited to refer to a dedicated server that provides services for a client (local terminal) in a network environment. The server is installed with a network operating system and various server application systems. As an intermediate layer, the client server is responsible for transmitting information between the local terminal and the cloud server. When the local terminal needs to access resources or services on the cloud server, the client server can play a bridging role. In the scenario where multiple people access the cloud server simultaneously, the client server can help share the load of the cloud server to ensure that the system runs more stably and efficiently.
[0120] It should be noted that in a multi-screen environment, when it is necessary to adapt and adjust the virtual screens on the cloud server, it first involves the transmission of multi-screen information. To ensure efficient, stable, and secure information interaction between the local terminal and the cloud server and improve the user experience in the multi-screen environment, this embodiment uses a client server in the transmission process of multi-screen information and virtual screens.
[0121] Through the embodiment provided by this application, the multi-screen information is sent to the client server, and the client server forwards the multi-screen information to the cloud server, where the client server is used to handle the information interaction between the local terminal and the cloud server; obtaining at least two virtual screens received by the client server from the cloud server, thereby achieving the purpose of ensuring efficient, stable, and secure information interaction between the local terminal and the cloud server, and thus realizing the technical effect of improving the user experience in the multi-screen environment.
[0122] Optionally, as an alternative implementation, as Figure 6 shown, the multi-screen display method based on cloud computers can be executed by an electronic device, and the electronic device can be, for example, a user device or a server as Figure 1 shown. The specific steps include:
[0123] S602. Obtain the multi-screen information sent by the local terminal. The multi-screen information is the information sent by the local terminal to the cloud server in response to a multi-screen adaptation request triggered for the cloud computer. The multi-screen adaptation request is used to request that the virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes the screen information of the at least two display screens. The cloud server is used to support the operation of the cloud computer;
[0124] S604. Render the picture corresponding to the virtual desktop according to the screen information to obtain at least two virtual pictures. The at least two virtual pictures include a first virtual picture and a second virtual picture. The first virtual picture matches the first display screen, and the second virtual picture matches the second display screen;
[0125] S606. Send the at least two virtual pictures to the local terminal, where the first virtual picture is displayed on the first display screen and the second virtual picture is displayed on the second display screen.
[0126] Optionally, in this embodiment, the above multi-screen display method based on the cloud computer can be but is not limited to being applied in a cloud computer client running on a local terminal. By reading the screen information of the local terminal, the virtual desktop of the cloud computer can adapt to different multi-screen environments, thereby enhancing the user experience. Meeting the requirements of the multi-screen application scenario, it solves the problem that the virtual desktop of the cloud computer cannot adapt to the multi-screen environment;
[0127] Among them, the virtual desktop can be but is not limited to a remote desktop service based on cloud computing technology, which allows users to access a unified desktop environment through the network on any device. The cloud server will render the corresponding virtual desktop picture according to the user's configuration and requirements and transmit it to the user's local terminal for display. In this way, users can run application programs, access files and data on the virtual desktop and perform various operations just like using a local terminal.
[0128] Optionally, in this embodiment, the cloud computer can be but is not limited to a remote computer service based on cloud computing technology, which allows users to connect to a remote server through the network and use the computing resources and application programs on the remote server. The operation of the cloud computer usually depends on the cloud server. The above remote server can be but is not limited to the cloud server. The cloud server has powerful computing, storage and network capabilities and can run various operating systems and application programs, thereby providing cloud computer services for users. When users connect to the cloud server through the network, they can use the computing resources and application programs on the cloud server just like using a local terminal.
[0129] Optionally, in this embodiment, the display screen connected to the local terminal may, but is not limited to, refer to a display connected to the local terminal or device, which can receive the images and data output by the local terminal and visually display them to the user. In the scenario of a cloud computer, the display screen connected to the local terminal can be used to display the virtual desktop of the cloud computer (which may also include the application interfaces and other graphical contents on the virtual desktop). The user can interact with the cloud computer through this display screen to operate the applications, files, and data on the cloud computer.
[0130] Optionally, in this embodiment, the first or second in the first display screen, second display screen, first virtual screen, second virtual screen, etc. is only for illustration and does not limit the quantity. For example, the local terminal can be connected to multiple display screens, not limited to 2. Similarly, there can be multiple virtual screens, not limited to 2.
[0131] Optionally, the screen information of the display screen can be, but is not limited to, used to evaluate the performance and applicability of the display screen. In this embodiment, the screen information is used to provide a rendering basis for the virtual screen by the cloud server. The screen information can include, but is not limited to, at least one of the following: resolution, screen size, screen ratio, panel type, color depth, refresh rate, brightness, contrast ratio, response time, interface type. Among them, the resolution can, but is not limited to, represent the number of pixels in the horizontal and vertical directions of the screen; the screen size can, but is not limited to, refer to the length of the screen diagonal; the screen ratio can, but is not limited to, refer to the ratio of the screen width to the height; the panel type can, but is not limited to, refer to the differences in color, viewing angle, response speed, etc. among different types of panels; the color depth can, but is not limited to, refer to the number of colors that the screen can display; the refresh rate can, but is not limited to, refer to the number of times the screen is updated per second; the brightness can, but is not limited to, refer to the brightness of the screen; the contrast ratio can, but is not limited to, refer to the brightness ratio between the brightest and darkest parts of the screen; the response time can, but is not limited to, refer to the time for a pixel to change from one color to another.
[0132] Optionally, in this embodiment, the virtual screen rendered by the cloud server according to the screen information is the screen corresponding to the virtual desktop. When the user uses the cloud computer service, the cloud server is responsible for running the operating system, applications, and rendering the corresponding images. These rendered images will be transmitted to the local terminal and displayed through the display screen connected to the local terminal to form the screen corresponding to the virtual desktop.
[0133] Optionally, in this embodiment, at least two virtual screens can, but are not limited to, be the same or different screens. In different situations, different application interfaces running on the virtual desktop, or virtual sub-desktops attached to the virtual desktop, or the virtual desktop can be divided into multiple regions, and the multiple regions are respectively displayed by at least two virtual screens.
[0134] Optionally, in this embodiment, when multiple display screens are involved, each display screen can be matched with a specific virtual screen. For example, in this embodiment, the first virtual screen can be matched with the first display screen, and the second virtual screen can be matched with the second display screen. Thus, each display screen can independently display different virtual desktops or application interfaces, providing a more flexible and multitasking working environment.
[0135] In addition, this embodiment can also allocate different applications or windows to different virtual screens according to its own work process and requirements, and view and operate them through the corresponding display screens, thereby improving work efficiency and meeting the user's switching and management needs between multiple tasks.
[0136] It should be noted that the cloud server renders virtual desktops (screens) that are respectively matched with each display screen connected to the local terminal based on the multi-screen information sent by the local terminal. The local terminal then displays the virtual desktops on the matching display screens, supporting the adaptive adjustment of virtual desktops during multi-screen display. Therefore, in a multi-screen environment, the user does not need to manually complete the adaptation adjustment of virtual desktops during multi-screen display, and naturally does not need to frequently switch the environment of the local terminal or cloud computer, thus achieving the technical effect of improving the multi-screen display efficiency based on cloud computers.
[0137] For specific embodiments, reference can be made to the examples shown in the above multi-screen display method based on cloud computers, and details are not elaborated here.
[0138] Through the embodiment provided by this application, the cloud server renders virtual desktops (screens) that are respectively matched with each display screen connected to the local terminal based on the multi-screen information sent by the local terminal. The local terminal then displays the virtual desktops on the matching display screens, thereby achieving the purpose of adaptive adjustment of virtual desktops during multi-screen display, and thus achieving the technical effect of improving the multi-screen display efficiency based on cloud computers.
[0139] As an optional solution, rendering the corresponding screens of the virtual desktops according to the screen information to obtain at least two virtual screens, including:
[0140] S7-1: Generating a first screen window and a second screen window using the screen information, where the first screen window corresponds to the screen information associated with the first display screen, and the second screen window corresponds to the screen information associated with the second display screen;
[0141] S7-2: Rendering the first screen of the virtual desktop into the first screen window, and rendering the second screen of the virtual desktop into the second screen window to obtain at least two virtual screens, where the at least two virtual screens include the screen rendered into the first screen window and the screen in the second screen window.
[0142] It should be noted that the cloud server generates corresponding screen windows using the screen information, and then renders different images of the virtual desktop for each screen window, finally obtaining virtual images that match each display screen, ensuring that each display screen gets high-quality virtual desktop images. Moreover, according to different screen information, the cloud server can accurately adjust the rendering output to provide users with the best experience of adaptive multi-screen display based on cloud computers.
[0143] For further illustration by way of example, optionally, in the cloud server, in order to achieve adaptive display on multiple display screens, the cloud server uses the received screen information to generate corresponding screen windows. According to the received screen information, the cloud server generates a first screen window and a second screen window. These two windows respectively correspond to the screen information associated with the first display screen and the second display screen;
[0144] Furthermore, after generating the corresponding screen windows, the cloud server starts to render the content of the virtual desktop, rendering the first image of the virtual desktop into the first screen window to ensure that the content adapts to the parameters and characteristics of the first display screen. Similarly, the cloud server renders the second image of the virtual desktop into the second screen window to ensure that the content adapts to the parameters and characteristics of the second display screen. After rendering, at least two virtual images are obtained, where the virtual images are the images respectively rendered into the first screen window and the second screen window, ensuring that each display screen can obtain virtual desktop content that matches its own parameters.
[0145] Through the embodiments provided in this application, the first screen window and the second screen window are generated using the screen information, where the first screen window corresponds to the screen information associated with the first display screen, and the second screen window corresponds to the screen information associated with the second display screen; the first image of the virtual desktop is rendered into the first screen window, and the second image of the virtual desktop is rendered into the second screen window, obtaining at least two virtual images, where the at least two virtual images include the image rendered into the first screen window and the image in the second screen window, thereby achieving the purpose that the cloud server can accurately adjust the rendering output, and thus realizing the technical effect of providing users with the best experience of adaptive multi-screen display based on cloud computers.
[0146] As an optional solution, sending at least two virtual images to the local terminal includes:
[0147] Send at least two virtual images to the client server, and the client server matches each virtual image in the at least two virtual images with each display screen in the at least two display screens one by one, and sends the at least two virtual images after matching by the client server to the local terminal, where the client server is used to process the information interaction between the local terminal and the cloud server, and the image rendered to the first screen window matches the first display screen, and the image rendered to the second screen window matches the second display screen.
[0148] Optionally, in this embodiment, the client server may but is not limited to refer to a dedicated server that provides services for a client (local terminal) in a network environment. The server is installed with a network operating system and various server application systems. As an intermediate layer, the client server is responsible for transmitting information between the local terminal and the cloud server. When the local terminal needs to access resources or services on the cloud server, the client server can play a bridging role. In the scenario where multiple people access the cloud server simultaneously, the client server can help share the load of the cloud server to ensure that the system runs more stably and efficiently.
[0149] It should be noted that in a multi-screen environment, when it is necessary to adapt and adjust the virtual images on the cloud server, it first involves the transmission of multi-screen information. To ensure efficient, stable, and secure information interaction between the local terminal and the cloud server and improve the user experience in the multi-screen environment, this embodiment uses a client server in the process of transmitting multi-screen information and virtual images.
[0150] For further illustration by example, optionally, for example, first, the cloud server sends these at least two virtual images to the client server. The client server acts as an important intermediary role and is responsible for processing all information interactions between the local terminal and the cloud server. After receiving these virtual images, the client server starts the matching operation. The task of the client server can be but is not limited to being understood as ensuring that each virtual image can be matched with the correct display screen. According to the screen information obtained from the cloud server before, the client server can match each of the at least two virtual images with each of the at least two display screens one by one. After completion of the matching, the client server sends the at least two virtual images after matching to the local terminal, and then each display screen will receive a virtual image that matches its parameters and characteristics.
[0151] Furthermore, when the local terminal receives these virtual images, the local terminal will present them on the corresponding display screen. Specifically, the image rendered to the first screen window will be sent to and matched with the first display screen, and the image rendered to the second screen window will be sent to and matched with the second display screen.
[0152] Through the embodiments provided in this application, at least two virtual screens are sent to the client server, and the client server matches each virtual screen among the at least two virtual screens with each display screen among the at least two display screens one by one, and sends the at least two virtual screens after matching by the client server to the local terminal. Among them, the client server is used to process the information interaction between the local terminal and the cloud server, the picture rendered to the first screen window matches the first display screen, and the picture rendered to the second screen window matches the second display screen. Furthermore, the purpose of ensuring efficient, stable, and secure information interaction between the local terminal and the cloud server is achieved, thereby realizing the technical effect of improving the user experience in a multi-screen environment.
[0153] As an optional solution, for the convenience of understanding, the above multi-screen display method based on cloud computers is applied to the usage scenario of cloud computers. As a remote desktop solution, cloud computers have been widely used in modern office environments. However, in the face of the setting of multiple monitors, the experience of cloud computer clients in related technologies still has limitations and cannot automatically adjust the cloud computer interface according to the number and resolution of the local terminal's screens, resulting in difficulties for users to achieve seamless docking in a multi-screen environment.
[0154] And this embodiment provides a method and system for improving the usage experience of cloud computer clients, realizing seamless docking between multiple screens. Based on the number and resolution of the screens of the user's local terminal, the cloud computer generates multiple screen windows according to this information and displays them on the corresponding screens through the client. When the user slides to the edge of the screen, the positional relationship between the screens can be recognized and the transition to another screen can be achieved. A function for managing the positional relationship of the screens is also provided.
[0155] Optionally, in this embodiment, the above cloud computer client may but is not limited to include an information reading module for reading the screen information of the user's local terminal, including the number of screens and the resolution of each screen; a server-side interface generation module for generating multiple screen windows according to the read screen information and allocating them to the corresponding cloud computer clients; a client-side interface display module for displaying windows with corresponding resolutions and sizes on each screen; a screen switching recognition module for recognizing the positional relationship between the screens and achieving the transition to another screen when the user slides to the edge of the screen during the operation; and a screen positional relationship management function for managing, editing, and adjusting the positional relationship between the screens.
[0156] Optionally, in this embodiment, for example Figure 7 As shown, the cloud computer control interface running on the local terminal is further responsive to the selected operation triggered by the user on the multi-screen adaptation control on the cloud computer control interface, obtains the cloud computer multi-screen adaptation request, and displays the virtual desktop of the cloud computer on multiple display screens connected to the local terminal.
[0157] It should be noted that the present embodiment reads the screen information of the user's local terminal, including the number of screens and the resolution of each screen; the cloud computer generates multiple screen windows based on the read screen information, and distributes them to the corresponding cloud computer clients; the cloud computer clients display windows of corresponding resolutions and sizes on each screen; during the operation, the user slides to the edge of the screen, the client identifies the positional relationship between the screens, and realizes the transition to another screen.
[0158] To further illustrate, the optional Figure 8 As shown, after the user starts the cloud computer on the terminal, he clicks and turns on the multi-screen adaptation function, and uploads the start multi-screen instruction to the client server. The client server starts to read the screen information of the local terminal (such as the number of screens, screen resolution, screen position relationship, etc.). The client server uploads various types of multi-screen information to the cloud computer server. The cloud computer server generates multiple screen windows based on the screen information. The cloud server renders the corresponding active screen and sends it to the client for display. The client server adjusts the window position and sends the screen to the terminal for display. The user's operating instructions will be sent to the cloud computer server, and the cloud computer server will render the corresponding screen according to the instructions and return it to the terminal for display. In addition, the user can adjust the screen size and position on the local terminal, or the user can click multi-screen adaptation again, repeat the above steps, and re-adapt to the multi-screen.
[0159] Optionally, in this embodiment, the cloud computer client can automatically identify and save the multi-screen layout set by the user, so that the user can quickly restore to the previous screen layout state when reconnecting after disconnecting the cloud computer.
[0160] Optionally, in this embodiment, based on the user's frequently used applications, the cloud computer client can perform intelligent analysis and provide suggestions, and automatically allocate the applications to the appropriate screen according to frequency of use or synergy.
[0161] Optionally, in this embodiment, the user can use specific gestures during the operation to quickly switch screens or move application windows, thereby improving the convenience of multi-screen operation.
[0162] Optionally, in this embodiment, when users need to work collaboratively on multiple screens, content can be transferred between different screens, such as images, files, or data. The client can recognize user operations, such as dragging a file to the edge of the screen, to automatically transfer the file to another screen.
[0163] Optionally, in this embodiment, in an office or meeting scenario, multiple users are allowed to use their own displays on the same cloud computer for collaborative work. The cloud computer client can identify and manage the operation permissions of different users to achieve resource sharing and collaborative editing.
[0164] Optionally, in this embodiment, on the basis of maintaining the adaptability to a multi-screen environment, the resolution and color of each screen are further adaptively adjusted to ensure the consistency of image quality and the optimization of the visual experience.
[0165] Optionally, in this embodiment, the voice recognition technology is integrated, and the user can switch, move, and manage applications between screens through voice commands, reducing the operation complexity and providing a more advanced interaction experience.
[0166] Through the embodiments provided in this application, by obtaining the number of screens and the resolution of each screen, the adaptability to a multi-screen environment is achieved. According to the read screen information, the cloud computer generates multiple screen windows for the corresponding client. Furthermore, when the user slides to the edge of the screen during the operation process, seamless transition between screens is achieved. At the same time, this embodiment also provides functions for managing, editing, and adjusting the positional relationship between screens, meeting the requirements of multi-screen application scenarios, solving the limitations of traditional cloud computer clients in a multi-screen environment, and enhancing the user experience.
[0167] It can be understood that in the specific implementation manner of this application, data related to user information, etc. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of relevant data need to comply with the relevant laws, regulations, and standards of relevant countries and regions.
[0168] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0169] According to another aspect of the embodiments of this application, a cloud-computer-based multi-screen display device for implementing the above cloud-computer-based multi-screen display method is further provided. As Figure 9 shown, the device includes:
[0170] A first sending unit 902, configured to send multi-screen information of a local terminal to a cloud server in response to a multi-screen adaptation request triggered for a cloud computer, where the multi-screen adaptation request is used to request that a virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0171] A first obtaining unit 904, configured to obtain at least two virtual images returned by the cloud server, where the at least two virtual images are images corresponding to the virtual desktop rendered by the cloud server according to the screen information, and the at least two virtual images include a first virtual image and a second virtual image, the first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0172] A first display unit 906, configured to display the first virtual image on the first display screen and display the second virtual image on the second display screen.
[0173] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on a cloud computer, and details are not described herein again in this example.
[0174] As an optional solution, the apparatus further includes: a second display unit, configured to display an operation identifier of the local terminal in the first virtual image during the process of displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen, where the operation identifier is used to represent a real-time operation performed on the local terminal; a third display unit, configured to display the operation identifier in the second virtual image in response to a first transition request triggered for the operation identifier during the process of displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen; or, a fourth display unit, configured to display the operation identifier in the second virtual image during the process of displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen; a fifth display unit, configured to display the operation identifier in the first virtual image in response to a second transition request triggered for the operation identifier during the process of displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen.
[0175] For specific embodiments, reference may be made to the examples shown in the multi-screen display method based on a cloud computer, and details are not described herein again in this example.
[0176] As an alternative, the second display unit includes: a first edge module for displaying an operation identifier at a position in the first virtual screen that is not at the screen edge; the third display unit includes: the apparatus further includes: a first transition unit for, in response to a first transition request triggered by the operation identifier, before displaying the operation identifier in the second virtual screen, when the operation identifier is at the first screen edge in the first virtual screen, obtaining the first transition request; a second edge module for, in response to the first transition request, displaying the operation identifier in the second virtual screen, wherein the operation identifier located at the first screen edge is set to be transitioned to and displayed in the second virtual screen, and the position in the first virtual screen that is not at the screen edge is the position outside the first screen edge in the first virtual screen; the fourth display unit includes: a third edge module for displaying the operation identifier at a position in the second virtual screen that is not at the screen edge; the apparatus further includes: a second transition unit for, in response to a second transition request triggered by the operation identifier, before displaying the operation identifier in the first virtual screen, when the operation identifier is at the second screen edge in the second virtual screen, obtaining the second transition request; a fourth edge module for, in response to the second transition request, displaying the operation identifier in the first virtual screen, wherein the operation identifier located at the second screen edge is set to be transitioned to and displayed in the first virtual screen, and the position in the second virtual screen that is not at the screen edge is the position outside the second screen edge in the second virtual screen.
[0177] For specific embodiments, reference can be made to the examples shown in the multi-screen display method based on a cloud computer, and the examples are not elaborated herein.
[0178] As an alternative, the apparatus further includes:
[0179] A moving unit for, after displaying the operation identifier of the local terminal at a position in the first virtual screen that is not at the screen edge, when a screen selection operation performed on the first virtual screen is obtained and the operation identifier moves from a position in the first virtual screen that is not at the screen edge to the first screen edge, displaying the second virtual screen on the first display screen and displaying the first virtual screen on the second display screen.
[0180] For specific embodiments, reference can be made to the examples shown in the above multi-screen display method based on a cloud computer, and the examples are not elaborated herein.
[0181] As an alternative, the apparatus further includes:
[0182] A second obtaining unit for, before sending the multi-screen information of the local terminal to the cloud server, obtaining first screen information of at least two display screens, wherein the first screen information includes first screen parameters of the first display screen and second screen parameters of the second display screen;
[0183] A third acquisition unit, configured to acquire second screen information of at least two display screens before sending the multi-screen information of the local terminal to the cloud server, where the second screen information includes information jointly associated between a first display screen and a second display screen.
[0184] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers. Such examples are not elaborated herein.
[0185] As an alternative solution, the second acquisition unit includes: a first acquisition module, configured to acquire the screen resolution of the first display screen and the screen resolution of the second display screen, where the first screen parameter includes the screen resolution of the first display screen, and the second screen parameter includes the screen resolution of the second display screen;
[0186] The third acquisition unit includes: a second acquisition module, configured to acquire the positional relationship between the first display screen and the second display screen.
[0187] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers. Such examples are not elaborated herein.
[0188] As an alternative solution, the apparatus further includes:
[0189] A second sending unit, configured to, after displaying a first virtual screen on the first display screen and a second virtual screen on the second display screen, send a first operation instruction to the cloud server when a first operation instruction triggered by the first virtual screen is acquired;
[0190] A fourth acquisition unit, configured to, after displaying a first virtual screen on the first display screen and a second virtual screen on the second display screen, acquire a new first virtual screen returned by the cloud server, where the new first virtual screen is a new screen corresponding to the virtual desktop rendered by the cloud server according to the first operation instruction;
[0191] A sixth display unit, configured to, after displaying a first virtual screen on the first display screen and a second virtual screen on the second display screen, display the new first virtual screen on the first display screen; or,
[0192] A third sending unit, configured to, after displaying a first virtual screen on the first display screen and a second virtual screen on the second display screen, send a second operation instruction to the cloud server when a second operation instruction triggered by the second virtual screen is acquired;
[0193] A fifth acquisition unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, acquire a new second virtual screen returned by a cloud server, where the new second virtual screen is a new screen corresponding to a virtual desktop rendered by the cloud server according to a second operation instruction;
[0194] A seventh display unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, display the new second virtual screen on the second display screen.
[0195] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on a cloud computer, and details are not described herein again in this example.
[0196] As an optional solution, the apparatus further includes:
[0197] A sixth acquisition unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, when a screen adjustment operation performed on a local terminal is acquired, acquire a new multi-screen adaptation request triggered for the cloud computer, where the screen adjustment operation is used to adjust a display screen connected to the local terminal;
[0198] A determination unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, in response to the new multi-screen adaptation request, determine at least one display screen currently connected to the local terminal, and acquire screen information of the at least one display screen;
[0199] A fourth sending unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, send the at least one display screen to the cloud server;
[0200] A seventh acquisition unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, acquire at least one virtual screen returned by the cloud server, where each virtual screen in the at least one virtual screen corresponds one-to-one to each display screen in the at least one display screen;
[0201] An eighth display unit, configured to, after displaying a first virtual screen on a first display screen and a second virtual screen on a second display screen, display the at least one matching virtual screen on the at least one display screen respectively.
[0202] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on a cloud computer, and details are not described herein again in this example.
[0203] As an alternative solution, the first sending unit 902 includes: a first sending module, configured to send multi-screen information to the client server, and the client server forwards the multi-screen information to the cloud server, where the client server is used to process information interaction between the local terminal and the cloud server;
[0204] The first obtaining unit 904 includes: a third obtaining module, configured to obtain at least two virtual images returned by the cloud server received by the client server.
[0205] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers, and details are not described herein again.
[0206] According to another aspect of the embodiments of the present application, there is also provided a multi-screen display device based on cloud computers for implementing the above multi-screen display method based on cloud computers. As Figure 10 shown, the device includes:
[0207] An eighth obtaining unit 1002, configured to obtain multi-screen information sent by the local terminal, where the multi-screen information is information sent by the local terminal to the cloud server in response to a multi-screen adaptation request triggered for the cloud computer, the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0208] A ninth obtaining unit 1004, configured to render the images corresponding to the virtual desktop according to the screen information to obtain at least two virtual images, where the at least two virtual images include a first virtual image and a second virtual image, the first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0209] A fifth sending unit 1006, configured to send the at least two virtual images to the local terminal, where the first virtual image is displayed on the first display screen, and the second virtual image is displayed on the second display screen.
[0210] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers, and details are not described herein again.
[0211] As an alternative solution, the ninth obtaining unit 1004 includes:
[0212] A generating module, configured to generate a first screen window and a second screen window by using the screen information, where the first screen window corresponds to the screen information associated with the first display screen, and the second screen window corresponds to the screen information associated with the second display screen;
[0213] A rendering module, configured to render a first screen of a virtual desktop into a first screen window, and render a second screen of the virtual desktop into a second screen window, to obtain at least two virtual screens, where the at least two virtual screens include the screen rendered into the first screen window and the screen rendered into the second screen window.
[0214] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers, and details are not described herein again in this example.
[0215] As an optional solution, the fifth sending unit 1006 includes:
[0216] A second sending module, configured to send at least two virtual screens to a client server, and the client server matches each virtual screen in the at least two virtual screens with each display screen in the at least two display screens one by one, and sends the at least two virtual screens after matching by the client server to a local terminal, where the client server is configured to process information interaction between the local terminal and the cloud server, the screen rendered into the first screen window matches the first display screen, and the screen rendered into the second screen window matches the second display screen.
[0217] For specific embodiments, reference may be made to the examples shown in the above multi-screen display method based on cloud computers, and details are not described herein again in this example.
[0218] According to another aspect of the embodiments of the present application, there is also provided an electronic device for implementing the above multi-screen display method based on cloud computers. The electronic device may be, but is not limited to, Figure 1 the user device 102 or the server 112 shown in Figure 11 As shown, the electronic device includes a memory 1102 and a processor 1104. A computer program is stored in the memory 1102, and the processor 1104 is configured to execute the steps in any one of the above method embodiments through the computer program.
[0219] Optionally, in this embodiment, the above electronic device may be at least one network device among multiple network devices in a computer network.
[0220] Optionally, in this embodiment, the above processor may be configured to execute the following steps through the computer program:
[0221] S8-1. In response to a multi-screen adaptation request triggered for a cloud computer, send the multi-screen information of the local terminal to the cloud server, where the multi-screen adaptation request is used to request that the virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0222] S8-2. Obtain at least two virtual images returned by the cloud server, where the at least two virtual images are the images corresponding to the virtual desktop rendered by the cloud server according to the screen information. The at least two virtual images include a first virtual image and a second virtual image. The first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0223] S8-3. Display the first virtual image on the first display screen and display the second virtual image on the second display screen; or,
[0224] S9-1. Obtain the multi-screen information sent by the local terminal, where the multi-screen information is the information sent by the local terminal to the cloud server in response to a multi-screen adaptation request triggered for the cloud computer. The multi-screen adaptation request is used to request that the virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0225] S9-2. Render the image corresponding to the virtual desktop according to the screen information to obtain at least two virtual images, where the at least two virtual images include a first virtual image and a second virtual image. The first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0226] S9-3. Send the at least two virtual images to the local terminal, where the first virtual image is displayed on the first display screen and the second virtual image is displayed on the second display screen.
[0227] Optionally, those of ordinary skill in the art can understand that Figure 11 the structure shown is only for illustration Figure 11 and does not limit the structure of the above-mentioned electronic device. For example, the electronic device may further include more or fewer components (such as a network interface, etc.) than those shown Figure 11 or have a different configuration from that shown Figure 11 .
[0228] Among them, the memory 1102 can be used to store software programs and modules, such as the program instructions / modules corresponding to the multi-screen display method and device based on cloud computer in the embodiments of the present application. The processor 1104 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102, that is, implements the above-mentioned multi-screen display method based on cloud computer. The memory 1102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memories. In some instances, the memory 1102 may further include a memory remotely disposed relative to the processor 1104, and these remote memories can be connected to the electronic device through a network. Examples of the above network include but are not limited to the Internet, enterprise intranet, local area network, mobile communication network, and combinations thereof. Among them, the memory 1102 can specifically but not limitedly be used to store multi-screen information, the first virtual screen, the second virtual screen and other information. As an example, as Figure 11 shown, the above memory 1102 may include but not limited to the first sending unit 902, the first obtaining unit 904, and the first display unit 906 in the above multi-screen display device based on cloud computer; or, Figure 11 the eighth obtaining unit 1002, the ninth obtaining unit 1004, and the fifth sending unit 1006 not shown in
[0229] Optionally, the above transmission device 1106 is used to receive or send data via a network. Specific examples of the above network may include a wired network and a wireless network. In one instance, the transmission device 1106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through a network cable, so as to communicate with the Internet or a local area network. In one instance, the transmission device 1106 is a radio frequency (Radio Frequency, RF) module, which is used to communicate with the Internet wirelessly.
[0230] In addition, the above electronic device further includes: a display 1108, which is used to display the above multi-screen information, the first virtual screen, the second virtual screen and other information; and a connection bus 1110, which is used to connect each module component in the above electronic device.
[0231] In other embodiments, the above user equipment or server can be a node in a distributed system. Among them, the distributed system can be a blockchain system, and the blockchain system can be a distributed system formed by connecting the multiple nodes in the form of network communication. Among them, the nodes can form a peer-to-peer network, and any form of computing device, such as an electronic device like a server or a user equipment, can become a node in the blockchain system by joining the peer-to-peer network.
[0232] According to one aspect of the present application, there is provided a computer program product, which includes a computer program / instructions, and the computer program / instructions contain program codes for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part, and / or installed from a removable medium. When the computer program is executed by the central processing unit, it executes various functions provided by the embodiments of the present application.
[0233] The serial numbers of the embodiments of the present application above are only for description and do not represent the advantages or disadvantages of the embodiments.
[0234] It should be noted that the computer system of the electronic device is only an example and should not bring any limitations to the functions and usage scopes of the embodiments of the present application.
[0235] The computer system includes a central processing unit (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) or the program loaded from the storage part into the random access memory (RAM). In the random access memory, various programs and data required for system operation are also stored. The central processing unit, the read-only memory, and the random access memory are connected to each other through a bus. The input / output interface (Input / Output interface, that is, I / O interface) is also connected to the bus.
[0236] The following components are connected to the input / output interface: an input section including a keyboard, a mouse, etc.; an output section including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section including a hard disk, etc.; and a communication section including a network interface card such as a local area network card, a modem, etc. The communication section performs communication processing via a network such as the Internet. A drive is also connected to the input / output interface as needed. A removable medium such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is installed on the drive as needed so that a computer program read from it can be installed into the storage section as needed.
[0237] In particular, according to an embodiment of the present application, the processes described in each method flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section and / or installed from a removable medium. When the computer program is executed by a central processing unit, various functions defined in the system of the present application are executed.
[0238] According to an aspect of the present application, there is provided a computer-readable storage medium, and a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the computer device executes the methods provided in the above various optional implementation manners.
[0239] Optionally, in this embodiment, the above computer-readable storage medium may be configured to store a computer program for executing the following steps:
[0240] S8-1, in response to a multi-screen adaptation request triggered for a cloud computer, send the multi-screen information of the local terminal to the cloud server, where the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0241] S8-2, obtain at least two virtual images returned by the cloud server, where the at least two virtual images are the images corresponding to the virtual desktop rendered by the cloud server according to the screen information, the at least two virtual images include a first virtual image and a second virtual image, the first virtual image matches the first display screen, and the second virtual image matches the second display screen;
[0242] S8-3, display a first virtual screen on a first display screen and a second virtual screen on a second display screen; or,
[0243] S9-1, obtain multi-screen information sent by a local terminal, where the multi-screen information is information sent by the local terminal to a cloud server in response to a multi-screen adaptation request triggered for a cloud computer. The multi-screen adaptation request is used to request that a virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal. The at least two display screens include a first display screen and a second display screen. The multi-screen information includes screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer;
[0244] S9-2, render the screen corresponding to the virtual desktop according to the screen information to obtain at least two virtual screens, where the at least two virtual screens include a first virtual screen and a second virtual screen. The first virtual screen matches the first display screen, and the second virtual screen matches the second display screen;
[0245] S9-3, send the at least two virtual screens to the local terminal, where the first virtual screen is displayed on the first display screen and the second virtual screen is displayed on the second display screen.
[0246] Optionally, in this embodiment, those of ordinary skill in the art can understand that all or part of the steps in the above-mentioned various methods of the embodiments can be completed by a program instructing the relevant hardware of an electronic device. The program can be stored in a computer-readable storage medium, and the storage medium can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc, etc.
[0247] The serial numbers of the embodiments of the present application above are only for description and do not represent the superiority or inferiority of the embodiments.
[0248] If the integrated unit in the above-mentioned embodiments is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in the above-mentioned computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present application.
[0249] In the above embodiments of the present application, the descriptions of the various embodiments each have their own focuses. For the parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.
[0250] In several embodiments provided by the present application, it should be understood that the disclosed user equipment can be implemented in other ways. Among them, the device embodiments described above are only illustrative. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces, and the indirect coupling or communication connection of units or modules can be in an electrical or other form.
[0251] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0252] In addition, the functional units in each embodiment of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.
[0253] The above are only the preferred embodiments of the present application. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and refinements can still be made, and these improvements and refinements should also be regarded as the protection scope of the present application.
Claims
1. A multi-screen display method based on cloud computers, characterized in that, Including: In response to a multi-screen adaptation request triggered for a cloud computer, sending multi-screen information of a local terminal to a cloud server, where the multi-screen adaptation request is used to request that a virtual desktop provided by the cloud computer be displayed on at least two display screens connected to the local terminal, the at least two display screens including a first display screen and a second display screen, the multi-screen information including screen information of the at least two display screens, and the cloud server being used to support the operation of the cloud computer; Obtaining at least two virtual images returned by the cloud server, where the at least two virtual images are images corresponding to the virtual desktop rendered by the cloud server according to the screen information, the at least two virtual images including a first virtual image and a second virtual image, the first virtual image matching the first display screen, and the second virtual image matching the second display screen; Displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen.
2. The method according to claim 1, characterized in that, During the process of displaying the first virtual image on the first display screen and displaying the second virtual image on the second display screen, the method further includes: Displaying an operation identifier of the local terminal in the first virtual image, where the operation identifier is used to represent a real-time operation performed on the local terminal; In response to a first transition request triggered for the operation identifier, displaying the operation identifier in the second virtual image; or, Displaying the operation identifier in the second virtual image; In response to a second transition request triggered for the operation identifier, displaying the operation identifier in the first virtual image.
3. The method according to claim 2, wherein The displaying the operation identifier of the local terminal in the first virtual image includes: Displaying the operation identifier at a position in the first virtual image that is not at the edge of the image; Before the displaying the operation identifier in the second virtual image in response to a first transition request triggered for the operation identifier, the method further includes: obtaining the first transition request when the operation identifier is at a first edge of the first virtual image; The displaying the operation identifier in the second virtual image in response to a first transition request triggered for the operation identifier includes: responding to the first transition request and displaying the operation identifier in the second virtual image, where the operation identifier located at the first edge of the first virtual image is set to transition to be displayed in the second virtual image, and the position in the first virtual image that is not at the edge of the image is the position outside the first edge of the first virtual image; or, The displaying the operation identifier in the second virtual image includes: displaying the operation identifier at a position in the second virtual image that is not at the edge of the image; Before displaying the operation identifier in the first virtual screen in response to a second transition request triggered by the operation identifier, the method further includes: when the operation identifier is located at a second screen edge of the second virtual screen, obtaining the second transition request; Displaying the operation identifier in the first virtual screen in response to the second transition request triggered by the operation identifier includes: in response to the second transition request, displaying the operation identifier in the first virtual screen, where the operation identifier located at the second screen edge is set to transition to and be displayed in the first virtual screen, and the position in the second virtual screen other than the screen edge is the position outside the second screen edge in the second virtual screen.
4. The method according to claim 3, characterized in that, After displaying the operation identifier at a position in the first virtual screen other than the screen edge, the method further includes: When a screen selection operation performed on the first virtual screen is obtained and the operation identifier moves from a position in the first virtual screen other than the screen edge to the first screen edge, displaying the second virtual screen on the first display screen and displaying the first virtual screen on the second display screen.
5. The method according to claim 1, characterized in that, Before sending the multi-screen information of the local terminal to the cloud server, the method further includes: Obtaining first screen information of the at least two display screens, where the first screen information includes first screen parameters of the first display screen and second screen parameters of the second display screen; Obtaining second screen information of the at least two display screens, where the second screen information includes information jointly associated between the first display screen and the second display screen.
6. The method according to claim 5, wherein: Obtaining the first screen information of the at least two display screens includes: obtaining the screen resolution of the first display screen and the screen resolution of the second display screen, where the first screen parameters include the screen resolution of the first display screen, and the second screen parameters include the screen resolution of the second display screen; Obtaining the second screen information of the at least two display screens includes: obtaining the positional relationship between the first display screen and the second display screen.
7. The method according to any one of claims 1 to 6, characterized in that, After displaying the first virtual screen on the first display screen and displaying the second virtual screen on the second display screen, the method further includes: When a first operation instruction triggered by the first virtual screen is obtained, sending the first operation instruction to the cloud server; Obtaining a new first virtual screen returned by the cloud server, where the new first virtual screen is a new screen corresponding to the virtual desktop rendered by the cloud server according to the first operation instruction; Displaying the new first virtual screen on the first display screen; or when a second operation instruction triggered by the second virtual screen is obtained, sending the second operation instruction to the cloud server; Obtain a new second virtual screen returned by the cloud server, where the new second virtual screen is a new screen corresponding to the virtual desktop rendered by the cloud server according to the second operation instruction; Display the new second virtual screen on the second display screen.
8. The method according to any one of claims 1 to 6, characterized in that, After displaying the first virtual screen on the first display screen and the second virtual screen on the second display screen, the method further includes: When a screen adjustment operation performed on the local terminal is obtained, obtain a new multi-screen adaptation request triggered for the cloud computer, where the screen adjustment operation is used to adjust the display screen connected to the local terminal; Respond to the new multi-screen adaptation request, determine at least one display screen currently connected to the local terminal, and obtain the screen information of the at least one display screen; Send the at least one display screen to the cloud server; Obtain at least one virtual screen returned by the cloud server, where each virtual screen in the at least one virtual screen matches one of the at least one display screens one by one; Display the at least one virtual screen that matches on the at least one display screen respectively.
9. The method according to any one of claims 1 to 6, characterized in that Sending the multi-screen information of the local terminal to the cloud server includes: sending the multi-screen information to the client server, and the client server forwards the multi-screen information to the cloud server, where the client server is used to process the information interaction between the local terminal and the cloud server; Obtaining at least two virtual screens returned by the cloud server includes: obtaining the at least two virtual screens obtained by the client server receiving the cloud server's return.
10. A multi-screen display method based on cloud computers, characterized in that, Includes: Obtain the multi-screen information sent by the local terminal, where the multi-screen information is the information sent by the local terminal to the cloud server in response to a multi-screen adaptation request triggered for the cloud computer, the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; Render the screen corresponding to the virtual desktop according to the screen information to obtain at least two virtual screens, where the at least two virtual screens include a first virtual screen and a second virtual screen, the first virtual screen matches the first display screen, and the second virtual screen matches the second display screen; Send the at least two virtual screens to the local terminal, where the first virtual screen is displayed on the first display screen and the second virtual screen is displayed on the second display screen.
11. The method according to claim 10, characterized in that, The rendering the screen corresponding to the virtual desktop according to the screen information to obtain at least two virtual screens includes: Generate a first screen window and a second screen window using the screen information, where the first screen window corresponds to the screen information associated with the first display screen, and the second screen window corresponds to the screen information associated with the second display screen; Render the first picture of the virtual desktop into the first screen window, and render the second picture of the virtual desktop into the second screen window to obtain the at least two virtual pictures, where the at least two virtual pictures include the picture rendered into the first screen window and the picture in the second screen window.
12. The method according to claim 11, wherein The sending the at least two virtual pictures to the local terminal includes: Send the at least two virtual pictures to the client server, and the client server matches each virtual picture in the at least two virtual pictures with each display screen in the at least two display screens one by one, and sends the at least two virtual pictures after matching by the client server to the local terminal, where the client server is used to process the information interaction between the local terminal and the cloud server, the picture rendered into the first screen window matches the first display screen, and the picture rendered into the second screen window matches the second display screen.
13. A multi-screen display device based on a cloud computer, characterized in that, Includes: A first sending unit, configured to send the multi-screen information of the local terminal to the cloud server in response to a multi-screen adaptation request triggered for the cloud computer, where the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; A first obtaining unit, configured to obtain at least two virtual pictures returned by the cloud server, where the at least two virtual pictures are pictures of the virtual desktop rendered by the cloud server according to the screen information, the at least two virtual pictures include a first virtual picture and a second virtual picture, the first virtual picture matches the first display screen, and the second virtual picture matches the second display screen; A first display unit, configured to display the first virtual picture on the first display screen and display the second virtual picture on the second display screen.
14. A multi-screen display device based on a cloud computer, characterized in that, Includes: An eighth obtaining unit, configured to obtain the multi-screen information sent by the local terminal, where the multi-screen information is the information sent by the local terminal to the cloud server after responding to a multi-screen adaptation request triggered for the cloud computer, the multi-screen adaptation request is used to request to display the virtual desktop provided by the cloud computer on at least two display screens connected to the local terminal, the at least two display screens include a first display screen and a second display screen, the multi-screen information includes the screen information of the at least two display screens, and the cloud server is used to support the operation of the cloud computer; A ninth acquisition unit, configured to render a picture corresponding to the virtual desktop according to the screen information, to obtain at least two virtual pictures, where the at least two virtual pictures include a first virtual picture and a second virtual picture, the first virtual picture is matched with the first display screen, and the second virtual picture is matched with the second display screen; A fifth sending unit, configured to send the at least two virtual pictures to the local terminal, where the first virtual picture is displayed on the first display screen, and the second virtual picture is displayed on the second display screen.
15. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, where the program, when run on an electronic device, executes the method described in any one of claims 1 to 9, or 10 to 12.
16. A computer program product, comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by a processor, the steps of the method described in any one of claims 1 to 9, or 10 to 12 are implemented.
17. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is configured to execute the method described in any one of claims 1 to 9, or 10 to 12 through the computer program.