Cloud computer remote maintenance method, device and equipment and storage medium

Abstract

The invention discloses a cloud computer remote maintenance method and device, equipment and a storage medium. The method comprises the steps that when a remote connection request initiated by a client is received, a first screen is provided in response to the remote connection request, and the first screen is a high-definition screen and / or a GPU screen for the client to access; when a remote maintenance request initiated by the operation and maintenance end is received, a screen switching instruction is generated in response to the remote maintenance request, a second screen is provided based on the screen switching instruction, the first screen is frozen, and the second screen is a QXL virtual screen for the operation and maintenance end to access; and under the condition that the operation and maintenance end interrupts the access to the second screen, generating a connection prompt signal, restoring the first screen, and sending the connection prompt signal to the client so that the client can access the first screen again. According to the scheme, the screen channel is dynamically switched between the client and the operation and maintenance end, so that multi-role remote access control and maintenance isolation of the cloud computer are realized, and the security of the cloud computer is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and particularly relates to a cloud computer remote maintenance method and device, equipment and storage medium. BACKGROUND

[0002] With the increasing popularity of cloud computers, more and more enterprises and individual users rely on cloud computers to complete daily office work, development testing and remote collaboration, and users' requirements for the stability, smoothness and security of remote use experience are also constantly improving. However, the existing cloud computer remote maintenance scheme has many shortcomings in actual application, which not only affects the convenience and continuity of user operation, but also has security risks and low fault troubleshooting efficiency, and it is difficult to meet the increasingly complex and changing use scenarios and management requirements.

[0003] In order to optimize the use experience of cloud computers, the existing scheme blocks unauthorized VNC connection by directly disabling QXL virtual screen, although this measure improves the security of the system to a certain extent and prevents technical personnel or other background personnel from unauthorized access to the user desktop, but at the same time it also brings obvious side effects. Once the cloud computer fails, the technical personnel will not be able to use the VNC remote desktop to effectively troubleshoot and diagnose, and cannot obtain the user desktop state and system running information in real time, which makes fault location difficult and time-consuming, and thus prolongs the time window of fault recovery, affecting the overall stability of the system and the user experience. SUMMARY

[0004] The present application provides a cloud computer remote maintenance method, device, equipment and storage medium, which can dynamically switch between the client high-definition screen and the operation and maintenance end QXL virtual screen through the screen switching mechanism, realizing access isolation and efficient cooperation during remote maintenance. The method supports independent access control of the client and the operation and maintenance end, and can automatically restore user connection and send a prompt signal after the operation and maintenance is completed, which significantly improves the security and user experience of remote maintenance, and is suitable for cloud computer operation and maintenance scenarios with multiple terminal concurrency.

[0005] In the first aspect, the present application provides a cloud computer remote maintenance method, comprising: When receiving a remote connection request initiated by a client, providing a first screen in response to the remote connection request, the first screen being a high-definition screen and / or a GPU screen for the client to access; When receiving a remote maintenance request initiated by an operation and maintenance end, generating a screen switching instruction in response to the remote maintenance request, providing a second screen based on the screen switching instruction and freezing the first screen, the second screen being a QXL virtual screen for the operation and maintenance end to access; In a case where the operation and maintenance end interrupts access to the second screen, a connection prompt signal is generated and the first screen is resumed, the connection prompt signal is sent to the client for the client to re-access the first screen.

[0006] In a second aspect, the present application provides a cloud computer remote maintenance device, comprising: a remote connection module configured to provide a first screen in response to a remote connection request initiated by a client when the remote connection request is received, the first screen being a high-definition screen and / or a GPU screen for the client to access; a remote maintenance module configured to generate a screen switching instruction in response to a remote maintenance request initiated by an operation and maintenance end when the remote maintenance request is received, provide a second screen based on the screen switching instruction and freeze the first screen, the second screen being a QXL virtual screen for the operation and maintenance end to access; a maintenance interruption module configured to generate a connection prompt signal and resume the first screen in a case where the operation and maintenance end interrupts access to the second screen, and send the connection prompt signal to the client for the client to re-access the first screen.

[0007] In a third aspect, the present application provides a cloud computer remote maintenance device, comprising: one or more processors; a memory storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the cloud computer remote maintenance method of the first aspect.

[0008] In a fourth aspect, the present application provides a storage medium containing computer executable instructions for executing the cloud computer remote maintenance method of the first aspect when executed by a computer processor.

[0009] In the present application, by constructing a cloud computer remote maintenance method based on screen switching control and connection state monitoring, an access isolation and connection recovery mechanism between the client and the operation and maintenance end is realized. When receiving a remote connection request initiated by the client, the method provides a high-definition screen and / or GPU screen for normal use, ensuring user operation experience; when detecting that the operation and maintenance end initiates a remote maintenance request, the cloud computer generates a screen switching instruction to dynamically switch to a QXL virtual screen for the operation and maintenance end to access, and synchronously freezes the client screen to ensure the independence and security of the operation and maintenance process. Further, when the operation and maintenance end interrupts the access to the QXL virtual screen, the cloud computer automatically restores the screen access permission of the client, and sends a connection prompt signal to the client, realizing instant notification and rapid reconnection after remote maintenance. The scheme combines dynamic scheduling of screen resources and intelligent response of connection events, improves the continuity and user interaction efficiency of remote maintenance, and is suitable for cloud computer remote maintenance scenarios with multi-role collaboration and multi-task concurrency. BRIEF DESCRIPTION OF DRAWINGS

[0010] Figure 1 is a flowchart of a cloud computer remote maintenance method provided by an embodiment of the present application; Figure 2 is a flowchart of a cloud computer screen detection and switching method provided by an embodiment of the present application; Figure 3 is a flowchart of a cloud computer screen extension display method provided by an embodiment of the present application; Figure 4 is a flowchart of a screen switching instruction generation method provided by an embodiment of the present application; Figure 5 is a flowchart of a cloud computer screen cache synchronization method provided by an embodiment of the present application; Figure 6 is a terminal interaction diagram of a cloud computer remote maintenance method provided by an embodiment of the present application; Figure 7 is a structural block diagram of a cloud computer remote maintenance device provided by an embodiment of the present application; Figure 8 is a structural schematic diagram of a cloud computer remote maintenance device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0011] In order to make the purposes, technical solutions and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below with reference to the drawings. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only parts related to the present application are shown in the drawings, but not all. Before discussing the example embodiments in more detail, it should be mentioned that some example embodiments are described as processes or methods depicted as flowcharts. Although the flowchart describes each operation (or step) as a sequential process, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when the operations are completed, but can also have additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, etc.

[0012] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally a class, not limited to the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the objects before and after are in a "or" relationship.

[0013] Currently, the traditional cloud computer remote maintenance method has significant shortcomings in operation efficiency, security protection and fault troubleshooting capability, and it is difficult to meet the growing demand for remote office and centralized operation. On the one hand, since the cloud computer defaults to set the low-performance QXL virtual screen as the main screen, the user needs to manually switch to the high-definition GPU screen after connecting the cloud computer each time, the operation process is cumbersome and lacks a memory mechanism, causing a fragmented user experience, and seriously affecting the connection efficiency and response speed. On the other hand, the existing VNC remote access mechanism lacks effective permission control, and technicians can bypass user consent to directly access their desktop, which brings potential privacy leakage and security risks. In order to improve the user experience, some solutions try to completely disable the QXL virtual screen, but this limits the emergency troubleshooting means when faults occur in practical applications, making it impossible for technicians to intervene and handle at critical moments, resulting in a decrease in system recovery efficiency.

[0014] To solve the above problems, the embodiment provides a cloud computer remote maintenance method, which realizes efficient switching and intelligent cooperation between client access experience and operation and maintenance operation by constructing a screen resource dynamic scheduling mechanism and a connection state perception model. When receiving a remote connection request initiated by a client, the method automatically provides a high-definition screen and / or a GPU screen as a client use interface to ensure image quality and use fluency; when detecting that a remote maintenance request is initiated by an operation and maintenance end, the cloud computer generates a screen switching instruction, provides a QXL virtual screen for operation and maintenance access based on the screen switching instruction, and freezes the current screen of the client, thereby effectively realizing access isolation of the user operation interface and the maintenance interface. When the operation and maintenance task ends or the connection is interrupted, the cloud computer can intelligently perceive the virtual screen access state, automatically restore the client screen connection, and generate a connection prompt signal and send it to the client to guide the client to re-enter the original operation interface, thereby guaranteeing the continuity of the connection and the integrity of the user experience. The scheme breaks through the limitations of traditional maintenance schemes in resource isolation and connection switching by organically combining the screen switching instruction, access permission division, and state perception signal, significantly improves the response efficiency and control accuracy of remote maintenance, and supports multi-role concurrent access and task switching, thereby enhancing the adaptability and stability of the cloud computer system in complex operation and maintenance scenarios. The technical scheme provides a flexible, safe, and expandable remote maintenance solution for a cloud terminal platform, and helps to build a more efficient human-computer cooperation operation and maintenance system.

[0015] The cloud computer remote maintenance method provided in the embodiment can be executed by a cloud computer remote maintenance device. The cloud computer remote maintenance device can be implemented in a software and / or hardware manner, and can be composed of two or more physical entities or one physical entity. For example, the cloud computer remote maintenance device can be an operation and maintenance server for controlling cloud computer screen switching.

[0016] The cloud computer remote maintenance device is installed with at least one type of operating system, wherein the operating system includes but is not limited to an Android system, a Linux system, and a Windows system. The cloud computer remote maintenance device can install at least one application program based on the operating system. The application program can be an application program provided by the operating system, or an application program downloaded from a third-party device or server. In the embodiment, the cloud computer remote maintenance device has at least an application program that can execute the cloud computer remote maintenance method.

[0017] For ease of understanding, the embodiment takes an operation and maintenance server as an example to describe the cloud computer remote maintenance method.

[0018] Figure 1 A flowchart of the cloud computer remote maintenance method provided in the embodiment is given. Referring to Figure 1 , the cloud computer remote maintenance method specifically includes: S110, in response to the remote connection request initiated by the client, a first screen is provided for the client to access, the first screen being a high-definition screen and / or a GPU screen.

[0019] In one embodiment, a remote connection request initiated by a client is first received, wherein the remote connection request refers to a desktop connection application initiated by the client based on a preset communication protocol to the cloud computer, and the client can be a user terminal device running a remote desktop application, such as a PC, a tablet or a mobile phone. After receiving the remote connection request, the cloud computer will respond to the request and provide a first screen for the client to access and interact. The first screen refers to a virtual display resource for displaying the operation interface of the cloud computer to the client, representing the image output path and the access mode of the computing resource allocated by the cloud computer. The first screen can be a high-definition screen and / or a GPU screen: the high-definition screen is a virtual display channel for rendering the interface with high-resolution images, which is suitable for operation scenarios with priority on clarity, such as office documents and web browsing; the GPU screen is a rendering interface accelerated by a GPU graphics processing unit, which is suitable for graphics-intensive application scenarios, such as graphics modeling, image processing or high-performance game running.

[0020] In one embodiment, the way to determine whether to provide the GPU screen for the client can be: to determine whether to allocate GPU resources according to the application type and service level requested by the client, and to select to provide the GPU screen if the request contains a GPU acceleration requirement label or triggers a specific policy condition.

[0021] In one embodiment, the way to determine the display resolution of the first screen can be: to dynamically adjust the resolution level based on the display capability of the client device, the network bandwidth condition and the preset service policy, so as to balance the quality and response performance.

[0022] In one embodiment, the way to determine the encoding transmission parameters of the first screen can be: to estimate the optimal code rate according to the network state of the remote connection, and to set appropriate image compression rate and frame rate parameters, so as to improve the remote picture synchronization efficiency and guarantee the user experience.

[0023] Optionally, Figure 2 A flowchart of a cloud computer screen detection and switching method provided by an embodiment of the application is given. Referring to Figure 2 The cloud computer screen detection and switching method specifically includes: S1101, upon receiving the remote connection request initiated by the client, performing display device detection to obtain a screen detection result.

[0024] Exemplarily, upon receiving a remote connection request initiated by a client, the cloud computer first performs a display device detection operation to obtain the state of the display device currently connected to the cloud computer, wherein the client refers to a user terminal device such as a PC, a tablet or a mobile device used to initiate a remote access request; the remote connection request refers to a control and display access request initiated by the client to the cloud computer system through a network; the display device detection refers to a state query process performed on all physical or virtual display interfaces of the host; and the screen detection result refers to a set of information representing the connection state, resolution, display channel and availability of the current display devices.

[0025] In one embodiment, the display device detection can be performed by invoking a virtual display service or an operating system underlying graphics interface to enumerate all available display channels, and identifying the access state, resolution configuration and operability flag of the HDMI, DP, VGA and virtual display interface.

[0026] In one embodiment, the screen detection result can be obtained by structuring and organizing the screen detection information, extracting the unique identifier, screen physical property, enabled state and graphics resource binding information of each display device, and forming a data object in a unified format for subsequent processing module calling.

[0027] In one embodiment, if the screen detection result shows that there are multiple available display devices, the cloud computer can further classify and label them, such as marking high-definition physical display screens and virtual screens, for subsequent screen switching and access policy making.

[0028] S1102, if the screen detection result contains a high-definition screen and / or a GPU screen, providing a first screen and disabling a second screen.

[0029] Exemplarily, if the high-definition screen and / or the GPU screen are included in the aforementioned screen detection result, the cloud computer will provide the first screen for the client to access and disable the second screen at the same time. Here, the first screen refers to a physical display device with high-definition resolution display capability or a graphics output channel bound to GPU resources, which is usually used to ensure that the client obtains high-quality display effect; and the second screen refers to a virtual display interface for operation and maintenance or remote control, such as a QXL virtual screen, and disabling the screen can prevent unauthorized access or resource redundancy.

[0030] In one embodiment, the first screen can be provided by the cloud computer based on the type of the client remote connection channel and the client capability characteristics to select the best physical display channel, map the image frame buffer corresponding to the channel to the display stream readable by the client, and start the graphics rendering synchronization service.

[0031] In one embodiment, the way to disable the second screen can be to disconnect the binding relationship between the virtual display device and the graphic session by calling the management interface of the virtual display service, such as QXL or Spice server API, or to set the state of the second screen to "unavailable" / "hidden" to release the graphic resources occupied by the second screen and avoid misuse by the remote operation end.

[0032] In one embodiment, the identification basis of the high-definition screen can be the resolution parameter, the output signal type or the flag of the binding GPU memory resource; and the identification basis of the GPU screen can be whether the GPU acceleration channel is enabled, the memory mapping capability or the binding state of the graphic card driver layer.

[0033] Optionally, Figure 3 A flowchart of a cloud computer screen extension display method provided by an embodiment of the present application is given. Referring to Figure 3 The cloud computer screen extension display method specifically includes: S1103, if the screen detection result contains a GPU screen, a screen configuration query request is sent to the client to generate screen configuration information by the client.

[0034] For example, if the screen detection result contains a GPU screen, the cloud computer sends a screen configuration query request to the client to prompt the client to generate screen configuration information based on the display state. The GPU screen refers to a display channel controlled by a graphic card and having graphic acceleration capability, and is usually used in remote operation scenarios with high image quality requirements; the screen configuration query request is used to trigger the client to perform local display environment scanning, including connected display information, resolution setting, screen layout, etc.; and the screen configuration information is used for accurate rendering and channel matching of the subsequent remote display session.

[0035] In one embodiment, the way to determine the existence of the GPU screen can be to identify a display channel with a graphic card hardware acceleration identifier or to detect that a physical output port associated with a GPU frame buffer is in an active state in the display device detection process.

[0036] In one embodiment, the way to generate and send the screen configuration query request can be that the cloud computer initiates a request to the client through an extension instruction or a custom API in a remote control protocol, such as RDP, SPICE, VNC, etc., carries a query instruction identifier, a timestamp and context authentication information, and ensures that the client can respond to the query in the session security context.

[0037] In an embodiment, the manner in which the client generates the screen configuration information can be that the client obtains information of all available display output devices according to a display configuration management module of an operating system, including the number of displays, resolution, refresh rate, primary and secondary screen relationship, and zoom setting, and constructs a standardized screen configuration structure and returns it to the server.

[0038] S1104, in response to receiving the screen configuration information, determining the display device of the client based on the screen configuration information; For example, when the cloud computer receives the screen configuration information returned by the client, it determines the display device currently connected to the client based on the screen configuration information. The display device refers to a physical or virtual display terminal in an enabled state and with a graphics output capability in the client system, including but not limited to a high-definition display, an external multi-screen, a notebook computer internal screen, or a graphics card output channel. The screen configuration information is used to represent the current screen structure, layout, and physical connection state of the client, and is the basis for remote display channel adaptation and screen switching logic determination.

[0039] In an embodiment, the manner in which the client generates the screen configuration information can be that the client obtains information of all available display output devices according to a display configuration management module of an operating system, including the number of displays, resolution, refresh rate, primary and secondary screen relationship, and zoom setting, and constructs a standardized screen configuration structure and returns it to the server.

[0040] In an embodiment, the fields used for display device identification in the screen configuration information can include screen number, resolution, refresh rate, connection type, primary screen identifier, graphics controller binding relationship, etc., and the cloud computer determines whether it is suitable for the remote transmission channel standard of the high-definition screen or the GPU screen according to these fields.

[0041] In an embodiment, after identifying the display device of the client, the cloud computer configures the first screen or constructs a display resource mapping table based on the identification result to support subsequent screen switching, remote display compression transmission, resolution adaptation, etc.

[0042] S1105, in the case where the display device exists an extended display device, enabling the GPU screen in an extended display mode and providing the GPU screen for the extended display device to display a picture.

[0043] For example, when the cloud computer identifies that the display device of the client has an extended display device, the cloud computer will automatically adopt an extended display mode to enable the GPU screen and provide picture output for the extended display device through the GPU screen. The extended display device is used to represent a secondary display terminal connected to the client through HDMI, DP, Type-C or virtual display channel, which is used to expand the desktop space or bear high-performance graphics output. The GPU screen refers to a screen buffer output area directly driven by a separate graphics card or an integrated graphics card, which is suitable for high-resolution graphics, video rendering or virtual display scenarios.

[0044] In one embodiment, the way to determine the presence of the extended display device can be that the cloud computer parses the multi-display channel configuration item contained in the screen configuration information of the client after receiving the screen configuration information, and if there is a screen that does not belong to the main display and its state is "enabled" or "connected", it is determined that there is an extended display device.

[0045] In one embodiment, the way to enable the GPU screen can be that the cloud computer calls the operating system graphics subsystem interface to activate the corresponding GPU output channel, and configures the channel as "extended mode" instead of "mirror mode", so as to ensure that the extended screen obtains independent picture content. The cloud computer also binds a background rendering thread for the GPU screen to ensure that data is rendered and compressed through the graphics card channel.

[0046] In one embodiment, the way to provide the GPU screen can be that the cloud computer sets the GPU screen as the target output of the extended display area of the client, binds the related resolution and frame rate parameters, and builds a remote frame buffer pushing channel in the background, so that the extended display device can display and interactively render the picture locally.

[0047] S120, when receiving a remote maintenance request initiated by the operation and maintenance end, generating a screen switching instruction in response to the remote maintenance request, providing a second screen and freezing the first screen based on the screen switching instruction, the second screen being a QXL virtual screen for the operation and maintenance end to access.

[0048] In one embodiment, a remote maintenance request initiated by the operation and maintenance end is first received, wherein the remote maintenance request refers to a request initiated by the operation and maintenance end through a remote control system to enter a maintenance state of the cloud computer, and the operation and maintenance end can be a maintenance control terminal with management authority. After receiving the remote maintenance request, the cloud computer will respond to the request, generate a screen switching instruction, and execute a screen switching operation accordingly. The screen switching instruction refers to a control instruction for controlling the switching state of the current display channel of the cloud computer, representing the redirection operation of the active screen under the multi-screen output architecture. In response to the screen switching instruction, the cloud computer freezes the original first screen and provides a second screen for the operation and maintenance end to access and remotely operate. The first screen is a high-definition screen or a GPU screen being accessed by the client, and freezing the first screen means that the cloud computer suspends the image refreshing and input interaction of the screen, preventing the client and the cloud computer from concurrent control, and ensuring the exclusivity and security of the remote maintenance process. The second screen is a QXL virtual screen for the operation and maintenance end, representing a remote virtual display channel configured in the cloud computer in the QXL protocol standard, having the characteristics of lightweight rendering, supporting efficient command transmission and graphic decoding, and being suitable for operation scenarios such as remote operation and maintenance, fault diagnosis, and configuration verification.

[0049] In one embodiment, the screen switching instruction can be generated by matching the corresponding screen switching strategy template according to the permission information and the maintenance target type in the operation and maintenance request, and automatically configuring the target screen type and the switching mode.

[0050] In one embodiment, the first screen can be frozen by disabling its image output and user input event response channel, so that it enters a read-only state and avoids operation conflicts with the second screen.

[0051] In one embodiment, the QXL virtual screen can be provided by dynamically loading the QXL driver module and allocating corresponding frame buffers and remote transmission channels, so that the operation and maintenance end can efficiently and low-latency access the maintenance interface.

[0052] Optionally, Figure 4 A flowchart of a screen switching instruction generation method provided by an embodiment of the present application is given. Referring to Figure 4 The screen switching instruction generation method specifically includes: S1201, generating a maintenance authorization request according to the remote maintenance request, and sending the maintenance authorization request to the client.

[0053] Exemplarily, after receiving the remote maintenance request initiated by the operation and maintenance end, the cloud computer first generates a maintenance authorization request according to the request, and sends the maintenance authorization request to the client. The remote maintenance request is used to represent the maintenance intention of the operation and maintenance end to access the cloud computer, and can include information such as a maintenance task type, an initiator identity, and a maintenance timestamp. The maintenance authorization request is used to request the client to confirm whether to agree to the remote maintenance operation, which is an important security mechanism to ensure that the user is informed and authorized.

[0054] In one embodiment, the way of generating the maintenance authorization request can be that the cloud computer extracts the identification information of the operation and maintenance personnel, the maintenance target, the permission range, and the maintenance operation description from the remote maintenance request, constructs an authorization request data packet, and encrypts and signs the authorization request data packet to prevent man-in-the-middle tampering.

[0055] In one embodiment, the way of sending the maintenance authorization request can be that the cloud computer pushes the maintenance authorization request to the client through the established client signaling channel, and triggers the client front-end pop-up prompt or notification module to display the maintenance request details.

[0056] In one embodiment, the client can choose to agree or refuse the maintenance authorization request, and the cloud computer will decide whether to continue the subsequent screen switching and resource redirection operation based on the authorization feedback result returned by the client.

[0057] S1202, generating a screen switching instruction in response to the received authorization response signal, the authorization response signal being sent by the client when determining authorization after receiving the maintenance authorization request.

[0058] Exemplarily, in response to receiving the authorization response signal sent by the client, the cloud computer generates a screen switching instruction. The authorization response signal refers to the response confirmation signal generated by the client according to the user authorization operation result after receiving the maintenance authorization request, to indicate the agreement or refusal to perform remote maintenance access; the screen switching instruction refers to an operation command for controlling the switching of the current display screen state, including specific execution instructions for activating the second screen and freezing the first screen; the client can be a terminal device accessing the cloud computer service, such as a client or a cloud terminal application. After obtaining the authorization response signal, the cloud computer extracts the authorization confirmation information from the authorization response signal and judges its legality, and if it is confirmed to allow remote maintenance, constructs a screen switching instruction, and prepares to initiate the display screen state switching to the target cloud computer through the QGA channel.

[0059] In one embodiment, the way of generating the screen switching instruction can be that the state flag bit, connection token, and session ID information in the authorization response signal are parsed, the current screen configuration state is combined, a structured instruction including a switching target, a freezing target, and an authorization context is generated through a screen control module, and the structured instruction is used for subsequent channel transmission and execution.

[0060] In an embodiment, the screen switching instruction can contain the following control parameters: target screen identification, switching priority label, original screen freeze mode, etc., to support differentiated remote operation and maintenance scenarios.

[0061] In an embodiment, if the authorization response signal represents "authorization denied", the cloud computer will not generate a screen switching instruction, but will record the authorization denial event and feed back the result to the operation and maintenance end for subsequent operation processing or manual confirmation.

[0062] Optionally, the providing a second screen and freezing the first screen based on the screen switching instruction comprises: The screen switching instruction is transmitted to the QGA service module in the cloud computer through the QGA channel, a preset screen switching program is called by the QGA service module, and the screen switching program is controlled to provide a second screen and freeze the first screen.

[0063] For example, the screen switching instruction is transmitted to the QGA service module in the cloud computer through the QGA channel, the QGA channel is used to represent the command communication link between the cloud host and the remote monitoring service, and has high reliability and low delay characteristics; the screen switching instruction indicates that the current display output needs to be switched to a remote operation and maintenance dedicated screen. After obtaining the screen switching instruction, the QGA service module calls a preset screen switching program to perform a screen state switching operation. The QGA service module is a lightweight daemon service running inside the cloud computer, which is used to respond to external management instructions and call corresponding system interfaces; the screen switching program is an operation component encapsulating screen enabling, disabling, freezing and display switching logic, supporting hot plug management of virtual screens. Moreover, the first screen is a high-definition display device and / or GPU rendering output device originally accessed by the client, and its freezing mode is dynamically determined according to the current active task state; the second screen is a QXL type virtual display device, which has low bandwidth compression capability and remote frame buffer optimization mechanism, and is suitable for fast response and accurate control of graphical interfaces in operation and maintenance scenarios.

[0064] In an embodiment, the way to call the screen switching program can be: the QGA service module dynamically calls the display management interface in the host graphics subsystem according to the target screen identification, freeze strategy parameters and display priority in the switching instruction, completes the freeze processing of the first screen, and loads the second screen for the operation and maintenance end to access.

[0065] Optionally, the authorization response signal carries an authorization connection duration; After the second screen is provided and the first screen is frozen based on the screen switching instruction, the method further comprises: Timing is started from the time point when the first screen is frozen, and when the timing reaches the authorization connection duration, the access of the operation and maintenance end to the second screen is interrupted.

[0066] For example, in response to receiving the authorization response signal sent by the client, the cloud computer generates a screen switching instruction, wherein the authorization response signal optionally carries an authorized connection duration. The authorized connection duration indicates a maximum time limit parameter for allowing the operation and maintenance end to access the virtual screen, for implementing session control of authorized access; the parameter can be dynamically generated by the client according to user settings or system default policies.

[0067] In one embodiment, after providing the second screen and freezing the first screen based on the screen switching instruction, the cloud computer starts timing from the time point of freezing the first screen, for controlling the valid period of operation and maintenance access.

[0068] In one embodiment, after freezing the first screen, the cloud computer sets a timer according to the authorized connection duration. After the timer starts timing, if the timing reaches the preset authorized connection duration, the cloud computer automatically interrupts the access of the operation and maintenance end to the second screen, ensuring that the operation and maintenance permission is constrained within the authorized time limit, thereby improving the security of remote control and controllability of resource use of the system.

[0069] In one embodiment, the way to determine the authorized connection duration can be that the client sends the authorization response signal to the server or the remote control module together with the authorized connection duration defined in the maintenance time window set in the user interaction interface or the default authorized duration defined in the platform policy.

[0070] In one embodiment, the way to interrupt the operation can be that the cloud computer calls the disconnection interface provided by the graphics driver layer, synchronously modifies the access permission flag bit, and sends a connection termination signal to the operation and maintenance end, to ensure that the operation and maintenance behavior is completely terminated, avoiding permission overreach or resource leakage.

[0071] Optionally, Figure 5 A flowchart of a cloud computer screen cache synchronization method provided by an embodiment of the present application is given. Referring to Figure 5 , the cloud computer screen cache synchronization method specifically includes: S123, obtaining frame buffer data of the first screen, and generating a screen initial snapshot corresponding to the first screen based on the frame buffer data.

[0072] For example, in the screen switching process, the cloud computer obtains the frame buffer data of the first screen, and generates a screen initial snapshot corresponding to the first screen based on the frame buffer data, to realize the recoverability of the remote screen state. The frame buffer data refers to the original pixel rendering information stored in the graphics display system, for representing the complete image information of the current screen content; the screen initial snapshot refers to a snapshot form of the static image file converted from the frame buffer data, for recording the visual state of the screen before switching.

[0073] In an embodiment, the cloud computer can perform frame buffer data acquisition in the following manner: extracting the frame buffer content of a specific display device through a graphics driver layer interface, and reading it as a raw image data stream.

[0074] In an embodiment, the cloud computer can generate a screen initial snapshot based on frame buffer data in the following manner: encoding the image data into a compressed image in JPEG, PNG, or WebP format, and storing it in a cache directory or a specified path for subsequent recovery interface or fault backtracking.

[0075] In an embodiment, the screen initial snapshot can be used to support the restoration and display of the first screen content during remote maintenance, or to assist the client user in confirming the desktop state before the interruption after the connection interruption is interrupted, thereby achieving a good visual experience and session traceability.

[0076] S124, send the screen initial snapshot to the operation and maintenance end for the operation and maintenance end to render the remote screen image of the cloud computer.

[0077] For example, after generating a screen initial snapshot corresponding to the first screen, the cloud computer sends the screen initial snapshot to the operation and maintenance end for the operation and maintenance end to render the remote screen image of the cloud computer in the remote maintenance initialization phase. The screen initial snapshot refers to the current state of the target cloud computer first screen encapsulated in the form of an image, the operation and maintenance end refers to a client system with remote control authority, and the remote screen image refers to a desktop visual interface rendered by an image, which is used to improve the instant feedback capability of screen switching response.

[0078] In an embodiment, the screen initial snapshot can be sent in the following manner: using an encrypted transmission protocol to push the snapshot image file to the image decoding module specified by the operation and maintenance end through a remote operation and maintenance channel in a data stream manner.

[0079] In an embodiment, after receiving the screen initial snapshot, the operation and maintenance end can perform image decoding and drawing through a graphics rendering engine such as Skia, OpenGL, or Web-based Canvas, thereby achieving fast loading and display of the screen static image, and providing a preview before the second screen is completely loaded.

[0080] In an embodiment, the transmission of the screen initial snapshot can also be used to cache the display content during network fluctuations or maintenance interruptions, ensuring that the operation and maintenance personnel have the perception of the latest screen state, thereby optimizing remote troubleshooting and interface loading experience.

[0081] S130, in the case where the operation and maintenance end interrupts access to the second screen, a connection prompt signal is generated and the first screen is restored, and the connection prompt signal is sent to the client for the client to re-access the first screen.

[0082] For example, when the maintenance terminal interrupts the access of the second screen, the cloud computer first generates a connection prompt signal. The interruption of the maintenance terminal refers to the active or passive disconnection of the maintenance control terminal from the QXL virtual screen, such as the end of operation, network anomaly, or release of permission. The connection prompt signal indicates that the client currently has the condition to reconnect to the cloud computer, and is used to wake up the reconnection logic module of the client. At the same time of generating the connection prompt signal, the cloud computer automatically performs a screen recovery operation to release the first screen from the frozen state and restore its image output and input channels, so that the client can access and control the cloud computer interface again. The first screen is the high-definition screen and / or GPU screen originally accessed by the client. The recovery process includes image refresh channel restart, user input event re-registration, and other operations to ensure seamless user experience. The connection prompt signal can include a screen recovery flag, a client identifier, and optional prompt content such as "remote maintenance has ended, please reconnect". The signal is sent to the target client terminal through a pre-set client communication channel.

[0083] In one embodiment, the connection prompt signal can be generated by listening to the disconnection event of the maintenance channel, and combining the session state and the screen mapping table to generate a prompt signal containing a session recovery identifier.

[0084] In one embodiment, the first screen can be recovered by revoking the original freeze instruction, re-enabling image rendering and input channels, and performing environment synchronization to ensure state consistency.

[0085] In one embodiment, the connection prompt signal can be sent by pushing the signal to the client through WebSocket, MQTT, or TCP-based long connection channel, so that the client can perceive the end of the remote session in the first time and initiate the reconnection process.

[0086] Optionally, Figure 6 A terminal interaction diagram of a cloud computer remote maintenance method provided by an embodiment of the application is given. Referring to Figure 6 The terminal main body of the cloud computer remote maintenance method includes a client 41, a cloud computer 42, and a maintenance terminal 43. The core process executed by the terminal main body is as follows: The client initiates an authorization request, and sends a VNC connection authorization instruction to the cloud computer host after user confirmation. The authorized connection contains a valid time length, and the authorization information is recorded by the cloud computer host for subsequent connection verification. After receiving the authorization, the cloud computer host starts the VNC service to listen to the operation and maintenance end connection. The operation and maintenance end initiates a VNC connection request according to the authorization information. After the connection is established, the operation and maintenance end needs to send an instruction to enable the QXL screen to the cloud computer through the QGA service. The QGA service responds to the operation and maintenance instruction, calls the built-in screen switching program, sets the QXL screen as the main display device, and completes the screen state update through the display controller. The display controller detects whether the QXL is in an active state, and returns the control result to the switching engine. The operation and maintenance end completes the system troubleshooting and maintenance operation through the activated QXL screen. If the VNC connection is interrupted due to timeout, the authorization process needs to be re-initiated to the client. The technician re-initiates the VNC connection according to the actual needs. After the maintenance is completed, the operation and maintenance end actively disconnects the VNC connection, and the cloud computer prompts the user to log in again through the client. The system automatically switches back to the high-definition main screen display, and closes the QXL screen to restore the normal use environment.

[0087] For example, when the cloud computer fails, in order to protect user data security and privacy, the technician needs to remotely troubleshoot the state of the cloud computer. However, the technician usually does not have user account permissions and needs to access the cloud computer through VNC. In order to avoid desktop access without the user's knowledge, the VNC connection permission is controlled by the user side, and the connection can only be established after the user's authorization. The user can configure the valid time length of the VNC connection, and after the expiration, the system automatically interrupts the remote access, ensuring that the authorized access has a clear time boundary. During the VNC connection process, it accesses the QXL type virtual screen, at this time the screen is in an inactive state, even if the connection is established, it will be displayed as a black screen, and no interface content can be observed. Therefore, after establishing the VNC connection, a control instruction needs to be sent through the QGA communication channel to activate the QXL screen and set it as the only available display device. This operation can avoid the window output misplacement problem caused by multiple display screen configurations, for example, the interface opened by the operation and maintenance personnel is displayed on the unconnected extended screen. The control program for QXL screen switching needs to be pre-installed in the cloud computer system during the image building stage, and the calling is completed through the QGA channel. During remote troubleshooting, if the problem cannot be repaired in time, and the VNC connection is forcibly disconnected by the cloud computer due to timeout, the technician needs to request user authorization again, and adjust the authorization time length according to the troubleshooting complexity. After completing the fault handling, the system should actively disconnect the VNC connection, and notify the user through the client to re-establish the connection channel. The system will automatically enable the high-definition main screen display, and synchronously close the QXL virtual screen, and restore the normal use state.

[0088] In one embodiment, after the client initiates a connection request with the cloud computer, the cloud computer will automatically trigger a detection operation for the display device to determine the currently available display output configuration. When the detection result indicates that the cloud computer is only connected with a QXL type virtual screen, the QXL screen is set as the main screen by default and enabled. This is the initial state, which is suitable for the scenario where a high-definition display device has not been created. However, in actual operation, the cloud computer system usually dynamically creates a high-definition screen device, which is set as the new main screen as soon as it is created, and the original QXL screen is automatically disabled by the cloud computer. At this time, the user can observe through the system display setting interface that the QXL screen is in an inactive state, and the image output is concentrated to the high-definition main screen. If the cloud computer detects a GPU-based physical display screen in addition to the QXL screen, the newly created high-definition screen will also be set as the main screen, the QXL virtual screen will be disabled, and the GPU-driven screen will be kept in an extended display state. For the scenario where the client is a dual-screen device, the cloud computer will automatically complete the dual-screen extension configuration, so that the content of the high-definition main screen is displayed between the two physical screens, improving the remote interaction experience and troubleshooting visibility.

[0089] On the basis of the above-mentioned embodiments, Figure 7 A structural block diagram of a cloud computer remote maintenance device provided by the embodiment of the application is shown in FIG. 1. Figure 7 The cloud computer remote maintenance device provided by the embodiment of the application specifically comprises a remote connection module 21, a remote maintenance module 22 and a maintenance interruption module 23.

[0090] The remote connection module 21 is configured to provide a first screen in response to a remote connection request initiated by a client when the remote connection request is received, the first screen being a high-definition screen and / or a GPU screen for the client to access; the remote maintenance module 22 is configured to generate a screen switching instruction in response to a remote maintenance request initiated by an operation and maintenance end when the remote maintenance request is received, provide a second screen based on the screen switching instruction and freeze the first screen, the second screen being a QXL virtual screen for the operation and maintenance end to access; and the maintenance interruption module 23 is configured to generate a connection prompt signal and restore the first screen in the case where the operation and maintenance end interrupts the access to the second screen, and send the connection prompt signal to the client so that the client re-accesses the first screen.

[0091] On the basis of the above-mentioned embodiments, the remote maintenance module 22 comprises an authorization request unit configured to generate a maintenance authorization request according to the remote maintenance request and send the maintenance authorization request to the client; and a switching instruction unit configured to generate a screen switching instruction in response to a received authorization response signal, the authorization response signal being sent by the client when the client determines authorization after receiving the maintenance authorization request.

[0092] On the basis of the above-mentioned embodiments, the authorization response signal carries an authorized connection duration; the cloud computer remote maintenance device further comprises an authorization timing module configured to start timing from a time point of freezing the first screen, and interrupt the access of the operation and maintenance end to the second screen when the timing reaches the authorized connection duration.

[0093] On the basis of the above-mentioned embodiments, the remote connection module 21 comprises a first screen detection unit configured to perform display device detection to obtain a screen detection result when receiving the remote connection request initiated by the client; and a screen switching unit configured to provide the first screen and disable the second screen if the screen detection result contains a high-definition screen and / or a GPU screen.

[0094] On the basis of the above-mentioned embodiments, the remote connection module 21 further comprises a second screen detection unit configured to send a screen configuration query request to the client to generate screen configuration information if the screen detection result contains a GPU screen; a display device unit configured to determine the display device of the client based on the screen configuration information in response to receiving the screen configuration information; and an extended display unit configured to enable the GPU screen in an extended display mode and provide the GPU screen for picture display by the extended display device if the display device exists an extended display device.

[0095] On the basis of the above-mentioned embodiments, the remote maintenance module 22 comprises a QGA service unit configured to transmit the screen switching instruction to a QGA service module in the cloud computer through a QGA channel, and control the screen switching program to provide the second screen and freeze the first screen by calling the preset screen switching program by the QGA service module.

[0096] On the basis of the above-mentioned embodiments, the cloud computer remote maintenance device further comprises a screen snapshot module configured to obtain frame buffer data of the first screen and generate a screen initial snapshot corresponding to the first screen based on the frame buffer data; and a screen rendering module configured to send the screen initial snapshot to the operation and maintenance end for rendering a remote screen image of the cloud computer.

[0097] The cloud computer remote maintenance device provided in the embodiments of the present application can be used to execute the cloud computer remote maintenance method provided in the above embodiments, and has the corresponding functions and beneficial effects.

[0098] The cloud computer remote maintenance device provided in the embodiments of the present application can be used to execute the cloud computer remote maintenance method provided in the above embodiments, and has the corresponding functions and beneficial effects.

[0099] Figure 8 is a structural schematic diagram of a cloud computer remote maintenance device provided in the embodiments of the present application, for reference Figure 8The cloud computer remote maintenance device comprises a processor 31, a memory 32, a communication device 33, an input device 34 and an output device 35. The number of the processor 31 in the cloud computer remote maintenance device can be one or more, and the number of the memory 32 in the cloud computer remote maintenance device can be one or more. The processor 31, the memory 32, the communication device 33, the input device 34 and the output device 35 of the cloud computer remote maintenance device can be connected through a bus or other means.

[0100] The memory 32 can be used to store software programs, computer executable programs and modules, such as program instructions / modules of the cloud computer remote maintenance method of any embodiment of the present application (for example, the remote connection module 21, the remote maintenance module 22 and the maintenance interruption module 23 in the cloud computer remote maintenance device). The memory 32 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function; the data storage area can store data created according to the use of the device, etc. In addition, the memory 32 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device or other non-volatile solid-state memory device. In some examples, the memory can further include a memory remotely arranged with respect to the processor, and these remote memories can be connected to the device through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0101] The communication device 33 is used for data transmission.

[0102] The processor 31 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory 32, that is, implements the cloud computer remote maintenance method described above.

[0103] The input device 34 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the device. The output device 35 can include a display device such as a display screen.

[0104] The cloud computer remote maintenance device provided above can be used to execute the cloud computer remote maintenance method provided by the above embodiments, and has corresponding functions and beneficial effects.

[0105] The embodiment of the present application further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to perform a cloud computer remote maintenance method, the cloud computer remote maintenance method comprising: when a remote connection request initiated by a client is received, providing a first screen in response to the remote connection request, the first screen being a high-definition screen and / or a GPU screen for the client to access; when a remote maintenance request initiated by an operation and maintenance end is received, generating a screen switching instruction in response to the remote maintenance request, providing a second screen based on the screen switching instruction and freezing the first screen, the second screen being a QXL virtual screen for the operation and maintenance end to access; in the case that the operation and maintenance end interrupts the access to the second screen, generating a connection prompt signal and restoring the first screen, and sending the connection prompt signal to the client for the client to re-access the first screen.

[0106] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include an installation medium, e.g., a CD-ROM, floppy disks, or tape device; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; or a non-volatile memory such as a magnetic medium (e.g., a hard disk or optical storage); registers, or other similar types of memory elements upon which instructions are stored and executed by a processing unit. The storage medium can also include other types of storage. For instance, the storage medium can also include a cache, or networked or standalone memory that is part of a remote processing unit. The term "storage medium" should therefore be taken to include a single medium or multiple media that store the instructions which are executed by the processing unit. The storage medium can be considered a computer program product. The terms "computer program medium" or "computer usable medium" are used to refer to the medium used to store program instructions for execution by, the processing unit, such as the hard disk, the storage or memory, or a network or wireless input / output adapter that communicates program instructions to the processing unit. The term "computer program medium" or "computer usable medium" can thus be taken to include a single medium or multiple media that store the program instructions, such as a single side of a disk, or each side of a dual-sided disk. The term "computer program product" can include the storage medium.

[0107] Of course, the storage medium provided by the embodiment of the present application comprises computer executable instructions, which are not limited to the cloud computer remote maintenance method as above, but can also perform the related operations in the cloud computer remote maintenance method provided by any embodiment of the present application.

[0108] The cloud computer remote maintenance device, the storage medium and the cloud computer remote maintenance equipment provided in the above embodiments can perform the cloud computer remote maintenance method provided by any embodiment of the present application, and the technical details not described in detail in the above embodiments can be referred to the cloud computer remote maintenance method provided by any embodiment of the present application.

[0109] The above merely describes the preferred embodiments of the present application and the technical principles applied. The present application is not limited to the specific embodiments herein, and various obvious changes, modifications and replacements made by those skilled in the art without departing from the scope of the present application shall not be excluded. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and more other equivalent embodiments can be included without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A method for remote maintenance of a cloud computer, used in a cloud computer, characterized in that, include: Upon receiving a remote connection request initiated by a client, a first screen is provided in response to the remote connection request, wherein the first screen is a high-definition screen and / or a GPU screen accessible to the client. Upon receiving a remote maintenance request initiated by the operation and maintenance terminal, a screen switching instruction is generated in response to the remote maintenance request. Based on the screen switching instruction, a second screen is provided and the first screen is frozen. The second screen is a QXL virtual screen that can be accessed by the operation and maintenance terminal. If the maintenance terminal interrupts access to the second screen, a connection prompt signal is generated and the first screen is restored. The connection prompt signal is then sent to the client so that the client can access the first screen again.

2. The cloud computer remote maintenance method according to claim 1, characterized in that, The step of generating a screen switching instruction in response to the remote maintenance request includes: A maintenance authorization request is generated based on the remote maintenance request, and the maintenance authorization request is sent to the client; A screen switching instruction is generated in response to the received authorization response signal, which is sent by the client when it determines authorization after receiving the maintenance authorization request.

3. The cloud computer remote maintenance method according to claim 2, characterized in that, The authorization response signal carries the authorized connection duration; After providing the second screen and freezing the first screen based on the screen switching instruction, the method further includes: The timer starts from the point when the first screen is frozen, and when the timer reaches the authorized connection duration, the operation and maintenance terminal's access to the second screen is interrupted.

4. The cloud computer remote maintenance method according to claim 1, characterized in that, The provision of a first screen in response to the remote connection request includes: Upon receiving a remote connection request initiated by the client, a display device detection is performed to obtain the screen detection result; If the screen detection results include a high-definition screen and / or a GPU screen, provide the first screen and disable the second screen.

5. The cloud computer remote maintenance method according to claim 4, characterized in that, After providing the first screen and disabling the second screen, the following is also included: If the screen detection result includes a GPU screen, a screen configuration query request is sent to the client so that the client can generate screen configuration information; In response to receiving the screen configuration information, the display device of the client is determined based on the screen configuration information; When an extended display device exists in the display device, the GPU screen is enabled in the extended display mode, and the GPU screen is provided for the extended display device to display images.

6. The cloud computer remote maintenance method according to claim 1, characterized in that, The step of providing a second screen and freezing the first screen based on the screen switching command includes: The screen switching command is transmitted to the QGA service module in the cloud computer via the QGA channel. The QGA service module then calls a preset screen switching program to provide a second screen and freeze the first screen.

7. The cloud computer remote maintenance method according to claim 1, characterized in that, After providing the second screen and freezing the first screen based on the screen switching instruction, the method further includes: Obtain the frame buffer data of the first screen, and generate an initial screen snapshot corresponding to the first screen based on the frame buffer data; The initial screenshot of the screen is sent to the operation and maintenance terminal so that the operation and maintenance terminal can render the remote screen image of the cloud computer.

8. A cloud computer remote maintenance device, characterized in that, include: A remote connection module is used to provide a first screen in response to a remote connection request initiated by a client, wherein the first screen is a high-definition screen and / or a GPU screen accessible to the client. The remote maintenance module is used to generate a screen switching instruction in response to a remote maintenance request initiated by the operation and maintenance terminal when it receives the remote maintenance request, provide a second screen based on the screen switching instruction and freeze the first screen, wherein the second screen is a QXL virtual screen that can be accessed by the operation and maintenance terminal; The maintenance interruption module is used to generate a connection prompt signal and restore the first screen when the operation and maintenance terminal interrupts access to the second screen, and send the connection prompt signal to the client so that the client can access the first screen again.

9. A cloud computer remote maintenance device, characterized in that, include: One or more processors; A memory that stores one or more programs, which, when executed by one or more processors, cause the one or more processors to implement the cloud computer remote maintenance method as described in any one of claims 1-7.

10. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the cloud computer remote maintenance method as described in any one of claims 1-7.

Images