Host access control method, device and storage medium

Abstract

The present invention relates to a host access control method, device and storage medium, wherein the method comprises initializing the connection relationship between the user device and the cloud PC platform, binding computing blades and allocating computing resources; if the user chooses to reinstall the operating system through the cloud PC user terminal or soft terminal, the bound computing blade sends the operating system image file to the user device through the cloud PC service terminal, and starts the preset system reinstallation program; based on the CDP remote desktop protocol, audio and video streams are transmitted between the user device, the cloud PC service terminal, the cloud PC platform, the cloud PC user terminal and the soft terminal. Through the cloud PC service terminal, the old host and workstation can be smoothly connected to the cloud PC platform and become part of the cloud resource pool.

Description

Technical Field

[0001] The present invention relates to the field of computer cloud technology, and in particular to a host access control method, device and storage medium. Background Art

[0002] With the development of cloud computing, more and more complex computing tasks are completed by the cloud. A large number of enterprises have improved the level of enterprise IT system construction through cloud transformation, which has improved the overall IT level of enterprises. However, in the process of IT transformation, for example, only thin terminals and other equipment are retained at employee workstations, and blade servers carrying computing and processing functions are concentrated in the central computer room of the enterprise. As a result, the original employee hosts and early obsolete servers will be replaced by other new equipment during the transformation process, and lose their value of continued use, resulting in a large amount of waste of host and early server resources. How to reuse the original hosts, servers and other equipment in the process of cloud IT transformation to avoid unnecessary waste has become an urgent problem to be solved. Summary of the invention

[0003] The present invention provides a host access control method, device and storage medium, aiming to solve at least one of the technical problems existing in the prior art.

[0004] The technical solution of the present invention is a host access control method, which is applied to a host access control device, which includes: a user device, which includes a host and a workstation; a cloud PC service terminal, which is electrically connected to the user device; a cloud PC platform, which is provided with a mainboard, a computing blade and a memory, and the user device is accessed to the cloud PC platform through the cloud PC service terminal, which is electrically connected to the cloud PC platform; a cloud PC user terminal, which is used to access a device connected to the cloud PC platform, which includes a user computer and a user mobile smart device, and which is electrically connected to the cloud PC platform; a soft terminal, which is used to access a device connected to the cloud PC platform, and which is electrically connected to the cloud PC platform. The host access control method includes the following steps:

[0005] S100, initializing the connection relationship between the user device and the cloud PC platform, binding computing blades and allocating computing resources;

[0006] S200: If the user chooses to reinstall the operating system through the cloud PC user terminal or soft terminal, the bound computing blade sends the operating system image file to the user device through the cloud PC service terminal and starts the preset system reinstallation program;

[0007] S300, based on the CDP remote desktop protocol, transmits audio and video streams between user devices, cloud PC service terminals, cloud PC platforms, cloud PC user terminals and soft terminals.

[0008] Further, the step S100 includes:

[0009] S110, based on the WebSocket communication protocol, the user device requests and establishes a connection with the cloud PC platform through the cloud PC service terminal, and uses SSL / TLS encryption to verify the user identity;

[0010] S120, the management service of the cloud PC platform allocates a computing blade and computing resources for processing the current user device, and establishes and initializes a CDP channel for communication between the user device, the cloud PC service terminal and the cloud PC platform based on the CDP remote desktop protocol;

[0011] S130, the computing blade of the cloud PC platform and the cloud PC service terminal are connected by handshake through a CDP channel;

[0012] S140, the user device is started through PXE boot and initiates a registration request to the cloud management platform through the network. The user device sends hardware information to the cloud PC platform to confirm the resolution configuration and data channel configuration. The hardware information includes at least CPU information, memory information, network card information and storage capacity.

[0013] Furthermore, the step S200 also includes, after the operating system of the connected user device is reinstalled, optionally remotely performing hardware configuration, system update maintenance and application installation operations on the user device through a cloud PC user terminal or a soft terminal.

[0014] Further, the step S300 includes:

[0015] S310, independently collect and encode audio and video data;

[0016] S320, based on network adaptive transmission, packet loss retransmission and error control technology, video stream and audio stream are transmitted through independent data channels of QUIC protocol respectively;

[0017] S330: If the terminal device captures the keyboard, mouse, and touch operation data of the user, it is packaged and processed, and transmitted through the USB over IP channel or the control channel. After receiving the operation data, the computing blade immediately performs the corresponding operation and generates a new screen image frame;

[0018] S340: The user equipment decapsulates the audio and video data and performs timestamp synchronization processing on the data before outputting it.

[0019] Further, in step S300,

[0020] The CDP remote desktop protocol is a transmission protocol based on QUIC (Quick UDP Internet Connections, a transport layer protocol based on UDP), and the CDP remote desktop protocol includes:

[0021] Control data stream, used to transmit input device signals, session management information, keyboard and mouse commands, and status synchronization information;

[0022] Video data stream, used to transmit video frame data;

[0023] Audio data stream, used to transmit audio frame data;

[0024] The control data stream, the video data stream and the audio data stream all have independent data stream numbers Stream IDs.

[0025] The encoding method of the video data stream is H.265 encoding, and the encoding method of the audio data stream is AAC / PCM encoding.

[0026] Further, the frame format of the control data stream includes:

[0027] A control frame header identification field is used to identify a control frame. The length of the frame header identification field is 4 bytes and the frame header identification field is a fixed value of 0xCDP_CTRL.

[0028] Frame type field: the length of the frame type field is 2 bytes. When the frame type is keyboard or mouse data, the value of the frame type field is 0x01; when the frame type is session command, the value of the frame type field is 0x02;

[0029] The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes.

[0030] Data content field, used to indicate keyboard and mouse coordinates, key information or command content;

[0031] The check code field is used to ensure data integrity. The length of the check code field is 4 bytes, and the check code field is a CRC32 check code.

[0032] Furthermore, the video data stream includes a transmission mode of incremental transmission and dynamic adaptive bit rate adjustment, and the frame format of the video data stream includes:

[0033] A video frame header identification field is used to identify a video frame. The length of the video frame header identification field is 4 bytes and the video frame header identification field is a fixed value 0xCDP_VIDEO.

[0034] Frame type field: the length of the frame type field is 2 bytes. When the frame type is a key frame, the value of the frame type field is 0x10; when the frame type is an incremental frame, the value of the frame type field is 0x11;

[0035] A timestamp field, the length of which is 4 bytes and the unit of which is milliseconds;

[0036] A fragment sequence number field is used to fragment the video data frame, and the length of the fragment sequence number field is 4 bytes;

[0037] The data length field is used to indicate the length of the video data content. The length of the data length field is 4 bytes.

[0038] A data content field is used to represent video encoding data, and the data content field is represented in the H.265 slice format;

[0039] The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

[0040] Further, the frame format of the audio data stream includes:

[0041] A frame header identification field is used to identify an audio frame. The length of the frame header identification field is 4 bytes, and the value of the frame header identification field is a fixed value 0xCDP_AUDIO;

[0042] Frame type field, the length of the frame type field is 2 bytes. When the frame type is an AAC encoded audio frame, the value of the frame type field is 0x20;

[0043] A timestamp field is used to indicate the timestamp of the audio data. The length of the timestamp field is 4 bytes. The audio data stream is synchronized with the video data stream by embedding the timestamp.

[0044] The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes.

[0045] The data content field is used to represent the audio frame data, and the format of the audio frame data is AAC / PCM encoding;

[0046] The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

[0047] Furthermore, the present invention also provides a host access control device, which is used to execute the host access control method, and the host access control device comprises:

[0048] User equipment, the user equipment includes a host and a workstation;

[0049] A cloud PC service terminal, the user device being electrically connected to the cloud PC service terminal;

[0050] A cloud PC platform, wherein the cloud PC platform is provided with a mainboard, a computing blade and a memory, the user device is connected to the cloud PC platform through the cloud PC service terminal, and the cloud PC service terminal is electrically connected to the cloud PC platform;

[0051] A cloud PC user terminal, used to access devices connected to the cloud PC platform, the cloud PC user terminal includes a user computer and a user mobile smart device, and the cloud PC user terminal is electrically connected to the cloud PC platform;

[0052] A soft terminal is used to access a device connected to the cloud PC platform, and the soft terminal is electrically connected to the cloud PC platform.

[0053] Furthermore, the present invention also provides a computer-readable storage medium on which program instructions are stored, and when the program instructions are executed by a processor, the host access control method is implemented.

[0054] The beneficial effects of the present invention are:

[0055] The host access control method, device and storage medium can smoothly connect old hosts and workstations to the cloud PC platform through the cloud PC service terminal and become part of the cloud resource pool. This allows the original host, server and other hardware to connect to the new cloud PC platform. Enterprises can maximize the resource utilization of existing hardware while avoiding the investment in a large number of new hardware devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 The figure is an overall flow chart of the host access control method.

[0057] Figure 2 The present invention is a flowchart of initializing the connection relationship between the user device and the cloud PC platform, binding computing blades and allocating computing resources in the host access control method.

[0058] Figure 3 The present invention is a flowchart of transmitting audio and video streams between user devices, cloud PC service terminals, cloud PC platforms, cloud PC user terminals and soft terminals based on the CDP remote desktop protocol in a host access control method.

[0059] Figure 4 The present invention is a flowchart of collecting and encoding audio and video in a host access control method.

[0060] Figure 5The present invention is a flowchart of the transmission and synchronization of audio and video data in the host access control method.

[0061] Figure 6 The present invention is a flowchart of the collection and priority transmission of operation input data in the host access control method.

[0062] Figure 7 This is a schematic diagram of the structure of the host access control device.

[0063] 100, user device; 110, host; 120, workstation; 200, cloud PC service terminal; 300, cloud PC platform; 310, motherboard; 320, computing blade; 330, memory; 400, cloud PC user terminal; 410, user computer; 420, user mobile smart device; 500, soft terminal. DETAILED DESCRIPTION

[0064] The following will be combined with the embodiments and drawings to clearly and completely describe the concept, specific structure and technical effects of the present invention, so as to fully understand the purpose, scheme and effect of the present invention. It should be noted that the embodiments and features in the embodiments of this application can be combined with each other without conflict.

[0065] It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature, or it may be indirectly fixed or connected to the other feature. In addition, the descriptions of up, down, left, right, top, bottom, etc. used in the present invention are only relative to the relative positional relationship of the components of the present invention in the drawings.

[0066] In addition, unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art. The terms used in this specification are only for describing specific embodiments, not for limiting the present invention. The term "and / or" used herein includes any combination of one or more related listed items.

[0067] It should be understood that, although the terms first, second, third, etc. may be used to describe various elements in the present disclosure, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, without departing from the scope of the present disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.

[0068] Reference Figures 1 to 7In some embodiments, the technical solution of the present invention is a host 110 access control method, the host 110 access control method is applied to a host 110 access control device, the host 110 access control device includes: a user device 100, the user device 100 includes a host 110 and a workstation 120; a cloud PC service terminal 200, the user device 100 is electrically connected to the cloud PC service terminal 200; a cloud PC platform 300, the cloud PC platform 300 is provided with a mainboard 310, a computing blade 320 and a memory 330, the user device 100 is connected to the ... The cloud PC service terminal 200 is connected to the cloud PC platform 300, and the cloud PC service terminal 200 is electrically connected to the cloud PC platform 300; the cloud PC user terminal 400 is used to access the device connected to the cloud PC platform 300, and the cloud PC user terminal 400 includes a user computer 410 and a user mobile smart device 420, and the cloud PC user terminal 400 is electrically connected to the cloud PC platform 300; the soft terminal 500 is used to access the device connected to the cloud PC platform 300, and the soft terminal 500 is electrically connected to the cloud PC platform 300, referring to Figure 1 , the host 110 access control method comprises the following steps:

[0069] S100, initializing the connection relationship between the user device 100 and the cloud PC platform 300, binding the computing blade 320 and allocating computing resources;

[0070] S200: If the user chooses to reinstall the operating system through the cloud PC user terminal 400 or the soft terminal 500, the bound computing blade 320 sends the operating system image file to the user device 100 through the cloud PC service terminal 200 and starts the preset system reinstallation program;

[0071] S300 , based on the CDP remote desktop protocol, audio and video streams are transmitted between the user device 100 , the cloud PC service terminal 200 , the cloud PC platform 300 , the cloud PC user terminal 400 and the soft terminal 500 .

[0072] The beneficial effects of the present invention are:

[0073] The host 110 access control method, device and storage medium can smoothly access the old host 110 and workstation 120 to the cloud PC platform 300 through the cloud PC service terminal 200, and become part of the cloud resource pool. The original host, server and other hardware can be connected to the new cloud PC platform. Enterprises can maximize the resource utilization of existing hardware and avoid investing in a large number of new hardware devices.

[0074] Specifically, in this technical solution, by using the cloud PC service terminal 200 to connect the host 110 or the workstation 120, combined with the computing blade 320 resources in the cloud PC platform 300, cloud management and remote access to traditional hardware devices are realized. The core of this solution is to use the cloud PC service terminal 200 to connect physical devices (such as the host 110 or the workstation 120) to the cloud PC platform 300, so that these devices become part of the cloud resource pool, and can perform operations such as resource scheduling, system image distribution, and remote access.

[0075] Further, refer to Figure 2 , the step S100 comprises:

[0076] S110, based on the WebSocket communication protocol, the user device 100 requests and establishes a connection with the cloud PC platform 300 through the cloud PC service terminal 200, and uses SSL / TLS encryption to verify the user identity;

[0077] S120, the management service of the cloud PC platform 300 allocates the computing blade 320 and computing resources for processing the current user device 100, and establishes and initializes a CDP channel for communication between the user device 100, the cloud PC service terminal 200 and the cloud PC platform 300 based on the CDP remote desktop protocol;

[0078] S130, the computing blade 320 of the cloud PC platform 300 and the cloud PC service terminal 200 perform a handshake connection through a CDP channel;

[0079] S140, the user device 100 is started through PXE boot and initiates a registration request to the cloud management platform through the network. The user device 100 sends hardware information to the cloud PC platform 300 to confirm the resolution configuration and data channel configuration. The hardware information includes at least CPU information, memory information, network card information and storage capacity.

[0080] Specifically, in step S120, the CDP remote desktop protocol realizes seamless interaction between the terminal and cloud physical resources through efficient collection, transmission and rendering of video, audio and input device signals, providing a low-latency, high-fidelity cloud PC usage experience.

[0081] In some embodiments, the CDP remote desktop protocol includes the following features:

[0082] Connection initialization and resource allocation

[0083] Connection request: The terminal establishes a connection through WebSocket and uses SSL / TLS encryption to verify the user's identity.

[0084] Resource allocation: The cloud PC management service allocates computing resources (such as physical blades) and initializes the CDP channel.

[0085] Handshake mechanism: CDP confirms the following contents with the terminal through the control signaling channel: resolution configuration and data channel configuration.

[0086] Low latency transmission of video streams

[0087] Image acquisition: Use FPGA hardware acceleration to capture image signals (HDMI input); adopt segmentation acquisition technology to divide the image into four strips for parallel processing, shortening the acquisition delay to 4ms (taking 1080P@60fps as an example).

[0088] Coding and transmission: Coding method: H.265 / HEVC hardware accelerated compression, support for YUV 4:4:4 color space; frame transmission: based on incremental transmission, only sending data in the changed area; bandwidth adaptation: dynamically adjust the bit rate and frame rate to ensure smooth display under 1-10Mbps bandwidth.

[0089] Terminal decoding and rendering: Use the hardware decoder to decode the image data and output it to the display (HDMI output); achieve video transmission delay within 30ms.

[0090] Input signal and USB transparent transmission

[0091] Keyboard and mouse control: User input data is transmitted through USB over IP technology, and the transmission instruction priority is higher than the video stream; USB peripheral support: Support USB 2.0 / 3.0 peripherals (U disk, printer, card reader).

[0092] Through the CDP remote desktop protocol, the following technical standards are met: video delay less than 30ms, frame rate support 60FPS @1080P, color space YUV 4:4:4, bandwidth adaptability 4-50 Mbps, data security AES-256 encryption, and input response time less than 10ms.

[0093] Specifically, the cloud PC service terminal 200 is connected to the host 110 or the workstation 120. The cloud PC service terminal 200 is a middleware or adapter that acts as a bridge between the physical device and the cloud PC platform 300. By connecting the host 110 or the workstation 120 to the cloud PC platform 300, the cloud PC service terminal 200 implements the following functions: Hardware adaptation and connection: adapting the hardware resources of the traditional PC or workstation 120 to the cloud PC platform 300, so that the physical device can be seamlessly connected with the cloud computing resources (such as the computing blade 320, storage resources, etc.); Protocol conversion and data interaction: The cloud PC service terminal 200 supports the CDP remote desktop protocol, which can convert the data stream of the local hardware and operating system into a format that can be recognized and processed by the cloud platform, and realize remote data exchange.

[0094] Through the cloud PC service terminal 200, the old host 110 and workstation 120 can be smoothly connected to the cloud PC platform 300 and become part of the cloud resource pool. This allows the original host, server and other hardware to be connected to the new cloud PC platform. Enterprises can maximize the resource utilization of existing hardware while avoiding the investment in a large number of new hardware devices. Through centralized management and cloud operations, the cloud PC platform 300 simplifies the system image management, application deployment, update maintenance and other tasks of the device to the cloud, reducing manual operations and improving the efficiency of enterprise IT operation and maintenance. Administrators can perform remote management through a unified console, reducing the complexity and cost of device management.

[0095] In step S140, the terminal device starts up through PXE boot and initiates a registration request to the cloud management platform through the network. During the handshake process, the terminal device sends its own hardware information (such as CPU, memory, network card, storage capacity, etc.) to the cloud platform. After receiving the terminal information, the cloud management platform connected to the cloud PC platform 300 verifies the legitimacy of the device and allocates adaptive computing resources (such as cloud blades). Determine the system image version required by the terminal and return a handshake response.

[0096] Furthermore, the step S200 also includes, after the connected user device 100 reinstalls the operating system, optionally remotely performing hardware configuration, system update maintenance and application installation operations on the user device 100 through the cloud PC user terminal 400 or the soft terminal 500.

[0097] Specifically, in step S200, the computing blade 320 is integrated with the cloud PC platform 300. In the cloud PC platform 300, the computing blade 320 is used as a core computing resource unit, which is usually used to carry the user's computing tasks. After the host 110 or the workstation 120 is connected to the cloud PC platform 300, their computing capabilities will be integrated with other computing resources in the cloud PC computing blade 320 resource pool, so that they can be scheduled and allocated according to demand. After the host 110 and the workstation 120 are connected through the cloud PC service terminal 200, they become part of the cloud PC computing resource pool.

[0098] System image distribution and centralized management: Through the Cloud PC Platform 300, administrators can distribute system images and perform unified configuration management on connected physical devices. This process makes device management more efficient and flexible, including:

[0099] Image management: Administrators can create operating system images and distribute them to connected physical devices in a unified manner, so that all devices can run in the same operating system and application environment, simplifying the operating system deployment and maintenance process.

[0100] Image management is the core function of the cloud PC system to provide standardized system deployment, fast reinstallation and status recovery for terminal devices. Through the cloud management platform, network transmission and image technology, the system is reinstalled after the terminal device is connected for the first time to ensure the consistency of the system environment and the fast initialization of the device.

[0101] In a specific embodiment, the cloud management platform pushes the system image file to the terminal through the PXE protocol or HTTP / TFTP protocol. The image types include: standard image and incremental image.

[0102] Standard image: a complete system image suitable for first-time deployment.

[0103] Incremental image: a terminal-based differential file suitable for fast recovery.

[0104] The transmission mechanism of the image file adopts multi-threaded parallel transmission technology to improve the image transmission speed, with a maximum transmission rate of 500MB / min. The file integrity is ensured by the checksum (MD5 / SHA-256) to prevent the image data from being damaged.

[0105] Writing of image files: After receiving the image, the terminal device writes it to the local storage medium (such as SSD / HDD). Use the partition management tool to automatically allocate the system partition and boot partition. Writing process monitoring: The progress and status of image writing are synchronously fed back to the cloud management platform.

[0106] After the system is reinstalled, the terminal device sends the deployment completion status to the cloud management platform. The cloud platform synchronously configures the cloud blade computing resources to ensure that the terminal and the cloud blade establish a communication channel. After the terminal device restarts, it loads the newly installed system and completes the first startup through PXE network boot or local boot.

[0107] The operation steps after the system installation is completed: hardware configuration, system initialization and settings, and automatic application installation. Among them,

[0108] (1) Hardware configuration includes hardware driver adaptation and peripheral detection. Hardware driver adaptation is the system automatically identifying the hardware information of the terminal device (such as network card, graphics card, USB interface, etc.), and the cloud platform pushes the matching driver for installation. Peripheral detection is to detect external devices (such as monitors, keyboards, mice, printers), and complete USB peripheral mapping and configuration.

[0109] (2) System initialization and setup include network configuration, domain control and security policies, and system self-check and report. Network configuration includes automatic acquisition of IP address, configuration of network connection, and access to the enterprise network. Static IP and DHCP automatic allocation are supported. Domain control and security policies include joining the enterprise Active Directory (AD domain control) and synchronizing enterprise accounts and permission policies. Security policies and patches are automatically pushed (such as firewall configuration and anti-virus software installation). System self-check and report are hardware and system self-checks after system startup, and the generation of operation status reports is fed back to the cloud management platform.

[0110] (3) Automatic installation of applications includes software distribution, personalized configuration, and application detection and verification. Software distribution is the batch installation of commonly used enterprise software (such as Office, browsers, enterprise ERP systems, etc.) by the cloud management platform through application deployment tools. Personalized configuration is the push of personalized applications and desktop environments based on user permissions and roles. Application detection and verification is the system detecting the application installation status, ensuring that the application is fully running, and synchronizing logs to the cloud management platform.

[0111] In a specific embodiment, the following technical standards are met during the image management process: the maximum image transmission speed is 500MB / minute, the image writing time is ≤5 minutes for standard images, ≤3 minutes for incremental images, the system initialization time is ≤2 minutes, the driver and peripheral configuration are automatically detected and the driver is configured, the success rate is ≥99.9%, the application automatic deployment time is ≤3 minutes (batch installation of 10 standard applications), and the data integrity MD5 / SHA-256 verification is used to ensure that the transmitted image is lossless.

[0112] Centralized configuration management: Through the Cloud PC Platform 300, administrators can centrally manage the configuration of all access devices, including hardware configuration, system settings, application installation, etc. Administrators do not need to configure each device one by one, but can perform tasks in batches through the cloud console, which improves operation and maintenance efficiency.

[0113] Further, refer to Figure 3 , the step S300 comprises:

[0114] S310, independently collect and encode audio and video data;

[0115] S320, based on network adaptive transmission, packet loss retransmission and error control technology, video stream and audio stream are transmitted through independent data channels of QUIC protocol respectively;

[0116] S330: If the terminal device captures the user's keyboard, mouse, and touch operation data, it is packaged and processed, and transmitted through the USB over IP channel or the control channel. After receiving the operation data, the computing blade 320 immediately performs the corresponding operation and generates a new screen image frame.

[0117] S340: The user equipment 100 performs data decapsulation and timestamp synchronization processing on the audio and video data and then outputs the data.

[0118] Specifically, refer to Figure 4 In step S310, the video acquisition is the cloud computing blade 320 collecting the current screen image data through the GPU hardware or FPGA acceleration module. The screen image is segmented and collected according to the frame rate, supporting 30FPS and 60FPS. The audio acquisition is to capture the audio output data from the cloud operating system level, and is processed in AAC / PCM format.

[0119] After acquisition, the audio and video are encoded and compressed, including: video encoding, audio encoding and timestamp embedding. Among them, video encoding uses the H.265 / HEVC encoding standard to compress image data; audio encoding performs AAC encoding on audio data and compresses the data into an efficient transmission format; timestamp embedding embeds timestamps (unit: milliseconds) in the audio and video data during the encoding stage for subsequent synchronization processing.

[0120] Reference Figure 5 In step S320, the transmission and synchronization of audio and video data includes independent data stream transmission, network adaptive transmission, packet loss retransmission and error control.

[0121] The data stream is transmitted independently, and the video stream and audio stream are transmitted through independent data channels of the QUIC protocol. Each data frame is accompanied by a timestamp to mark the data generation time to ensure the transmission order and synchronization accuracy.

[0122] Network adaptive transmission detects the network status between the terminal and the cloud, and dynamically adjusts the data transmission rate according to the bandwidth conditions. For high bandwidth (>10Mbps), the resolution is 1080P and the frame rate is 60FPS. For medium bandwidth (5-10Mbps), the resolution is 1080P and the frame rate is 30FPS. For low bandwidth (2-5Mbps), the resolution is 720P and the frame rate is 30FPS.

[0123] Packet loss retransmission and error control are built-in fast retransmission mechanisms in the QUIC protocol. Lost data packets can be retransmitted independently to ensure data integrity. The cloud and the terminal detect audio and video frame errors through timestamps, perform frame reorganization and compensation, and ensure that the audio and video synchronization error is ≤30ms.

[0124] Reference Figure 6 In step S330, input data is collected. If the terminal device captures the user's keyboard, mouse, and touch operation data, it is packaged and processed. Priority scheduling is performed, and the input data is transmitted through the USB over IP channel or the control channel. During the transmission process, the priority of the input data is higher than the audio and video stream, ensuring that the operation instructions are transmitted back to the cloud in real time. The cloud feedback is synchronized with the picture. After the cloud receives the input instruction, it immediately executes the corresponding operation and generates a new screen image frame; the screen changes are sent back to the terminal in real time through video encoding, forming a continuous operation feedback link.

[0125] The step S340 is terminal decoding and audio and video synchronization processing. Data decapsulation and decoding include decapsulation and decoding of video data and audio data, wherein video data is decoded using the hardware decoder of the terminal device and rendered to the display, and audio data is played in real time using the AAC / PCM decoder. It also includes a timestamp synchronization mechanism, where the terminal aligns according to the timestamp of the audio and video data, and achieves precise synchronization through buffer management, with an error of ≤30ms. The picture is synchronized with the operation, and the input command feedback is rendered synchronously with the screen image update to ensure that the user's operation is not delayed, and the overall operation response time is ≤30ms.

[0126] During the process of transmitting the audio and video streams in step S300, the following technical standards can be met: audio and video synchronization error ≤30ms, operation input response time ≤20ms, and video frame transmission delay ≤30ms.

[0127] Further, in step S300, the CDP remote desktop protocol is a transmission protocol based on QUIC (Quick UDP Internet Connections, a transport layer protocol based on UDP), and the CDP remote desktop protocol includes:

[0128] Control data stream, used to transmit input device signals, session management information, keyboard and mouse commands, and status synchronization information;

[0129] Video data stream, used to transmit video frame data;

[0130] Audio data stream, used to transmit audio frame data;

[0131] The control data stream, the video data stream and the audio data stream all have independent data stream numbers Stream IDs.

[0132] The encoding method of the video data stream is H.265 encoding, and the encoding method of the audio data stream is AAC / PCM encoding.

[0133] Specifically, the CDP remote desktop protocol uses QUIC (Quick UDP Internet Connections) as the underlying transmission protocol, replacing the traditional TCP, and makes full use of QUIC's low latency, multiplexing and fast retransmission features to ensure efficient transmission of remote desktop video, audio and input data.

[0134] Advantages and applicability of the QUIC protocol: Based on UDP, reducing transmission latency: QUIC can achieve efficient transmission under weak network conditions by reducing handshake time and congestion window control. Multiplexing to avoid blocking: Transmit multiple data streams (video stream, audio stream, control stream) in parallel in a single connection to avoid TCP's head-of-line blocking problem. Built-in retransmission and flow control: QUIC has a built-in fast retransmission mechanism and data packet confirmation mechanism, and packet loss can be quickly retransmitted without affecting other data streams. End-to-end encryption: Encrypted with TLS 1.3 to ensure secure data transmission.

[0135] In a specific embodiment, the data stream number Stream ID of the control data stream is 0x01, the data stream number Stream ID of the video data stream is 0x02, and the data stream number Stream ID of the audio data stream is 0x03.

[0136] Further, the frame format of the control data stream includes:

[0137] A control frame header identification field is used to identify a control frame. The length of the frame header identification field is 4 bytes and the frame header identification field is a fixed value of 0xCDP_CTRL.

[0138] Frame type field: the length of the frame type field is 2 bytes. When the frame type is keyboard or mouse data, the value of the frame type field is 0x01; when the frame type is session command, the value of the frame type field is 0x02;

[0139] The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes.

[0140] Data content field, used to indicate keyboard and mouse coordinates, key information or command content;

[0141] The check code field is used to ensure data integrity. The length of the check code field is 4 bytes, and the check code field is a CRC32 check code.

[0142] Furthermore, the video data stream includes a transmission mode of incremental transmission and dynamic adaptive bit rate adjustment, and the frame format of the video data stream includes:

[0143] A video frame header identification field is used to identify a video frame. The length of the video frame header identification field is 4 bytes and the video frame header identification field is a fixed value 0xCDP_VIDEO.

[0144] Frame type field: the length of the frame type field is 2 bytes. When the frame type is a key frame, the value of the frame type field is 0x10; when the frame type is an incremental frame, the value of the frame type field is 0x11;

[0145] A timestamp field, the length of which is 4 bytes and the unit of which is milliseconds;

[0146] A fragment sequence number field is used to fragment the video data frame, and the length of the fragment sequence number field is 4 bytes;

[0147] The data length field is used to indicate the length of the video data content. The length of the data length field is 4 bytes.

[0148] A data content field is used to represent video encoding data, and the data content field is represented in the H.265 slice format;

[0149] The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

[0150] Further, the frame format of the audio data stream includes:

[0151] A frame header identification field is used to identify an audio frame. The length of the frame header identification field is 4 bytes, and the value of the frame header identification field is a fixed value 0xCDP_AUDIO;

[0152] Frame type field, the length of the frame type field is 2 bytes. When the frame type is an AAC encoded audio frame, the value of the frame type field is 0x20;

[0153] A timestamp field is used to indicate the timestamp of the audio data. The length of the timestamp field is 4 bytes. The audio data stream is synchronized with the video data stream by embedding the timestamp.

[0154] The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes.

[0155] The data content field is used to represent the audio frame data, and the format of the audio frame data is AAC / PCM encoding;

[0156] The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

[0157] Since the audio data stream is provided with a timestamp field, through the cloud PC platform 300, users can not only access the remote desktop, but also enjoy the synchronous transmission of audio and video. Even in remote operation, the audio and video content can be displayed in real time and smoothly on the user's device, ensuring that the user is not affected when using multimedia applications. The system ensures that the quality of audio and video transmission is consistent with the remote desktop experience through optimized encoding and decoding technology and bandwidth management strategies.

[0158] Audio and video synchronization and operation response are key links in achieving high-performance remote desktop experience for cloud PCs. The present invention realizes data transmission and real-time interaction between terminal devices and cloud computing resources by combining and applying core technologies such as independent encoding of audio and video data, timestamp synchronization, and input command priority scheduling, ensuring low latency, high synchronization accuracy, and smooth operation feedback.

[0159] Further, refer to Figure 7 The present invention further proposes a host 110 access control device, which is used to execute the host 110 access control method, and the host 110 access control device comprises:

[0160] User equipment 100, the user equipment 100 includes a host 110 and a workstation 120;

[0161] A cloud PC service terminal 200, the user device 100 is electrically connected to the cloud PC service terminal 200;

[0162] A cloud PC platform 300, wherein the cloud PC platform 300 is provided with a mainboard 310, a computing blade 320 and a memory 330, wherein the user device 100 is connected to the cloud PC platform 300 through the cloud PC service terminal 200, and the cloud PC service terminal 200 is electrically connected to the cloud PC platform 300;

[0163] A cloud PC user terminal 400, used to access devices connected to the cloud PC platform 300, the cloud PC user terminal 400 includes a user computer 410 and a user mobile smart device 420, and the cloud PC user terminal 400 is electrically connected to the cloud PC platform 300;

[0164] The soft terminal 500 is used to access the device connected to the cloud PC platform 300 . The soft terminal 500 is electrically connected to the cloud PC platform 300 .

[0165] Specifically, remote access is performed through the cloud PC user terminal 400. Once the host 110 or workstation 120 successfully accesses the cloud PC platform 300 through the cloud PC service terminal 200, the user can perform remote access through the cloud PC user terminal 400 and enjoy the same operating experience as local use. The cloud PC user terminal 400 provides the following functions:

[0166] Remote desktop access through the cloud PC user terminal 400 or soft terminal 500: Users can use cloud PC terminal devices (such as PCs, laptops, tablets, and even mobile phones) for remote desktop access, view and operate the desktop content of the connected host 110 or workstation 120 in real time, and complete work tasks; in addition, users can access the cloud PC platform 300 from different devices at any time according to their needs, so that they can maintain efficient work whether in the office, at home, or on the go.

[0167] In addition to the cloud PC user terminal 400, the soft terminal 500 also supports flexible remote access through the cloud PC platform 300. The soft terminal 500 generally refers to a lightweight client (such as a desktop client, etc.) that has no hardware dependency and has the following advantages: Software client: The soft terminal 500 supports Windows, Linux, Mac, and Android operating systems, allowing users to access the cloud PC platform 300 more quickly and conveniently. Cloud desktop environment consistency: Regardless of which terminal the user uses, the cloud PC platform 300 can provide a consistent desktop experience, ensuring that the image, audio, input and output operations during the access process are seamlessly connected with local use.

[0168] In some embodiments, two remote access methods, a cloud PC user terminal 400 and a software terminal, are provided to meet the needs of multiple terminal devices accessing cloud PC resources.

[0169] (1) Cloud PC user terminal 400 access

[0170] Hardware startup: Users access the cloud PC system through cloud terminal devices (HDMI output, USB input).

[0171] Authentication and desktop allocation: Dual authentication based on WebSocket and Token. The system allocates computing blade 320 resources.

[0172] (2) Cloud PC soft terminal 500 access

[0173] Client installation: supports installation of cloud PC software on Windows, Android, iOS and other platforms.

[0174] Resource access: The soft terminal 500 establishes a connection with the cloud PC platform 300 through the CDP protocol to provide remote desktop operations.

[0175] Furthermore, the present invention also provides a computer-readable storage medium on which program instructions are stored. When the program instructions are executed by a processor, the host 110 access control method is implemented.

[0176] The above is only a preferred embodiment of the present invention. The present invention is not limited to the above implementation. As long as the technical effect of the present invention is achieved by the same means, any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the scope of protection of the present disclosure. All should belong to the protection scope of the present invention. Within the protection scope of the present invention, its technical scheme and / or implementation method can have various modifications and changes.

Claims

1. A host access control method, wherein the host access control method is applied to a host access control device, wherein the host access control device comprises: A user device (100), the user device (100) comprising a host (110) and a workstation (120); a cloud PC service terminal (200), the user device (100) being electrically connected to the cloud PC service terminal (200); and a cloud PC platform (300), the cloud PC platform (300) being provided with a mainboard (310), a computing blade (320) and a memory (330), the user device (100) being connected to the cloud PC platform (300) via the cloud PC service terminal (200), the cloud PC service terminal (200) being electrically connected to the cloud PC platform (300). 0) electrically connected; a cloud PC user terminal (400) for accessing a device connected to the cloud PC platform (300), the cloud PC user terminal (400) comprising a user computer (410) and a user mobile smart device (420), the cloud PC user terminal (400) being electrically connected to the cloud PC platform (300); a soft terminal (500) for accessing a device connected to the cloud PC platform (300), the soft terminal (500) being electrically connected to the cloud PC platform (300), characterized in that the host (110) access control method comprises the following steps: S100, initializing the connection relationship between the user device (100) and the cloud PC platform (300), binding the computing blade (320) and allocating computing resources; S200: If the user chooses to reinstall the operating system through the cloud PC user terminal (400) or the soft terminal (500), the bound computing blade (320) sends the operating system image file to the user device (100) through the cloud PC service terminal (200) and starts a preset system reinstallation program; S300, based on the CDP remote desktop protocol, transmitting audio and video streams between the user device (100), the cloud PC service terminal (200), the cloud PC platform (300), the cloud PC user terminal (400) and the soft terminal (500).

2. The host access control method according to claim 1, characterized in that: The step S100 includes: S110, based on the WebSocket communication protocol, the user device (100) requests and establishes a connection with the cloud PC platform (300) through the cloud PC service terminal (200), and uses SSL / TLS encryption to verify the user identity; S120, the management service of the cloud PC platform (300) allocates a computing blade (320) and computing resources for processing the current user device (100), and establishes and initializes a CDP channel for communication between the user device (100), the cloud PC service terminal (200) and the cloud PC platform (300) based on the CDP remote desktop protocol; S130, the computing blade (320) of the cloud PC platform (300) and the cloud PC service terminal (200) perform a handshake connection via a CDP channel; S140, the user device (100) is started through PXE booting and initiates a registration request to the cloud management platform through the network. The user device (100) sends hardware information to the cloud PC platform (300) to confirm the resolution configuration and data channel configuration. The hardware information includes at least CPU information, memory information, network card information and storage capacity.

3. The host access control method according to claim 1, characterized in that: The step S200 also includes, after the operating system of the connected user device (100) is reinstalled, optionally remotely performing hardware configuration, system update maintenance and application installation operations on the user device (100) through a cloud PC user terminal (400) or a soft terminal (500).

4. The host access control method according to claim 1, characterized in that: The step S300 includes: S310, independently collect and encode audio and video data; S320, based on network adaptive transmission, packet loss retransmission and error control technology, video stream and audio stream are transmitted through independent data channels of QUIC protocol respectively; S330, if the terminal device captures the user's keyboard, mouse, and touch operation data, it is packaged and processed, and transmitted through the USB over IP channel or the control channel. After receiving the operation data, the computing blade (320) immediately performs the corresponding operation and generates a new screen image frame; S340: The user equipment (100) performs data decapsulation and timestamp synchronization processing on the audio and video data and then outputs the data.

5. The host access control method according to claim 1, characterized in that: In the step S300, The CDP remote desktop protocol is a QUIC-based transmission protocol, and the CDP remote desktop protocol includes: Control data stream, used to transmit input device signals, session management information, keyboard and mouse commands, and status synchronization information; Video data stream, used to transmit video frame data; Audio data stream, used to transmit audio frame data; The control data stream, the video data stream and the audio data stream all have independent data stream numbers StreamID. The encoding method of the video data stream is H.265 encoding, and the encoding method of the audio data stream is AAC / PCM encoding.

6. The host access control method according to claim 5, characterized in that: The frame format of the control data stream includes: A control frame header identification field is used to identify a control frame. The length of the frame header identification field is 4 bytes and the frame header identification field is a fixed value of 0xCDP_CTRL. Frame type field: the length of the frame type field is 2 bytes. When the frame type is keyboard or mouse data, the value of the frame type field is 0x01; when the frame type is session command, the value of the frame type field is 0x02; The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes. Data content field, used to indicate keyboard and mouse coordinates, key information or command content; The check code field is used to ensure data integrity. The length of the check code field is 4 bytes, and the check code field is a CRC32 check code.

7. The host access control method according to claim 5, characterized in that: The video data stream includes a transmission mode of incremental transmission and dynamic adaptive bit rate adjustment, and the frame format of the video data stream includes: A video frame header identification field is used to identify a video frame. The length of the video frame header identification field is 4 bytes and the video frame header identification field is a fixed value 0xCDP_VIDEO. Frame type field: the length of the frame type field is 2 bytes. When the frame type is a key frame, the value of the frame type field is 0x10; when the frame type is an incremental frame, the value of the frame type field is 0x11; A timestamp field, the length of which is 4 bytes and the unit of which is milliseconds; A fragment sequence number field is used to fragment the video data frame, and the length of the fragment sequence number field is 4 bytes; The data length field is used to indicate the length of the video data content. The length of the data length field is 4 bytes. A data content field is used to represent video encoding data, and the data content field is represented in the H.265 slice format; The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

8. The host access control method according to claim 5, characterized in that: The frame format of the audio data stream includes: A frame header identification field is used to identify an audio frame. The length of the frame header identification field is 4 bytes, and the value of the frame header identification field is a fixed value 0xCDP_AUDIO; Frame type field, the length of the frame type field is 2 bytes. When the frame type is an AAC encoded audio frame, the value of the frame type field is 0x20; A timestamp field is used to indicate the timestamp of the audio data. The length of the timestamp field is 4 bytes. The audio data stream is synchronized with the video data stream by embedding the timestamp. The data length field is used to indicate the length of the data content. The length of the data length field is 4 bytes. The data content field is used to represent the audio frame data, and the format of the audio frame data is AAC / PCM encoding; The check code field represents the check code of the CRC32 check. The check code field ensures transmission integrity. The length of the check code field is 4 bytes.

9. A host access control device, used to execute the host access control method according to any one of claims 1 to 8, characterized in that: The host access control device comprises: A user device (100), wherein the user device (100) comprises a host (110) and a workstation (120); A cloud PC service terminal (200), the user device (100) being electrically connected to the cloud PC service terminal (200); A cloud PC platform (300), wherein the cloud PC platform (300) is provided with a mainboard (310), a computing blade (320) and a memory (330), wherein the user device (100) is connected to the cloud PC platform (300) via the cloud PC service terminal (200), and the cloud PC service terminal (200) is electrically connected to the cloud PC platform (300); A cloud PC user terminal (400), used to access a device connected to the cloud PC platform (300), the cloud PC user terminal (400) comprising a user computer (410) and a user mobile smart device (420), the cloud PC user terminal (400) being electrically connected to the cloud PC platform (300); The soft terminal (500) is used to access a device connected to the cloud PC platform (300), and the soft terminal (500) is electrically connected to the cloud PC platform (300).

10. A computer-readable storage medium having program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images