Video redirecting method based on desktop cloud, cloud server and video redirecting system

A cloud server and redirection technology, applied in the field of video processing, can solve the problem of consuming a large amount of memory resources of cloud servers and virtual machines, and achieve the effects of improving fluency, reducing resource usage, and improving user experience

Pending Publication Date: 2016-07-20

OPZOON TECH

0 Cites 21 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0004] The present invention provides a desktop cloud-based video redirection method, cloud server and system to solve the problem in the prior art that...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Method used

During concrete implementation, virtual machine calls its WMP player as the background play controller of client player, and client player is when carrying out video progress control, as " fast forward ", " dragging " etc., client The video progress control command will be sent to the virtual machine, and the virtual machine will intercept the video stream and audio stream corresponding to the control command according to the video progress control command, send it to the client, and the client will decode and play it. For example, when the client player executes a drag command, the virtual machine analyzes the time point of video playback according to the drag command, and sends the video stream and audio stream corresponding to the time point to the client, so as to improve the video lo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Abstract

The invention relates to a video redirecting method based on a desktop cloud, a cloud server and a video redirecting system. The method comprises the steps of capturing the action that a WMP player opens a video file in a virtual machine, wherein the virtual machine is the virtual machine on the cloud server, and the video file is the file corresponding to a video playing request sent by a client to the virtual machine; intercepting the video stream and audio stream of the video file, wherein the video stream and the audio stream are obtained through separating the opened video file by the WMP player; and sending the intercepted video stream and audio stream to the client, and decoding and playing the video stream and the audio stream by the client. According to the method, the redirection of the video is achieved through intercepting the video stream and the audio stream which are not decoded; through decoding and playing the video stream and the audio stream by the client, the resource occupancy rate of the cloud server is reduced, and the playing fluency of the video is improved.

Application Domain

Selective content distribution

Technology Topic

Client-sideVirtual machine +3

Image

Examples

Experimental program(1)

Example Embodiment

[0028] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0029] The embodiment of the present invention is designed based on the cloud server adopting the WMP player (WindowsMediaPlayer) under the Windows operating system platform released by Microsoft.

[0030] figure 1 The desktop cloud-based video redirection method provided for the embodiment of the present invention, such as figure 1 As shown, the method includes:

[0031] S1, capturing the action of opening a video file by the WMP player in the virtual machine, wherein the virtual machine is a virtual machine on the cloud server, and the video file is a file corresponding to a video playback request sent by the client to the virtual machine;

[0032] S2, the video stream and the audio stream of the video file are intercepted, and the video stream and the audio stream are obtained by separating and processing the opened video file by the WMP player;

[0033] S3, sending the intercepted video stream and audio stream to the client, and the client decodes and plays the video stream and audio stream.

[0034] In the embodiment of the present invention, after the action of opening the video file by the WMP player in the virtual machine is captured, the video stream and audio stream of the video file are intercepted and sent directly to the client, and the client decodes and plays the video stream and audio stream to realize Video redirection; for the virtual machine, only the separation and sending of the video file is completed during the video playback process, which greatly reduces the resource usage of the cloud server and the virtual machine, especially when the video playback request is large, Improve the fluency of video playback and enhance user experience.

[0035] It should be understood that the above cloud server may be a common personal computer or other terminal, or a commercial server, which is not limited in this embodiment of the present invention.

[0036] Specifically, the above step S1 captures the action of opening the video file by the WMP player in the virtual machine by setting a hook function Hook function in the virtual machine.

[0037] The Media Foundation framework (hereinafter referred to as MF) is a new generation of multimedia application library launched by Microsoft on the Windows Vista system. The purpose is to provide a unified multimedia audio-visual solution for the Windows platform. Transcoding, or encoding a series of pictures into a video, etc. One of the programming models provided by MediaFoundation is MediaPipeline, a media pipeline model based on MediaSession. It is a layer that directly generates and processes media data, and can define how data flows and is processed through topology. The pipeline consists of "MediaSources", "MFTs (MediaFoundataionTransforms)" and "MediaSinks". Most applications do not need to directly call the methods of the pipeline layer objects, but only need to use the upper layer objects such as "MediaSession", "SourceReader" and "SinkWriter".

[0038] MediaSources are used to generate media data, typically reading files, capturing devices, or network streams. MFTs are used in codecs, digital signal processing. MediaSinks are the destinations of media streams. They will present data through graphics cards and sound cards, convert data into files with a fixed format, or publish data to the network.

[0039] Hook is a platform of Windows message processing mechanism, which allows applications to intercept and process window messages or specific events. The hook function is actually a program segment for processing messages, which is hooked into the system through system calls. Whenever a specific message is sent, before reaching the destination window, the hook function will first capture the message, that is, the hook function first obtains the control right, then the hook function can process the message, or continue to pass the message without processing message, you can also forcibly end the delivery of the message, etc.

[0040] API (Application Programming Interface) is the application programming interface of the Windows system, such as WIN32API is the application programming interface of the Microsoft Windows 32-bit platform. Through the HookAPI, the specific events of the Window system can be controlled according to the requirements. For example, when the specific event of the remote desktop needs to be controlled in the embodiment of the present invention, the Hook point of MF can be set by using Windows, that is, the Hook is set to MFCreateRemoteDesktopPluginAPI (MF application programming interface), and specify that the action of triggering the Hook function is to open the video file, that is, after the Hook function captures the action of opening the video file by the WMP player in the virtual machine, the process in the Hook function is executed, including the above-mentioned steps S2 and S3, Change the direction of the audio stream of the MF video stream to implement video redirection.

[0041] The embodiment of the present invention makes full use of the built-in multimedia application library MediaFoundation in the Windows system, and only needs to set the hook function Hook function in the virtual machine and call the interface function in the MF to realize video redirection, which is simple and easy. In addition, the Hook function is used to realize video redirection, and there is no restriction on the system used by the client, that is, the client system can be the Windows system corresponding to the cloud server, or it can be a Linux system. The built-in video decoding library can realize the decoding and playback of video streams and audio streams.

[0042] Preferably, before the above-mentioned step S2 intercepts the video stream and the audio stream of the video file, it also includes not shown in the figure:

[0043] S2', receiving the video playback progress control instruction sent by the client;

[0044]At this time, the step S2 of intercepting the video stream and audio stream of the video file specifically includes: intercepting the video stream and audio stream corresponding to the video playback progress control instruction.

[0045] During specific implementation, the virtual machine calls its WMP player as the background playback controller of the client player. When the client player performs video progress control, such as "fast forward", "drag", etc., the client will use the The video progress control command is sent to the virtual machine, and the virtual machine intercepts the video stream and audio stream corresponding to the control command according to the video progress control command, sends them to the client, and the client decodes and plays them. For example, when the client player executes a drag command, the virtual machine analyzes the time point of video playback according to the drag command, and sends the video stream and audio stream corresponding to the time point to the client, so as to improve the video loading speed. When the client is decoding and playing, it will redraw the decoded picture frame on the client's video playback window.

[0046] It should be added that when the cloud server sends the intercepted video stream and audio stream to the client, in order to reduce the bandwidth and improve the transmission speed, the video stream and audio stream to be sent can be compressed. Correspondingly, the client decompresses the received video stream and audio stream, and then decodes and plays them.

[0047] It should be understood that the cloud server may transmit the intercepted video stream and audio stream to the client through a protocol channel, such as a protocol virtual channel of RDP.

[0048] figure 2 It is a schematic structural diagram of a cloud server according to an embodiment of the present invention, such as figure 2 As shown, the cloud server includes:

[0049] The capture module is used to capture the action of the WMP player in the virtual machine to open the video file. The virtual machine is a virtual machine on the cloud server, and the video file is the file corresponding to the video playback request sent by the client to the virtual machine;

[0050] The interception module is used to intercept the video stream and the audio stream of the video file, and the video stream and the audio stream are obtained by separating and processing the opened video file by the WMP player;

[0051] The sending module is used to send the intercepted video stream and audio stream to the client, and the client decodes and plays the video stream and audio stream.

[0052] Preferably, the above-mentioned cloud server also includes:

[0053] The video playback progress information receiving module is used to receive the video playback progress control instruction sent by the client;

[0054] At this time, the above-mentioned intercepting module is specifically configured to: intercept the video stream and audio stream corresponding to the video playback progress control instruction.

[0055] The description of the cloud server embodiment is relatively simple, and for relevant parts, please refer to the description of the method embodiment, which will not be repeated here.

[0056] An embodiment of the present invention also provides a video redirection system, including a client and the above-mentioned cloud server. When the cloud server captures the action of opening the video file by the WMP player in the virtual machine, it intercepts the video stream and audio stream of the video file, and transmits them to the client through the protocol virtual channel. For specific description, refer to the description of the method and the cloud server embodiment of the present invention, which will not be repeated here.

[0057] During specific implementation, the client may be an ordinary computer, mobile terminal, etc., which is not limited in this embodiment of the present invention. After the client receives the intercepted video stream and audio stream sent by the cloud server, the decoding of the video stream and audio stream can be performed through a soft decoder or a hard decoder, such as a graphics card, by calling the video decoding library for decoding and playback.

[0058] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention. within the bounds of the requirements.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Login to view more

PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine

Login to view more

Classification and recommendation of technical efficacy words

Improve fluency
Reduce resource usage

Video redirecting method based on desktop cloud, cloud server and video redirecting system

A cloud server and redirection technology, applied in the field of video processing, can solve the problem of consuming a large amount of memory resources of cloud servers and virtual machines, and achieve the effects of improving fluency, reducing resource usage, and improving user experience

AI-Extracted Technical Summary

Problems solved by technology

Method used

Abstract

Image

Examples

Example Embodiment

PUM

Description & Claims & Application Information

Similar technology patents

Information transmission method and device and mobile terminal

Neural network acceleration system based on FPGA

Indexing method and device based on key value pair KV system, electronic equipment and medium

Task information transmission method and device in workflow system and computer equipment

Device and method for realizing online transaction asynchronous processing based on database

Classification and recommendation of technical efficacy words

Method and device for displaying dragging progress bar

Code rate smoothing method of video live transmission through wireless network

System and method for generating a separated signal

Information processing method and device and storage medium

Video recording device and method

Method for realizing multi-screen playing video

Data access resource allocation method, system and equipment therefor

Search result showing method and search result showing device

Virtual machine cluster resource allocation and scheduling method

Large wall paste-up interdynamic touch method and apparatus thereof