Cloud computing service system using uniform jump frame selection mode
By adopting a uniform jump frame selection mode in the cloud computing inter-frame encoding system, dynamically adjusting the search number and reference frame selection according to the resolution of the video content, the problem of rigid inter-frame encoding mechanism in the existing technology is solved, and the encoding effect is significantly improved.
Patent Information
- Application Number
- CN202410955073.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2044-07-17
AI Technical Summary
The existing inter-frame encoding mechanism based on cloud computing is too rigid when searching for reference frames and cannot adapt to the varied image content to be encoded, resulting in unsatisfactory encoding effect.
The search number is determined based on the horizontal resolution and vertical resolution of the video content of the image to be encoded between frames, and the previous encoded image is used as the frame to be selected, and the closest signal is selected through the uniform jump frame selection method. Reference frame for noise ratio.
Adaptive inter-frame encoding processing of video contents of different resolutions is realized, and the encoding effect of inter-frame encoding processing is improved.
Abstract
Description
Technical Field
[0001] The present invention relates to the field of cloud computing, and in particular to a cloud computing service system applying a uniform jump frame selection mode. Background Art
[0002] The value of cloud computing lies in its high flexibility, scalability and high cost-effectiveness. Compared with the traditional network application model, it has the following advantages and characteristics:
[0003] 1. Virtualization technology: It must be emphasized that virtualization breaks through the boundaries of time and space and is the most significant feature of cloud computing. Virtualization technology includes application virtualization and resource virtualization. As we all know, there is no spatial connection between the physical platform and the application deployment environment. It is through the virtual platform that data backup, migration and expansion are completed for the corresponding terminal operations.
[0004] 2. Dynamic scalability: Cloud computing has efficient computing capabilities. Adding cloud computing functions to the original server can rapidly increase the computing speed, and ultimately achieve dynamic expansion of the virtualization level to achieve the purpose of expanding the application.
[0005] 3. On-demand deployment: Computers contain many applications, program software, etc. Different applications correspond to different data resource libraries, so users need strong computing power to deploy resources when running different applications. The cloud computing platform can quickly allocate computing power and resources according to user needs.
[0006] 4. High flexibility: Currently, most IT resources, software and hardware on the market support virtualization, such as storage networks, operating systems, and development software and hardware. Virtualization elements are uniformly managed in the cloud system resource virtual pool. It can be seen that cloud computing has very strong compatibility. It is not only compatible with low-configuration machines and hardware products from different manufacturers, but also can achieve higher performance computing with peripherals.
[0007] It can be seen that cloud computing is widely used because of the above advantages. For example, cloud computing is used in inter-frame coding of large-scale image data. However, the inter-frame coding mechanism based on cloud computing in the prior art adopts a set search range when searching for reference frames, and performs a frame-by-frame search mode within the set search range. This overly rigid inter-frame coding mechanism obviously cannot adapt to the variable image content of the current frame to be inter-frame coded, resulting in the coding effect failing to meet expectations. Summary of the invention
[0008] In order to solve the technical problems in the related fields, the present invention provides a cloud computing service system that applies a uniform jump frame selection mode. In the inter-frame coding mechanism based on cloud computing, the search number of reference frames selected as inter-frame coding is determined based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content, and a uniform jump frame selection method is adopted to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby completing adaptive inter-frame coding processing of video contents with different resolutions, and improving the coding effect of the inter-frame coding processing.
[0009] According to the present invention, a cloud computing service system using a uniform skip frame selection mode is provided, the system comprising:
[0010] A signal receiving device, used for receiving video content that performs inter-frame coding, wherein the video content is composed of an image sequence, and the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;
[0011] A data analysis device connected to the signal receiving device, used for analyzing the horizontal resolution of the video content and the vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns of each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows of each frame of the video content;
[0012] A content conversion device, connected to the data analysis device, for determining the number of searches based on the horizontal resolution of the video content and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined;
[0013] a cloud computing server connected to the content conversion device, configured to use, for each image to be inter-frame coded of the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;
[0014] a coding processing device connected to the cloud computing server, and configured to select a frame to be selected from the plurality of frames to be selected, the frame having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame coded as a reference frame for performing inter-frame coding on the image to be inter-frame coded, so as to perform inter-frame coding on the image to be inter-frame coded;
[0015] Among them, for each image to be inter-frame coded of the video content, using multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, and the number of the multiple coded images before the image to be inter-frame coded is equal to the search number includes: using a uniform skip frame selection method to use the multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image;
[0016] Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately before the image to be inter-frame encoded and adjacent to the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.
[0017] It can be seen that the present invention has at least the following important invention points:
[0018] Firstly: for each image to be inter-frame coded in the video content, the number of search frames selected as reference frames for inter-frame coding is determined based on the horizontal resolution of the video content and the vertical resolution of the video content. The lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined, thereby completing the adaptive inter-frame coding processing of video contents with different resolutions;
[0019] Secondly: for each inter-frame coded image of the video content, a plurality of coded images before the inter-frame coded image are used as a plurality of frames to be selected for the inter-frame coded image, the number of the plurality of coded images before the inter-frame coded image is equal to the search number, wherein the plurality of coded images before the inter-frame coded image are used as a plurality of frames to be selected for the inter-frame coded image by adopting a uniform skipping frame selection method;
[0020] Again: select a frame to be selected whose signal-to-noise ratio is closest to the signal-to-noise ratio of the image to be inter-frame encoded from the multiple frames to be selected obtained by the uniform jump frame selection method as a reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded. DETAILED DESCRIPTION
[0021] The implementation scheme of the cloud computing service system using the uniform skip frame selection mode of the present invention will be described in detail below.
[0022] The cloud computing service system using the uniform skip frame selection mode shown in the A embodiment of the present invention includes:
[0023] A signal receiving device, used for receiving video content that performs inter-frame coding, wherein the video content is composed of an image sequence, and the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;
[0024] For example, a signal receiving device is used to receive video content that performs inter-frame coding, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images that are continuously distributed on a time axis, and includes: a content receiving component and a frame number counting component built in the signal receiving device, wherein the content receiving component is connected to the frame number counting component;
[0025] A data analysis device connected to the signal receiving device, used for analyzing the horizontal resolution of the video content and the vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns of each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows of each frame of the video content;
[0026] A content conversion device, connected to the data analysis device, for determining the number of searches based on the horizontal resolution of the video content and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined;
[0027] a cloud computing server connected to the content conversion device, configured to use, for each image to be inter-frame coded of the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;
[0028] a coding processing device connected to the cloud computing server, and configured to select a frame to be selected from the plurality of frames to be selected, the frame having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame coded as a reference frame for performing inter-frame coding on the image to be inter-frame coded, so as to perform inter-frame coding on the image to be inter-frame coded;
[0029] Among them, for each image to be inter-frame coded of the video content, using multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, and the number of the multiple coded images before the image to be inter-frame coded is equal to the search number includes: using a uniform skip frame selection method to use the multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image;
[0030] The method of uniformly skipping frames to select multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the image to be inter-frame coded includes: obtaining each frame to be selected that is immediately before the image to be inter-frame coded and adjacent to the image to be inter-frame coded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected at intervals of a set number of frames;
[0031] Wherein, determining the search quantity based on the horizontal resolution of the video content and the vertical resolution of the video content, the lower the horizontal resolution of the video content, the smaller the determined search quantity, and the lower the vertical resolution of the video content, the smaller the determined search quantity includes: using a two-input and one-output data mapping formula to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity;
[0032] Compared with implementation scheme A, the cloud computing service system using the uniform skip frame selection mode shown in implementation scheme B of the present invention may also include:
[0033] a clock generating component, which is arranged near the signal receiving device, the data analyzing device, the content converting device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content converting device and the encoding processing device respectively;
[0034] Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.
[0035] Compared with implementation scheme A, the cloud computing service system using the uniform skip frame selection mode shown in implementation scheme C of the present invention may further include:
[0036] a heat dissipation processing component, which is disposed near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively;
[0037] Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.
[0038] Next, the specific structure of the cloud computing service system applying the uniform jump frame selection mode of the present invention is further described.
[0039] In a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0040] An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
[0041] In a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0042] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
[0043] In a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0044] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
[0045] In a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0046] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
[0047] And in a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0048] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
[0049] In addition, in the cloud computing service system that applies the uniform jump frame selection mode, a two-input and one-output data mapping formula is used to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity, including: in the two-input and one-output data mapping formula, the horizontal resolution of the video content and the vertical resolution of the video content are two input parameters of the two-input and one-output data mapping formula, and the determined search quantity is a single output parameter of the two-input and one-output data mapping formula.
[0050] The cloud computing service system using the uniform jump frame selection mode of the present invention can determine the search number of reference frames selected for inter-frame coding based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content in the inter-frame coding mechanism based on cloud computing, and use the uniform jump frame selection method to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby improving the coding effect of the inter-frame coding processing.
[0051] The present invention has been described in great detail above, so that after reading and understanding this specification, various changes and modifications of the present invention will become obvious to those skilled in the art. Therefore, all such changes and modifications are also included in this invention, and therefore they are within the scope of protection of the claims.
Claims
1. A cloud computing service system using a uniform jump frame selection mode, characterized in that: The system comprises: A signal receiving device, used for receiving video content that performs inter-frame coding, wherein the video content is composed of an image sequence, and the image sequence includes a plurality of frames of images that are continuously distributed on a time axis; A data analysis device connected to the signal receiving device, used for analyzing the horizontal resolution of the video content and the vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns of each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows of each frame of the video content; A content conversion device, connected to the data analysis device, for determining the number of searches based on the horizontal resolution of the video content and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined; Wherein, a two-input-one-output data mapping formula is used to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity; a cloud computing server connected to the content conversion device, configured to use, for each image to be inter-frame coded of the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number; a coding processing device connected to the cloud computing server, and configured to select a frame to be selected from the plurality of frames to be selected, the frame having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame coded as a reference frame for performing inter-frame coding on the image to be inter-frame coded, so as to perform inter-frame coding on the image to be inter-frame coded; Among them, for each image to be inter-frame coded of the video content, using multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, and the number of the multiple coded images before the image to be inter-frame coded is equal to the search number includes: using a uniform skip frame selection method to use the multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image; Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately before the image to be inter-frame encoded and adjacent to the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.
2. The cloud computing service system using the uniform jump frame selection mode according to claim 1, characterized in that: The system further comprises: a clock generating component, which is arranged near the signal receiving device, the data analyzing device, the content converting device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content converting device and the encoding processing device respectively; Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.
3. The cloud computing service system using the uniform jump frame selection mode according to claim 1, characterized in that: The system further comprises: a heat dissipation processing component, which is disposed near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively; Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.
4. The cloud computing service system using the uniform jump frame selection mode according to any one of claims 1 to 3, characterized in that: An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
5. The cloud computing service system using the uniform skip frame selection mode as claimed in claim 4, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
6. The cloud computing service system using the uniform skip frame selection mode according to claim 4, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
7. The cloud computing service system using the uniform skip frame selection mode according to claim 4, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
8. The cloud computing service system using the uniform skip frame selection mode as claimed in claim 4, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
Citation Information
Patent Citations
Dynamic reference frame reordering for frame sequential stereoscopic video encoding
CN102598673A
Video encoding method and device, video decoding method and device, terminal, server and storage medium
CN108495130A