Cloud computing service system applying uniform jump frame selection mode

By adopting the reference frame selection of uniform jump frame selection mode and signal-to-noise ratio matching in cloud computing, the problem of rigid inter-frame encoding mechanism is solved, and flexible encoding processing of variable image content is realized, which improves the encoding effect.

CN118984318AActive Publication Date: 2024-11-19山东怡然信息技术有限公司

Patent Information

Application Number
CN202410955073.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-17
Publication Date
2024-11-19
Estimated Expiration
2044-07-17

AI Technical Summary

Technical Problem

The existing inter-frame encoding mechanism based on cloud computing is too rigid when searching for reference frames and cannot adapt to the varied image content of the frame to be executed, resulting in poor encoding effect.

Method used

Using the uniform jump frame selection mode, determine the number of searches based on the horizontal resolution and vertical resolution of the image to be encoded between frames, and select frames with close signal-to-noise ratio from the previous coded images as reference frames, and select frames by uniform jump Inter-frame encoding processing is performed.

Benefits of technology

The encoding effect of inter-frame encoding processing is improved, adaptive encoding processing of video contents of different resolutions is realized, and encoding quality is improved.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to a cloud computing service system applying a uniform jump frame selection mode, and the system comprises a cloud computing server which is used for taking a plurality of coded images before an inter-frame coding image as a plurality of to-be-selected frames of the inter-frame coding image, and the number of the plurality of coded images is equal to the search number determined in a targeted manner; and the coding processing device is used for selecting the to-be-selected frame with the signal-to-noise ratio closest to the signal-to-noise ratio of the to-be-inter-coded image as a reference frame for performing inter-coding on the to-be-inter-coded image. According to the invention, in an inter-frame coding mechanism based on cloud computing, the search number of reference frames selected as inter-frame coding can be determined based on the horizontal resolution and the vertical resolution of the video content of the image to be inter-frame coded; and a plurality of coded images corresponding to the search number before the to-be-interframe coded image are used as a plurality of to-be-selected frames of the interframe coded image by adopting a uniform jump frame selection mode, so that the coding effect of the interframe coding processing is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of cloud computing, and in particular to a cloud computing service system applying a uniform jump frame selection mode. Background Art

[0002] The value of cloud computing lies in its high flexibility, scalability, and high performance-to-price ratio. Compared with traditional network application models, it has the following advantages and characteristics:

[0003] 1. Virtualization technology: It must be emphasized that virtualization breaks through the boundaries of time and space and is the most significant feature of cloud computing. Virtualization technology includes application virtualization and resource virtualization. As we all know, the physical platform and the application deployment environment have no spatial connection. It is through the virtual platform that data backup, migration, and expansion are completed for the corresponding terminal operations.

[0004] 2. Dynamic scalability: Cloud computing has efficient computing capabilities. Adding cloud computing functions to the original server can rapidly increase the computing speed, and ultimately achieve the dynamic expansion of the virtualization level to achieve the purpose of expanding applications.

[0005] 3. On-demand deployment: Computers contain many applications, program software, etc. Different applications correspond to different data resource libraries, so users need strong computing power to deploy resources when running different applications. Cloud computing platforms can quickly allocate computing power and resources according to user needs.

[0006] 4. High flexibility: Currently, most IT resources, software, and hardware on the market support virtualization, such as storage networks, operating systems, and development software and hardware. Virtualization elements are uniformly managed in the cloud system resource virtual pool. It can be seen that cloud computing has strong compatibility. It is not only compatible with low-configuration machines and hardware products from different manufacturers, but also enables peripherals to achieve higher-performance computing.

[0007] As can be seen, cloud computing is widely used due to its aforementioned advantages, for example, in inter-frame coding of large amounts of image data. However, existing cloud-based inter-frame coding mechanisms use a set search range when searching for reference frames, and perform a frame-by-frame search within the set search range. This overly rigid inter-frame coding mechanism is clearly unable to adapt to the changing image content of the current frame to be inter-coded, resulting in suboptimal coding results. Summary of the Invention

[0008] In order to solve the technical problems in related fields, the present invention provides a cloud computing service system that applies a uniform jump frame selection mode. In the inter-frame coding mechanism based on cloud computing, the search number of reference frames selected as inter-frame coding is determined based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content, and a uniform jump frame selection method is used to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby completing adaptive inter-frame coding processing of video content with different resolutions and improving the coding effect of the inter-frame coding processing.

[0009] According to the present invention, a cloud computing service system using a uniform skip frame selection mode is provided, the system comprising:

[0010] A signal receiving device, configured to receive video content that is inter-frame coded, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;

[0011] a data analysis device connected to the signal receiving device, and configured to analyze the horizontal resolution and vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns in each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows in each frame of the video content;

[0012] a content conversion device connected to the data analysis device, configured to determine a search quantity based on a horizontal resolution of the video content and a vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the determined search quantity, and the lower the vertical resolution of the video content, the smaller the determined search quantity;

[0013] a cloud computing server connected to the content conversion device, configured to, for each image to be inter-frame coded in the video content, use a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;

[0014] an encoding processing device connected to the cloud computing server, configured to select, from the plurality of frames to be selected, a frame to be selected having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame encoded as a reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded;

[0015] The step of selecting, for each image to be inter-frame coded in the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of coded images preceding the image to be inter-frame coded is equal to the search number, includes: selecting the plurality of coded images preceding the image to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded image by uniformly skipping frame selection;

[0016] Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately adjacent to the image to be inter-frame encoded before the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.

[0017] It can be seen that the present invention has at least the following important invention points:

[0018] First, for each image to be inter-coded in the video content, the number of search frames selected as reference frames for inter-coding is determined based on the horizontal resolution and vertical resolution of the video content. The lower the horizontal resolution of the video content, the smaller the number of search frames determined, and the lower the vertical resolution of the video content, the smaller the number of search frames determined, thereby completing adaptive inter-coding processing for video content with different resolutions.

[0019] Secondly: for each picture to be inter-frame coded in the video content, a plurality of coded pictures preceding the picture to be inter-frame coded are used as a plurality of frames to be selected for the inter-frame coded picture, where the number of the plurality of coded pictures preceding the picture to be inter-frame coded is equal to the search number, wherein a uniform skipping frame selection method is used to select the plurality of coded pictures preceding the picture to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded picture;

[0020] Again: from the multiple frames to be selected obtained by the uniform jump frame selection method, select the frame to be selected whose signal-to-noise ratio is closest to the signal-to-noise ratio of the image to be inter-frame encoded as the reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded. DETAILED DESCRIPTION

[0021] The following is a detailed description of an implementation scheme of a cloud computing service system using a uniform skip frame selection mode according to the present invention.

[0022] According to embodiment A of the present invention, a cloud computing service system using a uniform skip frame selection mode includes:

[0023] A signal receiving device, configured to receive video content that is inter-frame encoded, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;

[0024] For example, a signal receiving device is configured to receive video content that performs inter-frame coding, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images continuously distributed on a time axis. The signal receiving device includes a built-in content receiving component and a frame counting component, wherein the content receiving component is connected to the frame counting component.

[0025] a data analysis device connected to the signal receiving device, and configured to analyze the horizontal resolution and vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns in each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows in each frame of the video content;

[0026] a content conversion device connected to the data analysis device, configured to determine a search quantity based on a horizontal resolution of the video content and a vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the determined search quantity, and the lower the vertical resolution of the video content, the smaller the determined search quantity;

[0027] a cloud computing server connected to the content conversion device, configured to, for each image to be inter-frame coded in the video content, use a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;

[0028] an encoding processing device connected to the cloud computing server, configured to select, from the plurality of frames to be selected, a frame to be selected having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame encoded as a reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded;

[0029] The step of selecting, for each image to be inter-frame coded in the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of coded images preceding the image to be inter-frame coded is equal to the search number, includes: selecting the plurality of coded images preceding the image to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded image by uniformly skipping frame selection;

[0030] The method of selecting multiple coded images preceding the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image by uniformly skipping frames comprises: obtaining frames to be selected that are immediately preceding the image to be inter-frame coded and adjacent to the image to be inter-frame coded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames;

[0031] The determining of the number of searches based on the horizontal resolution and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined, includes: using a two-input-one-output data mapping formula to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content, the vertical resolution of the video content, and the determined number of searches;

[0032] Compared to embodiment A, the cloud computing service system using the uniform skip frame selection mode shown in embodiment B of the present invention may further include:

[0033] a clock generating component, disposed near the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device and connected to the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device, respectively;

[0034] Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.

[0035] Compared to embodiment A, the cloud computing service system using the uniform skip frame selection mode shown in embodiment C of the present invention may further include:

[0036] a heat dissipation processing component, disposed near the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device and connected to the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device, respectively;

[0037] Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.

[0038] Next, the specific structure of the cloud computing service system applying the uniform skip frame selection mode of the present invention will be further described.

[0039] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:

[0040] An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.

[0041] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:

[0042] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.

[0043] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:

[0044] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.

[0045] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:

[0046] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.

[0047] And in a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:

[0048] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.

[0049] In addition, in the cloud computing service system that applies the uniform jump frame selection mode, a two-input and one-output data mapping formula is used to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity, including: in the two-input and one-output data mapping formula, the horizontal resolution of the video content and the vertical resolution of the video content are two input parameters of the two-input and one-output data mapping formula, and the determined search quantity is a single output parameter of the two-input and one-output data mapping formula.

[0050] The cloud computing service system using the uniform jump frame selection mode of the present invention addresses the technical problems in the prior art that the inter-frame coding mechanism is not flexible enough and has insufficient adaptability. In the inter-frame coding mechanism based on cloud computing, the system can determine the search number of reference frames selected as inter-frame coding based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content, and use the uniform jump frame selection method to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby improving the coding effect of the inter-frame coding processing.

[0051] The present invention has been described in sufficient detail above that various changes and modifications of the present invention will become apparent to those skilled in the art upon reading and understanding this specification. It is intended that all such changes and modifications be included in this invention and fall within the scope of the claims.

Claims

1. A cloud computing service system using a uniform jump frame selection mode, characterized in that: The system comprises: A signal receiving device, used for receiving video content that performs inter-frame coding, wherein the video content is composed of an image sequence, and the image sequence includes a plurality of frames of images that are continuously distributed on a time axis; A data analysis device connected to the signal receiving device, used for analyzing the horizontal resolution of the video content and the vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns of each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows of each frame of the video content; A content conversion device, connected to the data analysis device, for determining the number of searches based on the horizontal resolution of the video content and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined; a cloud computing server connected to the content conversion device, configured to use, for each image to be inter-frame coded of the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number; a coding processing device connected to the cloud computing server, and configured to select a frame to be selected from the plurality of frames to be selected, the frame having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame coded as a reference frame for performing inter-frame coding on the image to be inter-frame coded, so as to perform inter-frame coding on the image to be inter-frame coded; Among them, for each image to be inter-frame coded of the video content, using multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, and the number of the multiple coded images before the image to be inter-frame coded is equal to the search number includes: using a uniform skip frame selection method to use the multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image; Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately before the image to be inter-frame encoded and adjacent to the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.

2. The cloud computing service system using the uniform skip frame selection mode according to claim 1, characterized in that: The search quantity is determined based on the horizontal resolution of the video content and the vertical resolution of the video content, the lower the horizontal resolution of the video content, the smaller the determined search quantity is, and the lower the vertical resolution of the video content, the smaller the determined search quantity is. This includes: using a two-input and one-output data mapping formula to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity.

3. The cloud computing service system using the uniform jump frame selection mode as claimed in claim 2, characterized in that: The system further comprises: a clock generating component, which is arranged near the signal receiving device, the data analyzing device, the content converting device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content converting device and the encoding processing device respectively; Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.

4. The cloud computing service system using the uniform jump frame selection mode according to claim 2, characterized in that: The system further comprises: a heat dissipation processing component, which is disposed near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively; Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.

5. The cloud computing service system using the uniform jump frame selection mode according to any one of claims 2 to 4, characterized in that: An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.

6. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.

7. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.

8. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.

9. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.

Citation Information

Patent Citations

  • Dynamic reference frame reordering for frame sequential stereoscopic video encoding

    CN102598673A

  • Video encoding method and device, video decoding method and device, terminal, server and storage medium

    CN108495130A

  • Video encoding method and device, electronic equipment and readable storage medium

    CN111741298A

  • Dynamic compression coding computer algorithm operating system

    CN116405682A

  • Ultrahigh-definition video coding acceleration algorithm based on SVT-AVS3

    CN117896537A

Cited By

  • Intelligent water meter remote data dynamic processing system

    CN119762390A