Cloud computing service system applying uniform jump frame selection mode
By adopting the reference frame selection of uniform jump frame selection mode and signal-to-noise ratio matching in cloud computing, the problem of rigid inter-frame encoding mechanism is solved, and flexible encoding processing of variable image content is realized, which improves the encoding effect.
Patent Information
- Application Number
- CN202410955073.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-17
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-07-17
AI Technical Summary
The existing inter-frame encoding mechanism based on cloud computing is too rigid when searching for reference frames and cannot adapt to the varied image content of the frame to be executed, resulting in poor encoding effect.
Using the uniform jump frame selection mode, determine the number of searches based on the horizontal resolution and vertical resolution of the image to be encoded between frames, and select frames with close signal-to-noise ratio from the previous coded images as reference frames, and select frames by uniform jump Inter-frame encoding processing is performed.
The encoding effect of inter-frame encoding processing is improved, adaptive encoding processing of video contents of different resolutions is realized, and encoding quality is improved.
Abstract
Description
Technical Field
[0001] The present invention relates to the field of cloud computing, and in particular to a cloud computing service system applying a uniform jump frame selection mode. Background Art
[0002] The value of cloud computing lies in its high flexibility, scalability, and high performance-to-price ratio. Compared with traditional network application models, it has the following advantages and characteristics:
[0003] 1. Virtualization technology: It must be emphasized that virtualization breaks through the boundaries of time and space and is the most significant feature of cloud computing. Virtualization technology includes application virtualization and resource virtualization. As we all know, the physical platform and the application deployment environment have no spatial connection. It is through the virtual platform that data backup, migration, and expansion are completed for the corresponding terminal operations.
[0004] 2. Dynamic scalability: Cloud computing has efficient computing capabilities. Adding cloud computing functions to the original server can rapidly increase the computing speed, and ultimately achieve the dynamic expansion of the virtualization level to achieve the purpose of expanding applications.
[0005] 3. On-demand deployment: Computers contain many applications, program software, etc. Different applications correspond to different data resource libraries, so users need strong computing power to deploy resources when running different applications. Cloud computing platforms can quickly allocate computing power and resources according to user needs.
[0006] 4. High flexibility: Currently, most IT resources, software, and hardware on the market support virtualization, such as storage networks, operating systems, and development software and hardware. Virtualization elements are uniformly managed in the cloud system resource virtual pool. It can be seen that cloud computing has strong compatibility. It is not only compatible with low-configuration machines and hardware products from different manufacturers, but also enables peripherals to achieve higher-performance computing.
[0007] As can be seen, cloud computing is widely used due to its aforementioned advantages, for example, in inter-frame coding of large amounts of image data. However, existing cloud-based inter-frame coding mechanisms use a set search range when searching for reference frames, and perform a frame-by-frame search within the set search range. This overly rigid inter-frame coding mechanism is clearly unable to adapt to the changing image content of the current frame to be inter-coded, resulting in suboptimal coding results. Summary of the Invention
[0008] In order to solve the technical problems in related fields, the present invention provides a cloud computing service system that applies a uniform jump frame selection mode. In the inter-frame coding mechanism based on cloud computing, the search number of reference frames selected as inter-frame coding is determined based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content, and a uniform jump frame selection method is used to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby completing adaptive inter-frame coding processing of video content with different resolutions and improving the coding effect of the inter-frame coding processing.
[0009] According to the present invention, a cloud computing service system using a uniform skip frame selection mode is provided, the system comprising:
[0010] A signal receiving device, configured to receive video content that is inter-frame coded, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;
[0011] a data analysis device connected to the signal receiving device, and configured to analyze the horizontal resolution and vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns in each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows in each frame of the video content;
[0012] a content conversion device connected to the data analysis device, configured to determine a search quantity based on a horizontal resolution of the video content and a vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the determined search quantity, and the lower the vertical resolution of the video content, the smaller the determined search quantity;
[0013] a cloud computing server connected to the content conversion device, configured to, for each image to be inter-frame coded in the video content, use a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;
[0014] an encoding processing device connected to the cloud computing server, configured to select, from the plurality of frames to be selected, a frame to be selected having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame encoded as a reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded;
[0015] The step of selecting, for each image to be inter-frame coded in the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of coded images preceding the image to be inter-frame coded is equal to the search number, includes: selecting the plurality of coded images preceding the image to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded image by uniformly skipping frame selection;
[0016] Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately adjacent to the image to be inter-frame encoded before the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.
[0017] It can be seen that the present invention has at least the following important invention points:
[0018] First, for each image to be inter-coded in the video content, the number of search frames selected as reference frames for inter-coding is determined based on the horizontal resolution and vertical resolution of the video content. The lower the horizontal resolution of the video content, the smaller the number of search frames determined, and the lower the vertical resolution of the video content, the smaller the number of search frames determined, thereby completing adaptive inter-coding processing for video content with different resolutions.
[0019] Secondly: for each picture to be inter-frame coded in the video content, a plurality of coded pictures preceding the picture to be inter-frame coded are used as a plurality of frames to be selected for the inter-frame coded picture, where the number of the plurality of coded pictures preceding the picture to be inter-frame coded is equal to the search number, wherein a uniform skipping frame selection method is used to select the plurality of coded pictures preceding the picture to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded picture;
[0020] Again: from the multiple frames to be selected obtained by the uniform jump frame selection method, select the frame to be selected whose signal-to-noise ratio is closest to the signal-to-noise ratio of the image to be inter-frame encoded as the reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded. DETAILED DESCRIPTION
[0021] The following is a detailed description of an implementation scheme of a cloud computing service system using a uniform skip frame selection mode according to the present invention.
[0022] According to embodiment A of the present invention, a cloud computing service system using a uniform skip frame selection mode includes:
[0023] A signal receiving device, configured to receive video content that is inter-frame encoded, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images that are continuously distributed on a time axis;
[0024] For example, a signal receiving device is configured to receive video content that performs inter-frame coding, wherein the video content is composed of an image sequence, wherein the image sequence includes a plurality of frames of images continuously distributed on a time axis. The signal receiving device includes a built-in content receiving component and a frame counting component, wherein the content receiving component is connected to the frame counting component.
[0025] a data analysis device connected to the signal receiving device, and configured to analyze the horizontal resolution and vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns in each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows in each frame of the video content;
[0026] a content conversion device connected to the data analysis device, configured to determine a search quantity based on a horizontal resolution of the video content and a vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the determined search quantity, and the lower the vertical resolution of the video content, the smaller the determined search quantity;
[0027] a cloud computing server connected to the content conversion device, configured to, for each image to be inter-frame coded in the video content, use a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number;
[0028] an encoding processing device connected to the cloud computing server, configured to select, from the plurality of frames to be selected, a frame to be selected having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame encoded as a reference frame for performing inter-frame encoding on the image to be inter-frame encoded, so as to perform inter-frame encoding on the image to be inter-frame encoded;
[0029] The step of selecting, for each image to be inter-frame coded in the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of coded images preceding the image to be inter-frame coded is equal to the search number, includes: selecting the plurality of coded images preceding the image to be inter-frame coded as the plurality of frames to be selected for the inter-frame coded image by uniformly skipping frame selection;
[0030] The method of selecting multiple coded images preceding the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image by uniformly skipping frames comprises: obtaining frames to be selected that are immediately preceding the image to be inter-frame coded and adjacent to the image to be inter-frame coded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames;
[0031] The determining of the number of searches based on the horizontal resolution and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined, includes: using a two-input-one-output data mapping formula to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content, the vertical resolution of the video content, and the determined number of searches;
[0032] Compared to embodiment A, the cloud computing service system using the uniform skip frame selection mode shown in embodiment B of the present invention may further include:
[0033] a clock generating component, disposed near the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device and connected to the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device, respectively;
[0034] Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.
[0035] Compared to embodiment A, the cloud computing service system using the uniform skip frame selection mode shown in embodiment C of the present invention may further include:
[0036] a heat dissipation processing component, disposed near the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device and connected to the signal receiving device, the data analyzing device, the content converting device, and the encoding processing device, respectively;
[0037] Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.
[0038] Next, the specific structure of the cloud computing service system applying the uniform skip frame selection mode of the present invention will be further described.
[0039] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:
[0040] An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
[0041] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:
[0042] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
[0043] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:
[0044] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
[0045] In a cloud computing service system using a uniform skip frame selection mode according to various embodiments of the present invention:
[0046] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
[0047] And in a cloud computing service system applying a uniform skip frame selection mode according to various embodiments of the present invention:
[0048] The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
[0049] In addition, in the cloud computing service system that applies the uniform jump frame selection mode, a two-input and one-output data mapping formula is used to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity, including: in the two-input and one-output data mapping formula, the horizontal resolution of the video content and the vertical resolution of the video content are two input parameters of the two-input and one-output data mapping formula, and the determined search quantity is a single output parameter of the two-input and one-output data mapping formula.
[0050] The cloud computing service system using the uniform jump frame selection mode of the present invention addresses the technical problems in the prior art that the inter-frame coding mechanism is not flexible enough and has insufficient adaptability. In the inter-frame coding mechanism based on cloud computing, the system can determine the search number of reference frames selected as inter-frame coding based on the horizontal resolution of the video content of the image to be inter-frame coded and the vertical resolution of the video content, and use the uniform jump frame selection method to use multiple encoded images corresponding to the search number before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, thereby improving the coding effect of the inter-frame coding processing.
[0051] The present invention has been described in sufficient detail above that various changes and modifications of the present invention will become apparent to those skilled in the art upon reading and understanding this specification. It is intended that all such changes and modifications be included in this invention and fall within the scope of the claims.
Claims
1. A cloud computing service system using a uniform jump frame selection mode, characterized in that: The system comprises: A signal receiving device, used for receiving video content that performs inter-frame coding, wherein the video content is composed of an image sequence, and the image sequence includes a plurality of frames of images that are continuously distributed on a time axis; A data analysis device connected to the signal receiving device, used for analyzing the horizontal resolution of the video content and the vertical resolution of the video content, wherein the horizontal resolution of the video content is the total number of pixel columns of each frame of the video content, and the vertical resolution of the video content is the total number of pixel rows of each frame of the video content; A content conversion device, connected to the data analysis device, for determining the number of searches based on the horizontal resolution of the video content and the vertical resolution of the video content, wherein the lower the horizontal resolution of the video content, the smaller the number of searches determined, and the lower the vertical resolution of the video content, the smaller the number of searches determined; a cloud computing server connected to the content conversion device, configured to use, for each image to be inter-frame coded of the video content, a plurality of coded images preceding the image to be inter-frame coded as a plurality of frames to be selected for the inter-frame coded image, wherein the number of the plurality of coded images preceding the image to be inter-frame coded is equal to the search number; a coding processing device connected to the cloud computing server, and configured to select a frame to be selected from the plurality of frames to be selected, the frame having a signal-to-noise ratio closest to the signal-to-noise ratio of the image to be inter-frame coded as a reference frame for performing inter-frame coding on the image to be inter-frame coded, so as to perform inter-frame coding on the image to be inter-frame coded; Among them, for each image to be inter-frame coded of the video content, using multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image, and the number of the multiple coded images before the image to be inter-frame coded is equal to the search number includes: using a uniform skip frame selection method to use the multiple coded images before the image to be inter-frame coded as multiple frames to be selected for the inter-frame coded image; Among them, using a uniform jump frame selection method to use multiple encoded images before the image to be inter-frame encoded as multiple frames to be selected for the inter-frame encoded image includes: obtaining each frame to be selected that is immediately before the image to be inter-frame encoded and adjacent to the image to be inter-frame encoded, and determining the multiple frames to be selected by selecting one frame as a single frame to be selected every set number of frames.
2. The cloud computing service system using the uniform skip frame selection mode according to claim 1, characterized in that: The search quantity is determined based on the horizontal resolution of the video content and the vertical resolution of the video content, the lower the horizontal resolution of the video content, the smaller the determined search quantity is, and the lower the vertical resolution of the video content, the smaller the determined search quantity is. This includes: using a two-input and one-output data mapping formula to represent a two-to-one numerical mapping relationship between the horizontal resolution of the video content and the vertical resolution of the video content and the determined search quantity.
3. The cloud computing service system using the uniform jump frame selection mode as claimed in claim 2, characterized in that: The system further comprises: a clock generating component, which is arranged near the signal receiving device, the data analyzing device, the content converting device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content converting device and the encoding processing device respectively; Among them, the clock generating component is arranged near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device, including: the clock generating component is used to provide the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device with their respective required working clock sequences.
4. The cloud computing service system using the uniform jump frame selection mode according to claim 2, characterized in that: The system further comprises: a heat dissipation processing component, which is disposed near the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device and is connected to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively; Among them, the heat dissipation processing component is arranged near the signal receiving device, the data analysis device, the content conversion device and the encoding processing device and is respectively connected to the signal receiving device, the data analysis device, the content conversion device and the encoding processing device, including: the heat dissipation processing component includes multiple cooling fans, which are used to provide the required heat dissipation services for the signal receiving device, the data analysis device, the content conversion device and the encoding processing device respectively.
5. The cloud computing service system using the uniform jump frame selection mode according to any one of claims 2 to 4, characterized in that: An image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
6. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing trap filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
7. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing band-stop filtering processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
8. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively, including: performing cubic polynomial interpolation processing on the output data of the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data analyzing device, the content conversion device and the encoding processing device respectively.
9. The cloud computing service system using the uniform skip frame selection mode according to claim 5, characterized in that: The image quality enhancement mechanism is used to perform image data processing on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively, including: performing vertical sharpening on the output data of the signal receiving device, the data parsing device, the content conversion device and the encoding processing device to obtain the output processing data corresponding to the signal receiving device, the data parsing device, the content conversion device and the encoding processing device respectively.
Citation Information
Patent Citations
Dynamic reference frame reordering for frame sequential stereoscopic video encoding
CN102598673A
Video encoding method and device, video decoding method and device, terminal, server and storage medium
CN108495130A
Video encoding method and device, electronic equipment and readable storage medium
CN111741298A
Dynamic compression coding computer algorithm operating system
CN116405682A
Ultrahigh-definition video coding acceleration algorithm based on SVT-AVS3
CN117896537A
Cited By
Intelligent water meter remote data dynamic processing system
CN119762390A
