Video customization search system

Abstract

The invention relates to a video customized search system, which comprises a customized search device, which is used for determining the search range of a reference frame selected when the current frame is subjected to inter-frame coding by searching forward from the current frame in a video sequence based on the complexity level of the current frame obtained by targeted analysis, and the lower the complexity level of the current frame is, the lower the reference frame is. The narrower the search range of the forward search for the reference frame for performing inter-frame coding is; and the coding execution device is used for searching a reference frame of the current frame based on the determined search range and executing inter-frame coding operation on the current frame based on the reference frame. According to the method and the device, on the basis of pertinently analyzing the complexity level of each frame, the current frame is dynamically selected according to the complexity level of the current frame to be subjected to inter-frame coding to search the search range of the reference frame for executing inter-frame coding forwards, so that the inter-frame coding effect of each frame is ensured, and the inter-frame coding efficiency is improved. And the operation cost and the time cost of inter-frame coding are reduced as much as possible.

Description

Technical Field

[0001] The present invention relates to the field of video search, and in particular to a video customized search system. Background Art

[0002] Intraframe coding is a compression technique that exploits the spatiotemporal correlations between consecutive frames in a video sequence.

[0003] The basic principle of intra-frame coding is to predict the value of the pixel in the current frame (target frame) by using the previous reference frame and the prediction error (residual) for encoding. The prediction error is compressed through methods such as differential coding and quantization, and the predicted pixel value is reconstructed through transmission between the encoder and decoder. The development of intra-frame coding technology has gone through early motion estimation-based methods, optimization and expansion in advanced stages, and further development and optimization in modern stages such as H.264 and H.265.

[0004] When searching forward for a reference frame in a video frame sequence where the current frame to be inter-frame coded is located, the determination of the forward search range, that is, how many video frames that have completed inter-frame coding are searched forward, needs to be flexibly determined according to the image content of the different current frames. If the search is too far, a lot of time and computing costs may be consumed, and if the search is too close, the reference frame that is most suitable for the inter-frame coding of the current frame may not be obtained. The inter-frame coding mechanism that adopts a fixed search range in the prior art is obviously unable to adapt to the flexible and changeable image content of the current frame. Summary of the invention

[0005] In order to solve the technical problems in the prior art, the present invention provides a video customized search system, which can dynamically select the search range of the reference frame for forward searching to perform inter-frame coding of the current frame based on the targeted analysis of the complexity level of each frame according to the complexity level of the current frame to be inter-frame coding. The lower the complexity level of the current frame, the narrower the search range of the reference frame for forward searching to perform inter-frame coding. This ensures the inter-frame coding effect of each frame while minimizing the computational cost and time cost of inter-frame coding.

[0006] According to the present invention, a video customized search system is provided, the system comprising: A data analysis device, configured to perform complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of a plurality of frames including the current frame and the plurality of frames respectively correspond to a plurality of time stamps; a customized search device connected to the data analysis device, for determining, based on the received complexity level of the current frame, a search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame, wherein the lower the complexity level of the current frame, the narrower the search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame; A coding execution device, connected to the customized search device, configured to search for a reference frame of the current frame based on a search range determined by the customized search device, and perform an inter-frame coding operation on the current frame based on the searched reference frame; Wherein, determining, based on the complexity level of the received current frame, a search range for selecting a reference frame in the video sequence by searching forward from the current frame when performing inter-frame coding on the current frame comprises: the search range is numerically represented by the number of coded frames searched before the current frame in the video sequence; The search range is numerically represented by the number of encoded frames searched before the current frame in the video sequence, including: the narrower the search range, the fewer the number of encoded frames searched before the current frame in the video sequence; Wherein, performing complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, the video sequence being composed of a plurality of frames including the current frame and the plurality of frames corresponding to a plurality of time stamps respectively, comprises: obtaining respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values; Wherein, obtaining respective red color channel values ​​respectively corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​comprises: the smaller the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​is, the lower the complexity level of the determined current frame is; Wherein, complexity analysis is performed on the current frame in the video sequence to obtain the complexity level of the current frame, the video sequence is composed of multiple frames including the current frame and the multiple frames correspond to multiple timestamps respectively, and further includes: the multiple timestamps are evenly arranged on the time axis.

[0007] It can be seen that the present invention has at least the following three important inventive features: Invention point 1: Based on the complexity level of the current frame to be inter-frame coded, the search range of the reference frame for forward searching of the current frame for inter-frame coded is dynamically selected. The lower the complexity level of the current frame, the narrower the search range of the reference frame for forward searching of inter-frame coded, thereby minimizing the computational cost and time cost of inter-frame coded while ensuring the inter-frame coded effect of each frame; Invention point 2: obtaining respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining a complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values; Invention point three: Specifically, the smaller the ratio of the number of multiple red color channel values ​​to the number of each red color channel value is, the lower the complexity level of the current frame is determined to be, thereby completing customized analysis processing of the complexity level of each frame, and improving the analysis accuracy of the complexity level of each frame in a pixel analysis mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The embodiments of the present invention will be described below with reference to the accompanying drawings, wherein:

[0009] Figure 1 It is a structural block diagram of a video customized search system according to implementation scheme A of the present invention.

[0010] Figure 2 It is a structural block diagram of a video customized search system according to Embodiment B of the present invention.

[0011] Figure 3 It is a structural block diagram of a video customized search system according to implementation scheme C of the present invention. DETAILED DESCRIPTION

[0012] The implementation scheme of the video customized search system of the present invention will be described in detail below with reference to the accompanying drawings.

[0013] Figure 1 The structure block diagram of the video customized search system according to the A embodiment of the present invention is shown, and the system includes: A data analysis device, configured to perform complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of a plurality of frames including the current frame and the plurality of frames respectively correspond to a plurality of time stamps; For example, a data analysis device for performing complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of multiple frames including the current frame and the multiple frames respectively correspond to multiple timestamps, comprises: selecting to use a MATLAB toolbox to perform a simulation and test of a data processing process of performing complexity analysis on the current frame in the video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of multiple frames including the current frame and the multiple frames respectively correspond to multiple timestamps; a customized search device connected to the data analysis device, for determining, based on the received complexity level of the current frame, a search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame, wherein the lower the complexity level of the current frame, the narrower the search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame; A coding execution device, connected to the customized search device, configured to search for a reference frame of the current frame based on a search range determined by the customized search device, and perform an inter-frame coding operation on the current frame based on the searched reference frame; Wherein, determining, based on the complexity level of the received current frame, a search range for selecting a reference frame in the video sequence by searching forward from the current frame when performing inter-frame coding on the current frame comprises: the search range is numerically represented by the number of coded frames searched before the current frame in the video sequence; The search range is numerically represented by the number of encoded frames searched before the current frame in the video sequence, including: the narrower the search range, the fewer the number of encoded frames searched before the current frame in the video sequence; Wherein, performing complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, the video sequence being composed of a plurality of frames including the current frame and the plurality of frames corresponding to a plurality of time stamps respectively, comprises: obtaining respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values; Wherein, obtaining respective red color channel values ​​respectively corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​comprises: the smaller the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​is, the lower the complexity level of the determined current frame is; The method further comprises: performing complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of multiple frames including the current frame and the multiple frames correspond to multiple time stamps respectively, and further comprising: evenly arranging the multiple time stamps on a time axis; Wherein, obtaining respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​further comprises: each pixel point of the current frame has a single red color channel value, a single green color channel value, and a single blue color channel value in an RGB color space; And wherein, the smaller the ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values, the lower the complexity level of the determined current frame is, including: using a numerical mapping formula to represent the numerical correspondence between the ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values ​​and the numerical correspondence between the complexity level of the determined current frame.

[0014] Figure 2 It is a structural block diagram of a video customized search system according to Embodiment B of the present invention.

[0015] Compared with the A embodiment, the video customized search system shown in the B embodiment of the present invention may also include: An on-site storage device, connected to the data analysis device, the customized search device and the coding execution device respectively, for providing data temporary storage services for the data analysis device, the customized search device and the coding execution device in a time-sharing manner; The on-site storage device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to provide data temporary storage services for the data analysis device, the customized search device and the coding execution device in a time-sharing manner, including: the data analysis device, the customized search device and the coding execution device are connected to the on-site storage device respectively using different data channels; Among them, the field storage device is connected to the data analysis device, the customized search device and the encoding execution device respectively, and is used to provide data temporary storage services for the data analysis device, the customized search device and the encoding execution device in a time-sharing manner, including: the data analysis device, the customized search device and the encoding execution device use the same reference clock signal.

[0016] Figure 3 It is a structural block diagram of a video customized search system according to implementation scheme C of the present invention.

[0017] Compared with implementation scheme A, the video customized search system shown in implementation scheme C of the present invention may also include: A content display device, connected to the data analysis device, the customized search device and the coding execution device respectively, and used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device; Wherein, the content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, including: the various status information of the data analysis device, the customized search device and the coding execution device displayed simultaneously includes the sleep state or working state of the data analysis device, the customized search device and the coding execution device; Wherein, the content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and further includes: the content display device is a liquid crystal display screen or an LED display array; Wherein, the content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and further comprises: the LED display array is composed of a plurality of LED display units arranged in a rectangular matrix pattern; Wherein, the content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and further comprises: the structure of the plurality of LED display units arranged in a rectangular matrix pattern is the same; And wherein, the content display device is respectively connected to the data analysis device, the customized search device and the encoding execution device, and is used to simultaneously display various status information of the data analysis device, the customized search device and the encoding execution device, and also includes: the multiple LED display units share the same clock generation unit to respectively obtain the reference clock signals they need.

[0018] In addition, in the video customized search system, a numerical mapping formula is used to represent the numerical correspondence between the ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values ​​and the determined complexity level of the current frame, including: in the numerical mapping formula, the numerical ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values ​​is the input parameter, and the determined complexity level of the current frame is the output parameter.

[0019] The video customized search system of the present invention can solve the technical problem in the prior art that the search range of the reference frame for forward searching for inter-frame coding by the inter-frame coding technology is too rigid, resulting in the inter-frame coding technology being not flexible and reliable enough. The system can dynamically select the search range of the reference frame for forward searching for inter-frame coding by the current frame according to the complexity level of the current frame to be inter-frame coding, based on the targeted analysis of the complexity level of each frame. This can reduce the computational cost and time cost of inter-frame coding as much as possible while ensuring the inter-frame coding effect of each frame.

[0020] Those skilled in the art will readily appreciate the additional advantages and changes. Therefore, the present invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Therefore, various changes may be made without departing from the spirit or scope of the general inventive concept defined by the appended claims and their equivalents.

Claims

1. A video customized search system, characterized in that: The system comprises: A data analysis device, configured to perform complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, wherein the video sequence is composed of a plurality of frames including the current frame and the plurality of frames respectively correspond to a plurality of time stamps; a customized search device connected to the data analysis device, for determining, based on the received complexity level of the current frame, a search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame, wherein the lower the complexity level of the current frame, the narrower the search range for selecting a reference frame in the video sequence when searching forward from the current frame to perform inter-frame coding on the current frame; A coding execution device, connected to the customized search device, configured to search for a reference frame of the current frame based on a search range determined by the customized search device, and perform an inter-frame coding operation on the current frame based on the searched reference frame; Wherein, determining, based on the complexity level of the received current frame, a search range for selecting a reference frame in the video sequence by searching forward from the current frame when performing inter-frame coding on the current frame comprises: the search range is numerically represented by the number of coded frames searched before the current frame in the video sequence; The search range is numerically represented by the number of encoded frames searched before the current frame in the video sequence, including: the narrower the search range, the fewer the number of encoded frames searched before the current frame in the video sequence; Wherein, performing complexity analysis on a current frame in a video sequence to obtain a complexity level of the current frame, the video sequence being composed of a plurality of frames including the current frame and the plurality of frames corresponding to a plurality of time stamps respectively, comprises: obtaining respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values; Wherein, obtaining respective red color channel values ​​respectively corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​comprises: the smaller the ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​is, the lower the complexity level of the determined current frame is; Wherein, complexity analysis is performed on the current frame in the video sequence to obtain the complexity level of the current frame, the video sequence is composed of multiple frames including the current frame and the multiple frames correspond to multiple timestamps respectively, and further includes: the multiple timestamps are evenly arranged on the time axis.

2. The video customized search system according to claim 1, characterized in that: Acquiring respective red color channel values ​​corresponding to respective pixel points of the current frame, performing deduplication processing on the respective red color channel values ​​to obtain a plurality of red color channel values, and determining the complexity level of the current frame based on a ratio of the number of the plurality of red color channel values ​​to the number of the respective red color channel values ​​further comprises: each pixel point of the current frame has a single red color channel value, a single green color channel value, and a single blue color channel value in an RGB color space; Among them, the smaller the ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values, the lower the complexity level of the determined current frame is, including: using a numerical mapping formula to represent the numerical correspondence between the ratio of the number of the multiple red color channel values ​​to the number of the individual red color channel values ​​and the numerical correspondence between the complexity level of the determined current frame.

3. The video customized search system according to claim 2, characterized in that: The system further comprises: An on-site storage device, connected to the data analysis device, the customized search device and the coding execution device respectively, for providing data temporary storage services for the data analysis device, the customized search device and the coding execution device in a time-sharing manner; Among them, the on-site storage device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to provide data temporary storage services for the data analysis device, the customized search device and the coding execution device in a time-sharing manner, including: the data analysis device, the customized search device and the coding execution device are connected to the on-site storage device respectively using different data channels.

4. The video customized search system as claimed in claim 3, characterized in that: The field storage device is respectively connected to the data analysis device, the customized search device and the coding execution device, and is used to provide data temporary storage services for the data analysis device, the customized search device and the coding execution device in a time-sharing manner, including: the data analysis device, the customized search device and the coding execution device use the same reference clock signal.

5. The video customized search system according to claim 2, characterized in that: The system further comprises: The content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device.

6. The video customized search system as claimed in claim 5, characterized in that: The content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, including: the various status information of the data analysis device, the customized search device and the coding execution device displayed simultaneously includes the sleep state or working state of the data analysis device, the customized search device and the coding execution device.

7. The video customized search system as claimed in claim 6, characterized in that: The content display device is respectively connected to the data analysis device, the customized search device and the coding execution device, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and also includes: the content display device is a liquid crystal display screen or an LED display array.

8. The video customized search system as claimed in claim 7, characterized in that: The content display device is respectively connected to the data analysis device, the customized search device and the coding execution device, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and also includes: the LED display array is composed of multiple LED display units arranged in a rectangular matrix pattern.

9. The video customized search system as claimed in claim 8, characterized in that: The content display device is connected to the data analysis device, the customized search device and the coding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the coding execution device, and further includes: the plurality of LED display units arranged in a rectangular matrix pattern have the same structure; Among them, the content display device is connected to the data analysis device, the customized search device and the encoding execution device respectively, and is used to simultaneously display various status information of the data analysis device, the customized search device and the encoding execution device. It also includes: the multiple LED display units share the same clock generation unit to respectively obtain the reference clock signals they need.

Images