Display screen picture dynamic regulation and control method and system based on picture information

Abstract

The invention relates to the technical field of display screen dynamic regulation and control, in particular to a display screen picture dynamic regulation and control method and system based on picture information, in the system, a picture information dynamic regulation and control module obtains the network state of a display screen receiving release data at the current time, and a jump parameter based on the current time is obtained; and based on the hopping parameters, constructing a frame extraction scheme based on each optimized frame object set, predicting conversion quantized values of adjacent pictures after the frame extraction scheme is executed, and screening an optimal frame extraction scheme based on the current time. According to the method, picture information is analyzed from the two dimensions of the hue offset coefficient and the motion vector of the corresponding frame, the quantization of the scene conversion degree between adjacent frames of pictures is realized, and data support is provided for dynamic selection of shot switching segmentation nodes; in combination with the network state of the display screen for receiving the delivery data, the dynamic acquisition of the frame extraction scheme is realized, and the effective management and control of the dynamic regulation and control data of the display screen picture are realized.

Description

Technical Field

[0001] The present invention relates to the technical field of dynamic control of display screens, and in particular to a method and system for dynamic control of display screen images based on image information. Background Art

[0002] Modern electronic devices (such as smartphones, tablets, laptops, televisions, monitors, and in-vehicle displays) generally use various display screens as the primary window for human-computer interaction and information presentation. However, the display's display is often constrained by network conditions. In the case of slow network transmission speeds, the displayed image information may sometimes become stuck. In such cases, adjustments to the transmitted image information often become necessary.

[0003] Existing display screen dynamic control systems based on image information often ensure image transmission speed by reducing resolution or frame rate using a preset mode. The frame reduction method is fixed and cannot be dynamically adjusted in combination with image information, resulting in poor visual quality of the image after frame reduction processing. Therefore, the existing technology has major defects. Summary of the Invention

[0004] The purpose of the present invention is to provide a method and system for dynamically controlling a display screen image based on image information, so as to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solution: a method for dynamically controlling a display screen image based on image information, the method comprising the following steps:

[0006] S1. Obtaining the image information to be transmitted on the display screen, extracting the image features of each frame in the image information to be transmitted, and constructing a frame image feature set;

[0007] S2. Based on the frame feature set, analyze the picture features corresponding to each frame to obtain conversion quantization values of adjacent frames; and dynamically obtain the shot switching segmentation nodes in the picture information to be transmitted based on the obtained conversion quantization values, and construct a shot frame set in the picture information to be transmitted;

[0008] S3. Analyze the optimized frame objects in each shot frame set based on the obtained converted quantized values of adjacent frames, and construct an optimized frame object set based on the shot frame set;

[0009] S4. Obtain the network status of the display screen receiving the delivery data at the current time, and obtain the jump parameters based on the current time; and based on the jump parameters, construct a frame extraction scheme based on each optimized frame object set, and predict the conversion quantization value of the adjacent pictures after executing the frame extraction scheme, and select the best frame extraction scheme based on the current time;

[0010] S5. Based on the optimal frame extraction scheme at the current time, during the process of transmitting the picture information to the display screen, a frame extraction operation is performed on the picture information to be transmitted in real time.

[0011] Furthermore, the picture features in S1 include the hue shift coefficient and motion vector of the corresponding frame;

[0012] The method for obtaining the hue shift coefficient of the corresponding frame includes the following steps:

[0013] S11. Convert each pixel of the frame from RGB space to HSV space, extract the hue H, and record the difference between the maximum and minimum R, G, and B values corresponding to each pixel as ΔC. When ΔC=0, the hue value H corresponding to the corresponding pixel is determined to be 0°, where H∈[0°, 360°);

[0014] When △C≠0, the maximum value of the R, G, and B values corresponding to the corresponding pixel points is recorded as max (R，G，B) ,

[0015] If max (R，G，B) is the corresponding R value, then determine and n is an integer;

[0016] If max (R，G，B) is the corresponding G value, then determine

[0017] If max (R，G，B) is the corresponding B value, then determine

[0018] S12, evenly divide the 360° hue circle into K hue intervals, where K is a preset constant; count the hue intervals to which the hue value corresponding to each pixel in the corresponding frame belongs, and take the median value of the hue interval with the highest number of pixels as the main color reference value H of the corresponding frame. main ;

[0019] S13. Obtain the hue shift coefficient of the corresponding frame. The calculation formula involved is as follows:

[0020]

[0021] Where P represents the hue shift coefficient of the corresponding frame; H i Indicates the hue value corresponding to the i-th pixel in the corresponding frame; w i Indicates the corresponding hue value and H in the corresponding frame i The percentage of identical pixels; N represents the total number of pixels in the corresponding frame; min{} represents the minimum value operation;

[0022] In the process of obtaining the motion vector of the corresponding frame, the corresponding frame is divided into multiple macroblocks of preset specifications, and the size specifications of each macroblock are the same; the absolute difference value and the minimum macroblock position corresponding to the pixel points between the j-th macroblock in the corresponding frame and any macroblock position in the previous frame are selected; the absolute difference value and the minimum macroblock position corresponding to the j-th macroblock in the previous frame and the corresponding frame are used as the mapping macroblock of the j-th macroblock in the corresponding frame, which is recorded as Aj; the motion vector of the j-th macroblock in the corresponding frame is constructed, which is recorded as (dx j ,dy j ); the dx j Indicates the number of pixels displaced along the long side of the frame with the right as the positive direction when Aj moves from the frame to the jth macroblock in the corresponding frame; j Indicates the number of pixels displaced in the positive direction along the width direction of the frame when Aj moves to the jth macroblock in the corresponding frame; calculates the average value of the corresponding modulus lengths of the motion vectors of each macroblock in the corresponding frame as the modulus length of the motion vector of the corresponding frame;

[0023] Each element in the frame feature set corresponds to a frame feature extraction result of a frame.

[0024] The present invention obtains the motion vector of the corresponding frame, and only needs to consider the modulus of the corresponding motion vector, without further considering the specific direction of the corresponding motion vector;

[0025] Furthermore, the conversion quantization value of the corresponding frame image is obtained in S2, and the calculation formula involved is as follows:

[0026] CV g→g+1 =P g→g+1 +μ×HP g→g+1

[0027] Among them, CV g→g+1 P represents the conversion quantization value between the adjacent g-th frame and g+1-th frame in the frame feature set; g→g+1 HP represents the modulus of the running vector of the g+1th frame in the frame feature set; g+1 It represents the absolute value of the difference between the hue shift coefficients corresponding to the adjacent g-th frame and the g+1-th frame in the frame feature set; μ represents a preset weight coefficient.

[0028] The present invention obtains the conversion quantization value of the corresponding frame image in order to quantify the scene conversion degree between adjacent frame images and provide data support for the dynamic selection of shot switching segmentation nodes.

[0029] Furthermore, in S2, the conversion quantization values of adjacent frames are obtained, and each obtained conversion quantization value is compared with a preset node cutting threshold.

[0030] If the obtained conversion quantization value is greater than or equal to a preset node cutting threshold, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to be a shot switching segmentation node, and the image information to be transmitted is segmented according to the obtained shot switching segmentation node, and the set composed of each frame between the two adjacent shot switching segmentation nodes is regarded as a shot frame set to obtain different shot frame sets based on the image information to be transmitted; otherwise, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to belong to the same shot frame set; each element in each shot frame set corresponds to one frame.

[0031] The present invention dynamically obtains each lens switching segmentation node in order to divide the image information to be transmitted into frame image set segments with different costs. When subsequently generating a frame extraction scheme, it is only necessary to use the optimized frame object set of the corresponding lens frame set as an analysis object, without taking the entire image information to be transmitted as an analysis object at one time. Dividing different lens frame sets can ensure the independence of the frame images corresponding to each lens; this method can ensure the accuracy of the frame extraction results while simultaneously realizing the rapid selection of frame extraction objects by introducing a multi-threaded method, thereby improving the generation speed of the frame extraction scheme.

[0032] Furthermore, in S3, the shot frame set in the picture information to be transmitted and the conversion quantization value of each adjacent frame in the corresponding shot frame set are obtained, and the next frame in the adjacent frame when the conversion quantization value of the adjacent frame in the corresponding shot frame set is less than a preset conversion quantization threshold is marked; the marked elements in each shot frame set are obtained in turn, and the set composed of the obtained elements is used as an optimized frame object set based on the corresponding shot frame set, and each marked element in the shot frame set corresponds to an optimized frame object in the shot frame set.

[0033] Furthermore, the network status in S4 includes a network delay for the display screen to receive the delivery data, and a jump parameter bound to the network status of the display screen receiving the delivery data at the current time is queried in a preset table in the database to obtain a jump parameter based on the current time; the jump parameter represents the number of frames that jump each time when the optimization operation is performed on the optimized frame object set of the lens frame set;

[0034] The method for constructing a frame extraction scheme based on a set of optimized frame objects includes the following steps:

[0035] S41, obtaining a jump parameter based on the current time, each shot frame set, and an optimized frame object set based on the corresponding shot frame set;

[0036] S42: Extracting a starting jump frame set from each optimized frame object set, where the starting jump frame set is a set consisting of elements whose number is the same as the jump parameter based on the current time and are obtained sequentially from the front to the back of the optimized frame object set. Any one element in the starting jump frame set is selected as the starting frame object of the corresponding optimized frame object set, and the process proceeds to step S43.

[0037] S43, extracting the most recently received frame object, denoted as Q; extracting the mapping position of Q in the corresponding shot frame set, and calculating the conversion quantization value between the two original frames adjacent to Q after the new corresponding shot frame set after Q is extracted, denoted as CVQ;

[0038] If CVQ is less than the preset conversion quantization threshold and the next frame picture in the adjacent frames corresponding to CVQ belongs to the optimized frame object set to which Q belongs, then the next frame picture in the adjacent frames corresponding to CVQ is used as the next frame object, and step S43 is performed again;

[0039] If CVQ is greater than or equal to the preset conversion quantization threshold or the next frame picture in the adjacent frame picture corresponding to CVQ does not belong to the optimized frame object set to which Q belongs, then the number of elements after the Q position in the optimized frame object set to which Q belongs is determined.

[0040] When the number of elements after position Q in the optimized frame object set to which Q belongs is greater than or equal to b, and b is equal to the jump parameter based on the current time, the bth element after position Q in the optimized frame object set to which Q belongs is used as the next frame extraction object, and step S43 is performed again;

[0041] When the number of elements after position Q in the optimized frame object set to which Q belongs is less than b, count the frame extraction sequence composed of the frame extraction objects received in sequence in S43 in the corresponding shot frame set, and jump to step S44;

[0042] S44, generating a frame extraction scheme based on each optimized frame object set according to a set of frame extraction sequences corresponding to each shot frame set obtained in step S43;

[0043] S45, obtaining respective frame extraction schemes corresponding to different elements in the starting transition frame set when the starting frame extraction object of the corresponding optimized frame object set is different, and constructing frame extraction schemes based on each optimized frame object set;

[0044] Calculate the average value of the converted quantization value corresponding to any adjacent frame in the new picture information to be transmitted after executing r frame extraction schemes, and record it as CVP r ; The CVP corresponding to different values of r r The frame extraction scheme to which the minimum value belongs is regarded as the best frame extraction scheme based on the current time.

[0045] A display screen image dynamic control system based on image information, the system comprising: a frame image feature acquisition module, a picture information dynamic segmentation module, an optimized frame object analysis module, a picture information dynamic control module and a picture information control management module;

[0046] The frame picture feature acquisition module obtains the picture information to be transmitted projected on the display screen, extracts the picture features of each frame picture in the picture information to be transmitted, and constructs a frame picture feature set;

[0047] The dynamic image information segmentation module analyzes the image features corresponding to each frame based on the frame feature set to obtain conversion quantization values of adjacent frames; and dynamically obtains the shot switching segmentation nodes in the image information to be transmitted based on the obtained conversion quantization values, and constructs the shot frame set in the image information to be transmitted;

[0048] The optimized frame object analysis module analyzes the optimized frame objects in each shot frame set based on the converted quantized values of the obtained adjacent frame images, and constructs an optimized frame object set based on the shot frame set;

[0049] The picture information dynamic control module obtains the network status of the display screen receiving the delivery data at the current time, obtains the jump parameters based on the current time; and based on the jump parameters, constructs a frame extraction scheme based on each optimized frame object set, and predicts the conversion quantization value of the adjacent pictures after executing the frame extraction scheme, and selects the best frame extraction scheme based on the current time;

[0050] The picture information control and management module performs a frame extraction operation on the transmitted picture information in real time during the process of transmitting the picture information to the display screen based on the best frame extraction scheme at the current time.

[0051] Furthermore, the picture information dynamic segmentation module includes a frame picture conversion quantization value calculation unit and a segmentation node dynamic acquisition unit.

[0052] The frame picture conversion quantization value calculation unit analyzes the picture features corresponding to each frame picture based on the frame picture feature set to obtain conversion quantization values of adjacent frame pictures;

[0053] The segmentation node dynamic acquisition unit dynamically acquires the shot switching segmentation node in the picture information to be transmitted according to the obtained conversion quantization value, and constructs a shot frame set in the picture information to be transmitted.

[0054] Furthermore, the picture information dynamic control module includes a jump parameter acquisition unit, a frame extraction scheme construction unit and an optimal frame extraction scheme screening unit.

[0055] The jump parameter acquisition unit acquires the network status of the display screen receiving the delivery data at the current time, and obtains the jump parameter based on the current time;

[0056] The frame extraction scheme construction unit constructs a frame extraction scheme based on each optimized frame object set based on the hopping parameter;

[0057] The optimal frame extraction scheme screening unit predicts the conversion quantization values of adjacent pictures after the frame extraction scheme is executed, and screens the optimal frame extraction scheme based on the current time.

[0058] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: the present invention extracts features from the picture and analyzes the picture information from two dimensions: the hue shift coefficient and motion vector of the corresponding frame, thereby quantifying the degree of scene conversion between adjacent frames and providing data support for the dynamic selection of shot switching segmentation nodes; and screening the optimized frame objects in each shot frame set, combining the network status of the display screen receiving the delivery data, thereby realizing the dynamic acquisition of the frame extraction scheme and the effective control of the dynamic control data of the display screen, thereby maintaining the smoothness of the picture as much as possible while maintaining the picture quality and improving the picture information transmission speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0060] Figure 1 This is a structural diagram of a display screen image dynamic control system based on image information of the present invention;

[0061] Figure 2 It is a flow chart of a method for dynamically controlling a display screen image based on image information of the present invention. DETAILED DESCRIPTION

[0062] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0063] See also Figure 1-Figure 2 , the present invention provides a technical solution: Figure 1 As shown, this embodiment provides a display screen image dynamic control system based on image information, the system includes: a frame image feature acquisition module, a picture information dynamic segmentation module, an optimized frame object analysis module, a picture information dynamic control module and a picture information control management module;

[0064] The frame picture feature acquisition module obtains the picture information to be transmitted projected on the display screen, extracts the picture features of each frame picture in the picture information to be transmitted, and constructs a frame picture feature set;

[0065] The picture information dynamic segmentation module includes a frame picture conversion quantization value calculation unit and a segmentation node dynamic acquisition unit.

[0066] The frame picture conversion quantization value calculation unit analyzes the picture features corresponding to each frame picture based on the frame picture feature set to obtain conversion quantization values of adjacent frame pictures;

[0067] The segmentation node dynamic acquisition unit dynamically acquires the shot switching segmentation node in the image information to be transmitted according to the obtained conversion quantization value, and constructs a shot frame set in the image information to be transmitted;

[0068] The optimized frame object analysis module analyzes the optimized frame objects in each shot frame set based on the converted quantized values of the obtained adjacent frame images, and constructs an optimized frame object set based on the shot frame set;

[0069] The picture information dynamic control module includes a jump parameter acquisition unit, a frame extraction scheme construction unit and an optimal frame extraction scheme screening unit.

[0070] The jump parameter acquisition unit acquires the network status of the display screen receiving the delivery data at the current time, and obtains the jump parameter based on the current time;

[0071] The frame extraction scheme construction unit constructs a frame extraction scheme based on each optimized frame object set based on the hopping parameter;

[0072] The optimal frame extraction scheme screening unit predicts the conversion quantization values of adjacent pictures after the frame extraction scheme is executed, and screens the optimal frame extraction scheme based on the current time;

[0073] The picture information control and management module performs a frame extraction operation on the transmitted picture information in real time during the process of transmitting the picture information to the display screen based on the best frame extraction scheme at the current time.

[0074] like Figure 2 As shown, this embodiment provides a method for dynamically controlling a display screen image based on image information, the method comprising the following steps:

[0075] S1. Obtaining the image information to be transmitted on the display screen, extracting the image features of each frame in the image information to be transmitted, and constructing a frame image feature set;

[0076] The picture features in S1 include the hue shift coefficient and motion vector of the corresponding frame;

[0077] The method for obtaining the hue shift coefficient of the corresponding frame includes the following steps:

[0078] S11. Convert each pixel of the frame from RGB space to HSV space, extract the hue H, and record the difference between the maximum and minimum R, G, and B values corresponding to each pixel as ΔC. When ΔC=0, the hue value H corresponding to the corresponding pixel is determined to be 0°, where H∈[0°, 360°);

[0079] When △C≠0, the maximum value of the R, G, and B values corresponding to the corresponding pixel points is recorded as max (R，G，B) ,

[0080] If max (R，G，B) is the corresponding R value, then determine and n is an integer;

[0081] If max (R，G，B) is the corresponding G value, then determine

[0082] If max (R，G，B) is the corresponding B value, then determine

[0083] S12, evenly divide the 360° hue circle into K hue intervals, where K is a preset constant; count the hue intervals to which the hue value corresponding to each pixel in the corresponding frame belongs, and take the median value of the hue interval with the highest number of pixels as the main color reference value H of the corresponding frame. main ;

[0084] S13. Obtain the hue shift coefficient of the corresponding frame. The calculation formula involved is as follows:

[0085]

[0086] Where P represents the hue shift coefficient of the corresponding frame; H i Indicates the hue value corresponding to the i-th pixel in the corresponding frame; w i Indicates the corresponding hue value and H in the corresponding frame i The percentage of identical pixels; N represents the total number of pixels in the corresponding frame; min{} represents the minimum value operation;

[0087] In the process of obtaining the motion vector of the corresponding frame, the corresponding frame is divided into multiple macroblocks of preset specifications, and the size specifications of each macroblock are the same; the absolute difference value and the minimum macroblock position corresponding to the pixel points between the j-th macroblock in the corresponding frame and any macroblock position in the previous frame are selected; the absolute difference value and the minimum macroblock position corresponding to the j-th macroblock in the previous frame and the corresponding frame are used as the mapping macroblock of the j-th macroblock in the corresponding frame, which is recorded as Aj; the motion vector of the j-th macroblock in the corresponding frame is constructed, which is recorded as (dx j ,dy j ); the dx j Indicates the number of pixels displaced along the long side of the frame with the right as the positive direction when Aj moves from the frame to the jth macroblock in the corresponding frame; j Indicates the number of pixels displaced in the positive direction along the width direction of the frame when Aj moves to the jth macroblock in the corresponding frame; calculates the average value of the corresponding modulus lengths of the motion vectors of each macroblock in the corresponding frame as the modulus length of the motion vector of the corresponding frame;

[0088] Each element in the frame feature set corresponds to a frame feature extraction result of a frame.

[0089] S2. Based on the frame feature set, analyze the picture features corresponding to each frame to obtain conversion quantization values of adjacent frames; and dynamically obtain the shot switching segmentation nodes in the picture information to be transmitted based on the obtained conversion quantization values, and construct a shot frame set in the picture information to be transmitted;

[0090] The conversion quantization value of the corresponding frame image is obtained in S2, and the calculation formula involved is as follows:

[0091] CV g→g+1 =P g→g+1 +μ×HP g→g+1

[0092] Among them, CV g→g+1 P represents the conversion quantization value between the adjacent g-th frame and g+1-th frame in the frame feature set; g→g+1 HP represents the modulus of the running vector of the g+1th frame in the frame feature set; g+1 It represents the absolute value of the difference between the hue shift coefficients corresponding to the adjacent g-th frame and the g+1-th frame in the frame feature set; μ represents a preset weight coefficient.

[0093] In said S2, the conversion quantization values of the adjacent frames are obtained, and each obtained conversion quantization value is compared with the preset node cutting threshold.

[0094] If the obtained conversion quantization value is greater than or equal to a preset node cutting threshold, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to be a shot switching segmentation node, and the image information to be transmitted is segmented according to the obtained shot switching segmentation node, and the set composed of each frame between the two adjacent shot switching segmentation nodes is regarded as a shot frame set to obtain different shot frame sets based on the image information to be transmitted; otherwise, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to belong to the same shot frame set; each element in each shot frame set corresponds to one frame.

[0095] S3. Analyze the optimized frame objects in each shot frame set based on the obtained converted quantized values of adjacent frames, and construct an optimized frame object set based on the shot frame set;

[0096] In the S3, the shot frame set in the picture information to be transmitted and the conversion quantization value of each adjacent frame in the corresponding shot frame set are obtained, and the next frame in the adjacent frame when the conversion quantization value of the adjacent frame in the corresponding shot frame set is less than a preset conversion quantization threshold is marked; the marked elements in each shot frame set are obtained in turn, and the set composed of the obtained elements is used as an optimized frame object set based on the corresponding shot frame set, and each marked element in the shot frame set corresponds to an optimized frame object in the shot frame set.

[0097] S4. Obtain the network status of the display screen receiving the delivery data at the current time, and obtain the jump parameters based on the current time; and based on the jump parameters, construct a frame extraction scheme based on each optimized frame object set, and predict the conversion quantization value of the adjacent pictures after executing the frame extraction scheme, and select the best frame extraction scheme based on the current time;

[0098] The network status in S4 includes the network delay of the display screen receiving the delivery data, and the jump parameter bound to the network status of the display screen receiving the delivery data at the current time is queried in the database preset table to obtain the jump parameter based on the current time; the jump parameter represents the number of frames that jump each time when the optimization operation is performed on the optimized frame object set of the lens frame set;

[0099] The method for constructing a frame extraction scheme based on a set of optimized frame objects includes the following steps:

[0100] S41, obtaining a jump parameter based on the current time, each shot frame set, and an optimized frame object set based on the corresponding shot frame set;

[0101] S42: Extracting a starting jump frame set from each optimized frame object set, where the starting jump frame set is a set consisting of elements whose number is the same as the jump parameter based on the current time and are obtained sequentially from the front to the back of the optimized frame object set. Any one element in the starting jump frame set is selected as the starting frame object of the corresponding optimized frame object set, and the process proceeds to step S43.

[0102] S43, extracting the most recently received frame object, denoted as Q; extracting the mapping position of Q in the corresponding shot frame set, and calculating the conversion quantization value between the two original frames adjacent to Q after the new corresponding shot frame set after Q is extracted, denoted as CVQ;

[0103] If CVQ is less than the preset conversion quantization threshold and the next frame picture in the adjacent frames corresponding to CVQ belongs to the optimized frame object set to which Q belongs, then the next frame picture in the adjacent frames corresponding to CVQ is used as the next frame object, and step S43 is performed again;

[0104] If CVQ is greater than or equal to the preset conversion quantization threshold or the next frame picture in the adjacent frame picture corresponding to CVQ does not belong to the optimized frame object set to which Q belongs, then the number of elements after the Q position in the optimized frame object set to which Q belongs is determined.

[0105] When the number of elements after position Q in the optimized frame object set to which Q belongs is greater than or equal to b, and b is equal to the jump parameter based on the current time, the bth element after position Q in the optimized frame object set to which Q belongs is used as the next frame extraction object, and step S43 is performed again;

[0106] When the number of elements after position Q in the optimized frame object set to which Q belongs is less than b, count the frame extraction sequence composed of the frame extraction objects received in sequence in S43 in the corresponding shot frame set, and jump to step S44;

[0107] S44, generating a frame extraction scheme based on each optimized frame object set according to a set of frame extraction sequences corresponding to each shot frame set obtained in step S43;

[0108] S45, obtaining respective frame extraction schemes corresponding to different elements in the starting transition frame set when the starting frame extraction object of the corresponding optimized frame object set is different, and constructing frame extraction schemes based on each optimized frame object set;

[0109] Calculate the average value of the converted quantization value corresponding to any adjacent frame in the new picture information to be transmitted after executing r frame extraction schemes, and record it as CVP r ; The CVP corresponding to different values of r r The frame extraction scheme to which the minimum value belongs is regarded as the best frame extraction scheme based on the current time.

[0110] In this implementation, if the optimized frame object set of the lens frame set is recorded as {U1, U2, U3, U4, U5};

[0111] If the jump parameter based on the current time is 2;

[0112] When the most recently acquired frame object of {U1, U2, U3, U4, U5} is U2, the next frame object selected may be U3 or U4;

[0113] S5. Based on the optimal frame extraction scheme at the current time, during the process of transmitting the picture information to the display screen, a frame extraction operation is performed on the picture information to be transmitted in real time.

[0114] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus.

[0115] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art will be able to modify the technical solutions described in the aforementioned embodiments or substitute equivalents for some of the technical features. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention.

Claims

1. A method for dynamically controlling a display screen image based on image information, characterized in that: The method comprises the following steps: S1. Obtaining the image information to be transmitted on the display screen, extracting the image features of each frame in the image information to be transmitted, and constructing a frame image feature set; S2. Based on the frame feature set, analyze the picture features corresponding to each frame to obtain conversion quantization values of adjacent frames; and dynamically obtain the shot switching segmentation nodes in the picture information to be transmitted based on the obtained conversion quantization values, and construct a shot frame set in the picture information to be transmitted; S3. Analyze the optimized frame objects in each shot frame set based on the obtained converted quantized values of adjacent frames, and construct an optimized frame object set based on the shot frame set; S4. Obtain the network status of the display screen receiving the delivery data at the current time, and obtain the jump parameters based on the current time; and based on the jump parameters, construct a frame extraction scheme based on each optimized frame object set, and predict the conversion quantization value of the adjacent pictures after executing the frame extraction scheme, and select the best frame extraction scheme based on the current time; S5. Based on the optimal frame extraction scheme at the current time, during the process of transmitting the picture information to the display screen, a frame extraction operation is performed on the picture information to be transmitted in real time.

2. The method for dynamically controlling a display screen image based on image information according to claim 1, characterized in that: The picture features in S1 include the hue shift coefficient and motion vector of the corresponding frame; The method for obtaining the hue shift coefficient of the corresponding frame includes the following steps: S11. Convert each pixel of the frame from RGB space to HSV space, extract the hue H, and record the difference between the maximum and minimum R, G, and B values corresponding to each pixel as ΔC. When ΔC=0, the hue value H corresponding to the corresponding pixel is determined to be 0°, where H∈[0°, 360°); When △C≠0, the maximum value of the R, G, and B values corresponding to the corresponding pixel points is recorded as max (R，G，B) , If max (R，G，B) is the corresponding R value, then determine and n is an integer; If max (R，G，B) is the corresponding G value, then determine If max (R，G，B) is the corresponding B value, then determine S12, evenly divide the 360° hue circle into K hue intervals, where K is a preset constant; count the hue intervals to which the hue value corresponding to each pixel in the corresponding frame belongs, and take the median value of the hue interval with the highest number of pixels as the main color reference value H of the corresponding frame. main ; S13. Obtain the hue shift coefficient of the corresponding frame. The calculation formula involved is as follows: Where P represents the hue shift coefficient of the corresponding frame; H i Indicates the hue value corresponding to the i-th pixel in the corresponding frame; w i Indicates the corresponding hue value and H in the corresponding frame i The percentage of identical pixels; N represents the total number of pixels in the corresponding frame; min{} represents the minimum value operation; In the process of obtaining the motion vector of the corresponding frame, the corresponding frame is divided into multiple macroblocks of preset specifications, and the size specifications of each macroblock are the same; the absolute difference value and the minimum macroblock position corresponding to the pixel points between the j-th macroblock in the corresponding frame and any macroblock position in the previous frame are selected; the absolute difference value and the minimum macroblock position corresponding to the j-th macroblock in the previous frame and the corresponding frame are used as the mapping macroblock of the j-th macroblock in the corresponding frame, which is recorded as Aj; the motion vector of the j-th macroblock in the corresponding frame is constructed, which is recorded as (dx j ,dy j ); the dx j Indicates the number of pixels displaced along the long side of the frame with the right as the positive direction when Aj moves from the frame to the jth macroblock in the corresponding frame; j Indicates the number of pixels displaced in the positive direction along the width direction of the frame when Aj moves to the jth macroblock in the corresponding frame; calculates the average value of the corresponding modulus lengths of the motion vectors of each macroblock in the corresponding frame as the modulus length of the motion vector of the corresponding frame; Each element in the frame feature set corresponds to a frame feature extraction result of a frame.

3. The method for dynamically controlling a display screen image based on image information according to claim 1, characterized in that: The conversion quantization value of the corresponding frame image is obtained in S2, and the calculation formula involved is as follows: CV g→g+1 =P g→g+1 +μ×HP g→g+1 Among them, CV g→g+1 P represents the conversion quantization value between the adjacent g-th frame and g+1-th frame in the frame feature set; g→g+1 HP represents the modulus of the running vector of the g+1th frame in the frame feature set; g+1 It represents the absolute value of the difference between the hue shift coefficients corresponding to the adjacent g-th frame and the g+1-th frame in the frame feature set; μ represents a preset weight coefficient.

4. The method for dynamically controlling a display screen image based on image information according to claim 1, characterized in that: In said S2, the conversion quantization values of the adjacent frames are obtained, and each obtained conversion quantization value is compared with the preset node cutting threshold. If the obtained conversion quantization value is greater than or equal to a preset node cutting threshold, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to be a shot switching segmentation node, and the image information to be transmitted is segmented according to the obtained shot switching segmentation node, and the set composed of each frame between the two adjacent shot switching segmentation nodes is regarded as a shot frame set to obtain different shot frame sets based on the image information to be transmitted; otherwise, the two adjacent frames corresponding to the corresponding conversion quantization value are determined to belong to the same shot frame set; each element in each shot frame set corresponds to one frame.

5. The method for dynamically controlling a display screen image based on image information according to claim 1, characterized in that: In the S3, the shot frame set in the picture information to be transmitted and the conversion quantization value of each adjacent frame in the corresponding shot frame set are obtained, and the next frame in the adjacent frame when the conversion quantization value of the adjacent frame in the corresponding shot frame set is less than a preset conversion quantization threshold is marked; the marked elements in each shot frame set are obtained in turn, and the set composed of the obtained elements is used as an optimized frame object set based on the corresponding shot frame set, and each marked element in the shot frame set corresponds to an optimized frame object in the shot frame set.

6. The method for dynamically controlling a display screen image based on image information according to claim 1, characterized in that: The network status in S4 includes the network delay of the display screen receiving the delivery data, and the jump parameter bound to the network status of the display screen receiving the delivery data at the current time is queried in the database preset table to obtain the jump parameter based on the current time; the jump parameter represents the number of frames that jump each time when the optimization operation is performed on the optimized frame object set of the lens frame set; The method for constructing a frame extraction scheme based on a set of optimized frame objects includes the following steps: S41, obtaining a jump parameter based on the current time, each shot frame set, and an optimized frame object set based on the corresponding shot frame set; S42: Extracting a starting jump frame set from each optimized frame object set, where the starting jump frame set is a set consisting of elements whose number is the same as the jump parameter based on the current time and are obtained sequentially from the front to the back of the optimized frame object set. Any one element in the starting jump frame set is selected as the starting frame object of the corresponding optimized frame object set, and the process proceeds to step S43. S43, extracting the most recently received frame object, denoted as Q; extracting the mapping position of Q in the corresponding shot frame set, and calculating the conversion quantization value between the two original frames adjacent to Q after the new corresponding shot frame set after Q is extracted, denoted as CVQ; If CVQ is less than the preset conversion quantization threshold and the next frame picture in the adjacent frames corresponding to CVQ belongs to the optimized frame object set to which Q belongs, then the next frame picture in the adjacent frames corresponding to CVQ is used as the next frame object, and step S43 is performed again; If CVQ is greater than or equal to the preset conversion quantization threshold or the next frame picture in the adjacent frame picture corresponding to CVQ does not belong to the optimized frame object set to which Q belongs, then the number of elements after the Q position in the optimized frame object set to which Q belongs is determined. When the number of elements after position Q in the optimized frame object set to which Q belongs is greater than or equal to b, and b is equal to the jump parameter based on the current time, the bth element after position Q in the optimized frame object set to which Q belongs is used as the next frame extraction object, and step S43 is performed again; When the number of elements after position Q in the optimized frame object set to which Q belongs is less than b, count the frame extraction sequence composed of the frame extraction objects received in sequence in S43 in the corresponding shot frame set, and jump to step S44; S44, generating a frame extraction scheme based on each optimized frame object set according to a set of frame extraction sequences corresponding to each shot frame set obtained in step S43; S45, obtaining respective frame extraction schemes corresponding to different elements in the starting transition frame set when the starting frame extraction object of the corresponding optimized frame object set is different, and constructing frame extraction schemes based on each optimized frame object set; Calculate the average value of the converted quantization value corresponding to any adjacent frame in the new picture information to be transmitted after executing r frame extraction schemes, and record it as CVP r ; The CVP corresponding to different values of r r The frame extraction scheme to which the minimum value belongs is regarded as the best frame extraction scheme based on the current time.

7. A display screen image dynamic control system based on image information, applying the display screen image dynamic control method based on image information according to claims 1-6, characterized in that: The system includes: a frame feature acquisition module, a picture information dynamic segmentation module, an optimized frame object analysis module, a picture information dynamic control module and a picture information control management module; The frame picture feature acquisition module obtains the picture information to be transmitted projected on the display screen, extracts the picture features of each frame picture in the picture information to be transmitted, and constructs a frame picture feature set; The dynamic image information segmentation module analyzes the image features corresponding to each frame based on the frame feature set to obtain conversion quantization values of adjacent frames; and dynamically obtains the shot switching segmentation nodes in the image information to be transmitted based on the obtained conversion quantization values, and constructs the shot frame set in the image information to be transmitted; The optimized frame object analysis module analyzes the optimized frame objects in each shot frame set based on the converted quantized values of the obtained adjacent frame images, and constructs an optimized frame object set based on the shot frame set; The picture information dynamic control module obtains the network status of the display screen receiving the delivery data at the current time, obtains the jump parameters based on the current time; and based on the jump parameters, constructs a frame extraction scheme based on each optimized frame object set, and predicts the conversion quantization value of the adjacent pictures after executing the frame extraction scheme, and selects the best frame extraction scheme based on the current time; The picture information control and management module performs a frame extraction operation on the transmitted picture information in real time during the process of transmitting the picture information to the display screen based on the best frame extraction scheme at the current time.

8. The display screen image dynamic control system based on image information according to claim 7, characterized in that: The picture information dynamic segmentation module includes a frame picture conversion quantization value calculation unit and a segmentation node dynamic acquisition unit. The frame picture conversion quantization value calculation unit analyzes the picture features corresponding to each frame picture based on the frame picture feature set to obtain conversion quantization values of adjacent frame pictures; The segmentation node dynamic acquisition unit dynamically acquires the shot switching segmentation node in the picture information to be transmitted according to the obtained conversion quantization value, and constructs a shot frame set in the picture information to be transmitted.

9. The display screen image dynamic control system based on image information according to claim 7, characterized in that: The picture information dynamic control module includes a jump parameter acquisition unit, a frame extraction scheme construction unit and an optimal frame extraction scheme screening unit. The jump parameter acquisition unit acquires the network status of the display screen receiving the delivery data at the current time, and obtains the jump parameter based on the current time; The frame extraction scheme construction unit constructs a frame extraction scheme based on each optimized frame object set based on the hopping parameter; The optimal frame extraction scheme screening unit predicts the conversion quantization values of adjacent pictures after the frame extraction scheme is executed, and screens the optimal frame extraction scheme based on the current time.

Images