Display device and video information processing method
By employing frame skipping decoding and adding compensation frames, the high cost and low reliability of high-processing-capability SoC chips were addressed, enabling smooth display at high resolution and high refresh rates and reducing the design cost of display devices.
Patent Information
- Application Number
- CN202010493104.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-06-03
- Publication Date
- 2025-10-17
- Estimated Expiration
- 2040-06-03
AI Technical Summary
In existing technologies, high-performance SoC chips are expensive and have low reliability, which causes LCD screens to stutter and display screen artifacts when the resolution is greater than 4K and the refresh rate is greater than 60Hz.
The original video stream is processed by frame skipping decoding to generate original video frames. Preset compensation frames are added between adjacent frames to generate target video information. The refresh rate of the display is reduced to avoid stuttering and screen tearing. Ordinary processors are used instead of high-processing-capability SoC chips.
This reduces the design cost of display devices, avoids screen stuttering and flickering issues, and also avoids the heat problems of high-performance chips, thus improving chip reliability.
Smart Images

Figure CN113766316B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of television sets, and in particular to a display device and a video information processing method. BACKGROUND
[0002] A television set usually comprises a System on Chip (SoC) chip and a liquid crystal display screen. The SoC chip can process a video code stream to obtain video information, and send the video information to the liquid crystal display screen, so that the liquid crystal display screen can display a video image according to the video information.
[0003] At present, when the liquid crystal display screen is a display screen with a 4K resolution and a 60 Hertz (Hz) refresh rate, the method for the liquid crystal display screen to display a video image comprises: receiving, by the SoC chip, a video code stream; decoding and processing, by the SoC chip, the video code stream to obtain video information, and sending, by the SoC chip, the video information to the liquid crystal display screen, so that the liquid crystal display screen displays a video image according to the video information.
[0004] In the prior art, the liquid crystal display screen is usually a display screen with a resolution greater than 4K and a refresh rate greater than 60 Hz. If the liquid crystal display screen with a resolution greater than 4K and a refresh rate greater than 60 Hz is required to display a video image smoothly, a SoC chip with high processing capability is required to decode and process a video code stream corresponding to the resolution greater than 4K and the refresh rate greater than 60 Hz. Since the SoC chip with high processing capability is usually expensive, the cost of the SoC chip is high. Moreover, since the SoC chip with high processing capability generates a large amount of heat during operation, the reliability of the SoC chip with high processing capability is reduced. SUMMARY
[0005] The present application provides a display device and a video information processing method. The cost of the processor is saved, thereby reducing the design cost of the display device, so that the display screen can display a video image smoothly according to target video information, and problems such as freezing and screen blooming of the display screen are avoided.
[0006] In a first aspect, the present application provides a display device, comprising: a processor and a display screen, wherein,
[0007] obtaining a decoding occupancy rate in a decoding process of an original video code stream, performing frame skipping decoding on the original video code stream to generate original video frames;
[0008] adding a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frames have different identifiers;
[0009] The processor sends the target video information to the display screen, wherein the display screen is configured to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
[0010] In a second aspect, the present application provides a video information processing method applied to a display device, the display device comprising a processor and a display screen, and the method comprises:
[0011] The processor acquires a decoding occupancy rate in the process of decoding and processing the original video code stream, performs frame skipping decoding processing on the original video code stream, and generates original video frames;
[0012] The processor adds a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the identifiers of the original video frames and the preset compensation frame are different;
[0013] The processor sends the target video information to the display screen, wherein the display screen is configured to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
[0014] The present application provides a display device and a video information processing method, the display device comprising a processor and a display screen, wherein the processor is configured to: acquire a decoding occupancy rate in the process of decoding and processing an original video code stream, perform frame skipping decoding processing on the original video code stream, and generate original video frames; add a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the identifiers of the original video frames and the preset compensation frame are different; and send the target video information to the display screen, wherein the display screen is configured to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame. The cost of the processor is saved, thereby reducing the design cost of the display device, and the display screen can smoothly display video images according to the target video information, avoiding problems such as freezing and screen blooming of the display screen. BRIEF DESCRIPTION OF DRAWINGS
[0015] In order to more clearly illustrate the technical solutions of the present application or the prior art, the following will briefly introduce the drawings needed in the embodiments or prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to these drawings without creative labor.
[0016] Figure 1 Flowchart of the video information processing method provided by the present application Figure One
[0017] Figure 2 Flowchart of the video information processing method provided by the present application Figure Two ;
[0018] Figure 3 A structural schematic diagram of a display device provided in the present application is shown in the following figure.
[0019] Figure 4 A structural schematic diagram of a video information processing apparatus provided in the present application is shown in the following figure. DETAILED DESCRIPTION
[0020] In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described in detail below with reference to the accompanying drawings in the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.
[0021] The technical solutions of the present application will be described in detail below with reference to the accompanying drawings in the present application. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described in some embodiments.
[0022] Figure 1 A flowchart of a video information processing method provided in the present application is shown in the following figure. Figure One As shown in the following figure, the video information processing method comprises: Figure 1
[0023] S101: obtaining a decoding occupancy rate in a decoding process of an original video code stream, performing frame skipping decoding processing on the original video code stream, and generating original video frames.
[0024] In some embodiments, the execution subject of the embodiments of the present application can be a processor in a display device, and can also be a video information processing apparatus arranged in the processor, which can be realized by a combination of software and / or hardware.
[0025] In some embodiments, the processor obtains an original video code stream from a storage medium arranged in the display device or a network device connected to the display device, and performs frame skipping decoding processing on the original video code stream in units of frames to generate original video frames.
[0026] In some embodiments, the frame skipping decoding processing represents a processing manner of decoding the original video code stream every N data frames. For example, the order of the data frames included in the original video code is data frame 1, data frame 2, data frame 3, data frame 4, data frame 5, and if N = 1, the original video frame 1 is obtained by decoding the data frame 1 in the original video code, the original video frame 3 is obtained by decoding the data frame 3, and the original video frame 5 is obtained by decoding the data frame 5. After the above processing, the order of the video frames included in the original video frames is original video frame 1, original video frame 3, and original video frame 5.
[0027] In some embodiments, N (frame skipping value) is determined according to the decoding occupancy, and then the original video code stream is processed by frame skipping decoding according to N to generate the original video frame.
[0028] In some embodiments, the decoding occupancy in the process of decoding the original video code stream is different when the number of original video frames generated in the same processing time is different. The decoding occupancy is the utilization rate of the processor in the decoding process.
[0029] In some embodiments, the frame skipping value is determined according to the decoding occupancy and a preset mapping relationship. The preset mapping relationship includes at least one decoding occupancy and a frame skipping value corresponding to each decoding occupancy. In some embodiments, after the decoding occupancy is obtained, the frame skipping value corresponding to the decoding occupancy is searched in the preset mapping relationship, and the frame skipping value corresponding to the decoding occupancy is determined as the above-mentioned N.
[0030] In some embodiments, the frame skipping value is determined according to the decoding occupancy, the code stream processing strategy, and the occupancy threshold. The code stream processing strategy can be a sequential frame processing strategy or a frame skipping processing strategy, and the occupancy threshold can be 80% or 85%. In actual applications, the specific value of the occupancy threshold can be designed according to actual needs. In some embodiments, at the initial stage, the code stream processing strategy is usually a sequential frame processing strategy, that is, the order of the data frames included in the original video code is data frame 1, data frame 2, data frame 3, data frame 4, and data frame 5. The decoding processing of data frame 1 obtains the original video frame 1, the decoding processing of data frame 2 obtains the original video frame 2, the decoding processing of data frame 3 obtains the original video frame 3, the decoding processing of data frame 4 obtains the original video frame 4, and the decoding processing of data frame 5 obtains the original video frame 5. When the data processing capability of the display device is insufficient, the code stream processing strategy can be a frame skipping processing strategy, that is, the order of the data frames included in the original video code is data frame 1, data frame 2, data frame 3, data frame 4, and data frame 5. If N = 1, the decoding processing of data frame 1 in the original video code obtains the original video frame 1, the decoding processing of data frame 3 obtains the original video frame 3, and the decoding processing of data frame 5 obtains the original video frame 5. Data frames 2 and 4 are not subjected to decoding processing. How to allocate the data frames not subjected to decoding processing needs to refer to the frame skipping value, which can be different with different decoding occupancy. In some embodiments, the method for determining the frame skipping value according to the decoding occupancy, the code stream processing strategy, and the occupancy threshold can refer to S201-S205 in Figure 2 .
[0031] In some embodiments, the frame skipping value makes the frame rate of the video frames in the video code stream received by the display device comply with the refresh rate of the display screen. Different frame skipping values correspond to different numbers of decoded original video frames, and correspondingly, the refresh rate of the display screen is also different.
[0032] S102: A preset compensation frame is added between the adjacent original video frames after frame skipping to generate target video information, wherein the original video frame and the preset compensation frame have different identities.
[0033] In some embodiments, the number of preset compensation frames can be determined according to the number of video frame intervals between adjacent original video frames, wherein the data amount included in the preset compensation frame is the same as that included in the original video frame.
[0034] For example, the adjacent original video frames are original video frame 1 and original video frame 3, and the number of video frame intervals between original video frame 1 and original video frame 3 is 1. Therefore, it can be determined that the number of preset compensation frames is 1. Further, one preset compensation frame can be added between original video frame 1 and original video frame 3 to form the target video information.
[0035] In some embodiments, the original video frame and the preset compensation frame have different display identifiers, for example, the original video frame has a first display identifier, and the preset compensation frame has a second display identifier, wherein the first display identifier and the second display identifier are different, and the first display identifier and the second display identifier have different effects. In some embodiments, the first display identifier can trigger the display screen to display the original video frame, and the second display identifier cannot trigger the display screen to display the original video frame.
[0036] In some embodiments, the original video frame includes a display identifier, and the preset compensation frame does not include the display identifier, wherein the display identifier can trigger the display screen to display the original video frame.
[0037] In some embodiments, if the frame skipping value is 2 and the preset display line number is 2200, that is, the number of lines of each original video frame is 2200, it means that two data frames are missing in the video code stream, and 2200 multiplied by 2 data need to be compensated to ensure the saturation of the data path between the processor and the display screen. Therefore, 2 frames of blank data (i.e., 2 preset compensation frames) need to be compensated between the adjacent two original video frames. The saturation of the data path between the processor and the display screen is required in some embodiments of the display device.
[0038] In some embodiments, if the data path between the processor and the display screen does not require saturation, the original video frame can be directly sent to the display screen to enable the display screen to refresh and display according to the original video frame. Since the frame rate of the original video frame determined by the frame skipping value meets the refresh rate of the display screen, the display screen can work normally.
[0039] In some embodiments, the refresh rate of the display screen is not a continuous value, but a preset number of values.
[0040] S103: sending the target video information to the display screen, wherein the display screen is configured to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
[0041] In some embodiments, for example, the display screen determines that a video frame includes a first display identifier, and can determine that the video frame is an original video frame; for example, the display screen determines that a video frame includes a second display identifier, and can determine that the video frame is a preset video frame.
[0042] In some embodiments, for example, the display screen determines that a video frame includes a display identifier, and can determine that the video frame is an original video frame.
[0043] It should be noted that the display screen is a variable refresh rate VRR display screen, which generally has a preset refresh rate (for example, X Hz). When the number of preset compensation frames between adjacent original video frames in the target video information is Y (the value of Y is equal to N), if the display screen is refreshed according to the original video frame to display the original video frame, the refresh rate of the display screen is X / (1+Y) Hz.
[0044] For example, when X=120, if Y=1, the refresh rate of the display screen is 120 / (1+1)=60 when the display screen is refreshed according to the original video frame to display the original video frame.
[0045] In some embodiments, during the process in which the processor sends the target video information to the display, the transmission frame rate of the target video information is within the preset receiving frame rate range of the display screen. For example, when X=120, the preset receiving frame rate range of the display screen is 0-120.
[0046] It should be noted that, during the process in which the display screen is refreshed according to the original video frame to display the original video frame, generally, after the refresh according to the current original video frame is completed, the display of the current original video frame is maintained until the next original video frame is received and the refresh according to the next original video frame is completed. That is, the display screen does not display the compensation video frame between the current original video frame and the next original video frame.
[0047] The video information processing method provided by some embodiments of the present application includes: obtaining a decoding occupancy rate in a decoding process of an original video code stream, performing frame skipping decoding processing on the original video code stream to generate original video frames; adding preset compensation frames between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frames have different identifiers; and sending the target video information to a display screen, wherein the display screen is configured to determine the original video frames according to the identifiers of the original video frames and to refresh the display screen according to the original video frames to display the original video frames. In the above method, the original video code stream is subjected to frame skipping decoding processing to generate original video frames, and preset compensation frames are added between adjacent original video frames after frame skipping to generate target video information, so that the display screen can be refreshed according to the original video frames to display the original video frames, the refresh rate of the display screen is reduced, the display screen can display the original video frames in a flow manner, and problems such as freezing and screen blooming of the display screen are avoided. Moreover, the original video code stream is subjected to frame skipping decoding processing to generate original video frames, which can avoid the problem that a high processing capacity of a processor leads to a high cost of the processor, further avoid the problem that a high processing capacity of a processor generates a large amount of heat during work, which reduces the reliability of a chip, save the cost of the processor, and thus reduce the design cost of a display device.
[0048] Unlike the prior art, in which when the resolution of the display screen is greater than 4K and the refresh rate is greater than 60 Hz (hertz), if a processor in the prior art is used to process the original video stream corresponding to the resolution greater than 4K and the refresh rate greater than 60 Hz to obtain video information, when the display screen displays a video image according to the video information, the display screen will have problems such as freezing and screen distortion. In the present application, the processor can determine target video information according to the frame skipping value and the original video information, so that when the resolution of the display screen is greater than 4K and the refresh rate is greater than 60 Hz, if a processor in the prior art is used to decode and process the video stream corresponding to the resolution greater than 4K and the refresh rate greater than 60 Hz to obtain target video information, when the display screen displays a video image according to the video information, the display screen will not have problems such as freezing and screen distortion.
[0049] On the basis of the above embodiments, the following will be described in combination with Figure 2 The video information processing method provided in the present application will be described in further detail.
[0050] Figure 2 The flowchart of the video information processing method provided in the present application is shown in Figure Two As shown in Figure 2 , the video information processing method comprises:
[0051] S201: Obtain the decoding occupancy rate and the stream processing strategy in the process of decoding and processing the original video stream.
[0052] The stream processing strategy can be a sequential frame processing strategy or a frame skipping processing strategy.
[0053] In some embodiments, the frame skipping value can be determined according to the decoding occupancy rate, and the stream processing strategy can be determined according to the frame skipping value. For example, when the frame skipping value is 0, the stream processing strategy is a sequential frame processing strategy; when the frame skipping value is greater than 0, the stream processing strategy is a frame skipping processing strategy.
[0054] In some embodiments, the stream processing strategy can be determined according to the identifier recorded by the display device. For example, when the identifier is an over-standard identifier, the stream processing strategy is a frame skipping processing strategy; when the identifier is an under-standard identifier, the stream processing strategy is a sequential frame processing strategy.
[0055] In some embodiments, when the frame skipping value is determined according to the decoding occupancy rate, the preset mapping relationship needs to be referred to, wherein the preset mapping relationship contains the decoding occupancy rate and the frame skipping value, and can also contain the decoding occupancy rate and the standard frame skipping value.
[0056] For example, when the preset mapping relationship contains the decoding occupancy rate and the frame skipping value, the frame skipping value corresponding to the decoding occupancy rate can be found in the preset mapping relationship, and the frame skipping value corresponding to the decoding occupancy rate is determined as the frame skipping value.
[0057] For example, when the preset mapping relationship contains the decoding occupancy ratio and the standard skip frame value, after the standard skip frame value corresponding to the decoding occupancy ratio is found in the preset mapping relationship, the skip frame value to be increased is determined according to the standard skip frame value and the current skip frame value, and then the skip frame value to be increased is taken as the skip frame value.
[0058] S202: processing the decoding occupancy ratio and the occupancy threshold to obtain the computing power monitoring information.
[0059] In some embodiments, it is determined whether the decoding occupancy is less than the occupancy threshold.
[0060] If the decoding occupancy ratio is less than the occupancy threshold, the ratio of the decoding occupancy ratio to the occupancy threshold and the exceeding standard identifier are determined as the computing power monitoring information.
[0061] If the decoding occupancy ratio is greater than or equal to the occupancy threshold, the ratio of the decoding occupancy ratio to the occupancy threshold is determined as the computing power monitoring information.
[0062] In some embodiments, when the decoding occupancy ratio is less than the occupancy threshold, the computing power monitoring information includes the exceeding standard identifier and the ratio of the decoding occupancy ratio to the occupancy threshold; and when the decoding occupancy ratio is greater than or equal to the occupancy threshold, the computing power monitoring information includes the ratio of the decoding occupancy ratio to the occupancy threshold. The ratio is equal to the ratio obtained by dividing the occupancy threshold by the decoding occupancy ratio.
[0063] Optionally, the exceeding standard identifier can be a pre-stored identifier for indicating that the decoding occupancy ratio is greater than or equal to the occupancy threshold. For example, the exceeding standard identifier can be “YES”, “1”, etc.
[0064] In some embodiments, when the decoding occupancy ratio is greater than or equal to the occupancy threshold, the computing power monitoring information can include a preset non-exceeding standard identifier, which is a pre-stored identifier for indicating that the decoding occupancy ratio is less than the occupancy threshold. For example, the preset non-exceeding standard identifier can be “NO”, “2”, etc.
[0065] S203: determining whether the code stream processing strategy is a sequential frame processing strategy.
[0066] If yes, S204 is performed.
[0067] If no, S205 is performed.
[0068] In some embodiments, the skip frame value is determined according to the preset mapping relationship.
[0069] In some embodiments, the target skip frame value is directly determined according to the preset mapping relationship, without the need for the processing strategy.
[0070] S204: when the computing power monitoring information contains the exceeding standard identifier, a first preset skip frame value is determined as the skip frame value.
[0071] Optionally, the first preset frame skip value is a frame skip value preset and stored in the display device. For example, the first preset frame skip value may be 1, 3, etc. In some embodiments, the present application does not limit the first preset frame skip value.
[0072] In some embodiments, when the computing power monitoring information includes a non-exceeding mark, or includes a non-exceeding mark, the original video code continues to be decoded sequentially according to the sequential frame processing strategy.
[0073] S205: When the computing power monitoring information does not contain an over-standard flag, and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to the preset threshold, the frame skipping value corresponding to the frame skipping processing strategy is subtracted from the second preset frame skipping value to obtain the frame skipping value; when the computing power monitoring information contains an over-standard flag, the frame skipping value corresponding to the frame skipping processing strategy is increased by the second preset frame skipping value to obtain the frame skipping value.
[0074] Optionally, the preset threshold is a threshold pre-stored in the display device, and the second preset frame skip value is a frame skip value pre-stored in the display device. For example, the preset threshold may be 2, 3, etc., and the second preset frame skip value may be 1, 2, etc. In some embodiments, this application does not limit the preset threshold and the second preset frame skip value.
[0075] For example, when the computing power monitoring information does not contain an over-standard flag, the preset threshold is 2, and the ratio of the decoding occupancy rate to the occupancy rate threshold is 3 (that is, the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than the preset threshold), if the frame skipping value corresponding to the frame skipping processing strategy is 2 and the second preset frame skipping value is 1, then the frame skipping value corresponding to the frame skipping processing strategy is 2 minus the second preset frame skipping value 1, and the resulting frame skipping value is 1.
[0076] For example, when the computing power monitoring information includes an over-standard flag, if the frame skipping value corresponding to the frame skipping processing strategy is 2 and the second preset frame skipping value is 1, then the frame skipping value 2 corresponding to the frame skipping processing strategy is increased by the second preset frame skipping value 1, and the resulting frame skipping value is 3.
[0077] It should be noted that the above process of obtaining the frame skipping value can be repeatedly performed to adjust the frame skipping value in real time.
[0078] S206: Determine the number of compensated video frames between the adjusted adjacent original video frames according to the frame skip value.
[0079] In some embodiments, the frame skip value is the same as the number of compensated video frames.
[0080] In some embodiments, when the number of compensation video frames is determined according to the frame skipping value, a preset correspondence relationship is used, wherein the preset correspondence relationship includes at least one frame skipping value and the number of compensation video frames corresponding to each frame skipping value. In practice, the number of compensation video frames corresponding to the frame skipping value can be found in the preset correspondence relationship, and the number of compensation video frames corresponding to the frame skipping value is determined as the number of compensation video frames.
[0081] S207: According to the number of compensation video frames between the original video frame and the adjusted adjacent original video frame, the number of compensation video frames is added between the adjacent original video frames to generate target video information.
[0082] For example, if the number of compensation video frames is 1, 1 compensation video frame is added; if the number of compensation video frames is 2, 2 compensation video frames (compensation video frame 1 and compensation video frame 2) are added.
[0083] For example, the adjusted adjacent original video frames are original video frame 1, original video frame 2, and original video frame 3, and if the number of compensation video frames is 2, the order of the video frames included in the target video information is original video frame 1, compensation video frame 1, compensation video frame 2, original video frame 2, compensation video frame 1, compensation video frame 2, and original video frame.
[0084] S208: Send the target video information to the display screen, wherein the display screen is used to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
[0085] In some embodiments, after receiving the target video information, the display screen refreshes data according to the display identifier in the target video information, so that the order of the video frames included in the target video information is: the valid video frame corresponding to the data frame 1, two invalid video frames, the valid video frame corresponding to the data frame 2, and two invalid video frames. Since the invalid video frames do not contain the display identifier or contain a display identifier different from that of the valid video frames, the display screen will refresh the television screen according to the display identifier of the data frame 1 to display the image content corresponding to the data frame 1 on the display screen. During the subsequent two invalid video frames, the display screen does not refresh, and the image content corresponding to the data frame 1 remains unchanged. The display screen is refreshed according to the display identifier of the data frame 2 to display the image content corresponding to the data frame 2 on the display screen during the subsequent two invalid video frames. The display screen does not refresh, and the image content corresponding to the data frame 2 remains unchanged. In this way, the refresh frequency of the display screen will change with the change of the target frame skipping value. In the above example, since there is no frame skipping in the first video stream, each frame of the image frame parsed from the first video stream will cause the display screen to refresh and display, and the refresh period is 1 / f, and the corresponding refresh rate is f. In the second video stream, since it is generated by frame skipping processing according to the target frame skipping value, two invalid video frames are included between adjacent valid video frames in the target video information when one frame is selected every two frames during the generation process. The display screen will be refreshed and displayed according to the valid video frame, and the refresh period is 3 / f, and the corresponding refresh rate is f / 3. The frame skipping processing method is only an example, and one frame can be selected every frame or one frame can be selected every N frames, where N is greater than or equal to 1.
[0086] Since the determination of the frame skipping value can change with the change of the decoding occupancy rate, the video stream decoded by the display device in the T1 time period and the video stream decoded in the T2 time period in the adjacent time period can be different, and the refresh frequency of the corresponding display screen will also be adjusted accordingly, where T1 is greater than or equal to 0, and T2 is greater than or equal to 0. The duration of T1 and T2 can be adjusted with the change of the decoding occupancy rate.
[0087] In some embodiments, when the decoding occupancy rate is stable and unchanged, the frame skipping value is not adjusted.
[0088] Some embodiments of the present application provide a video information processing method, including: obtaining a decoding occupancy rate in a decoding process of an original video bitstream and a bitstream processing strategy; processing the decoding occupancy rate and an occupancy threshold to obtain computing power monitoring information; determining whether the bitstream processing strategy is a sequential frame processing strategy; if yes, determining a first preset frame skipping value as a frame skipping value when the computing power monitoring information contains an over-limit identifier; if not, obtaining a frame skipping value corresponding to a frame skipping processing strategy by subtracting a second preset frame skipping value from the frame skipping value when the computing power monitoring information does not contain the over-limit identifier and a ratio of the decoding occupancy rate to the occupancy threshold is greater than or equal to a preset threshold; and obtaining the frame skipping value by adding the second preset frame skipping value to the frame skipping value corresponding to the frame skipping processing strategy when the computing power monitoring information contains the over-limit identifier. In the above method, the decoding occupancy rate and the occupancy threshold are processed to obtain the computing power monitoring information, and then the target video information is obtained according to the computing power monitoring information, so that the display screen can be refreshed according to the original video frame to display the original video frame, the refresh rate of the display screen is reduced, the display screen can display the original video frame in a flow, and problems such as screen freezing and screen blooming are avoided, and the problem that a processor with high processing capability generates a large amount of heat during work to reduce the reliability of a chip is also avoided, the cost of the processor is saved, and the design cost of the display device is reduced.
[0089] Figure 3 A structural schematic diagram of a display device provided by the present application is shown in FIG. 1. As shown in FIG. 1, the display device 30 includes a processor 301 and a display screen 302, wherein, Figure 3
[0090] The processor 301 is configured to perform the following steps:
[0091] obtain a decoding occupancy rate in a decoding process of an original video bitstream, perform frame skipping decoding processing on the original video bitstream, and generate original video frames;
[0092] add a preset compensation frame between adjacent original video frames after frame skipping to generate target video information, wherein the original video frames and the preset compensation frame have different identifiers;
[0093] send the target video information to the display screen 302, wherein the display screen 302 is configured to determine the original video frames according to the identifiers of the original video frames, and refresh the display screen 302 according to the original video frames to display the original video frames.
[0094] The processor in the display device provided by the present application can perform the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects are similar, which will not be described here in detail.
[0095] In some embodiments, the processor 301 obtains a decoding occupancy rate in a decoding process of an original video code stream, performs a frame skipping decoding process on the original video code stream to obtain original video information, including:
[0096] According to the decoding occupancy rate, the code stream processing strategy and the occupancy threshold, a frame skipping value is determined.
[0097] According to the frame skipping value, the frame skipping decoding process is performed on the original video code stream to generate the original video information, wherein the original video information includes a display identifier, and the preset compensation frame does not include the display identifier.
[0098] In some embodiments, the processor 301 determines the frame skipping value according to the decoding occupancy rate, the code stream processing strategy and the occupancy threshold, including:
[0099] The decoding occupancy rate and the occupancy threshold are processed to obtain power monitoring information.
[0100] According to the power monitoring information and the code stream processing strategy, the frame skipping value is determined, and different frame skipping values correspond to different decoding occupancy rates.
[0101] In some embodiments, the processor 301 is further configured to:
[0102] If the decoding occupancy rate is less than the occupancy threshold, the ratio of the decoding occupancy rate to the occupancy threshold and an over-standard identifier are determined as the power monitoring information.
[0103] If the decoding occupancy rate is greater than or equal to the occupancy threshold, the ratio of the decoding occupancy rate to the occupancy threshold is determined as the power monitoring information.
[0104] In some embodiments, the processor 301 is further configured to:
[0105] When the code stream processing strategy is a sequential frame processing strategy, if the power monitoring information includes the over-standard identifier, a first preset frame skipping value is determined as the frame skipping value.
[0106] In some embodiments, the processor 301 is further configured to:
[0107] When the code stream processing strategy is a frame skipping processing strategy, if the power monitoring information does not include the over-standard identifier and the ratio of the decoding occupancy rate to the occupancy threshold is greater than or equal to a preset threshold, a frame skipping value corresponding to the frame skipping processing strategy is obtained by subtracting a second preset frame skipping value.
[0108] If the power monitoring information includes the over-standard identifier, the frame skipping value corresponding to the frame skipping processing strategy is obtained by adding the second preset frame skipping value.
[0109] In some embodiments, the processor 301 is further configured to:
[0110] determine the number of compensation video frames between the adjusted adjacent original video frames according to the frame skipping value;
[0111] add compensation video frames between the adjacent original video frames to generate target video information according to the number of compensation video frames between the original video frames and the adjusted adjacent original video frames.
[0112] In some embodiments, the transmission frame rate of the target video information is within a preset receiving frame rate range of the display screen.
[0113] In some embodiments, the decoding occupancy rate in the process of decoding and processing the original video code stream is different when the number of original video frames generated in the same processing duration is different.
[0114] In some embodiments, the display screen 302 is further configured to maintain the display of the current original video frame until the next frame of original video frame is received and refreshed according to the next frame of original video frame after the refresh according to the current original video frame is completed.
[0115] Figure 4 A structural schematic diagram of a video information processing apparatus provided in the present application is provided. The video information processing apparatus 40 is arranged in the processor 301, and the video information processing apparatus 40 comprises a decoding module 401, a decoding monitoring module 402, a video information determining module 404, and a sending module 405, wherein,
[0116] The decoding module 401 is configured to obtain the original video frame obtained by decoding and processing the original video code stream, and provide the original video frame to the video information determining module 404;
[0117] The decoding monitoring module 402 is configured to obtain the decoding occupancy rate, and provide the decoding occupancy rate to the video information determining module 404;
[0118] The video information determining module 404 is configured to add a preset compensation frame between the adjacent original video frames after frame skipping according to the received decoding occupancy rate and original video frame, generate target video information, and provide the target video information to the sending module 405.
[0119] The sending module 405 is configured to send the target video information to the display screen.
[0120] The video information processing apparatus provided in the present application can execute the technical solutions shown in the method embodiments, and the implementation principles and beneficial effects are similar, which will not be described here.
[0121] In some embodiments, the video information processing apparatus 40 can further comprise a frame skipping determining module 403, wherein,
[0122] The frame skipping determination module 403 is configured to acquire the decoding occupancy in the decoding module 402, the code stream processing strategy of the decoding module 401, determine a frame skipping value according to the decoding occupancy, the occupancy threshold and the processing strategy, and provide the frame skipping value to the video information determination module 404.
[0123] The video information determination module 404 is further configured to determine target video information according to the frame skipping value and the original video information.
[0124] The video information processing apparatus provided in the present application can execute the technical solutions shown in the method embodiments, and the implementation principles and beneficial effects are similar, which will not be repeated here.
[0125] In the above Figure 3 In the embodiments shown in the above
[0126] The memory can contain a high-speed RAM memory, and can also include a non-volatile storage NVM, such as a disk memory.
[0127] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, the bus in the drawings of the present application does not limit to only one bus or one type of bus.
[0128] The present application also provides a computer readable storage medium, the computer readable storage medium stores computer execution instructions, when the processor executes the computer execution instructions, the video information processing method is realized.
[0129] The computer readable storage medium described above can be realized by any type of volatile or nonvolatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special purpose computer.
[0130] An exemplary readable storage medium is coupled to the processor, so that the processor can read information from the readable storage medium, and can write information to the readable storage medium. Of course, the readable storage medium can also be an integral part of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist as discrete components in the device.
[0131] The division of units is only a logical functional division, and in actual implementation, there can be another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0132] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. According to actual needs, part or all of the units can be selected to achieve the purpose of the embodiment scheme.
[0133] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit.
[0134] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the present application that essentially contribute to the prior art or the parts of the technical solutions can be embodied in the form of software products. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the embodiments of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.
[0135] Those of ordinary skill in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction-related hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes a ROM, a RAM, a magnetic disk or an optical disk, and various media that can store program codes.
[0136] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacements for part or all of the technical features; and these modifications or replacements do not make the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A display device, characterized in that: include: processor and display, among which, The processor is configured to execute: Process the decoding occupancy rate and occupancy rate threshold to obtain computing power monitoring information; Determine a frame skipping value based on the computing power monitoring information and the bitstream processing strategy, where different frame skipping values correspond to different decoding occupancy rates; When the code stream processing strategy is a frame skipping strategy, if the computing power monitoring information does not include an over-limit flag, and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to a preset threshold, subtracting a second preset frame skipping value from a frame skipping value corresponding to the frame skipping strategy to obtain the frame skipping value; When the code stream processing strategy is a frame skipping strategy, if the computing power monitoring information includes the exceeding indicator, the frame skipping value corresponding to the frame skipping strategy is increased by a second preset frame skipping value to obtain the frame skipping value; Performing frame skipping decoding on the original video stream according to the frame skipping value to generate original video frames; Adding a preset compensation frame between adjacent original video frames after the frame skipping to generate target video information, wherein the original video frame and the preset compensation frame have different identifiers; the original video frame includes a display identifier, while the preset compensation frame does not include the display identifier; The target video information is sent, wherein the display screen is used to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
2. The device according to claim 1, characterized in that The processor is further configured to: If the decoding occupancy rate is less than the occupancy rate threshold, determining the ratio of the decoding occupancy rate to the occupancy rate threshold and the exceeding-standard flag as the computing power monitoring information; If the decoding occupancy rate is greater than or equal to the occupancy rate threshold, the ratio of the decoding occupancy rate to the occupancy rate threshold is determined as the computing power monitoring information.
3. The device according to claim 1 or 2, characterized in that The processor is further configured to: When the code stream processing strategy is a sequential frame processing strategy, if the computing power monitoring information includes an over-limit flag, the first preset frame skipping value is determined as the frame skipping value.
4. The device according to claim 1 or 2, characterized in that The processor is further configured to: Determining the number of compensated video frames between adjusted adjacent original video frames according to the frame skip value; According to the number of compensation video frames between the original video frame and the adjusted adjacent original video frames, the compensation video frames are added between the adjacent original video frames to generate the target video information.
5. The device according to claim 1, characterized in that The transmission frame rate of the target video information is within the preset receiving frame rate range of the display screen.
6. The device according to claim 1, characterized in that If the number of generated original video frames is different within the same processing time, the decoding occupancy rate during the decoding process of the original video stream will be different.
7. The device according to claim 1, characterized in that The display screen is further configured to: after refreshing according to the current original video frame is completed, maintain display of the current original video frame until a next original video frame is received and refresh according to the next original video frame.
8. A video information processing method, characterized in that: Applied to a display device, the display device includes a processor and a display screen, and the method includes: The processor processes the decoding occupancy rate and the occupancy rate threshold to obtain computing power monitoring information; Determine a frame skipping value based on the computing power monitoring information and the bitstream processing strategy, where different frame skipping values correspond to different decoding occupancy rates; When the code stream processing strategy is a frame skipping strategy, if the computing power monitoring information does not include an over-limit flag, and the ratio of the decoding occupancy rate to the occupancy rate threshold is greater than or equal to a preset threshold, subtracting a second preset frame skipping value from a frame skipping value corresponding to the frame skipping strategy to obtain the frame skipping value; When the code stream processing strategy is a frame skipping strategy, if the computing power monitoring information includes the exceeding indicator, the frame skipping value corresponding to the frame skipping strategy is increased by a second preset frame skipping value to obtain the frame skipping value; Performing frame skipping decoding on the original video stream according to the frame skipping value to generate original video frames; The processor adds a preset compensation frame between adjacent original video frames after the frame skipping to generate target video information, wherein the original video frame and the preset compensation frame have different identifiers; the original video frame includes a display identifier, while the preset compensation frame does not include the display identifier; The processor sends the target video information, wherein the display screen is used to determine the original video frame according to the identifier corresponding to the original video frame, and refresh the display screen according to the original video frame to display the original video frame.
Citation Information
Patent Citations
Video decoding method
CN101715129A
Remote video display method and system
CN106658176A
Video playing method and apparatus, computer equipment, and computer readable medium
CN108933952A
Video image decoding method and device
CN109120936A