EPG UI frame processing method, device, server and storage medium

By reducing frame data of EPG UI frames in cloud-based set-top boxes, the problem of unsmooth and lag caused by insufficient decoding capabilities in set-top boxes when processing media streams is solved, and the optimized smoothness effect is achieved.

CN112839262BActive Publication Date: 2025-04-22ZTE CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN201911168968.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-25
Publication Date
2025-04-22
Estimated Expiration
2039-11-25

AI Technical Summary

Technical Problem

When the set-top box processes media streams from CDN and media streams from EPG UIs sent in the cloud, due to limited performance, the decoding processing capabilities are insufficient, and the screen display is not smooth and stuttered.

Method used

A method for processing EPG UI frames is provided, including receiving EPG UI frames to be sent to the cloud-based set-top box, and performing frame data reduction processing according to preset data deletion rules when the cloud-based set-top box meets the low decoding conditions to reduce the decoding requirements for the cloud-based set-top box.

Benefits of technology

By reducing frame data, the decoding needs of cloud-based set-top boxes are reduced, the fluency of set-top boxes is optimized, and the poor display fluency and lag problems caused by low hardware performance are solved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112839262B_ABST
    Figure CN112839262B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides a method, device, server and storage medium for processing an EPG UI frame, which receives an EPG UI frame to be sent to a cloud set-top box; when it is determined that the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to a preset data deletion rule. When the cloud set-top box currently meets the low decoding condition, the EPG UI frame can be subjected to frame data reduction processing, thereby reducing the decoding requirements for the cloud set-top box, and achieving the beneficial effect of optimizing the fluency of the set-top box.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to, but are not limited to, the technical fields of multimedia terminals and cloud computing, and specifically, to, but are not limited to, a method, device, server, and storage medium for processing an EPG UI frame. Background Art

[0002] As big video services become increasingly mature, users have higher requirements for service experience, hoping to have a better UI (User Interface) experience and enjoy more value-added services. At the same time, with the rapid development of cloud computing and virtualization technology, cloud set-top boxes based on cloud computing and virtualization technology have been used. The solution of cloud set-top boxes in related technologies is as follows: the set-top box retains the core decoding capability and peripheral interface capability. For UI, complex services and games, they are first processed by the cloud, and then sent to the set-top box in the form of media streams for display by the set-top box. The advantages of this cloud set-top box are as follows: (1) Long cycle, high experience: inject a stronger new experience, and extend the life cycle of the set-top box device; (2) Zero adaptation, second upgrade: service launch, version upgrade, no longer need to adapt multiple manufacturers and multiple set-top box models one by one, greatly saving manpower and material resources. Although cloud-based set-top boxes have the above advantages, this also means that the set-top boxes need to process the media streams distributed from the CDN (Content Delivery Network) and the EPG (Electronic Program Guide) UI media streams sent from the cloud at the same time. Therefore, for set-top boxes with limited performance, there will be insufficient decoding processing capabilities, resulting in unsmooth and stuck picture display on the TV. Summary of the invention

[0003] The EPG UI frame processing method, device, server and storage medium provided by the embodiments of the present invention mainly solve the technical problem that when the set-top box in the related art simultaneously processes the media stream distributed by the CDN and the media stream of the EPG UI sent from the cloud, due to the limited performance of the set-top box, insufficient decoding processing capability will occur, resulting in problems such as unsmooth and stuck display of the picture on the TV.

[0004] In order to solve the above technical problems, an embodiment of the present invention provides a method for processing an electronic program guide user interface EPG UI frame, comprising:

[0005] Receive the EPG UI frame to be sent to the cloud set-top box;

[0006] When it is determined that the cloud-based set-top box meets the low decoding condition, frame data reduction processing is performed on the EPG UI frame according to a preset data deletion rule.

[0007] In order to solve the above technical problems, an embodiment of the present invention further provides a processing device for an EPG UI frame, comprising:

[0008] The virtual processor unit is used to receive the EPG UI frame to be sent to the cloud set-top box; when it is determined that the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to a preset data deletion rule.

[0009] To solve the above technical problems, an embodiment of the present invention further provides a set-top box cloud server, including a processor, a memory and a communication bus;

[0010] The communication bus is used to realize the connection and communication between the processor and the memory;

[0011] The processor is used to execute one or more computer programs stored in the memory to implement the steps of the EPG UI frame processing method as described above.

[0012] To solve the above technical problem, an embodiment of the present invention further provides a computer-readable storage medium, which stores one or more computer programs. The one or more computer programs can be executed by one or more processors to implement the steps of the EPG UI frame processing method as described above.

[0013] The beneficial effects of the present invention are:

[0014] According to the EPG UI frame processing method, device, server and storage medium provided by the embodiment of the present invention, by receiving the EPG UI frame to be sent to the cloud set-top box; when it is determined that the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to the preset data deletion rule. In some implementation processes, when the cloud set-top box meets the low decoding condition, the cached EPG UI frame is subjected to frame data reduction processing, thereby reducing the decoding requirements for the cloud set-top box, playing a role in optimizing the fluency of the set-top box, and solving the problems of poor display fluency and freeze on the TV due to the low hardware performance of the set-top box and insufficient decoding capability.

[0015] Other features and corresponding beneficial effects of the present invention are described in the latter part of the specification, and it should be understood that at least part of the beneficial effects become obvious from the description in the specification of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A basic framework diagram of a system according to various embodiments of the present invention;

[0017] Figure 2 A flow chart of a method for processing an EPG UI frame provided in Embodiment 1 of the present invention;

[0018] Figure 3 A flow chart of an optional EPG UI frame processing method provided in Embodiment 1 of the present invention;

[0019] Figure 4 A flow chart of an optional EPG UI frame processing method provided in Embodiment 1 of the present invention;

[0020] Figure 5 A flow chart of a method for processing an EPG UI frame provided in Embodiment 2 of the present invention;

[0021] Figure 6 A flow chart of a method for processing an EPG UI frame provided in Embodiment 3 of the present invention;

[0022] Figure 7 A schematic diagram of a set-top box cloud server provided in Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the following is a further detailed description of the embodiments of the present invention through specific implementation methods combined with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0024] See also Figure 1 , Figure 1 It is a basic framework diagram of the system of each embodiment. In some embodiments, the system can be a cloud set-top box system.

[0025] The system can include three parts: cloud set-top box (tSTB), cloud platform and other business systems (such as content distribution network (CDN), electronic program guide (EPG)). The cloud platform includes: tSTB authentication system, cloud platform virtual machine control system (VM Controller) and virtual processor system (vSTB).

[0026] The tSTB is connected to the cloud platform through the tSTB authentication system; after being authenticated by the tSTB authentication system, the VMController assigns the corresponding vSTB to the tSTB; the vSTB receives the key commands from the tSTB, and based on the processing of the key commands, the vSTB feeds back the results to the tSTB.

[0027] Embodiment 1:

[0028] In order to solve the problem that when a set-top box processes the media stream distributed by CDN and the media stream of EPGUI sent from the cloud at the same time, the decoding processing capability is insufficient due to the limited performance of the set-top box, resulting in the problem of unsmooth display and freeze on the TV, the embodiment of the present invention provides a method for processing EPG UI frames, see Figure 2 The processing method of the EPG UI frame specifically comprises the following steps:

[0029] S201: receiving an EPG UI frame to be sent to a cloud-based set-top box;

[0030] S202: Determine whether the cloud-based set-top box meets the low decoding condition, if so, execute S203; otherwise, execute S204;

[0031] S203: performing frame data reduction processing on the EPG UI frame according to a preset data deletion rule, encoding the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream; and sending the first UI stream to the cloud set-top box;

[0032] S204: directly encode the EPG UI frame to obtain a second UI stream; and send the second UI stream to the cloud-based set-top box.

[0033] It can be understood that the decoding requirement of the first UI stream on the cloud-based set-top box is lower than the decoding requirement of the second UI stream on the cloud-based set-top box.

[0034] In some embodiments, the low decoding condition includes: the cloud set-top box is currently in a multimedia playback state. The multimedia playback state includes preview video playback, full-screen video playback, and game playback. It should be understood that at this time, the tSTB will simultaneously process the media stream distributed from the CDN and the media stream of the EPG UI issued by the cloud platform, and output them to the TV after superimposing and displaying them.

[0035] In some embodiments, the preset data deletion rule includes any one of the following:

[0036] Rule 1: Delete a set number of EPG UI frames according to a set frame deletion policy for each EPG UI frame;

[0037] Rule 2: Delete a set number of pixels from at least one EPG UI frame in each EPG UI frame according to a set pixel deletion strategy;

[0038] Rule three: for each EPG UI frame, a set number of EPG UI frames are deleted according to a set frame deletion policy; then, for at least one EPG UI frame among the remaining EPG UI frames, a set number of pixels are deleted according to a set pixel deletion policy.

[0039] It should be noted that, in the above rule 3, deleting a set number of pixels from at least one of the remaining EPG UI frames according to the set pixel deletion strategy may include any one of the following methods:

[0040] Method 1: Deleting a set number of pixels from the even-numbered frames of the remaining EPG UI frames according to a set pixel deletion strategy;

[0041] Method 2: Deleting a set number of pixels from the odd-numbered frames in the remaining EPG UI frames according to a set pixel deletion strategy;

[0042] Method 3: Delete a set number of pixels from each of the remaining EPG UI frames according to a set pixel deletion strategy.

[0043] In some embodiments, the preset data deletion rule includes the rule one or the rule three;

[0044] The frame deletion strategy includes:

[0045] The difference mean is calculated for each frame in the S1 frame picture according to the set difference value calculation formula, and then the difference means of the S1 frame pictures are sorted, and the S2 frame pictures are deleted; the difference mean of each frame picture in the S2 frame pictures is smaller than the difference mean of each remaining frame picture.

[0046] In some embodiments, the S1 and the S2 are obtained through the identification information of the cloud-based set-top box and the preset corresponding relationship between the identification information of the cloud-based set-top box and the parameters.

[0047] In some embodiments, the preset data deletion rule includes the rule 2 or the rule 3;

[0048] The pixel deletion strategy includes:

[0049] For each unit in each frame of the picture, M pixels are deleted according to a preset color condition; each unit includes N adjacent pixels.

[0050] In some embodiments, the N and the M are obtained through the identification information of the cloud-based set-top box and the preset corresponding relationship between the identification information of the cloud-based set-top box and the parameters.

[0051] It should be noted that when tSTB is authenticating with the cloud platform, it will also send its own model to the tSTB authentication system; after the tSTB authentication system passes the tSTB authentication, it will send the tSTB model to the vSTB; and the vSTB has a preset configuration table containing S1, S2, N, and M parameters. The vSTB can match the corresponding S1, S2, N, and M according to the tSTB model. Generally, S1 is greater than S2; N is greater than M.

[0052] In order to better understand the present invention, an embodiment of the present invention provides an optional frame data reduction processing process, which is as follows: vSTB matches S1 and S2 according to the model of tSTB, which are 100 and 10 respectively; at this time, for the UI frame from EPG, vSTB first caches 100 frames of pictures, and then performs a differential comparison calculation of the previous and next frames on these 100 frames. Specifically, the n+1 frame is differentially compared with its previous frame (n frame) and the next frame (n+2 frame), and the difference values ​​are averaged. The calculation method is: P(n+1) = (q(n) + q(n+2)) / 2, n is an integer greater than or equal to 0; P(n+1) in the above calculation formula is the average difference between the n+1 frame and the previous and next frames; q(n) is the difference between the n+1 frame and the n frame, that is, the first difference value; q(n+2) is the difference between the n+1 frame and the n+2 frame, that is, the second difference value. According to the above calculation formula, the 100 frames of cached images are processed to obtain the P value of each frame. After sorting them according to the size of the P value, the 10 frames with the smallest P value are deleted.

[0053] In order to better understand the present invention, an embodiment of the present invention provides an optional frame data reduction processing process, which is as follows: vSTB matches S1, S2, N, and M according to the model of tSTB, and the values ​​are 100, 20, 10, and 2 respectively. First, 20 frames are deleted according to the set frame deletion strategy to obtain 80 frames of pictures, and then each of the 80 frames of pictures is divided into units. The unit division rule is: for each frame of the picture, 10 adjacent pixels are used as a unit, and each frame of the picture is divided into several units; then, according to the principle of giving priority to discarding the closer the color to the adjacent pixels, two pixels are taken out from each unit to obtain a new unit. At this time, several new units are combined together to form a frame of pictures with reduced pixels. Through the above process, 80 frames of pictures with reduced pixels can be finally obtained.

[0054] In order to better understand the present invention, the present invention implements an optional EPG UI frame processing method, see Figure 3 , the processing method of the EPG UI frame comprises the following steps:

[0055] S301: Receive the EPG UI frame to be sent to the cloud set-top box.

[0056] S302: According to the video playback start instruction sent by the cloud-based set-top box, determine that the cloud-based set-top box is currently in a video playback state.

[0057] S303: Perform frame data reduction processing on the EPG UI frame according to a preset data reduction rule; encode the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream; and send the first UI stream to the cloud set-top box.

[0058] S304: According to the video playback end instruction sent by the cloud-based set-top box, it is determined that the cloud-based set-top box is not currently in the video playback state.

[0059] S305: directly encode the EPG UI frame to obtain a second UI stream; and send the second UI stream to the cloud set-top box.

[0060] It can be understood that the first UI stream has lower decoding requirements for the cloud set-top box than the second UI stream. When the CDN media stream is played on the tSTB, the vSTB performs frame data reduction processing on the EPG UI frame, so that the overall decoding requirements of the tSTB are at a lower level.

[0061] The present invention also provides an optional EPG UI frame processing method, see Figure 4 , the processing method of the EPG UI frame comprises the following steps:

[0062] S401: Receive the EPG UI frame to be sent to the cloud set-top box.

[0063] S402: According to the preview video playback start instruction sent by the cloud-based set-top box, it is determined that the cloud-based set-top box is currently in a preview video playback state.

[0064] S403: Perform frame data reduction processing on the EPG UI frame according to Rule 1 or Rule 2, encode the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream; send the first UI stream to the cloud set-top box; and then execute S406.

[0065] S404: According to the full-screen video playback start instruction sent by the cloud-based set-top box, it is determined that the cloud-based set-top box is currently in a full-screen video playback state.

[0066] S405: Perform frame data reduction processing on the EPG UI frame according to rule three, encode the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream; send the first UI stream to the cloud set-top box; and then execute S406.

[0067] S406: According to the video playback end instruction sent by the cloud-based set-top box, it is determined that the cloud-based set-top box is not currently in the video playback state.

[0068] S407: directly encode the cached EPG UI frame to obtain a second UI stream; and send the second UI stream to the cloud-based set-top box.

[0069] The EPG UI frame processing method provided by the embodiment of the present invention receives the EPG UI frame to be sent to the cloud set-top box; when it is determined that the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to the preset data deletion rule. When the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing, thereby reducing the decoding requirements for the cloud set-top box and optimizing the fluency of the set-top box.

[0070] Embodiment 2:

[0071] In order to solve the problem that when a set-top box processes the media stream distributed by CDN and the media stream of EPGUI sent from the cloud at the same time, the decoding processing capability is insufficient due to the limited performance of the set-top box, resulting in the problem of unsmooth display and freeze on the TV, the embodiment of the present invention provides a method for processing EPG UI frames, see Figure 5 , the processing method of the EPG UI frame comprises the following steps:

[0072] S501: When the TV and tSTB start working, the tSTB accesses the cloud platform through the tSTB authentication system. After passing the authentication of the tSTB authentication system, the VM Controller assigns the corresponding vSTB to the tSTB, and the tSTB is normally connected to the vSTB.

[0073] S502: The vSTB receives an EPG UI frame to be sent to the cloud set-top box;

[0074] S503: vSTB directly encodes the EPG UI frame to obtain a second UI stream;

[0075] S504: vSTB sends the second UI stream to tSTB;

[0076] S505: After the tSTB decodes the second UI stream, it outputs the EPG UI display to the TV set;

[0077] S506: tSTB receives the key command of the remote control and sends it to vSTB. After processing the broadcast control message, vSTB feeds back the broadcast control command of the video to tSTB. After receiving the broadcast control command, tSTB initiates a broadcast control request to CDN to request the audio and video stream.

[0078] S507: CDN responds to the broadcast control request and sends the audio and video stream to tSTB;

[0079] S508: After obtaining the audio and video streams from the CDN, the tSTB feeds back a video playback start instruction to the vSTB;

[0080] S509: performing frame data reduction processing on the EPG UI frame according to a preset data deletion rule; encoding the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream;

[0081] S510: vSTB sends the first UI stream to tSTB;

[0082] S511: After decoding the audio and video streams and the first UI stream, the tSTB outputs the EPG UI and video overlay display to the TV.

[0083] S512: tSTB receives the key command of the remote control and sends it to vSTB. After processing the broadcast control message, vSTB feeds back the broadcast control command of the video to tSTB. After tSTB obtains the broadcast control command, it ends the video playback and feeds back the video playback end command to vSTB.

[0084] S513: vSTB directly encodes the EPG UI frame to obtain a second UI stream;

[0085] S514: vSTB sends the second UI stream to tSTB;

[0086] S515: After decoding the second UI stream, the tSTB outputs the EPG UI display to the TV.

[0087] In some embodiments, the preset data deletion rule includes any one of the following:

[0088] Rule 1: Delete a set number of EPG UI frames according to a set frame deletion policy for each EPG UI frame;

[0089] Rule 2: Delete a set number of pixels from at least one EPG UI frame in each EPG UI frame according to a set pixel deletion strategy;

[0090] Rule three: for each EPG UI frame, a set number of EPG UI frames are deleted according to a set frame deletion policy; then, for at least one EPG UI frame among the remaining EPG UI frames, a set number of pixels are deleted according to a set pixel deletion policy.

[0091] Among them, in the above rule 3, deleting a set number of pixels from at least one of the remaining EPG UI frames according to a set pixel deletion strategy may include any one of the following methods:

[0092] Method 1: Deleting a set number of pixels from the even-numbered frames of the remaining EPG UI frames according to a set pixel deletion strategy;

[0093] Method 2: Deleting a set number of pixels from the odd-numbered frames in the remaining EPG UI frames according to a set pixel deletion strategy;

[0094] Method 3: Delete a set number of pixels from each of the remaining EPG UI frames according to a set pixel deletion strategy.

[0095] In some embodiments, the preset data deletion rule includes rule 1 or rule 3; the frame deletion strategy includes: calculating the difference mean for each frame in the S1 frame picture according to the set difference value calculation formula, then sorting the difference mean of the S1 frame picture, and deleting the S2 frame picture; the difference mean of each frame picture in the S2 frame picture is smaller than the difference mean of each remaining frame picture. Wherein, S1 and S2 are obtained through the identification information of the cloud set-top box, and the preset corresponding relationship between the identification information of the cloud set-top box and the parameter.

[0096] In some embodiments, the preset data deletion rule includes rule 2 or rule 3; the pixel deletion strategy includes: deleting M pixels for each unit in each frame of the picture according to the preset color condition; each unit includes N adjacent pixels. Wherein, N and M are obtained through the identification information of the cloud set-top box and the preset corresponding relationship between the identification information of the cloud set-top box and the parameter.

[0097] The EPG UI frame processing method provided by the embodiment of the present invention is applicable to scenarios including but not limited to EPG and video playback, EPG and TV games, etc. When it is determined that the cloud set-top box is currently in a multimedia playback state, the EPG UI frame is subjected to frame data reduction processing according to a preset data deletion rule to reduce the demand for tSTB decoding, thereby optimizing the fluency of the set-top box.

[0098] Embodiment three:

[0099] In order to solve the problem that when a set-top box processes the media stream distributed by CDN and the media stream of EPGUI sent from the cloud at the same time, the decoding processing capability is insufficient due to the limited performance of the set-top box, resulting in the problem of unsmooth display and freeze on the TV, the embodiment of the present invention provides a method for processing EPG UI frames, see Figure 6 , the processing method of the EPG UI frame comprises the following steps:

[0100] S601: When the TV and tSTB start working, the tSTB accesses the cloud platform through the tSTB authentication system and sends the tSTB model to the tSTB authentication system; after passing the authentication of the tSTB authentication system, the VM Controller assigns the corresponding vSTB to the tSTB and gives the tSTB model to the vSTB, and the tSTB is normally connected to the vSTB;

[0101] S602: The vSTB is preset with a configuration table including S1, S2, N, and M parameters, and the S1, S2, M, and N parameters are matched according to the tSTB model;

[0102] S603: The vSTB receives the EPG UI frame to be sent to the cloud set-top box;

[0103] S604: vSTB directly encodes the EPG UI frame to obtain a second UI stream;

[0104] S605: vSTB sends the second UI stream to tSTB;

[0105] S606: After decoding the second UI stream, the tSTB outputs the EPG UI display to the TV set;

[0106] S607: tSTB receives the key command of the remote control and sends it to vSTB. After processing the broadcast control message, vSTB feeds back the broadcast control command of the video to tSTB. After receiving the broadcast control command, tSTB initiates a broadcast control request to CDN to request the audio and video stream.

[0107] S608: CDN responds to the broadcast control request and sends the audio and video stream to the tSTB;

[0108] S609: After obtaining the audio and video streams from the CDN, the tSTB feeds back a video playback start instruction to the vSTB;

[0109] S610: the vSTB performs frame data reduction processing on the EPG UI frame according to rule three, and encodes the EPG UI frame obtained after the frame data reduction processing to obtain a first UI stream;

[0110] S611: vSTB sends the first UI stream to tSTB;

[0111] S612: After decoding the audio and video stream and the first UI stream, the tSTB outputs the EPG UI and the video overlay display to the TV set;

[0112] S613: tSTB receives the key command of the remote control and sends it to vSTB. After processing the broadcast control message, vSTB feeds back the broadcast control command of the video to tSTB. After tSTB obtains the broadcast control command, it ends the video playback and feeds back the video playback end command to vSTB.

[0113] S614: vSTB directly encodes the EPG UI frame to obtain a second UI stream;

[0114] S615: vSTB sends the second UI stream to tSTB;

[0115] S616: After decoding the second UI stream, the tSTB outputs the EPG UI display to the TV.

[0116] It should be noted that the above-mentioned frame data reduction process for the cached EPG UI frame according to rule three is specifically as follows:

[0117] If vSTB matches S1, S2, N, and M according to the model of tSTB and they are 100, 20, 10, and 2 respectively, then for the UI frame from EPG, vSTB first caches 100 frames of pictures, and then performs a differential comparison calculation of the previous and next frames on these 100 frames. The differential comparison calculation is to perform a differential comparison between the n+1 frame and its previous frame (n frame) and the next frame (n+2 frame), and take the average of the difference values. The calculation method is: P(n+1) = (q(n) + q(n+2)) / 2, n is an integer greater than or equal to 0; P(n+1) in the above calculation formula is the average difference between the n+1 frame and the previous and next frames; q(n) is the difference between the n+1 frame and the n frame, that is, the first difference value; q(n+2) is the difference between the n+1 frame and the n+2 frame, that is, the second difference value. According to the above calculation formula, the 100 frames of cached images are processed, the P value of each frame is obtained, and after sorting according to the size of the P value, the 20 frames of images with the smallest P value are deleted, and then each frame of the remaining 80 frames of images is divided into units. The unit division rule is: for each frame of the image, 10 adjacent pixels are used as a unit, and each frame of the image is divided into several units; then, according to the principle of giving priority to discarding the pixels that are closer to the adjacent pixels, 2 pixels are taken from each unit to obtain a new unit. At this time, several new units are combined together to form a frame of images with reduced pixels. Through the above process, 80 frames of images with reduced pixels can be finally obtained.

[0118] The EPG UI frame processing method provided by the embodiment of the present invention reduces the frame data of the EPG UI frame according to a preset data deletion rule during video playback, thereby reducing the tSTB decoding requirement and optimizing the fluency of the set-top box.

[0119] Embodiment 4:

[0120] In order to solve the problem in the related art that when a set-top box processes a media stream distributed by a CDN and a media stream of an EPGUI sent from the cloud at the same time, due to the limited performance of the set-top box, the decoding processing capability is insufficient, resulting in problems such as unsmooth and stuck picture display on the TV, an embodiment of the present invention provides an EPG UI frame processing device, the EPG UI frame processing device includes a virtual processor unit, which is used to receive an EPG UI frame to be sent to a cloud set-top box; when it is determined that the cloud set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to a preset data deletion rule.

[0121] In some embodiments, the low decoding condition includes: the cloud set-top box is currently in a multimedia playback state. The multimedia playback state includes preview video playback, full-screen video playback, and game playback. It should be understood that at this time, the tSTB will simultaneously process the media stream distributed from the CDN and the media stream of the EPG UI issued by the cloud platform, and output them to the TV after superimposing and displaying them.

[0122] In some embodiments, the preset data deletion rule includes any one of the following:

[0123] Rule 1: Delete a set number of EPG UI frames according to a set frame deletion policy for each EPG UI frame;

[0124] Rule 2: Delete a set number of pixels from at least one EPG UI frame in each EPG UI frame according to a set pixel deletion strategy;

[0125] Rule three: for each EPG UI frame, a set number of EPG UI frames are deleted according to a set frame deletion policy; then, for at least one EPG UI frame among the remaining EPG UI frames, a set number of pixels are deleted according to a set pixel deletion policy.

[0126] It should be noted that, in the above rule 3, deleting a set number of pixels from at least one of the remaining EPG UI frames according to the set pixel deletion strategy may include any one of the following methods:

[0127] Method 1: Deleting a set number of pixels from the even-numbered frames of the remaining EPG UI frames according to a set pixel deletion strategy;

[0128] Method 2: Deleting a set number of pixels from the odd-numbered frames in the remaining EPG UI frames according to a set pixel deletion strategy;

[0129] Method 3: Delete a set number of pixels from each of the remaining EPG UI frames according to a set pixel deletion strategy.

[0130] In some embodiments, the preset data deletion rules include rule one or rule three; the frame deletion strategy includes: calculating the difference mean for each frame in the S1 frame picture according to the set difference value calculation formula, then sorting the difference means of the S1 frame pictures, and deleting the S2 frame pictures; the difference mean of each frame picture in the S2 frame pictures is smaller than the difference mean of each remaining frame picture.

[0131] In some embodiments, S1 and S2 are obtained through identification information of the cloud-based set-top box and a preset correspondence between identification information of the cloud-based set-top box and parameters.

[0132] In some embodiments, the preset data deletion rule includes rule two or rule three; the pixel deletion strategy includes: deleting M pixels for each unit in each frame of the image according to preset color conditions; each unit includes N adjacent pixels.

[0133] In some embodiments, N and M are obtained through the identification information of the cloud-based set-top box and the preset correspondence between the identification information of the cloud-based set-top box and the parameters.

[0134] It should be noted that when tSTB is authenticating with the cloud platform, it will also send its own model to the tSTB authentication system; after the tSTB authentication system passes the tSTB authentication, it will send the tSTB model to the vSTB; and the vSTB has a preset configuration table containing S1, S2, N, and M parameters. The vSTB can match the corresponding S1, S2, N, and M according to the tSTB model. Generally, S1 is greater than S2; N is greater than M.

[0135] In order to better understand the present invention, an embodiment of the present invention provides an optional frame data reduction processing process, which is as follows: vSTB matches S1 and S2 according to the model of tSTB, which are 100 and 10 respectively; at this time, for the UI frame from EPG, vSTB first caches 100 frames of pictures, and then performs a differential comparison calculation of the previous and next frames on these 100 frames. Specifically, the n+1 frame is differentially compared with its previous frame (n frame) and the next frame (n+2 frame), and the difference values ​​are averaged. The calculation method is: P(n+1) = (q(n) + q(n+2)) / 2, n is an integer greater than or equal to 0; P(n+1) in the above calculation formula is the average difference between the n+1 frame and the previous and next frames; q(n) is the difference between the n+1 frame and the n frame, that is, the first difference value; q(n+2) is the difference between the n+1 frame and the n+2 frame, that is, the second difference value. According to the above calculation formula, the 100 frames of cached images are processed to obtain the P value of each frame. After sorting them according to the size of the P value, the 10 frames with the smallest P value are deleted.

[0136] In order to better understand the present invention, an embodiment of the present invention provides an optional frame data reduction processing process, which is as follows: vSTB matches S1, S2, N, and M according to the model of tSTB, and the values ​​are 100, 20, 10, and 2 respectively. First, 20 frames are deleted according to the set frame deletion strategy to obtain 80 frames of pictures, and then each of the 80 frames of pictures is divided into units. The unit division rule is: for each frame of the picture, 10 adjacent pixels are used as a unit, and each frame of the picture is divided into several units; then, according to the principle of giving priority to discarding the closer the color to the adjacent pixels, two pixels are taken out from each unit to obtain a new unit. At this time, several new units are combined together to form a frame of pictures with reduced pixels. Through the above process, 80 frames of pictures with reduced pixels can be finally obtained.

[0137] The EPG UI frame processing device provided by the embodiment of the present invention is used to receive the EPG UI frame to be sent to the cloud set-top box through the virtual processor unit; when it is determined that the cloud set-top box currently meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to the preset data deletion rule. When the cloud set-top box meets the low decoding condition, the cached EPG UI frame is subjected to frame data reduction processing, thereby reducing the decoding requirements for the cloud set-top box and optimizing the fluency of the set-top box.

[0138] Embodiment five:

[0139] This embodiment also provides a set-top box cloud server, see Figure 7 As shown, it includes a processor 701, a memory 702 and a communication bus 703, wherein:

[0140] The communication bus 703 is used to realize the connection and communication between the processor 701 and the memory 702;

[0141] The processor 701 is used to execute one or more computer programs stored in the memory 702 to implement the steps of the EPG UI frame processing method in the above embodiments.

[0142] The present embodiment also provides a computer-readable storage medium, which includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable read only memory), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer.

[0143] The computer-readable storage medium in this embodiment can be used to store one or more computer programs, and the one or more computer programs stored therein can be executed by a processor to implement the steps of the EPG UI frame processing method in the above embodiments.

[0144] This embodiment also provides a computer program (or computer software), which can be distributed on a computer-readable medium and executed by a computing device to implement the steps of the method for optimizing the fluency of a cloud-based set-top box in the above embodiments. In some cases, the steps shown or described can be performed in a different order than described in the above embodiments.

[0145] This embodiment further provides a computer program product, including a computer readable device, on which the computer program as shown above is stored. In this embodiment, the computer readable device may include the computer readable storage medium as shown above.

[0146] It can be seen that those skilled in the art should understand that all or some of the steps, systems, and functional modules / units in the above disclosed methods can be implemented as software (which can be implemented with computer program code executable by a computing device), firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component can have multiple functions, or a function or step can be performed by several physical components in cooperation. Some or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit.

[0147] In addition, it is well known to those skilled in the art that communication media generally contain computer readable instructions, data structures, computer program modules or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery media. Therefore, the present invention is not limited to any specific hardware and software combination.

[0148] The above contents are further detailed descriptions of the embodiments of the present invention in combination with specific implementation methods, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the scope of protection of the present invention.

Claims

1. A method for processing an electronic program guide user interface EPG UI frame, characterized in that: include: Receive the EPG UI frame to be sent to the cloud set-top box; When it is determined that the cloud-based set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to a preset data reduction rule, wherein the low decoding condition includes that the cloud-based set-top box is currently in a multimedia playback state, and the multimedia playback state includes preview video playback, full-screen video playback, and game playback.

2. The processing method of EPG UI frame as claimed in claim 1, characterized in that, The preset data deletion rule includes any one of the following: Rule 1: Delete a set number of EPG UI frames according to a set frame deletion policy for each EPG UI frame; Rule 2: Delete a set number of pixels from at least one EPG UI frame in each EPG UI frame according to a set pixel deletion strategy; Rule 3: Delete a set number of EPG UI frames according to the set frame deletion policy for each EPG UI frame; Then, a set number of pixels are deleted from at least one of the remaining EPG UI frames according to a set pixel deletion strategy.

3. The method for processing an EPG UI frame according to claim 2, wherein the preset data deletion rule comprises the rule 1 or the rule 3; The frame deletion strategy includes: The difference mean is calculated for each frame in the S1 frame picture according to the set difference value calculation formula, and then the difference means of the S1 frame pictures are sorted, and the S2 frame pictures are deleted; the difference mean of each frame picture in the S2 frame pictures is smaller than the difference mean of each remaining frame picture.

4. The processing method of EPG UI frame as claimed in claim 3, characterized in that: The S1 and the S2 are obtained through the identification information of the cloud-based set-top box and the preset corresponding relationship between the identification information of the cloud-based set-top box and the parameters.

5. The method for processing an EPG UI frame according to claim 2, wherein the preset data deletion rule comprises the rule 2 or the rule 3; The pixel deletion strategy includes: For each unit in each frame of the image, M pixels are deleted according to the preset color condition; Each of the units includes N adjacent pixels.

6. The method for processing an EPG UI frame as claimed in claim 5, wherein: The N and the M are obtained through the identification information of the cloud-based set-top box and the preset corresponding relationship between the identification information of the cloud-based set-top box and the parameters.

7. A processing device for an EPG UI frame, comprising: A virtual processor unit, used for receiving an EPG UI frame to be sent to a cloud set-top box; When it is determined that the cloud-based set-top box meets the low decoding condition, the EPG UI frame is subjected to frame data reduction processing according to a preset data reduction rule, wherein the low decoding condition includes that the cloud-based set-top box is currently in a multimedia playback state, and the multimedia playback state includes preview video playback, full-screen video playback, and game playback.

8. A set-top box cloud server, the set-top box cloud server comprising a processor, a memory and a communication bus; The communication bus is used to realize the connection and communication between the processor and the memory; The processor is configured to execute one or more computer programs stored in the memory to implement the steps of the method for processing an EPG UI frame according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more computer programs, and the one or more computer programs can be executed by one or more processors to implement the steps of the method for processing an EPG UI frame according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Method, device and system for realizing set-top box (STB) cloudification

    CN106998479A

  • Video playing method and device and electronic device

    CN110012315A