A method, server, and image playback system for optimizing image playback jitter
By using texture pools in the image playback system to cache image frame data and optimize reading strategies, the lag problem during image playback is solved, and the display effect and viewing experience of the LED display screen are improved.
Patent Information
- Application Number
- CN202210332619.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-30
- Publication Date
- 2025-07-11
- Estimated Expiration
- 2042-03-30
AI Technical Summary
The input stuttering and output stuttering caused by network problems during image playback will affect the display effect of the LED display.
Image frame data is cached through the texture pool, and the reading amount is calculated based on the ratio of the total amount of image frame data to the threshold. Combined with the preset reading strategy and lag judgment strategy, the reading and sending process of image frame data is optimized.
It solves the problems of input lag and output lag, improves the screen display effect of the LED display, and ensures the viewing experience.
Smart Images

Figure CN114706545B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of image playback, and in particular, to a method, a server, and an image playback system for optimizing image playback stuttering. Background Art
[0002] In the image playback technology, a server receives image data from another server, a capture card, a camera, or other image source devices. The image data can be in the form of files and streaming media. However, during the transmission of image data, the image data often suffers from frame loss due to network problems. As a result, during the playback process, the playback effect for a certain period of playback time is normal, while the playback effect for another period of playback time is stuttering (stuck on the last output image frame). Network problems include input stuttering problems and output stuttering problems. Among them, the input stuttering problem is specifically manifested as unstable input (including insufficient input and excessive input); the output stuttering problem is specifically manifested as insufficient output. The factors causing the input stuttering problem mainly include: 1. Bandwidth network; 2. Hard disk data reading; 3. Decoding ability of the server, etc.; the factor causing the output stuttering problem is mainly the insufficient rendering speed of the graphics card in the server.
[0003] The above stuttering problem will significantly affect the display effect of the LED display screen. Therefore, those skilled in the art urgently need to find a new technical solution to solve the above image playback stuttering problem. Summary of the Invention
[0004] In view of the technical problems in the prior art, the present invention provides a method, a server, and an image playback system for optimizing image playback stuttering.
[0005] A method for optimizing image playback stuttering according to the present invention includes:
[0006] Receiving image frame data and putting it into the texture pool;
[0007] According to a preset image frame reading quantity determination strategy, a preset image frame data quantity threshold XT, and the total amount X of image frame data in the current texture pool, calculating the image frame data reading quantity A to be read out from the texture pool at the next moment;
[0008] According to a preset image reading strategy and the image frame data reading quantity A, reading out the corresponding image frame data from the texture pool and sending it to the LED display screen;
[0009] Among them, the image frame reading quantity determination strategy includes:
[0010] Calculating the ratio X / XT of the total amount X of image frame data to the image frame data quantity threshold XT;
[0011] Determining the image frame data reading quantity A through the ratio X / XT.
[0012] Further, the amount A of image frame data read is determined by the ratio X / XT, including:
[0013] The amount A of image frame data read is: where K1 + K2 = 1.
[0014] Further, according to the preset image reading strategy and the amount A of image frame data read, the corresponding image frame data is read from the texture pool and sent to the LED display screen, including:
[0015] Obtain the amount of image frame data read corresponding to the image frame data that has been read from the texture pool;
[0016] Calculate the sum of the amount of image frame data read and the amount A of image frame data read as the new amount of image frame data read;
[0017] Round down the new amount of image frame data read to obtain the number of the image frame data to be read;
[0018] Judge whether the image frame data corresponding to the number has been sent to the LED display screen; if so,
[0019] Do not read the image frame data; if not,
[0020] Read the image frame data corresponding to the number and send it to the LED display screen.
[0021] Further, it also includes:
[0022] According to the preset carding judgment strategy and the amount A of image frame data read, judge the carding type of the current image frame data transmission.
[0023] Further, the carding judgment strategy includes:
[0024] Judge the size relationship between the amount A of image frame data read and 1; if A = 1, the carding type of the current image frame data transmission is "no carding"; if A < 1, the carding type of the current image frame data transmission is "input insufficient"; if A > 1, the carding type of the current image frame data transmission is "input excessive and / or output insufficient".
[0025] Further, it also includes: if the carding type is "input excessive and / or output insufficient", the image frame data in the texture pool is read at intervals according to the preset image interval reading strategy.
[0026] Further, the image interval reading strategy is: read the image frame data once every unit time, and each time the read image frame data is read at an interval of one frame.
[0027] The present invention also includes a server for optimizing image playback jitter. The server includes an image receiving module, a texture pool module, an image reading module, and an image sending module.
[0028] The image receiving module is connected to the texture pool module. The image receiving module is used to receive image frame data and put it into the texture pool module.
[0029] The texture pool module is connected to the image receiving module and the image reading module. The texture pool module is used to store image frame data.
[0030] The image reading module is connected to the texture pool module and the image sending module. The image reading module is used to determine the image frame reading amount according to a preset image frame reading amount determination strategy and a preset image frame data amount threshold XT and the total amount X of image frame data in the current texture pool module, and calculate the image frame data reading amount A to be read from the texture pool module at the next moment; and according to a preset image reading strategy and the image frame data reading amount A, read the corresponding image frame data from the texture pool module. Among them, the image frame reading amount determination strategy includes: calculating the ratio X / XT of the total amount X of image frame data to the image frame data amount threshold XT; and determining the image frame data reading amount A through the ratio X / XT.
[0031] The image sending module is connected to the image reading module. The image sending module is used to send the image frame data read by the image reading module to the LED display screen.
[0032] Further, the image reading module determines the image frame data reading amount A through the ratio X / XT, including:
[0033] The image frame data reading amount A is: Wherein, K1 + K2 = 1.
[0034] The present invention also includes an image playback system. The image playback system includes the above-mentioned server, and also includes a sending device, a receiving device, and an LED display screen. Among them:
[0035] The server is connected to the sending device and realizes communication connection with the LED display screen through the connection between the sending device and the receiving device. The server is used to send image frame data to the LED display screen.
[0036] The LED display screen is connected to the receiving device and realizes communication connection with the server through the connection between the receiving device and the sending device. The LED display screen is used to receive and display image frame data.
[0037] The method, server, and image playback system for optimizing image playback stuttering according to the embodiments of the present invention cache image frame data through a texture pool, calculate the amount of image frame data to be read from the texture pool at the next moment according to the ratio of the total amount of image frame data to the threshold of the amount of image frame data, then read the corresponding image frame data from the texture pool according to a preset image reading strategy and the amount of image frame data, and send it to the LED display screen, so that the display effect of the image frame data displayed on the LED display screen shows a linear change and no longer stutters, solving the problems of input stuttering and output stuttering in the prior art, thereby improving the screen display effect of the LED display screen and ensuring people's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0039] Figure 1 It is a flowchart of the steps of the method for optimizing image playback stuttering according to the embodiments of the present invention;
[0040] Figure 2 It is a flowchart of the steps of the method for optimizing image playback stuttering according to another embodiment of the present invention;
[0041] Figure 3 It is a flowchart of the steps of the method for optimizing image playback stuttering according to yet another embodiment of the present invention;
[0042] Figure 4 It is a structural composition diagram of the server according to the embodiments of the present invention;
[0043] Figure 5 It is a structural composition diagram of the image playback system according to the embodiments of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the protection scope of the present invention.
[0045] A method for optimizing image playback stuttering according to an embodiment of the present invention, as Figure 1 shown, includes the following steps:
[0046] Step S10: Receive image frame data and put it into the texture pool.
[0047] The texture pool, also known as the texture pool, is specifically used to cache image frames and can be understood as a queue. The elements in the queue are equivalent to the textures of the texture pool, and the texture is the input image frame data. The texture pool is a dynamic pool, and the image frame data in the dynamic pool is dynamic (equivalent to the length of the elements in the queue). In the embodiments of the present invention, the image frame data is processed to solve the stuttering problem mentioned in the background art. For example, in the input stuttering problem, the input is unstable (including too much input and insufficient input), and at this time, the image frame data in the texture pool will be too much or too little. There is also the problem of insufficient output in the output stuttering problem, and at this time, the image frame data in the texture pool will be too much.
[0048] Step S20: According to the preset image frame reading amount determination strategy, the preset image frame data amount threshold XT, and the total amount X of image frame data in the current texture pool, calculate the image frame data reading amount A to be read from the texture pool at the next moment.
[0049] Among them, the image frame reading amount determination strategy in step S20 of this embodiment includes:
[0050] Calculate the ratio X / XT of the total amount X of image frame data in the current texture pool to the image frame data amount threshold XT;
[0051] Determine the image frame data reading amount A through the ratio X / XT.
[0052] In this embodiment, the value of the total amount X of image frame data changes over time. That is, after the received image frame data is put into the texture pool and after the image frame data is read out from the texture pool, the total amount X of image frame data in the texture pool will change. The specific determination method of the image frame data reading amount A in the embodiments of the present invention is: the image frame data reading amount A is: Among them, K1 + K2 = 1. The embodiments of the present invention adopt the PI (Proportion-Integral) control method to control the value of the image frame data reading amount A. K1 and K2 are used as coefficients, and the embodiments of the present invention do not limit their values. For example, K1 can be 0.7 and K2 can be 0.3.
[0053] In this embodiment, assume that the current total amount X of image frame data = 60, the preset image frame data amount threshold XT is 60 (the value of the image frame data amount threshold XT is set by those skilled in the art according to requirements such as the size of the texture pool and is not limited here. For example, it can also be set to 40, 90, 120, 240, etc.), and the value of time t is set to 1s. Then the value of the image frame data reading amount A is 1. If the total amount X of image frame data = 30, then the value of the image frame data reading amount A is 0.5. If the total amount X of image frame data = 90, then the value of the image frame data reading amount A is 1.5.
[0054] Step S30: According to the preset image reading strategy and the image frame data reading amount A, read the corresponding image frame data from the texture pool and send it to the LED display screen.
[0055] In this step, the corresponding image frame data is read from the texture pool according to the image frame data reading amount A calculated in step S20. As Figure 2 shown, it specifically includes the following steps:
[0056] Step S301: Obtain the read amount of the image frame data corresponding to the image frame data that has been read from the texture pool.
[0057] Suppose the image frame data read out from the texture pool is numbered 1, 2, 3, 4, 5, 6, 7, 8, 9... in sequence. If the first frame of image frame data has been read from the texture pool, that is, the read amount of the image frame data corresponding to the image frame data that has been read from the texture pool is equal to 1 frame. In the normal case without jamming, the reading should continue frame by frame in the order of the image frame data numbers 2, 3, 4, 5...
[0058] In this embodiment, the value of the read amount of the image frame data can be determined according to the actual situation. This embodiment only takes the read amount of the image frame data = 1 as an example for illustration, and the numbering of the image frame data also corresponds according to the actual situation. This is only for illustration as an example here.
[0059] Step S302: Calculate the sum of the read amount of the image frame data and the image frame data reading amount A as the new read amount of the image frame data.
[0060] If the image frame data reading amount A is equal to 1, then the new read amount of the image frame data = the read amount of the image frame data + 1; if the image frame data reading amount A is equal to 1.5, then the new read amount of the image frame data = the read amount of the image frame data + 1.5; if the image frame data reading amount A is equal to 0.5, then the new read amount of the image frame data = the read amount of the image frame data + 0.5.
[0061] In the present invention, after each time the image frame data is read from the texture pool, the total amount X of the image frame data is recalculated, and at the same time, the new image frame data reading amount A is also calculated. Since the number of frames of the image frame data input and output from the texture pool may be equal or unequal, the value of the image frame data reading amount A will also change at different times. For the convenience of example in the embodiment, assume that the value of the image frame data reading amount A calculated each time is equal (that is, the number of frames of the image frame data input to the texture pool is equal to the number of frames of the image frame data output from the texture pool). Then, the new read amounts of the image frame data calculated in the following three adjacent reading times through the steps of this embodiment are:
[0062] If the amount A of the read image frame data is equal to 1, the amounts of the read new image frame data calculated at the subsequent three adjacent moments are 2, 3, and 4;
[0063] If the amount A of the read image frame data is equal to 1.5, the amounts of the read new image frame data calculated at the subsequent three adjacent moments are 2.5, 4, and 5.5;
[0064] If the amount A of the read image frame data is equal to 0.5, the amounts of the read new image frame data calculated at the subsequent three adjacent moments are 1.5, 2, and 2.5.
[0065] Step S303: Round down the amount of the read new image frame data to obtain the number of the image frame data to be read.
[0066] Combined with the above examples, then
[0067] If the amount A of the read image frame data is equal to 1, the numbers of the image frame data to be read are 2, 3, and 4;
[0068] If the amount A of the read image frame data is equal to 1.5, the numbers of the image frame data to be read are 2, 4, and 5;
[0069] If the amount A of the read image frame data is equal to 0.5, the numbers of the image frame data to be read are 1, 2, and 2.
[0070] Step S304: Determine whether the image frame data corresponding to the number has been sent to the LED display screen; if so, execute Step S305; if not, execute Step S306.
[0071] Step S305: Do not read the image frame data.
[0072] Step S306: Read the image frame data corresponding to the number and send it to the LED display screen.
[0073] Combining the above examples, it can be seen that the number of the image frame data read from the texture pool for the first time in this embodiment is 1, that is, the first frame of image frame data is read; starting from the second moment, if the amount of image frame data read A calculated each time is equal to 1, then the second frame of image frame data is read at the second moment, the third frame of image frame data is read at the third moment, and so on; if the amount of image frame data read A calculated each time is equal to 1.5, then the second frame of image frame data is read at the second moment, the fourth frame of image frame data is read at the third moment, the fifth frame of image frame data is read at the fourth moment, and so on; if the amount of image frame data read A calculated each time is equal to 0.5, then the first frame of image frame data is read at the second moment (since the first frame of image frame data has been read for the first time, no image frame data is read at the second moment, and the LED display still displays the first frame of image frame data at the second moment), the second frame of image frame data is read at the third moment, the second frame of image frame data is read at the fourth moment (similarly to the second moment, the second frame of image frame data has been read at the third moment, so no image frame data is read at the fourth moment, and the LED display still displays the second frame of image frame data at the fourth moment), and so on.
[0074] From the above steps, it can be seen that when the value of the image frame data read amount A is equal to 1, greater than 1, or less than 1, there are differences in the image frame data read from the texture pool at each moment. For example, when the value of the image frame data read amount A is greater than 1 (that is, the problem of excessive input or insufficient output), a new frame of image frame data is read at each moment, and there is a situation of skipping frames to read, thereby accelerating the output; while when the value of the image frame data read amount A is less than 1 (that is, insufficient input), the same frame of image frame data is displayed at two moments, thereby slowing down the output.
[0075] As Figure 3 shown, another embodiment of the present invention is: after calculating the amount A of image frame data to be read from the texture pool at the next moment in step S20, it further includes: step S40: judging the type of card of the current image frame data transmission according to a preset card judgment strategy and the amount A of image frame data read.
[0076] Specifically, the card judgment strategy of this embodiment includes:
[0077] judging the size relationship between the amount A of image frame data read and 1; if A = 1, the type of card of the current image frame data transmission is "no card"; if A < 1, the type of card of the current image frame data transmission is "insufficient input"; if A > 1, the type of card of the current image frame data transmission is "excessive input and / or insufficient output".
[0078] In combination with the above embodiments, when the image frame data reading amount A=1, the jamming type of the current image frame data transmission is "no jamming"; when the image frame data reading amount A=1.5, the jamming type of the current image frame data transmission is "too much input and / or insufficient output", so a new frame of image frame data will be read at each moment, and there will be frame skipping, thereby speeding up the output; when the image frame data reading amount A=0.5, the jamming type of the current image frame data transmission is "insufficient input", so there will be two moments when the same frame of image frame data is displayed, thereby slowing down the output.
[0079] Specifically, in the embodiment of the present invention, if the jamming type is "too much input and / or insufficient output", step S50 is executed: the image frame data in the texture pool is read at intervals according to a preset image interval reading strategy.
[0080] The image interval reading strategy of the embodiment of the present invention can perform corresponding interval reading through the method of the aforementioned embodiment (interval reading also ensures that frame loss is a uniform frame loss state), and technical personnel in this field can also set other interval reading methods, such as an interval frame reading method, reading the first frame at the first moment, reading the third frame at the second moment, reading the fifth frame at the third moment, and so on; or, reading the first frame at the first moment, reading the second frame at the second moment, reading the fourth frame at the third moment, reading the fifth frame at the fourth moment, and so on.
[0081] Preferably, the image interval reading strategy in step S50 of the present embodiment is: the image frame data is read once every unit time, and the image frame data read each time is read every other frame, that is, the first frame is read at the first moment, and is not read at the second moment (the first frame continues to be displayed), the third frame is read at the third moment, and is not read at the fourth moment (the third frame continues to be displayed), the fifth frame is read at the fifth moment, and is not read at the sixth moment (the fifth frame continues to be displayed), and so on. If repeated frame display is adopted in the image interval reading strategy of the present embodiment, it can also be applied to the situation of "insufficient input". Although the image interval reading strategy of the present embodiment causes frame drops through vibration isolation reading, the picture of the LED display screen will not be stuck, and will not cause obvious visual differences to the viewer, thereby ensuring the basic display effect.
[0082] The present invention also includes an embodiment of a server for optimizing image playback jams, such as Figure 3 As shown, the server 100 includes an image receiving module 101, a texture pool module 102, an image reading module 103 and an image sending module 104, wherein:
[0083] The image receiving module 101 is connected to the texture pool module 102, and the image receiving module 101 is used to receive image frame data and put it into the texture pool module 102;
[0084] The texture pool module 102 is connected to the image receiving module 101 and the image reading module 103, and the texture pool module 102 is used to store image frame data;
[0085] The image reading module 103 is connected to the texture pool module 102 and the image sending module 104. The image reading module 103 is used to determine the image frame reading amount according to the preset image frame reading amount determination strategy, the preset image frame data amount threshold XT, and the total amount X of image frame data in the current texture pool module 102, and calculate the image frame data reading amount A to be read from the texture pool module 102 at the next moment; and according to the preset image reading strategy and the image frame data reading amount A, read the corresponding image frame data from the texture pool module 102; wherein, the image frame reading amount determination strategy includes: calculating the ratio X / XT of the total amount X of image frame data to the image frame data amount threshold XT; and determining the image frame data reading amount A through the ratio X / XT;
[0086] The image sending module 104 is connected to the image reading module 103, and the image sending module 104 is used to send the image frame data read by the image reading module 103 to the LED display screen.
[0087] Specifically, in this embodiment, the image reading module 103 determines the image frame data reading amount A through the ratio X / XT, including:
[0088] The image frame data reading amount A is: where K1 + K2 = 1.
[0089] Specifically, the server 100 in the embodiment of the present invention realizes related functions according to the following steps:
[0090] Step S10: Receive image frame data and put it into the texture pool.
[0091] Step S20: According to the preset image frame reading amount determination strategy, the preset image frame data amount threshold XT, and the total amount X of image frame data in the current texture pool, calculate the image frame data reading amount A to be read from the texture pool at the next moment.
[0092] Step S30: According to the preset image reading strategy and the image frame data reading amount A, read the corresponding image frame data from the texture pool and send it to the LED display screen.
[0093] Specifically, step S30 includes:
[0094] Step S301: Obtain the image frame data read amount corresponding to the image frame data that has been read from the texture pool.
[0095] Step S302: Calculate the sum of the image frame data read amount and the image frame data reading amount A as the new image frame data read amount.
[0096] Step S303: Round down the amount of new image frame data that has been read to obtain the number of the image frame data to be read.
[0097] Step S304: Determine whether the image frame data corresponding to the number has been sent to the LED display screen; if so, execute Step S305; if not, execute Step S306.
[0098] Step S305: Do not read the image frame data.
[0099] Step S306: Read the image frame data corresponding to the number and send it to the LED display screen.
[0100] The function of the server 100 in the embodiment of the present invention further includes: determining the type of carding in the current image frame data transmission according to a preset carding judgment strategy and the amount A of image frame data read.
[0101] Specifically, the carding judgment strategy in this embodiment includes:
[0102] Determine the size relationship between the amount A of image frame data read and 1; if A = 1, the type of carding in the current image frame data transmission is "no carding"; if A < 1, the type of carding in the current image frame data transmission is "insufficient input"; if A > 1, the type of carding in the current image frame data transmission is "excessive input and / or insufficient output". If the carding type is "excessive input and / or insufficient output", the image frame data in the texture pool is read at intervals according to a preset image interval reading strategy.
[0103] The implementation process of the above steps can be implemented correspondingly with reference to the relevant description of the method for optimizing image playback carding in the foregoing embodiment, and will not be elaborated here.
[0104] The embodiment of the present invention further includes an image playback system, as Figure 4 shown, the image playback system includes the server 100 of the above embodiment, and further includes a sending device 200, a receiving device 300, and an LED display screen 400, wherein:
[0105] The server 100 is connected to the sending device 200 and realizes communication connection with the LED display screen 400 through the connection between the sending device 200 and the receiving device 300. The server 100 is used to send image frame data to the LED display screen 400;
[0106] The LED display screen 400 is connected to the receiving device 300 and realizes communication connection with the server 100 through the connection between the receiving device 300 and the sending device 200. The LED display screen 400 is used to receive and display image frame data.
[0107] The communication connection between the server 100 and the LED display 400 in this embodiment is achieved through the corresponding sending device 200 and receiving device 300. The sending device 200 and the receiving device 300 respectively implement the sending and receiving of image frame data. Those skilled in the art can select a sending card and a receiving card to implement this function, and the specific product selection is not limited in this embodiment.
[0108] The method, server and image playback system for optimizing image playback stuttering in the embodiments of the present invention cache image frame data through a texture pool, calculate the amount of image frame data to be read from the texture pool at the next moment according to the ratio of the total amount of image frame data to the image frame data volume threshold, and then read the corresponding image frame data from the texture pool according to the preset image reading strategy and the amount of image frame data, and send it to the LED display, so that the display effect of the LED display showing the image frame data presents a linear change and no longer stutters, solving the problems of input stuttering and output stuttering in the prior art, thereby improving the screen display effect of the LED display and ensuring people's viewing experience.
[0109] The above further describes the present invention with the aid of specific embodiments. However, it should be understood that the specific description here should not be construed as a limitation on the essence and scope of the present invention. Various modifications made by those of ordinary skill in the art to the above embodiments after reading this specification all fall within the scope protected by the present invention.
Claims
1. A method for optimizing image playback stuttering, characterized in that, including: Receiving image frame data and putting it into the texture pool; According to a preset image frame reading quantity determination strategy, a preset image frame data quantity threshold XT, and the total quantity X of image frame data in the current texture pool, calculating the image frame data reading quantity A to be read out from the texture pool at the next moment; According to a preset image reading strategy and the image frame data reading quantity A, reading out the corresponding image frame data from the texture pool and sending it to the LED display screen; wherein, the image frame reading quantity determination strategy includes: Calculating the ratio X / XT of the total quantity X of the image frame data to the image frame data quantity threshold XT; Determining the image frame data reading quantity A through the ratio X / XT; According to a preset image reading strategy and the image frame data reading quantity A, reading out the corresponding image frame data from the texture pool and sending it to the LED display screen, including: Obtaining the read quantity of the image frame data corresponding to the image frame data already read from the texture pool; Calculating the sum of the read quantity of the image frame data and the image frame data reading quantity A as the new read quantity of the image frame data; Taking the floor of the new read quantity of the image frame data to obtain the number of the image frame data to be read; Judging whether the image frame data corresponding to the number has been sent to the LED display screen; if so, not reading the image frame data; if not, reading the image frame data corresponding to the number and sending it to the LED display screen; Determining the image frame data reading quantity A through the ratio X / XT, including: The read amount A of the image frame data is as follows: , where .
2. The method for optimizing image playback stuttering according to claim 1, wherein, further including: Judging the type of jamming in the current image frame data transmission according to a preset jamming judgment strategy and the image frame data reading quantity A.
3. The method for optimizing image playback stuttering according to claim 2, wherein, The jamming judgment strategy includes: Judging the size relationship between the image frame data reading quantity A and 1; if A = 1, the type of jamming in the current image frame data transmission is "no jamming"; if A < 1, the type of jamming in the current image frame data transmission is "insufficient input"; if A > 1, the type of jamming in the current image frame data transmission is "excessive input and / or insufficient output".
4. The method for optimizing image playback stuttering according to claim 3, wherein further including: If the type of jamming is "excessive input and / or insufficient output", performing interval reading on the image frame data in the texture pool according to a preset image interval reading strategy.
5. The method for optimizing image playback jitter as claimed in claim 4, wherein, The image interval reading strategy is: reading the image frame data once every unit time, and each time the read image frame data is alternate-frame reading.
6. A server for optimizing image playback stuttering, characterized in that, The server includes an image receiving module, a texture pool module, an image reading module, and an image sending module, The image receiving module is connected to the texture pool module, and the image receiving module is used for receiving image frame data and putting it into the texture pool module; The texture pool module is connected to the image receiving module and the image reading module, and the texture pool module is used for storing image frame data; The image reading module is connected to the texture pool module and the image sending module. The image reading module is used to determine the image frame reading quantity according to a preset image frame reading quantity determination strategy, a preset image frame data quantity threshold XT, and the total quantity X of image frame data in the current texture pool module, and calculate the image frame data reading quantity A to be read from the texture pool module at the next moment; and read the corresponding image frame data from the texture pool module according to a preset image reading strategy and the image frame data reading quantity A. Among them, the image frame reading quantity determination strategy includes: calculating the ratio X / XT of the total quantity X of image frame data to the image frame data quantity threshold XT; and determining the image frame data reading quantity A through the ratio X / XT. The image sending module is connected to the image reading module. The image sending module is used to send the image frame data read by the image reading module to the LED display screen. Reading the corresponding image frame data from the texture pool module according to a preset image reading strategy and the image frame data reading quantity A and sending it to the LED display screen includes: Obtaining the image frame data read quantity corresponding to the image frame data that has been read from the texture pool module. Calculating the sum of the image frame data read quantity and the image frame data reading quantity A as the new image frame data read quantity. Taking the floor of the new image frame data read quantity to obtain the number of the image frame data to be read. Judging whether the image frame data corresponding to the number has been sent to the LED display screen; if so, no image frame data is read; if not, reading the image frame data corresponding to the number and sending it to the LED display screen. The image reading module determines the image frame data reading quantity A through the ratio X / XT, including: The amount A of the read image frame data is as follows: , where .
7. An image playback system, characterized in that, The image playing system includes the server according to claim 6, and further includes a sending device, a receiving device, and an LED display screen, where: The server is connected to the sending device and realizes communication connection with the LED display screen through the connection between the sending device and the receiving device. The server is used to send image frame data to the LED display screen. The LED display screen is connected to the receiving device and realizes communication connection with the server through the connection between the receiving device and the sending device. The LED display screen is used to receive and display the image frame data.
Citation Information
Patent Citations
Real-time waveform smoothing drawing method, device and system
CN109086019A