Frame rate conversion method and device and computer readable storage medium
By using cache clock and defragment frame insertion technology in frame rate conversion, the memory consumption and delay problems during frame rate conversion are solved, efficient and low-cost frame rate adjustment is achieved, and the real-time performance of video processing is improved and efficiency.
Patent Information
- Application Number
- CN202411031259.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2024-11-08
AI Technical Summary
The prior art consumes a lot of memory space during frame rate conversion, increases processing delay, affects the real-time and efficiency of the system, especially when processing high-resolution videos.
By obtaining the source frame rate coded data, using the cache clock to cache it in memory, and performing frame rate conversion processing through the extraction and interpolation technology, the target frame rate coded data is read, avoiding frequent data transfer and calculation. Reduces memory consumption and power consumption.
Achieve small-range adjustment of high-resolution video frame rate under extremely low memory consumption, improve the real-time nature of frame rate conversion, reduce hardware costs, avoid the problems of high power consumption and heating during frame rate conversion, and support IP The frame rate conversion is directly implemented at the level.
Smart Images

Figure CN118921523A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the technical field of audio and video data processing, and in particular to a frame rate conversion method, device and computer-readable storage medium. Background Art
[0002] In the field of audio and video, due to the diversity of broadcasting standards, video frame rate conversion has become a routine operation to ensure compatibility with different standards. When performing frame rate conversion, it is indispensable to cache several frames to support the frame rate conversion algorithm. When faced with the need to convert the frame rate of raw video data, traditional methods directly operate on the huge raw video data, which often leads to a large consumption of memory resources, especially when processing high-resolution videos, the memory consumption problem is particularly significant.
[0003] For video sources in the form of input IP streams, traditional methods cannot directly convert the frame rate. Therefore, it is usually necessary to first unpack and decode the IP stream to obtain the original data, then convert the frame rate, and finally re-encode and assemble it into a new IP stream. This process not only consumes a lot of memory space, but also increases processing delays, affecting the real-time performance and efficiency of the system. Summary of the invention
[0004] In view of the above problems, an example of the present invention provides a frame rate conversion method, device and computer-readable storage medium, which are used to solve the problem that frame rate conversion in the prior art consumes a large amount of memory space, increases processing delay, and affects the real-time performance and efficiency of the system.
[0005] According to one aspect of an example of the present invention, a frame rate conversion method is provided, the method comprising: Get source frame rate encoding data; Cache the source frame rate encoded data into a memory according to a cache clock; The source frame rate coded data is subjected to frame rate conversion processing by using a frame extraction and interpolation technology, and the target frame rate coded data is obtained by reading from the memory.
[0006] In some optional manners, the obtaining source frame rate coded data specifically includes: Compress the original video using video lossless compression technology to generate source frame rate encoding data; or receiving a losslessly compressed IP stream and depacketizing the IP stream using an IP depacketization technique to generate source frame rate encoded data; The source frame rate encoding data format is an axi-stream format, tuser is used as a frame start signal, and tlast is used as a frame end signal.
[0007] In some optional embodiments, the lossless compression technology is any one of JPEG XS technology, JPEG2000 technology, and NDI technology.
[0008] In some optional embodiments, the IP unpacking technology includes: extracting IP data corresponding to the MAC address from the IP stream according to the TCP protocol, and obtaining source frame rate encoded data by removing the packet header.
[0009] In some optional embodiments, after obtaining the target frame rate encoded data, the method further includes: Decoding target frame rate coded data by using video lossless compression technology to generate target frame rate data; Alternatively, the target frame rate encoded data may be re-packetized through IP packetization technology to generate target frame rate data.
[0010] In some optional ways, the memory is provided with an input buffer, an output buffer and a free buffer, and the states of the input buffer, the output buffer and the free buffer can be dynamically converted; the caching of the source frame rate encoded data into the memory according to the buffer clock specifically includes: First, the source frame rate encoded data is cached into the input cache according to the cache clock until the input cache is full; If the input buffer is full, determine whether the output buffer is fully read. If the output buffer is fully read, convert the free buffer into the input buffer and write the next frame. Otherwise, determine whether the free buffer is full. If the free buffer is full, the next frame of data is discarded, otherwise the next frame of data is written to the free buffer.
[0011] In some optional manners, the step of reading from the memory to obtain target frame rate encoded data includes: First, the source frame rate encoded data is output from the output buffer until the output buffer is read out; If the output buffer is fully read, determine whether the input buffer is full. If so, change the input buffer to the output buffer and output the next frame. Otherwise, repeat the output of the source frame rate encoded data of the current frame in the output buffer.
[0012] In some optional manners, the frame rate conversion processing of the source frame rate coded data by using the frame extraction and interpolation technology specifically includes: Determine the frame output clock according to the preset target frame rate, and determine the starting address of the source frame rate coded data according to the frame output clock. When the source frame rate coded data of a frame is read or the cache is full, the frame is discarded or copied by resetting the offset address. When increasing the frame rate of target frame rate encoded data, frame duplication is performed by resetting the read address offset; When the frame rate of the target frame rate encoded data is reduced, frame discarding is performed by resetting the write address offset.
[0013] According to another aspect of an embodiment of the present invention, a frame rate conversion device is provided, the device comprising: A data reading module is used to obtain source frame rate encoding data; A data cache module, used for caching the source frame rate encoded data into a memory according to a cache clock; The frame rate conversion reading module is used to perform frame rate conversion processing on the source frame rate coded data through frame extraction and interpolation technology, and read the target frame rate coded data from the memory.
[0014] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the storage medium stores at least one executable instruction, and when the executable instruction is executed on the frame rate conversion device as described above, the frame rate conversion device performs the operation of the frame rate conversion method as described above.
[0015] The present invention provides a frame rate conversion method, device and computer-readable storage medium, and its beneficial effects are: the present invention writes source frame rate encoding data into a memory, and performs frame rate conversion processing on the source frame rate encoding data through frame extraction and interpolation technology, so that the frame rate of the read encoded data is the target frame rate. The present invention realizes a small range adjustment of the frame rate of high-resolution video with extremely low memory consumption, especially in application scenarios that require precise control of frame rate conversion. The technology of the present invention not only significantly reduces memory consumption, but also avoids problems such as high power consumption and heat generation caused by frequent handling and calculation of large amounts of data during the frame rate conversion process, effectively reducing hardware costs. In addition, the present invention also supports direct frame rate conversion at the IP level, further improving the real-time performance of frame rate conversion, and reducing conversion delays, making video processing more efficient and smooth.
[0016] The above description is only an overview of the technical solution of the example of the present invention. In order to more clearly understand the technical means of the embodiment of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the example of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are specifically listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] The accompanying drawings are only used to illustrate the embodiments and are not to be considered as limiting the present invention. In addition, the same reference symbols are used to represent the same components throughout the accompanying drawings. In the accompanying drawings: Figure 1 A schematic flow chart of a first embodiment of a frame rate conversion method provided by the present invention is shown; Figure 2 A schematic diagram showing the structure of the memory provided by the present invention is shown; Figure 3 A schematic diagram of a process of caching source frame rate coded data into a memory according to a cache clock provided by the present invention is shown; Figure 4 A schematic diagram of a process of reading target frame rate coded data from a memory provided by the present invention is shown; Figure 5 A schematic structural diagram of a first embodiment of a frame rate conversion device provided by the present invention is shown; Figure 6 A schematic structural diagram of a frame rate conversion device according to Embodiment 3 of the present invention is shown. DETAILED DESCRIPTION
[0018] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein.
[0019] Embodiment 1: Figure 1 A first embodiment of a frame rate conversion method of the present invention is shown, and the method comprises: 110, obtain source frame rate encoding data; in step 110, obtain source frame rate encoding data, specifically including: compressing the original video through video lossless compression technology to generate source frame rate encoding data; or receiving a lossless compressed IP stream and unpacking the IP stream through IP unpacking technology to generate source frame rate encoding data; wherein the source frame rate encoding data format is axi-stream stream format, tuser is used as a frame start signal, and tlast is used as a frame end signal.
[0020] 120, caching the source frame rate encoded data into the memory according to the cache clock; in step 120, caching the source frame rate encoded data into the memory according to the cache clock specifically includes: first caching the source frame rate encoded data into the input cache according to the cache clock until the input cache is full; if the input cache is full, determining whether the output cache is fully read, if the output cache is fully read, converting the idle cache into the input cache and writing the next frame, otherwise determining whether the idle cache is full; if the idle cache is full, discarding the next frame of data, otherwise writing the next frame of data into the idle cache.
[0021] 130, performing frame rate conversion processing on the source frame rate coded data by using a frame extraction and interpolation technology, and reading target frame rate coded data from the memory; in step 130, performing frame rate conversion processing on the source frame rate coded data specifically includes: determining a frame output clock according to a preset target frame rate, and determining a starting address of the source frame rate coded data according to the frame output clock, and when a frame of source frame rate coded data is read out or the cache is full, resetting the offset address to discard the frame or copy the frame; Among them, the source frame rate encoding data read from the memory can be lossless compression encoding data before frame rate conversion. In addition, after the source frame rate encoding data is processed by frame extraction and interpolation technology, that is, the source frame rate encoding data is encoded data after frame discarding; including the source frame rate encoding data described above, they all fall within the protection scope of this application.
[0022] The present invention writes source frame rate coded data into a memory, and performs frame rate conversion processing on the source frame rate coded data through frame extraction and interpolation technology, so that the frame rate of the read coded data is the target frame rate. The present invention realizes small-range adjustment of high-resolution video frame rate with extremely low memory consumption, especially in application scenarios that require precise control of frame rate conversion. The technology of the present invention not only significantly reduces memory consumption, but also avoids problems such as high power consumption and heat generation caused by frequent handling and calculation of large amounts of data during the frame rate conversion process, effectively reducing hardware costs. In addition, the present invention also supports direct frame rate conversion at the IP level, further improving the real-time performance of frame rate conversion, and reducing conversion delays, making video processing more efficient and smooth.
[0023] In some optional methods, the source frame rate coded data is obtained, specifically including: compressing the original video through video lossless compression technology to generate source frame rate coded data; or receiving a lossless compressed IP stream and unpacking the IP stream through IP unpacking technology to generate source frame rate coded data; wherein the source frame rate coded data format is axi-stream stream format, tuser is used as a frame start signal, and tlast is used as a frame end signal. Lossless compression technology includes but is not limited to JPEG XS / JPEG2000 / NDI using intra-frame compression. IP unpacking technology includes: according to the TCP protocol, extracting the IP data corresponding to the MAC address from the IP stream, and obtaining the source frame rate coded data by removing the packet header.
[0024] After acquiring the target frame rate coded data, the method further includes: decoding the target frame rate coded data by video lossless compression technology to generate target frame rate data; or repackaging the target frame rate coded data by IP packetization technology to generate target frame rate data.
[0025] In this embodiment, the video lossless compression technology refers to a technology that can completely retain all the information of the original video, including color, brightness, resolution, etc., when compressing the video data, so as to ensure that the quality of the original video can be fully restored after decompression. The lossless compression technology here specifically refers to the lossless compression technology of intra-frame compression, that is, it mainly focuses on the data compression within a single video frame without considering the redundant information between adjacent frames, such as JPEG2000, JPEG XS, NDI, etc. The IP unpacking technology extracts the IP data corresponding to the MAC address from the received IP stream according to the TCP protocol, and obtains the compressed video data by removing the header operation. The IP packet assembly technology adds a header to the compressed video data according to the TCP protocol requirements for network transmission.
[0026] To avoid the loss of frame start and end information during lossless compression or IP decompression, and to unify the data structure for subsequent processing, the source frame rate encoded data obtained after lossless compression or decompression is encapsulated into the axi-stream format, where tuser is used as the frame start signal and tlast is used as the frame end signal. When writing source frame rate encoded data to the cache, frame synchronization is performed based on these signals, and the corresponding write start address is generated.
[0027] For some alternatives, see Figure 2 , the memory is set with input buffer, output buffer and free buffer, and the status of input buffer, output buffer and free buffer can be dynamically converted. Three memory areas are set in the memory as input buffer, output buffer and free buffer respectively; the roles of these buffers are dynamically converted according to the video frame rate conversion requirements. The setting of read and write addresses is based on the starting address and offset address of the frame. The starting address is configured by the frame rate conversion control module, and the offset address is automatically incremented with the read and write operations. When a frame of data is read or the input buffer is full, the frame is copied or discarded by resetting the offset address. When the frame rate needs to be increased, it is achieved by resetting the read address offset to 0 through frame copying; when the frame rate needs to be reduced, it is achieved by resetting the write address offset through frame discarding.
[0028] See also Figure 3 , cache the source frame rate coded data into the memory according to the cache clock, specifically including: first cache the source frame rate coded data into the input cache according to the cache clock until the input cache is full; if the input cache is full, determine whether the output cache is fully read, if the output cache is fully read, change the free cache to the input cache and write the next frame, otherwise determine whether the free cache is full; if the free cache is full, discard the next frame data, otherwise write the next frame data into the free cache. The coded data first enters the input cache, and when the input cache is full, it is transferred to the free cache. If both are full, the new frame data will be discarded.
[0029] See also Figure 4, read the target frame rate encoding data from the memory, including: first output the source frame rate encoding data from the output buffer until the output buffer is read; if the output buffer is read, determine whether the input buffer is full, if so, change the input buffer to the output buffer and output the next frame, otherwise, repeatedly output the source frame rate encoding data of the current frame in the output buffer. When outputting, read data from the output buffer, if the buffer is empty and the type remains unchanged, read it repeatedly to simulate frame interpolation. When the output buffer is empty and the input buffer is full, the buffer type will be converted.
[0030] In some optional ways, the source frame rate coded data is subjected to frame rate conversion processing by frame extraction and interpolation technology, specifically including: determining the frame output clock according to the preset target frame rate, and determining the starting address of the source frame rate coded data according to the frame output clock, when the source frame rate coded data of a frame is read or the cache is full, the frame is discarded or the frame is copied by resetting the offset address; when the frame rate of the target frame rate coded data is increased, the frame is copied by resetting the read address offset; when the frame rate of the target frame rate coded data is reduced, the frame is discarded by resetting the write address offset. In this embodiment, the frame extraction and interpolation technology adjusts the frame rate by precisely controlling the memory read and write addresses. The setting of the read and write addresses is based on the starting address and offset address of the frame. The starting address is configured by the frame output clock signal, and the offset address is automatically incremented with the read and write operations. When a frame of data is read or the input cache is full, the frame is copied or discarded by resetting the offset address. When the frame rate needs to be increased, it is achieved by resetting the read address offset to 0; when the frame rate needs to be reduced, the purpose is achieved by resetting the write address offset by discarding the frame.
[0031] Because the frame cache clock, i.e. the write clock, is recovered from the source frame rate coded data, and the frame output clock, i.e. the read clock, is preset according to the target frame rate, the ratio of the cache read and write rates is equal to the ratio of the target frame rate to the source frame rate. That is: Cache read rate / cache write rate = target frame rate preset value / source frame rate The present invention adaptively adjusts the ratio of read and write rates to ensure that when the target frame rate is different from the source frame rate, the frame rate can be automatically increased or decreased, providing a stable and consistent frame rate output for the decoded video. The entire process does not require manual intervention, greatly improving the efficiency and flexibility of video processing.
[0032] Embodiment 2: Figure 5The first embodiment of a frame rate conversion device of the present invention is shown. According to another aspect of the embodiment of the present invention, a frame rate conversion device is provided, the device comprising: a data reading module 510, used to obtain source frame rate coded data; a data cache module 520, used to cache the source frame rate coded data into a memory according to a cache clock; a frame rate conversion reading module 530, used to perform frame rate conversion processing on the source frame rate coded data by frame extraction and interpolation technology, and read the target frame rate coded data from the memory. The present invention writes the source frame rate coded data into the memory, and performs frame rate conversion processing on the source frame rate coded data by frame extraction and interpolation technology, so that the frame rate of the read coded data is the target frame rate. The present invention realizes a small range adjustment of the frame rate of high-resolution video with extremely low memory consumption, especially in application scenarios where frame rate conversion needs to be accurately controlled. The technology of the present invention not only significantly reduces memory consumption, but also avoids the problems of high power consumption and heat generation caused by frequent handling and calculation of a large amount of data during frame rate conversion, effectively reducing hardware costs. In addition, the present invention also supports direct frame rate conversion at the IP level, further improving the real-time performance of frame rate conversion and reducing conversion delay, making video processing more efficient and smooth.
[0033] First, the present invention shows significant advantages in reducing memory consumption, especially in video standard switching, including but not limited to JPEG XS / JPEG2000 / NDI using intra-frame compression. Taking the application of converting a video frame rate of 3840×2160 resolution and 60fps to 59.94fps as an example, if the JPEG XS lossless compression algorithm is used, and the compression ratio is assumed to be 10:1 and the loss ratio is 0.7, the minimum memory consumption required is 10.17MB calculated by the following formula: Memory consumption = resolution width × resolution height × number of cached frames × number of bytes per pixel × 1 / compression ratio × 1 / loss ratio This value is significantly affected by the intra-frame compression ratio. As the compression ratio increases, the required memory can be reduced by several times to dozens of times, significantly reducing memory consumption.
[0034] In addition, the present invention has the ability to directly convert the frame rate of videos in the form of IP streams, without the need to first decode and then encode, and without considering the compatibility of different video formats in reading and writing in memory. This feature not only reduces memory consumption, but also simplifies the process of frame rate conversion, reduces operating power consumption and design complexity. At the same time, the technology further improves the real-time nature of the conversion and reduces the conversion delay, thereby broadening its application scope in the field of video processing.
[0035] Embodiment 3: According to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the storage medium stores at least one executable instruction, and when the executable instruction is executed on the frame rate conversion device as described above, the frame rate conversion device performs the operation of the frame rate conversion method as described above.
[0036] In this embodiment, see Figure 6 The frame rate conversion device may also include a lossless compression encoding module, an IP stream receiving module, a frame buffer module, a clock recovery module, a write control module, a read control module, a frame rate conversion control module, a frame output module, a target frame rate clock generation module, a lossless compression decoding module, an IP stream sending module, a memory, and a memory controller.
[0037] Specifically, the original video is compressed by the lossless compression encoding module, or the lossless compressed encoded IP stream is directly received and unpacked by the IP stream receiving module to generate the encoded data of the source frame rate. The frame buffer module caches the source frame rate encoded data into the memory under the control of the write control module, and the frame output module reads the encoded data cached in the memory under the control of the read control module. Frames are discarded in the process of caching data, and frame interpolation is performed in the process of reading data in the memory. After the above process, the data read out of the memory is the encoded data after the frame rate conversion, that is, the encoded data of the target frame rate. The encoded data of the target frame rate is sent to the lossless compression decoding module for decoding, or is sent to the IP sending module for repackaging, so as to obtain the target frame rate data or the IP stream of the target frame rate. The clock recovery module can recover the clock of the source frame rate encoded data, which will be given to the frame buffer module and the write address generation module for the cache operation of the encoded frame. The target frame rate clock generation module will generate a frame sending clock, and the frame sending clock will be given to the read control module and the frame output module for the frame output operation. The frame rate conversion control module can determine whether the input cache and the free cache are full and whether the output cache is empty according to the address of the write control module and the read control mode; in addition, the frame rate conversion control module will also send the read base address to the read control module and the write control module to complete the mutual conversion of the input cache, the output cache and the free cache; finally, the frame rate conversion control module will also configure the target frame rate clock generation module according to the target frame rate, and obtain the source frame rate by monitoring the clock recovery module.
[0038] Since the original video data will take up a large storage space, lossless compression technology, such as JPEG2000, JPEG XS, NDI, etc., is used to compress the video into coded data of the source frame rate. For application scenarios with small-scale frame rate changes, the frame extraction and interpolation method can ensure video quality while further reducing resource consumption. Frame extraction and interpolation is achieved by operating the memory read and write address, repeatedly caching coded frames, or repeatedly reading out coded frames. The coded data of the source frame rate is obtained after frame extraction and interpolation to obtain the coded data of the target frame rate, and the coded data of the target frame rate can be decoded to obtain the target frame data. From then on, the video frame rate can be changed.
[0039] If the losslessly compressed IP stream is directly unpacked to obtain the encoded data of the source frame rate, and then processed by the above-mentioned frame extraction or frame insertion method without repeated encoding and decoding processes, and finally the processed target frame rate encoded data is repacked as output, the frame rate conversion at the IP level can be achieved.
[0040] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system or other device. In addition, the embodiments of the present invention are not directed to any particular programming language.
[0041] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. Similarly, in order to simplify the present invention and help understand one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. Wherein, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself is a separate embodiment of the present invention.
[0042] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and further may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive.
[0043] It should be noted that the above embodiments illustrate the present invention rather than limit it, and that those skilled in the art may devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets shall not be construed as a limitation on the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be understood as limitations on the order of execution.
Claims
1. A frame rate conversion method, It is characterized in that The method comprises: Get source frame rate encoding data; Cache the source frame rate encoded data into a memory according to a cache clock; The source frame rate coded data is subjected to frame rate conversion processing by using a frame extraction and interpolation technology, and the target frame rate coded data is obtained by reading from the memory.
2. The frame rate conversion method according to claim 1, It is characterized in that The obtaining of source frame rate encoding data specifically includes: Compress the original video using video lossless compression technology to generate source frame rate encoding data; or receiving a losslessly compressed IP stream and depacketizing the IP stream using an IP depacketization technique to generate source frame rate encoded data; The source frame rate encoding data format is an axi-stream format, tuser is used as a frame start signal, and tlast is used as a frame end signal.
3. The frame rate conversion method according to claim 2, It is characterized in that The lossless compression technology is any one of JPEG XS technology, JPEG2000 technology, and NDI technology.
4. The frame rate conversion method according to claim 3, It is characterized in that The IP depacketization technology includes: extracting IP data corresponding to the MAC address from the IP stream according to the TCP protocol, and obtaining source frame rate encoded data by removing the packet header.
5. The frame rate conversion method according to claim 4, It is characterized in that After obtaining the target frame rate coded data, the method further includes: Decoding target frame rate coded data by using video lossless compression technology to generate target frame rate data; Alternatively, the target frame rate encoded data may be re-packetized through IP packetization technology to generate target frame rate data.
6. The frame rate conversion method according to claim 1, It is characterized in that The memory is provided with an input buffer, an output buffer and an idle buffer, and the states of the input buffer, the output buffer and the idle buffer can be dynamically converted; the source frame rate encoded data is cached into the memory according to the cache clock, specifically including: First, the source frame rate encoded data is cached into the input cache according to the cache clock until the input cache is full; If the input buffer is full, determine whether the output buffer is fully read. If the output buffer is fully read, convert the free buffer into the input buffer and write the next frame. Otherwise, determine whether the free buffer is full. If the free buffer is full, the next frame of data is discarded, otherwise the next frame of data is written to the free buffer.
7. The frame rate conversion method according to claim 6, It is characterized in that The step of reading from the memory to obtain target frame rate encoded data includes: First, the source frame rate encoded data is output from the output buffer until the output buffer is read out; If the output buffer is fully read, determine whether the input buffer is full. If so, change the input buffer to the output buffer and output the next frame. Otherwise, repeat the output of the source frame rate encoded data of the current frame in the output buffer.
8. The frame rate conversion method according to claim 7, It is characterized in that The frame rate conversion process of the source frame rate coded data by using the frame extraction and interpolation technology specifically includes: Determine the frame output clock according to the preset target frame rate, and determine the starting address of the source frame rate coded data according to the frame output clock. When the source frame rate coded data of a frame is read or the cache is full, the frame is discarded or copied by resetting the offset address. When increasing the frame rate of target frame rate encoded data, frame duplication is performed by resetting the read address offset; When the frame rate of the target frame rate encoded data is reduced, frame discarding is performed by resetting the write address offset.
9. A frame rate conversion device, It is characterized in that The device comprises: A data reading module is used to obtain source frame rate encoding data; A data cache module, used for caching the source frame rate encoded data into a memory according to a cache clock; The frame rate conversion reading module is used to perform frame rate conversion processing on the source frame rate coded data through frame extraction and interpolation technology, and read the target frame rate coded data from the memory.
10. A computer-readable storage medium, It is characterized in that The storage medium stores at least one executable instruction. When the executable instruction is executed on the frame rate conversion device as claimed in claim 9, the frame rate conversion device performs the operation of the frame rate conversion method as claimed in any one of claims 1 to 8.
Citation Information
Cited By
Video stream processing method and device based on image frame difference
CN121281181A
A video stream processing method and apparatus based on image frame differences
CN121281181B
