A method, a sending card and a playback system for performing frame interpolation at any time

Abstract

Embodiments of the present disclosure relate to a method, a transmitting card, and a playback system for performing frame interpolation at any time. The method includes: obtaining the position of an interpolated frame and determining the previous frame and the next frame of the interpolated frame; obtaining a first time interval from the previous frame to the next frame and a second time interval from the previous frame to the interpolated frame; obtaining a forward optical flow from the previous frame to an intermediate frame and a ratio of the second time interval to the first time interval; determining a first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio; generating first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame; wherein, the position of the intermediate frame is at the 1 / 2 position from the previous frame to the next frame; the position of the interpolated frame is at any time between the previous frame and the next frame. The present disclosure can generate corresponding image information for the interpolated frame of frame interpolation at any time, thereby ensuring that the intervals between frames of the video are consistent at non-doubled frequencies, and further making the picture presentation smoother.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the technical field of image processing devices, and in particular, to a method, a sending card, and a playback system for performing frame interpolation at any time. Background Art

[0002] Currently, functions such as image noise reduction, color adjustment, contrast and brightness adjustment, and frame rate improvement are available in current video processing chips during digital image processing. With the development of 4K and 8K resolution technologies, more requirements are placed on the specifications of video processing chips. Most existing display terminal devices such as televisions, set-top boxes, and mobile phones also support different video formats and output frame rates. Consumers and manufacturers have higher demands for the refresh rate of display terminal devices in order to pursue better display of content details. The frame rate improvement technology solves the problem of unsmooth or low-definition pictures caused by too low frame rate of the original video by converting the input low-frame rate video into a high-frame rate video.

[0003] In related technologies, the existing video frame interpolation technology inserts intermediate frames between two frames to achieve the effect of improving the smoothness of the picture. This can achieve a better frame interpolation effect in 2x or 4x frequency doubling scenarios such as 30Hz -> 60Hz or 24Hz -> 96Hz, ensuring the consistency of the inter-frame time interval.

[0004] Regarding the above technical solution, in non-integer multiple frequency doubling scenarios, such as in the 48Hz -> 60Hz frequency doubling scenario. One additional frame needs to be inserted every 4 frames. Such a method will show inconsistent time intervals, which will in turn lead to inconsistent speeds of video frame changes and a "stuttering" feeling in the video. As a result, the inter-frame intervals of the video are inconsistent in non-frequency doubling time frames, and thus the smoothness of the picture cannot be guaranteed.

[0005] Therefore, it is necessary to improve one or more problems existing in the above related technical solutions.

[0006] It should be noted that the information disclosed in the above background art section is only used to enhance the understanding of the background of the present disclosure, and thus may include information that does not constitute the prior art known to those of ordinary skill in the art. Summary of the Invention

[0007] The purpose of the embodiments of the present disclosure is to provide a method, a sending card, and a playback system for performing frame interpolation at any time, so as to at least solve problems such as inconsistent inter-frame intervals of the video in non-frequency doubling time frames and inability to ensure smooth pictures.

[0008] The purpose of the present disclosure is achieved by adopting the following technical solutions:

[0009] In a first aspect, the present disclosure provides a method for performing frame interpolation at any time, including:

[0010] Obtain the position of the interpolated frame, and determine the previous frame and the subsequent frame of the interpolated frame;

[0011] Obtain the first time interval from the previous frame to the subsequent frame and the second time interval from the previous frame to the interpolated frame;

[0012] Obtain the forward optical flow from the previous frame to the intermediate frame, and the ratio of the second time interval to the first time interval;

[0013] Determine the first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio;

[0014] Generate the first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame;

[0015] Wherein, the position of the intermediate frame is the position at the 1 / 2 of the distance from the previous frame to the subsequent frame; the position of the interpolated frame is the position at any moment between the previous frame and the subsequent frame.

[0016] Optionally, the step of obtaining the position of the interpolated frame and determining the previous frame and the subsequent frame of the interpolated frame includes:

[0017] Determine the position of the interpolated frame according to the difference between the frame rate before upsampling and the frame rate after upsampling.

[0018] The beneficial effect of this technical solution is that a more reasonable position of the interpolated frame can be determined.

[0019] Optionally, the step of determining the first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio includes:

[0020] The first interpolated optical flow is calculated by the following formula:

[0021] flow’ = flow × 2t;

[0022] Wherein, flow’ is the first interpolated optical flow; flow is the forward optical flow; t is the ratio of the second time interval to the first time interval.

[0023] The beneficial effect of this technical solution is that the first interpolated optical flow can be calculated more clearly through the formula.

[0024] Optionally, the step of generating the first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame includes:

[0025] Substitute the first interpolated optical flow and the image information of the previous frame into the warping calculation method, and generate the first image information of the interpolated frame.

[0026] The beneficial effect of this technical solution is that the image information of the interpolated frame can be calculated more directly through the warping method.

[0027] Optionally, it further includes:

[0028] Obtain the backward optical flow from the subsequent frame to the intermediate frame;

[0029] Determine the second interpolated optical flow from the subsequent frame to the interpolated frame according to the backward optical flow and the ratio;

[0030] Generate the second image information of the interpolated frame according to the second interpolated optical flow and the image information of the subsequent frame.

[0031] The beneficial effect of this technical solution is that the image information of the interpolated frame can also be generated based on the optical flow through the subsequent frame.

[0032] Optionally, it further includes: performing weighted summation on the first image information and the second image information to generate the third image information of the interpolated frame.

[0033] The beneficial effect of this technical solution is that the image information of the interpolated frame becomes more reasonable through weighted summation.

[0034] Optionally, the step of performing weighted summation on the first image information and the second image information to generate the third image information of the interpolated frame includes:

[0035] Determine the weighting coefficients of the first image information and the second image information according to the ratio of the second time interval in the first time interval.

[0036] The beneficial effect of this technical solution is that the weighting coefficients are made more explicit by the ratio.

[0037] Optionally, the step of determining the second interpolated optical flow from the subsequent frame to the interpolated frame according to the backward optical flow and the ratio includes:

[0038] The second interpolated optical flow is calculated by the following formula:

[0039] flow_bck’ = flow_bck × 2(1 - t);

[0040] where flow_bck’ is the second interpolated optical flow; flow_bck is the backward optical flow; and t is the ratio of the second time interval in the first time interval.

[0041] The beneficial effect of this technical solution is that the second interpolated optical flow is calculated more explicitly by the formula.

[0042] In a second aspect, the present disclosure provides a transmitting card, comprising:

[0043] a processor, which generates upsampled video image information according to the method of inserting frames at any time described in any one of the above embodiments.

[0044] In a third aspect, the present disclosure provides a playback system, comprising:

[0045] a host computer, which is configured to send video image data;

[0046] a transmitting card, which is configured to receive the video image data, convert it into video image information, and send the video image information;

[0047] a receiving card, which is configured to receive the video image information and control a display device to perform display;

[0048] wherein, the transmitting card is the transmitting card described in the above embodiments.

[0049] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0050] In the embodiments of the present disclosure, corresponding image information can be generated for the interpolated frames inserted at any time, so as to ensure that the intervals between frames of the video remain consistent at non-multiplied frequencies, and further make the picture presentation smoother.

[0051] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0053] Figure 1 A flowchart showing a method of inserting frames at any time in an exemplary embodiment of the present disclosure;

[0054] Figure 2 A schematic diagram showing the insertion of intermediate frames during frequency doubling in an exemplary embodiment of the present disclosure;

[0055] Figure 3 A schematic diagram showing the insertion of intermediate frames at non-multiplied frequencies in an exemplary embodiment of the present disclosure;

[0056] Figure 4Schematic diagram showing frame interpolation at any time without frequency doubling in an exemplary embodiment of the present disclosure;

[0057] Figure 5 Schematic flow chart showing another method of frame interpolation at any time in an exemplary embodiment of the present disclosure;

[0058] Figure 6 Schematic flow chart showing another method of frame interpolation at any time in an exemplary embodiment of the present disclosure;

[0059] Figure 7 Schematic flow chart showing another method of frame interpolation at any time in an exemplary embodiment of the present disclosure;

[0060] Figure 8 Schematic flow chart showing another method of frame interpolation at any time in an exemplary embodiment of the present disclosure;

[0061] Figure 9 Schematic diagram showing the structure of a sending card in an exemplary embodiment of the present disclosure;

[0062] Figure 10 Schematic diagram showing the structure of a playback system in an exemplary embodiment of the present disclosure;

[0063] Figure 11 Schematic diagram showing a storage medium in an exemplary embodiment of the present disclosure. Detailed implementation

[0064] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art. The features, structures, or characteristics described may be combined in any suitable manner in one or more embodiments.

[0065] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0066] In this example embodiment, a method of frame interpolation at any time is first provided. Referring to Figure 1 as shown in, the method includes the following steps:

[0067] Step S101: Obtain the position of the interpolated frame and determine the previous frame and the next frame of the interpolated frame.

[0068] Step S102: Obtain the first time interval from the previous frame to the next frame and the second time interval from the previous frame to the interpolated frame.

[0069] Step S103: Obtain the forward optical flow from the previous frame to the middle frame and the ratio of the second time interval to the first time interval.

[0070] Step S104: Determine the first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio.

[0071] Step S105: Generate the first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame.

[0072] Among them, the position of the middle frame is the position at the 1 / 2 of the distance from the previous frame to the next frame; the position of the interpolated frame is the position at any moment between the previous frame and the next frame.

[0073] It should be understood that video image data refers to a continuous sequence of images, which is essentially composed of a group of continuous images. For the image itself, there is no structural information except for the order of their appearance. Among them, a frame is the smallest visual unit that composes a video and is a static image. Synthesizing a sequence of frames that are continuous in time together forms a dynamic video. The description of a frame can adopt the description method of an image. Therefore, the retrieval of frames can be carried out by using a retrieval method similar to that of images.

[0074] It should also be understood that in inter-frame coding, a motion vector (Motion Vector, MV) is used to represent the relative displacement between the current coded block and the best matching block in the reference image. Each divided block has corresponding motion information that needs to be transmitted to the decoding end. If the MV of each block is independently coded and transmitted, especially when divided into small-sized blocks, a considerable amount of bits will be consumed. To reduce the number of bits used for coding motion information, H.264 / AVC utilizes the spatial correlation between adjacent macroblocks and predicts the motion information of the current block to be coded according to the motion information of adjacent coded blocks, and then codes the prediction difference. This can effectively reduce the number of bits representing motion information. Based on this, during the coding process of the MV of the current macroblock, H.264 / AVC first uses the MV of adjacent coded blocks to predict the MV of the current macroblock, and then codes the difference (denoted as MVD (Motion Vector Difference)) between the predicted value of the MV (denoted as MVP (Motion Vector Prediction)) and the true value of the MV, thereby effectively reducing the coding bits of the MV.

[0075] It should also be understood that, referring to Figure 2 as shown, when the frame rate is increased from 30 Hz to 60 Hz, or in the case of 2x or 4x frequency doubling from 24 Hz to 96 Hz, the consistency of the inter-frame time interval can be ensured by inserting intermediate frames. However, in non-frequency doubling scenarios such as 48 Hz to 60 Hz, the consistency of the inter-frame time interval cannot be ensured. Referring to Figure 3 as shown, in the case of 48 Hz to 60 Hz, 1 additional frame needs to be inserted every 4 frames. For example, by inserting the intermediate frame between T2 and T3, it can be clearly seen that the inter-frame time intervals are inconsistent.

[0076] It should also be understood that, referring to Figure 4 as shown, for the same 48 Hz to 60 Hz, 1 additional frame will be inserted every 4 frames. To ensure the consistency of the inter-frame time interval, with each frame time interval being 0.75, insertion frames need to be generated at T0.75 and T2.25, and the middle part cannot be replaced. Through the above method, the insertion frames at T0.75, T1.5, and T2.25 can be generated, thus ensuring the consistency of the inter-frame time interval.

[0077] According to the above method of inserting frames at any time, corresponding image information can be generated for the interpolated frames inserted at any time, thus ensuring that the intervals between frames in the video are consistent during non-frequency doubling, and further making the picture presentation smoother.

[0078] Next, referring to Figures 1 to 8 shown in, the above method in this exemplary embodiment will be described in more detail.

[0079] Referring to Figure 5 shown in, optionally, in step S101, the following steps are included:

[0080] Step S501: Determine the positions of the interpolated frames according to the difference between the frame rate before frequency increase and the frame rate after frequency increase.

[0081] It should be understood that, for example, for 48 Hz to 60 Hz, the difference to be inserted is 12 frames, that is, 1 additional frame will be inserted every 4 frames. To ensure the consistency of the inter-frame time interval, with each frame time interval being 0.75, the positions of the interpolated frames at T0.75, T1.5, and T2.25 can thus be determined.

[0082] Optionally, in step S104, the following steps are included:

[0083] The first interpolated optical flow is calculated by the following formula:

[0084] flow’ = flow × 2t (1)

[0085] Among them, flow’ is the first interpolated optical flow; flow is the forward optical flow; t is the ratio of the second time interval to the first time interval.

[0086] It should be understood that first, the optical flow (flow) from the previous frame (T0 frame) for frame interpolation to the intermediate frame is obtained by the optical flow method. Based on the assumption of linear transformation between two frames, it can be known that the optical flow (flow’) from the previous frame to “any moment frame between two frames” can be calculated by formula (1). Among them, t ∈ [0, 1], and [0, 1] represents the normalized time interval from the previous frame to the next frame. t represents the time interval from the previous frame to “any moment frame between two frames”, that is, t is the value in [0, 1] after normalization.

[0087] Reference Figure 6 As shown in

[0088] Step S601: Input the first interpolated optical flow and the image information of the previous frame into the warping calculation method, and generate the first image information of the interpolated frame.

[0089] It should be understood that after obtaining the optical flow flow’, any moment frame is calculated through warping (a general technology for frame interpolation). For example, when the previous frame is the T0 frame, it can be calculated by warped_image = warp(image_T0, flow’).

[0090] Reference Figure 7 As shown in

[0091] Step S701: Obtain the backward optical flow from the next frame to the intermediate frame.

[0092] Step S702: Determine the second interpolated optical flow from the next frame to the interpolated frame according to the backward optical flow and the ratio.

[0093] Step S703: Generate the second image information of the interpolated frame according to the second interpolated optical flow and the image information of the next frame.

[0094] It should be understood that first, two optical flows for frame interpolation are obtained by the optical flow method: previous frame -> intermediate frame: forward optical flow (flow_for). Next frame -> intermediate frame: backward optical flow (flow_bck). The optical flow (flow_for’) from the previous frame to “any moment frame between two frames” is as follows:

[0095] flow_for’ = flow_for × 2t (2)

[0096] Among them, t is the ratio of the second time interval to the first time interval. Additionally, t ∈ [0, 1], where [0, 1] represents the normalized time interval from the previous frame to the next frame, and t represents the time interval from the previous frame to "any moment frame between two frames", that is, t is the value in [0, 1] after normalization.

[0097] Optionally, in step S702, the following steps are included:

[0098] The second interpolated optical flow is calculated by the following formula:

[0099] flow_bck’ = flow_bck × 2(1 - t); (3)

[0100] Among them, flow_bck’ is the second interpolated optical flow; flow_bck is the backward optical flow; t is the ratio of the second time interval to the first time interval.

[0101] Reference Figure 8 As shown in, optionally, after step S703, the following steps are further included:

[0102] Step S801: Weightedly sum the first image information and the second image information to generate the third image information of the interpolated frame.

[0103] It should be understood that when the interpolation moment is closer to the previous frame, the weight of the previous frame is greater; otherwise, the weight of the next frame is greater.

[0104] Optionally, in step S801, according to the ratio of the second time interval to the first time interval, the weighting coefficients of the first image information and the second image information are determined.

[0105] It should be understood that the final interpolation result is the weighted sum result of the forward and backward warping images, as shown in the following formula:

[0106] warped_image = (1 - t) × warp(image_T0, flow_for′) + t × warp(image_T1, flow_bck′) (4)

[0107] Among them, image_T0 represents the previous frame, and image_T1 represents the next frame.

[0108] Furthermore, in this exemplary embodiment, referring to Figure 9 as shown in, a transmitting card is further provided. It includes:

[0109] A processor that generates upsampled video image information according to the method of interpolating frames at any moment in any of the above embodiments.

[0110] Furthermore, in this exemplary embodiment, referring toFigure 10 As shown, a playback system is also provided. It includes:

[0111] A host computer, which is used to send video image data;

[0112] A sending card, which is used to receive video image data, convert it into video image information, and send the video image information;

[0113] A receiving card, which is used to receive video image information and control a display device to perform display;

[0114] Among them, the sending card is the sending card in the above embodiment.

[0115] It should also be understood that the specific ways of the sending card and the playback system have been described in detail in the embodiments related to the method for improving the frame rate of the display device, and will not be elaborated here.

[0116] It should be noted that although several modules or units of the devices for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units. The components shown as modules or units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present disclosure solution. Those of ordinary skill in the art can understand and implement it without creative work.

[0117] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a computer program is stored. When the program is executed by, for example, a processor, the steps of the method for performing frame interpolation at any time in any of the above embodiments can be implemented. In some possible implementation manners, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above control method part of this specification.

[0118] Reference Figure 11As shown, a program product 110 for implementing the above method according to an embodiment of the present disclosure is described. It can adopt a portable compact disc read-only memory (CD-ROM), include program code, and can run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0119] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0120] The computer-readable storage medium can include a data signal propagated in a baseband or as part of a carrier wave, in which the readable program code is carried. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium can also be any readable medium other than the readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium can be transmitted by any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0121] The program code for performing the operations of the present disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages - such as Java, C++, etc., and also including conventional procedural programming languages - such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, by using an Internet service provider to connect through the Internet).

[0122] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed in the present disclosure. The specification and examples are only regarded as exemplary, and the true scope and spirit of the present disclosure are indicated by the appended claims.

Claims

1. A method for frame interpolation at any time, characterized in that, Including: Obtain the position of the interpolated frame and determine the previous frame and the next frame of the interpolated frame; Determine the position of the interpolated frame according to the difference between the frame rate before upsampling and the frame rate after upsampling; Obtain the first time interval from the previous frame to the next frame and the second time interval from the previous frame to the interpolated frame; Obtain the forward optical flow from the previous frame to the intermediate frame and the ratio of the second time interval to the first time interval; Determine the first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio; Generate the first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame; Wherein, the position of the intermediate frame is the position at the 1 / 2 of the distance from the previous frame to the next frame; the position of the interpolated frame is the position at any moment between the previous frame and the next frame.

2. The method according to claim 1, wherein The step of determining the first interpolated optical flow from the previous frame to the interpolated frame according to the forward optical flow and the ratio includes: The first interpolated optical flow is calculated by the following formula: flow’=flow×2t; Wherein, flow’ is the first interpolated optical flow; flow is the forward optical flow; t is the ratio of the second time interval to the first time interval.

3. The method according to claim 2, wherein The step of generating the first image information of the interpolated frame according to the first interpolated optical flow and the image information of the previous frame includes: Bring the first interpolated optical flow and the image information of the previous frame into the warping calculation method and generate the first image information of the interpolated frame.

4. The method according to claim 1, wherein Also including: Obtain the backward optical flow from the next frame to the intermediate frame; Determine the second interpolated optical flow from the next frame to the interpolated frame according to the backward optical flow and the ratio; Generate the second image information of the interpolated frame according to the second interpolated optical flow and the image information of the next frame.

5. The method according to claim 4, wherein Also including: Perform weighted summation on the first image information and the second image information to generate the third image information of the interpolated frame.

6. The method according to claim 5, characterized in that, The step of performing weighted summation on the first image information and the second image information to generate the third image information of the interpolated frame includes: Determine the weighting coefficients of the first image information and the second image information according to the ratio of the second time interval to the first time interval.

7. The method according to any one of claims 4 to 6, characterized in that The step of determining the second interpolated optical flow from the next frame to the interpolated frame according to the backward optical flow and the ratio includes: The second interpolated optical flow is calculated by the following formula: flow_bck’=flow_bck×2(1 - t); Wherein, flow_bck’ is the second interpolated optical flow; flow_bck is the backward optical flow; t is the ratio of the second time interval to the first time interval.

8. A sending card, characterized in that, Including: A processor, which generates the video image information after upsampling according to the method of interpolating frames at any moment according to any one of claims 1 to 7.

9. A playback system, characterized in that, Including: A host computer, which is used to send video image data; A sending card, which is used to receive the video image data, convert it into video image information, and send the video image information; A receiving card, which is used to receive the video image information and control a display device to perform display; Wherein, the sending card is the sending card described in claim 8.

Images