Method and system for generating video frames and correcting motion

a video frame and motion correction technology, applied in the field of video transmission, can solve the problems of insufficient transmission bandwidth between the media server 102 and the rendering computer 106, presentation jittery and strobe-like, and simply not as smooth, and the system does not account for certain idiosyncrasies within selected streaming presentations

Inactive Publication Date: 2010-11-04
REALNETWORKS INC
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The frame generator enhances video quality by preventing anomalous results, maintaining text positioning, and filtering out interpolation artifacts, resulting in a smoother and more stable video presentation.

Problems solved by technology

Currently, certain technical problems exist relating to transmitting and rendering a video presentation across low bandwidth computer networks FIG. 1 illustrates a conventional streaming video system 100.
One problem that is encountered in current streaming systems is that the transmission bandwidth between the media server 102 and the rendering computer 106 is not sufficient to support a real-time seamless presentation, such as is provided by a standard television set.
The resulting presentations, however, are jittery and strobe-like and are simply not as smooth as a presentation that has a higher frame rate.
These systems do not account for certain idiosyncrasies within selected streaming presentations.
For example, current frame generators that use motion compensated frame interpolation do not account for video presentations that have textual characters.
If motion compensated frame interpolation generates an intermediate frame having textual characters, the generated frame may inappropriately move the text to a new position, thereby creating some floating text that was not intended by the creator of the video presentation.
Another problem associated with existing frame generators is that they unintelligently perform frame generation regardless of whether such interpolation results in a better quality video presentation.
Although frame interpolation does increase the number of frames presented to the viewer, such frame generation can produce strange results under certain circumstances.
Additionally, current frame generators do not perform any type of post filtering to the generated frames.
If frame generation would produce anomalous results, frame generation should not be performed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for generating video frames and correcting motion
  • Method and system for generating video frames and correcting motion
  • Method and system for generating video frames and correcting motion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

” one will understand how the features of this invention provide advantages over other frame generators.

[0017]One embodiment of the invention includes a method of generating video frames, the method comprising receiving a first frame in a memory in the computer system, the first frame representative of an image at a first instance in time, the first frame including a plurality of first elements and a plurality of motion vectors, each of the motion vectors being associated with one of the plurality of first elements, receiving a second frame in a memory in the computer system, the second frame representative of an image at a second instance in time, the second frame including a plurality of second elements and a plurality of motion vectors, each of the motion vectors being associated with one of the plurality of second elements, modifying at least one of the motion vectors in the first and / or second frames based upon the value of one of the other motion vectors in the first and / or th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

System and method for generating video frames. The system includes a frame generator which generates one or more intermediate frames based upon one base frames. Each of the base frames are comprised of a plurality of macroblocks. Furthermore, one or more of the macroblocks have a motion vector. The macroblocks are comprised of a plurality of pixels. In the frame generation process, the frame generator performs a number of steps such as: (i) determines whether frame generation is appropriate, (ii) examines the first and second base frames to check for the presence of textual characters, (iii) selects a frame generation method based upon information in the first and second frames, (iv) filters the generated frames. In one embodiment, the system includes a server computer having an encoder, a client computer having a decoder, and a network connecting the server computer to the client computer. In this embodiment, the frame generator resides and executes within the client computer and receives the base frames from the decoder.

Description

RELATED APPLICATIONS[0001]This application is a continuation of U.S. patent application Ser. No. 09 / 345,577, filed on Jun. 30, 1999, which is hereby incorporated by reference in its entirety. The present application is also related to and incorporates by reference in their entirety the following U.S. patent applications: application Ser. No. 09 / 345,686, entitled “System and Method for Generating Video Frames,” filed Jun. 30, 1999; application Ser. No. 09 / 345,576, entitled “System and Method for Generating Video Frames and Detecting Text,” filed Jun. 30, 1999; and application Ser. No. 09 / 345,584, entitled “System and Method for Generating Video Frames and Post Filtering,” filed Jun. 30, 1999.BACKGROUND OF THE INVENTION[0002]1. Field of the Invention[0003]The invention pertains to the field of video transmissions. More particularly, the invention pertains to a system and a method for generating video frames.[0004]2. Description of the Related Art[0005]Virtually all applications of vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(United States)
IPC IPC(8): H04N5/14H04N7/26H04N7/46
CPCH04N19/80H04N19/577H04N19/587
InventorCONKLIN, GREG
OwnerREALNETWORKS INC