1198results about "Conversion by changing video signal frequency" patented technology

The invention is related to methods and apparatus that can advantageously alter a playback rate of a multimedia presentation, such as a video clip. One embodiment of the invention permits a multimedia presentation to be sped up or slowed down with a controlled change in pitch of the sped up or slowed down audio. In one embodiment, this controlled change in the pitch permits the sped up or slowed down audio to retain a same sounding pitch as at normal playback speeds. In one embodiment, a duration is specified and playback of the video clip is advantageously sped to complete playback within the specified duration. In another embodiment, a finish by a time is specified, and the playback of the video clip is advantageously sped to complete playback by the specified time.

A method for forming an output stream of data includes determining an output resolution for the output stream of data, determining an output frame rate for the output stream of data, determining an output color depth for the output stream of data, retrieving a first frame of data, a second frame of data, and a third frame of data from an input stream of data, the input stream of data having an input resolution, an input frame rate, and an input color depth, subsampling the first frame of data, the second frame of data, and the third frame of data to respectively form a first subsampled frame of data, a second subsampled frame of data, and a third subsampled frame of data, when the output resolution is lower than the input resolution, dropping the second subsampled frame of data, when the output frame rate is lower than the input frame rate, reducing color depth for the first subsampled frame of data and the second subsampled frame of data to respectively form a first reduced frame of data and a second reduced frame of data, when the output color depth is smaller than the input color depth, and converting the first reduced frame of data and the second reduced frame of data into the output stream of data.

An image rendering unit (IRU) of a device determines the dynamic frame rate capabilities (DFRCs) of a display and an image frame rate of content to be displayed. Preferably, the DFRCs are stored in a storage device deployed within the display itself. Based on the DFRCs and the image frame rate for the content, the IRU determines an updated frame rate and thereafter provides the content to the display at the updated frame rate. Where control of power consumption is desired, selection of a reduced frame rate can effect a power savings. In this manner, the present invention provides flexible control over display frame rates and / or power consumption of the device.

A display device is mounted on and / or inside the eye. The eye mounted display contains multiple sub-displays, each of which projects light to different retinal positions within a portion of the retina corresponding to the sub-display. The projected light propagates through the pupil but does not fill the entire pupil. In this way, multiple sub-displays can project their light onto the relevant portion of the retina. Moving from the pupil to the cornea, the projection of the pupil onto the cornea will be referred to as the corneal aperture. The projected light propagates through less than the full corneal aperture. The sub-displays use spatial multiplexing at the corneal surface. Various electronic devices interface to the eye mounted display.

An image display apparatus for displaying a 3D video signal using a liquid crystal device such as an HTPS or LCOS device comprises a frame rate converter (3) that converts the input video signal to a doubled frame rate, a signal format converter (4) that converts the pixel sequence of the video signal, a light source controller (7) that outputs a light source control signal for turning the light source used for image display on and off, and a 3D glasses controller (8) that generates a glasses control signal (c3) for shutters (64R, 64L) that switch the transmission of the light to the right and left eyes of 3D glasses (64). The risk of crosstalk between the right and left images, due to device response speed is reduced, without requiring a large number of frame memories.

The present invention relates to methods and systems for the exhibition of a motion picture with enhanced perceived resolution and visual quality. The enhancement of perceived resolution is achieved both spatially and temporally. Spatial resolution enhancement creates image details using both temporal-based methods and learning-based methods. Temporal resolution enhancement creates synthesized new image frames that enable a motion picture to be displayed at a higher frame rate. The digitally enhanced motion picture is to be exhibited using a projection system or a display device that supports a higher frame rate and / or a higher display resolution than what is required for the original motion picture.

A first motion vector is estimated by using a first frame and a second frame that follows the first frame. A support frame is generated from at least either the first or the second frame by using the first motion vector. The support frame is divided into a plurality of small blocks. Motion vector candidates are estimated by using the first and second frames, in relation to each of the small blocks. A small block on the first frame, a small block on the second frame and the small blocks on the support frame are examined. The small block on the first frame and the small block on the second frame correspond to each of the motion vector candidates. A second motion vector is selected from the motion vector candidates, and points the small block on the first frame and the small block on the second frame which have the highest correlation with each of the small blocks on the support frame. An interpolated frame is generated from at least either the first or the second frame by using the second motion vector.

An active matrix type display panel is a hold type display panel which has a plurality of pixels arranged in a matrix form, and holds and displays an electrical signal pixel by pixel for a predetermined time. A frame rate conversion circuit converts a video signal having a first vertical frequency (60 Hz) into a video signal having a second vertical frequency (120 Hz) which is m / n-fold (wherein m is an integer of 2 or more, n is an integer of 1 or more, and conditions of m>n are satisfied) of the first vertical frequency. A time base emphasizing circuit subjects an output from the frame rate conversion circuit to time base emphasis. A drive circuit displays the video signal having the second vertical frequency in a display panel.

There is provided an image processing method capable of improving the picture quality. The image processing method comprises: incorporating input frame pictures to be displayed on a display device, on the basis of an input picture signal and an input synchronizing signal which is synchronized with the input picture signal; recording the incorporated input frame pictures in an input frame memory; and producing output frame pictures from input frame pictures, which have been recorded in the input frame memory, by producing an interpolated picture or inserting a black raster picture or thinning out the frame pictures, between input frame pictures corresponding to a picture information of the input frame picture to be displayed, on the basis of the picture information and the input synchronizing signal and an output synchronizing signal.

An apparatus for displaying video signals includes an input source to receive video signals having different frame frequencies and provide an input video signal from among the received video signals, a frame frequency detector to detect, as a first frame frequency, the frame frequency of the input video signal, a determiner to determine a second frame frequency according to the first frame frequency and provide a frame frequency conversion rate, the second frame frequency being higher than the first frame frequency, an interpolation frame generator to generate interpolation frames according to the frame frequency conversion rate, and a frame frequency converter to convert the input video signal into a video signal having the second frame frequency by interpolating the generated interpolation frames between original frames of the input video signal.

A method performed by one or more computing devices. The method includes identifying first and second portions of a digital video signal. First and second values of a plurality of quality metrics are determined for the first and second portions, respectively. The first and second values of the metrics are used to determine first and second values, respectively, of a plurality of picture quality parameters such that a signal transmitted using either the first or second values of the parameters would require at most a maximum output bitrate. The first values of the parameters may differ from the second values of the parameters. The first and second portions are adjusted using the first and second values, respectively, of the parameters. The first and second adjusted portions are transmitted in a continuous signal. Optionally, the first and second adjusted portions are compressed before they are transmitted.

A method and a device for motion estimated and compensated Field Rate Up-conversion (FRU) for video applications is disclosed and claimed. The invention provides for dividing an image field to be interpolated into a plurality of image blocks, where each image block includes a respective set of image elements of the image field. In one embodiment, for each image block of a subset of image blocks, a group of neighboring image blocks is selected. A motion vector for the image block is estimated that describes the movement of the image block from a previous image field to a current image field on the basis of predictor motion vectors associated to the group of neighboring image blocks. Each image element of the image block is determined by interpolation of two corresponding image elements in the previous and current image fields related by the estimated motion vector. To estimate a motion vector, the invention provides for applying each of the predictor motion vectors to the image block to determine a respective pair of corresponding image blocks in the previous and current image fields. For each of the pairs of corresponding image blocks, an error function which is the Sum of luminance Absolute Difference (SAD) between corresponding image elements in the pair of corresponding image blocks is evaluated. For each pair of the predictor motion vectors, a degree of homogeneity is also evaluated, followed by the application of a fuzzy rule having an activation level that is proportional to the degree of homogeneity of the pair of predictor motion vectors and the error functions of the pair of predictor motion vectors. An optimum fuzzy rule having the highest activation level is selected, from which the best predictor motion vector is determined, having the smaller error function of the pair associated to the optimum fuzzy rule. In most cases, the motion vector for the image block is estimated on the basis of the best predictor motion vector.

Systems and methods are provided for improving the visual quality of low resolution and / or low frame rate video content displayed on large-screen displays. A video format converter may be used to process a low resolution and / or low frame rate video signal from a media providing device before the video is displayed. The video format converter may detect the true resolution of the video and deinterlace the video signal accordingly. The video format converter may also determine the frame rate of a video and may increase the frame rate if the received frame rate is below a certain threshold. For videos that are also low in quality, the video format converter may reduce compression artifacts and apply techniques to enhance the appearance of the video.

An image converting apparatus includes a memory which can store frame information of an image to be played, and an image processing section which can read frame information from the memory and convert the frame rate to a predetermined frame rate in response to a predetermined state and in accordance with the play state.

In a high speed image capturing state, a camera signal processing circuit is not needed to perform a signal process at a high screen rate, but at a regular screen rate. In the high speed image capturing mode, raw data of 240 fps received from an image sensor 101 are recorded on a recording device 111 through a conversion processing section 201 and a recording device controlling circuit 210. Raw data that have been decimated and size-converted are supplied to a camera signal processing circuit 203 through a pre-processing circuit 202 and an image being captured is displayed on a display section 112 with a signal for which a camera process has been performed. In a reproducing state, raw data are read from the recording device 111 at a low screen rate according to a display performance of the display section 112 and the raw data that have been read are processed are processed by the pre-processing circuit 202 and the camera signal processing circuit 203 and a reproduced image is displayed by the display section 112.

The invention discloses a video super-resolution reconstruction method based on a deep residual network. According to the method, a corresponding high-resolution image is reconstructed from a set of continuous low-resolution video frame images of a video sequence so that the video display effect can be obviously enhanced. The innovativeness of the video super-resolution algorithm is mainly reflected in two aspects: firstly, the initial stage, the series convolutional layer computation stage and the residual block computation stage are directly performed from the low-resolution video images by using the deep residual network and then the high-resolution video image is reconstructed by using the deconvolution and convolution operation mode gradually so that conventional preprocessing of bicubic interpolation does not need to be performed on the low-resolution video images; and secondly, compared with the most classic single frame and video super-resolution reconstruction method based on deep learning, the high-resolution video image can be effectively reconstructed in different environments under the condition of using few training data, and the video image display effect can be greatly enhanced.

There is provided a video processing apparatus comprising a motion vector detection unit for detecting data on the motions of objects by using at least two frames, an interpolation frame generation unit for generating interpolation frames in the horizontal / vertical and temporal directions in accordance with the motion vectors obtained by the motion vector detection unit, and an image feature detection unit for detecting the features of motions extended over the at least two frames, wherein the procedures, performed by the image feature detection unit, of generating interpolation frames in the horizontal / vertical and temporal directions are switched over in accordance with the features of motions.

In an image display apparatus which displays a picture by inverting the drive polarity for each sub-frame, when the pictures of adjacent sub-frames are different from each other, image data is generated to prevent accumulation of electrical charges in each display element. For this purpose, the first and second sub-frames are generated from a frame of interest of a moving picture. The difference between the pictures of the first and the second sub-frames is detected. A correction value is calculated by subtracting from the difference a cumulative value multiplied by a predetermined coefficient. A value obtained by subtracting the correction value from the difference is accumulated as the cumulative value. The pictures of the first and second sub-frames are corrected by the correction value.

A method for managing media communications. In one embodiment, the method comprises establishing a session to a computer over a network and through a switch; generating first and second frames of an image stream; identifying updated regions of the first and the second frames, wherein the updated region of the first frame has a first size and the updated region of the second frame has a second size different from the first size; compressing, based on a value from a congestion manager, the updated regions of the first and the second frames to generate a first and a second encoding, respectively; transmitting the first encoding over the session at a first rate determined from the first size and the value; and transmitting the second encoding over the session at a second rate determined from the second size and the value, wherein the second rate is different from the first rate.

A first motion vector is estimated by using a first frame and a second frame that follows the first frame. A support frame is generated from at least either the first or the second frame by using the first motion vector. The support frame is divided into a plurality of small blocks. Motion vector candidates are estimated by using the first and second frames, in relation to each of the small blocks. A small block on the first frame, a small block on the second frame and the small blocks on the support frame are examined. The small block on the first frame and the small block on the second frame correspond to each of the motion vector candidates. A second motion vector is selected from the motion vector candidates, and points the small block on the first frame and the small block on the second frame which have the highest correlation with each of the small blocks on the support frame. An interpolated frame is generated from at least either the first or the second frame by using the second motion vector.

Disclosed is an imaging apparatus with a flicker detector that restrains an increased calculation amount and image quality degradation. The apparatus includes a frame rate controller for setting a frame rate of an acquired image to a first frame rate or different second frame rate, a luminance calculator for calculating a first luminance difference between two images of a first group continuously acquired at the first frame rate and a second luminance difference between two images of a second group continuously acquired at the second frame rate, and a flicker detector for comparing the first and second luminance differences with first and second threshold, respectively, and determining whether flickers of a first frequency and a different second frequency are generated or not.

The invention provides a video frame rate up-conversion method and system based on a convolutional neural network. The method includes: receiving an initial video transmitted by a sending end; dividing the initial video into multiple image blocks of which each comprises two consecutive frame images; using the two consecutive frame images in the image block as input of the target convolutional-neural-network, and synthesizing an intermediate frame corresponding to the two consecutive frame images, wherein the target convolutional-neural-network is obtained through training of a preset trainingdata set, and includes an encoder, a decoder and an optical-flow prediction layer; and inserting the intermediate frame image into the image block to obtain a target video after video frame rate up-conversion. Therefore, mapping from a previous frame and a next frame to the intermediate frame can be completed, a frame rate of the original video is improved, and up-conversion of the video frame rate is better completed.

The invention discloses a high-frame-rate video generation method based on depth learning. The method includes the steps that one or more original high-frame-rate video segments are used for generating a training sample set; multiple video frame subsets in the training sample set are used for training a dual-channel convolutional neural network model so as to obtain an optimized dual-channel convolutional neural network, wherein the dual-channel convolutional neural network model is a convolutional neural network formed by fusing two convolutional channels; the optimized dual-channel convolutional neural network is adopted, according to any two adjacent video frames in a low-frame-rate video, an insert frame of the two video frames is generated, and therefore a video whose frame rate is higher than that of the low-frame-rate video is generated. The whole process of the method is in an end-to-end mode, no subsequent processing is needed for video frames, the video frame rate conversion effect is good, the fluency of the synthetic video is high, and the method has excellent robustness on shaking, video scene changing and other problems in the video shooting process.

An apparatus and a method for frame interpolation based on precision motion estimation are provided. The apparatus for frame interpolation may generate an interpolation frame to restore images based on a motion vector which is determined after a motion vector is determined based on a rotation element in addition to forward motion and backward motion between frames.

Systems and methods for efficiently reformatting video data in regions of video including occlusions are disclosed. In one embodiment, the method includes determining multiple motion vectors that link / relate matching blocks of two reference frames and calculating a measure related to overlap area of the matching blocks in one or both of the reference frames with a block to be constructed in an intermediate frame. The measure related to overlap area takes into account a particular interpolation phase of the frame being constructed in relation to the two reference frames. In one embodiment, a ranking of the measure related to overlap areas is used to classify the block to be constructed according to a degree of occlusion. In another aspect the location of the matching blocks in one or both of the reference frames is used in the classification of the block to be constructed.

An electronic device determines that an application has been launched for which screencasting is available. In response, the device displays a screencast control panel. A user inputs an instruction to begin screencasting via the control panel. In response to this instruction, the electronic device screencasts media content including content created by the application.

A mobile information terminal that changes various settings associated with reproduction of a moving image content based on a type of the content so as to reduce power consumption. The mobile information terminal starts a television in response to operation by a user, and receives a moving image content of a selected broadcast program, and EPG data. When a power saving mode is ON, the type of the program is judged according to the EPG data. Subsequently, a default frame rate is changed to a value that has been preset for the program type. Hence, the mobile information terminal reproduces the program at a suitable frame rate. Such a change may be made to settings other than the frame rate.

Certain aspects of a method and system for optical flow based motion vector estimation for picture rate up-conversion (PRUC) may include generating one or more motion vectors based on extracted picture rate up-conversion (PRUC) data by minimizing a cost function. The cost function may be constrained by any combination of a block matching constraint, a smoothness constraint and a bias constraint. The PRUC data may be extracted from a compressed video data stream while the compressed video data stream is being decompressed by a video decompression engine. The PRUC data may comprise local block motion vectors, block coding modes, quantization levels, quantized residual data and decoded pictures. A plurality of interpolated pictures may be generated based on extracting the PRUC data.

A colour display (100, 200) for displaying an image is described wherein the colour display (100, 200) is adapted for displaying a number of basic colour light channels (102a, 102b, 102c). The colour display (100, 200) comprises a basic colour combiner (112, 212) for combining the basic colours and at least one basic colour light channel (102a, 102b, 102c) comprising at least two light sources (104) having different spectral characteristics. The colour display (100, 200) furthermore comprises an adjuster (106, 206) for adjusting a basic colour by adjusting a relative proportion of a luminous output from the at least two light sources (104) in the basic colour light channel (102a, 102b, 102c). A corresponding adjuster / controller, a multi-display system and a corresponding method for setting and / or adjusting a display system also is described.

A video processor, upstream of a frame rate converter determines video attribute data. This attribute data is formatted and passed along a channel to the frame rate converter. The frame rate converter extracts the attribute data from the channel for use in frame rate conversion. The frame rate converter may thus rely on attribute data obtained by the video processor, and need not re-analyze video frames.