902 results about "Motion estimation" patented technology

Motion estimation of a macro block in inter16×16, inter16×8, and inter8×16 modes is performed and a determination of whether to further perform motion estimation in a P8×8 mode is made. Motion estimation in P8×8 mode is either omitted or performed and one mode is determined according to a rate distortion cost of the respective modes. Spatial prediction encoding may then be performed or omitted based on comparing the rate distortion cost of the one mode with a predetermined value. Accordingly, by selectively omitting variable block motion estimation and spatial prediction encoding which are the most complicated operations in an H.264 encoder, determining an encoding mode is rapidly performed such that encoding speed increases.

A novel method, system, and apparatus for efficient multi-block motion estimation in a digital signal compression and coding scheme. This invention selects only a few representative block sizes for motion estimation when certain favourable conditions occur, rather than using all available block sizes. This invention produces significantly reduced computational costs with virtually no sacrifice in visual quality and in bit-rate.

The invention discloses a motion vector forecasting method in a resolution quantizing structure, wherein, forecasting motion vectors of macro blocks in enhancement layers are acquired by utilization of relativity of motion vectors of a time domain, a space domain and an interlayer domain. The realization process is that: on the time domain, candidate motion vectors of the time domain are acquired from motion vectors of macro blocks with the same position with the prior frame; on the space domain, candidate motion vectors of the space domain are acquired from motion vectors of adjacent blocks; on the interlayer domain, candidate motion vectors of the interlayer domain are acquired from corresponding motion vectors with low space domain resolution hierarchy; candidate motion vectors with minimum motion estimation cost are selected to be forecasting motion vectors by selection among the candidate motion vectors of the time domain, the space domain and the interlayer domain. The invention has the advantages of capability of acquiring more accurate forecasting motion vectors, capability of compressing code rate of motion vectors, and obtaining of performance gain.

Transcoding is achieved by decoding a received video signal which has been coded according to a first coding scheme employing motion compensation and carries coded data and motion compensation information, and encoding the decoded according to a second coding scheme also employing motion compensation. Estimated motion vectors are generated for a current frame of the video signal, using vectors which, in the received signal, accompanying at least one other frame of the video signal. These may be used directly or used to define a search area for motion estimation.

Video encoding device including a video input processor, for receiving said video signal, a global controller, for controlling the global operation of the video encoding device, a motion estimation processor, a digital signal processor and a bit-stream processor, wherein the global controller stores encodes commands received from a host interface thereby programming the video input processor, the motion estimation processor, the digital signal processor and the bit-stream processor, the video input processor receives and stores the video signal in an external memory unit, the motion estimation processor retrieves the video signal from the memory unit, generates motion analysis of the video signal, stores the motion analysis in the memory unit and provides the motion analysis to the digital signal processor, the digital signal processor processes the video signal according to the motion analysis, thereby producing an encoding commands sequence and encoded data, the bit-stream processor produces an encoded video signal according to the encoding command sequence and the encoded data.

An imaging device and methods of stabilizing video captured using a rolling shutter operation. Motion estimation is used to determine a row motion vector for individual rows of a current frame of a pixel array. The row motion vectors are used to map the location of pixels in the current frame to a mapped frame representing a single acquisition time for the current frame.

A method for motion estimation within biological tissue is disclosed. The method involves acoustically coupling a transducer to a target biological tissue, which transducer emits an ultrasonic signal and collects the energy back-scattered by the target issue. A first set of energy data is collected and stored, then target tissue is axially compressed and a second set of ultrasonic energy data is collected and stored. One of the first and second data sets is warped to account for the anticipated compression forming a warped data set. This warped data set is cross-correlated with the unwarped one of the first and said second data sets to obtain a fine scale displacement of said target biological tissue from the displacement estimated by the warping. This fine scale displacement is summed with the warped data set to obtain a total axial displacement. A gradient of the total axial displacement is taken and used to form a strain image. An apparatus for practicing this method is also disclosed.

Embodiments include a motion estimation method performed in a parallel processing system that determines a list of several candidate motion vectors for a macroblock of a video image and retains them through multiple computation passes. All candidate motion vectors are used as potential neighboring predictors, so that the best combination of differential vectors rises to the top of the candidate list. Numerous combinations of differential motion vectors are considered during the process that compares motion vectors among up to eight neighboring macroblocks, instead of simply between pairs of macroblocks. The motion estimation system is configured to use a large number of compute engines, such as on a highly parallel GPU platform. This is achieved by having no dependencies between macroblocks except one per pass. This allows the number of calculations per pass to be very large.

Region-of-interest cropping of high-resolution video is supported video compression and extraction methods. The compression method divides each frame into virtual tiles, each containing a rectangular array of macroblocks. Intra-frame compression uses constrained motion estimation to ensure that no macroblock references data beyond the edge of a tile. Extra slice headers are included on the left side of every macroblock row in the tiles to permit access to macroblocks on the left edge of each tile during extraction. The compression method may also include breaking skipped macroblock runs into multiple smaller skipped macroblock runs. The extraction method removes slices from virtual tiles that intersect the region-of-interest to produce cropped frames. The cropped digital video stream and the compressed digital video stream have the same video sequence header information.

A method for tracking one or multiple objects from an input video sequence allows a user to select one or more regions that contain the object(s) of interest in the first and the last frame of their choice. An initialization component selects the current and the search frame and divides the selected region into equal sized macroblocks. An edge detection component computes the gradient of the current frame for each macroblock and a threshold component decides then which of the macroblocks contain sufficient information for tracking the desired object. A motion estimation component computes for each macroblock in the current frame its position in the search frame. The motion estimation component utilizes a search component that executes a novel search algorithm to find the best match. The mean absolute difference between two macroblocks is used as the matching criterion. The motion estimation component returns the estimated displacement vector for each block. An output component collects the motion vectors of all the predicted blocks and calculates the new position of the object in the next frame.

Digitalized video images are compressed in several steps in order to provide a system for transmitting moving video pictures via narrow band channels, such as the telephone network. The system is based on any extension of the bit-plane coding technique to video sequences and lossy conditions. The compression technique can also be advantageously used in a lossless compression system. The system involves the steps of bit plane representation and skipping the least significant bit plane(s), shifting the pixels, coding with a Gray code, the use of segmentation, and motion-estimation/motion compensation and application of a transmit/not transmit/motion compensate (TX/NT/MC) procedure, exploiting of the temporal redundancy of two corresponding bit planes via an XOR operation on two successive images, and a plane-by-plane application of an extended RLEID technique. The RLEID technique includes coding a run of like binary symbols with one word, the run including a transition between the penultimate and ultimate binary symbol.

A motion estimation and compensation device that avoids discrepancies in chrominance components which could be introduced in the process of motion vector estimation. The device has a motion vector estimator for finding motion vectors in given interlace-scanning chrominance-subsampled video signals. The estimator compares each candidate block in a reference picture with a target block in an original picture by using a sum of absolute differences (SAD) in luminance as similarity metric, chooses a best matching candidate block that minimizes the SAD, and determines its displacement relative to the target block. In this process, the estimator gives the SAD of each candidate block an offset determined from the vertical component of a corresponding motion vector, so as to avoid chrominance discrepancies. A motion compensator then produces a predicted picture using such motion vectors and calculates prediction error by subtracting the predicted picture from the original picture.

A method of inter prediction encoding of an image, the method including: searching for a first reference block in a reference picture by using a current block, and estimating a first motion vector in a first pel unit in regards to the first reference block; estimating a second motion vector by using pixels included in a pre-encoded area adjacent to the current block, and pixels adjacent to the first reference block, and determining a second reference block based on the second motion vector; and encoding the current block based on the first motion vector and the second reference block.

The present invention discloses a system and method for performing motion estimation associated with an encoder, e.g., a H.264/MPEG-4 AVC compliant encoder. For example, the method selects a motion vector centering for a current block in a search area of at least one reference picture. The method calculates a matching cost for each of a plurality of candidate motion vectors derived from the search area, and outputs at least one of the plurality of candidate motion vectors based on the matching cost associated with each of the plurality of candidate motion vectors to a main coding loop.

Disclosed herein is an adaptive motion estimation and mode decision apparatus and method for an H.264 video codec. The apparatus includes a background image detection unit, an inter mode inspection unit, an intra mode inspection unit and a mode inspection skip unit. The background image detection unit inspects whether a fixed background or slowly and regularly moving block exists, and skips the step of dividing a first corresponding macroblock into smaller sized blocks and performing block mode inspection. The inter mode inspection unit inspects whether an irregularly or fast moving macroblock exists, and determines whether to divide a corresponding macroblock into smaller sized blocks and to perform block mode inspection on the smaller sized blocks. The intra mode inspection unit performs AZCB inspection on the macroblocks, and determines whether to divide a corresponding macroblock into smaller sized blocks block and to perform mode inspection on the smaller sized blocks. The mode inspection skip unit skips the block mode inspection for the smaller sized blocks.

A camera comprising a first circuit and a second circuit. The first circuit may be configured to perform image signal processing using encoding related information. The second circuit may be configured to encode image data using image signal processing related information. The first circuit may be further configured to pass the image signal processing related information to the second circuit. The second circuit may be further configured to pass the encoding related information to the first circuit. The second circuit may be further configured to modify one or more motion estimation processes based upon the information from the first circuit.

The present invention relates to systems and methods for motion estimation and mode decision for low-complexity H.264 standard decoders. The present invention includes a method for optimizing the selection of motion vectors and motion compensation block modules in a video encoder in order to decrease the complexity of the video upon decoding. The novel method of the present invention may include novel steps for selecting motion vectors, block modes, and for applying a complexity-control algorithm to encode the received input video data sequence in accordance with the identified target complexity level. The present invention may be implemented in accordance with current and future video decoding standards to optimize decoding by reducing decoding complexity and thereby reducing required resources and power consumption.

A de-blocking filter processing apparatus that achieves high picture quality without consuming processing apparatus power unnecessarily. A loop filter 170 used as a de-blocking filter processing apparatus first acquires a variable-size motion estimation block in a frame for which motion estimation processing is performed. Then, de-blocking filter processing is applied adaptively to a frame for which motion estimation processing is performed, in accordance with the acquired motion estimation block. Application of de-blocking filter processing is executed only at a boundary between a particular motion estimation block and a motion estimation block adjacent to that motion estimation block in a frame for which motion estimation processing is performed.

A method for compensating for reduced picture quality when combining a multi-chip encoding chipset into a single integrated semiconductor IC. The method includes additional functions provided on the single IC to compensate for the negative effects on picture quality produced as a result of rounding 8 bit luminance pixel data to 5 bits, where the luminance data values are supplied as input to the search function. The additional functions are collectively referred to as motion biasing and are applied to influence the choice of a "best match" motion type, which is well known in the art. The biasing is performed by the addition of a weight factor to a total difference result that is calculated by the search function. The biasing is applied only for the purpose of influencing the choice of a reference frame that is not necessarily the frame which produces an optimal motion vector, but rather will result in using fewer bits to encode macroblocks.

The invention provides an electronic image stabilization method based on characteristic coupling. The method comprises the following steps: (1) motion estimation: estimating motion parameters of a present frame and a previous frame to obtain a global motion vector and a local motion vector; (2) motion filtering: employing a Kalman filter to carry out filtering on the global motion vector, and obtaining a willful scan vector, wherein difference between the global motion vector and the willful scan vector is a vibration parameter needs to compensate; (3) motion compensation: utilizing a compensation parameter obtained by filtering carrying out frame by frame compensation; (4) video restoration: by utilizing space-time redundant information of video, carrying out restoration on the local motion vector with a motion restoration method and guiding pixel point filling. In order to solve motion carrier vibration influence on video shooting effect, the invention provides the electronic image stabilization method based on characteristic coupling. The method has the advantages of high accuracy, good anti-noise performance, strong tracking performance, good boundary consistency and the like.

Methods and systems for processing a set of images are described. In accordance with this disclosure, images are registered and an analysis is performed in view of one or more constraints (such as constraints based upon anatomical or physiological considerations). Weighting factors are determined based on the analysis. The weighting factors are used in subsequent processing of the registered (and/or unregistered) images and/or to formulate a visualization that conveys the degree of confidence in the motion estimation used in the registration process.

Provided are a method of efficiently transmitting motion model parameters using temporal correlation between video frames and a video encoding and decoding method and apparatus, in which motion estimation and motion compensation are performed by generating a plurality of reference pictures that are motion-compensated using motion model parameters. Motion model parameters are encoded based on temporal correlation between motion vectors of representative points expressing the motion model parameters, global motion compensation is performed on a previous reference video frame using motion model parameters in order to generate a plurality of transformation reference pictures, and a current video frame is encoded using the plurality of transformation reference pictures.

Online browsing behavior is used to predict the intent of online users dynamically. The category of online user is predicted and the prediction can be used to provide assistance to the user, if required. Such prediction is based on a combination of a Naïve's Bayes classifier and a Markov model.

A non-iterative 3D processing method and system is disclosed for generic noise reduction. The 3D noise reducer is based on a simple conversion of the five types of noise to equivalent additive noise of varying statistics. The proposed technique comprises also an efficient temporal filtering technique which combines Minimization of Output Noise Variance (MNV) and Embedded Motion Estimation (EME). The proposed temporal filtering technique may be furthermore combined with classical motion estimation and motion compensation for more efficient noise reducer. The proposed technique comprises also a spatial noise reducer which combines Minimum Mean Squared Error (MMSE) with robust and effective shape adaptive windowing (SAW) is utilized for smoothing random noise in the whole image, particularly for edge regions. Another modification to MMSE is also introduced for handling banding effect for eventual excessive filtering in slowly varying regions.

The systems and methods described herein are directed at accelerating video encoding using a graphics processing unit. In one aspect, a video encoding system uses both a central processing unit (CPU) and a graphics processing unit (GPU) to perform video encoding. The system implements a technique that enables the GPU to perform motion estimation for video encoding. The technique allows the GPU to perform a motion estimation process in parallel with the video encoding process performed by the CPU. The performance of video encoding using such a system is greatly accelerated as compared to encoding using just the CPU. In another aspect, data related to motion estimation is arranged and provided to the GPU in a way that utilizes the capabilities of the GPU. Data about video frames may be collocated to enable multiple channels of the GPU to process tasks in parallel. The depth buffer of the GPU may be used to consolidate repeated calculations and searching tasks during the motion estimation process. The use of frame collocation and depth buffer enables the GPU to be better utilized and to further accelerate video encoding.

An inter-mode for encoding a video macroblock is selected based on a comparison of at least two rate-distortion values associated with inter-modes. The number of potential inter-modes for encoding the video macroblock is initially reduced based on the rate-distortion calculation of the SKIP mode between the current macroblock and the collocated macroblock (corresponding to a 0,0 motion vector). Motion estimation is performed on the remaining inter-modes to identify reference blocks and motion vectors. The number of calculations performed in identifying the reference blocks and motion vectors is potentially reduced because associations between inter-modes are recognized and leveraged.

In a video motion compensation encoding apparatus in which each of periodically selected pictures is encoded as successive blocks of picture elements, by encoding of the prediction error amounts obtained for each block in conjunction with variable-length encoding by a motion vector encoder of motion vectors which are utilized in motion compensation processing to derive the prediction error amounts, each of these motion vectors is selected by a comparator-controlled switch either as an estimated motion vector derived by a conventional type of motion estimation section or as a predicted motion vector derived by a motion vector prediction section based on previously encoded motion vectors, with the estimated motion vector being selected only if it is found that an amount of prediction error which would occur from using the predicted motion vector is significantly greater than that which would result from using the estimated motion vector. A higher probability of encoding successively identical motion vectors is thereby achieved, resulting in greater encoding efficiency.

A method and apparatus for estimating motion of a pixel block in a first frame, the method including searching a first area in a second frame to identify a first matching block that corresponds to the pixel block, the first matching block including a first error value that is a minimum of at least one error criteria between the pixel block and the first matching block, calculating a first motion vector associated with the first matching block. The method further including searching a second area in the second frame to identify a second matching block that corresponds to the pixel block, the second matching block including a second error value that is a minimum of the at least one error criteria between the pixel block and the second matching block, calculating a second motion vector associated with the second matching block and selecting a final motion vector between the first and second motion vectors based on the first and second error value.

A method of and apparatus are provided for determining an inter-mode in video encoding. The method includes calculating a motion vector by performing hierarchical motion estimation on a current block to be encoded in units of sub-pixels, storing reference area data indicated by the calculated motion vector in an internal memory, calculating a first cost by performing motion estimation in units of sub-pixels using the reference area data stored in the internal memory, calculating a second cost for the current block by performing motion estimation using a motion vector predicted, if reference area data indicated by the motion vector predicted calculated using motion vectors of neighboring blocks of the current block is included in the internal memory, and comparing the first-cost and the second cost and determining an inter-mode having the smallest cost.

Provided are a method of and an apparatus for deciding an encoding mode for variable block size motion estimation, which can decide an encoding mode quickly and with less computation during variable block size motion estimation. The method includes searching in a reference frame for a macroblock that is most similar to a current macroblock, selecting a temporary encoding mode candidate group for encoding of the current macroblock from among a plurality of encoding mode candidate groups including at least one encoding mode, using encoding mode information of the searched-for macroblock of the reference frame, selecting the decided temporary encoding mode candidate group or an encoding mode candidate group including an encoding mode using a smaller block than the decided temporary encoding mode candidate group as a final encoding mode candidate group, based on the temporary encoding mode candidate group, the complexity of the current macroblock or sub-blocks obtained by dividing the current macroblock, and the difference between the current macroblock or each of the sub-blocks and the reference frame, and performing motion estimation in encoding mode included in the final encoding mode candidate group and deciding an encoding mode of the current macroblock.