515 results about "Image motion" patented technology

An image processing apparatus includes a motion prediction processor configured to detect a motion vector that indicates inter-image motion between a current image and a reference image; a motion compensation processor configured to perform a motion compensation process for the reference image by using the motion vector and generate a motion compensated image; an addition processor configured to generate a noise reduced image in which noise of the current image is reduced by adding the current image and the motion compensated image; an addition determination unit configured to compute an addition weight in units of pixels of the motion compensated image; a down-sampling processor configured to perform a process for reducing the current image and the motion compensated image; and an up-sampling processor configured to perform a process for expanding an addition coefficient map that is an output of the addition determination unit.

An electro-optical framing camera forward motion compensation (FMC) reconnaissance system comprising a moving shutter and a full frame focal plane array detector is designed to minimize the variation of image motion from a target scene across the focal plane array. The full frame focal plane array, such as a Charge Coupled Device (CCD), is designed to transfer and add the image from pixel to pixel at a predetermined rate of image motion corresponding to the region exposed by the focal plane shutter. The focal plane shutter aperture and velocity are set to predetermined values coordinated with the available illumination. The CCD image transfer rate is set to minimize the smear effects due to image motion in the region of the scene exposed by the focal plane shutter. This rate is variable with line of sight depression angle, aircraft altitude, and aircraft velocity / altitude ratio. Further, a method of FMC utilizes a comparison of a measured light level to a standard value in order to determine the appropriate exposure time and shutter motion rate. An optimal FMC clocking signal is calculated based on image motion equations incorporated in the processing unit of the reconnaissance system.

A method of operating a mobile device with a camera, a display and a position sensor to provide a display of supplementary information aligned with a view of a scene. One or more image obtained from the camera is uploaded to a remote server together with corresponding data from the position sensor. Image processing is then performed to track image motion between that image and subsequent images obtained from the camera, determining a mapping between the uploaded image and a current image. Data is then received via the network indicative of a pixel location for display of supplementary information within the reference image. The mapping is used to determine a corresponding pixel location for display of the supplementary information within the current image, and the supplementary information is displayed on the display correctly aligned with the view of the scene.

The invention discloses a three-dimensional virtual human head image generation method, and a method and a device of human head image motion tracking, and belongs to the field of image processing. The three-dimensional virtual human head image generation method comprises collecting a human face picture, obtaining feature points on the human face picture, wherein the feature points are used for showing a left eyebrow, a right eyebrow, a left eye, a right eye, a nose, the edge contour of a human face and a forehead portion of the human face; obtaining a personalized three-dimensional human face model according to the obtained feature points and a preset standard human face model; and carrying out texture mapping to the personalized three-dimensional human face model, and generating a three-dimensional virtual human head image. Due to the facts that the feature points which are used for characterizing feature information of the human face on a single human face picture are obtained, and are applied in the three-dimensional human face model, and the personalized three-dimensional human face model which includes the forehead portion and is good in third dimension is generated, the three-dimensional virtual human head image generation method, and the method and the device of the human head image motion tracking have the advantages of being in no need of manual marking of the feature points, greatly reducing manual processing amount, being applicable to modeling occasions which require for simpleness and speediness, and being capable of enabling the third dimension of the generated three-dimensional human head image to be greatly improved and to be high in accuracy due to the fact that the feature points include feature points of the forehead portion of the human face.

The apparatus generates simulated strobe effects in the form of video or still image output in response to receipt of a video stream, and without the need of additional strobe hardware. Videos of a moving target object are categorized into one of multiple categories, from which a strobe generation process is selected. In one mode, the two categories comprise target objects with either small motion or large motions in relation to the frame size. Interoperation between image registration and cloning are utilized to produce simulated strobe motion videos or pictures. Motion segmentation is applied to the foreground object in each image frame, and a foreground mask is updated as each checkpoint is reached along the object trajectory, such as in response to time differences between checkpoints. Potential applications include special features for camcorders, digital cameras, or computer software.

The invention relates to a space borne TDICCD camera integral timing and adjusting method, which comprises the following steps: (1) the orbit is simulated with high precision in which positions parameters of photographed spots of the satellite under drift angle control or at different swinging angles are outputted such as vector coordinates and oblique distances of the photographed spots as well as vector simulation data for the satellite position; (2) the vector simulation data for the satellite position are analyzed to come out with the shift speeds of the photographed spots; (3) eliminate the radial-directional speeds from the shift speeds of the photographed spots to become the image motion speeds; (4) utilize the image motion speeds and the oblique distances of the photographed spots to obtain the integral times. The invention also provides a design method for TDICCD related parameters as well as a real-time adjusting method for integral times on the satellite under control of ground commands. The space borne TDICCD camera integral timing and adjusting method realizes an organic combination of simulation modeling with high precision and positional vector differential method, which eliminates errors introduced into the deduction process in traditional geometric analysis and calculation and controls error delivery to improve calculation precision; the arrival real-time adjusting method for integral times on the satellite ensures a reliable integral synchronous control.

A video coding or decoding method using inter-image prediction to encode input video data in which each chrominance component has 1 / Mth of the horizontal resolution of the luminance component and 1 / Nth of the vertical resolution of the luminance component, where M and N are integers equal to 1 or more, comprises: storing one or more images preceding a current image; interpolating a higher resolution version of prediction units of the stored images so that the luminance component of an interpolated prediction unit has a horizontal resolution P times that of the corresponding portion of the stored image and a vertical resolution Q times that of the corresponding portion of the stored image, where P and Q are integers greater than 1; detecting inter-image motion between a current image and the one or more interpolated stored images so as to generate motion vectors between a prediction unit of the current image and areas of the one or more preceding images; and generating a motion compensated prediction of the prediction unit of the current image with respect to an area of an interpolated stored image pointed to by a respective motion vector; in which the interpolating step comprises: applying a ×R horizontal and ×S vertical interpolation filter to the chrominance components of a stored image to generate an interpolated chrominance prediction unit, where R is equal to (U×M×P) and S is equal to (V×N×Q), U and V being integers equal to 1 or more; and subsampling the interpolated chrominance prediction unit, such that its horizontal resolution is divided by a factor of U and its vertical resolution is divided by a factor of V, thereby resulting in a block of MP×NQ samples.

A portable data processing apparatus is provided. It has at least one data processing function which depends on detected motion of the apparatus. The apparatus comprises a video camera operable to capture successive images of a part of the real environment around the apparatus; a video motion detector operable to detect motion of the apparatus by analysis of image motion between pairs of captured images; a hardware motion detector operable to detect motion of the apparatus, whereby the data processing function depends on motion detected by the hardware motion detector; and a controller operable to adjust the operation of the hardware motion detector if the motion detected by the video motion detector and the motion detected by the hardware motion detector differ by at least a threshold difference.

In a method for determining the frame rate and exposure time for each frame of a video collection, an image capture system acquires at least two successive frames of a scene, separated in time. The two images are compared to determine if objects in the scene are in motion. If motion is detected, then the speed and displacement of the objects that are moving is determined. If the speed of the fastest moving object creates an unacceptable amount of image displacement, then the frame rate for the next frame is changed to one that produces an acceptable amount of image displacement. Also, if the speed of the fastest moving object creates an unacceptable amount of motion blur, then the exposure time for the next frame is changed to one that produces an acceptable amount of motion blur.

The invention relates to a novel imaging method in agile satellite maneuvering, which is capable of realizing imaging of satellite during a posture adjustment process. The method comprises the following steps: according to geographic latitude and longitude of on-board orbit forecast data and imaging object point, a triaxial attitude angle directional target imaging start point of satellite is arranged; a roll angle and a pitch angle are obtained through a modeling algorithm for determining the satellite optical axis directional target imaging point; establishing a CCD image plane in a satellite model, performing calculation to obtain image motion velocity vector and a drift angle through projection calculating, and yaw angle of the satellite is controlled for correcting the drift angle, calculating the image motion velocity vector to obtain TDICCD integration time for image motion compensation, and satisfying the image processing requirement of imaging in maneuvering. The design method is capable of using in a triaxial attitude maneuvering process of the satellite for starting optical payload for a dynamic imaging technology for imaging, so that target directional requirement and image processing requirement during an imaging process can be realized.

A method for estimating egomotion of a camera mounted on a vehicle that uses infra-red images is disclosed, comprising the steps of (a) receiving a pair of frames from a plurality of frames from the camera, the first frame being assigned to a previous frame and an anchor frame and the second frame being assigned to a current frame; (b) extracting features from the previous frame and the current frame; (c) finding correspondances between extracted features from the previous frame and the current frame; and (d) estimating the relative pose of the camera by minimizing reprojection errors from the correspondences to the anchor frame. The method can further comprise the steps of (e) assigning the current frame as the anchor frame when a predetermined amount of image motion between the current frame and the anchor frame is observed; (f) assigning the current frame to the previous frame and assigning a new frame from the plurality of frames to the current frame; and (g) repeating steps (b)-(f) until there are no more frames from the plurality of frames to process. Step (c) is based on an estimation of the focus of expansion between the previous frame and the current frame.

The invention discloses a panorama image stabilization method based on the iteration of global characteristic points. The method of the invention includes two parts of the estimation of image motion parameters based on the iteration of characteristic points and the compensation of image motion based on the wave filtering. The estimation of global motion parameters includes that a Harries characteristic point which is the most stable in the image is combined with a characteristic window; local characteristic points are gradually deleted through the identification of the distance consistency and the updating of the iteration of characteristic points so that the global characteristic point set converges rapidly and the global motion parameters can be accurately obtained. The compensation of the motion image includes that the global motion parameters are filtered to acquire dither parameters, and actual dither parameters are compensated and the normal scanning motion of an image pickup system is retained; simultaneously, the image fusion is combined with the compensation to realize the output of a panorama image. The method of the invention can effectively process the dithers such as translation, rotation and zooming, etc., of the image pick-up system and more complex local motion of the scene, and can be used for removing the influence on the video sequence by a motion carrier so as to output a stable video and improve the observation effect of the video monitoring or tracking.

The invention discloses a non-uniform image motion blur removing method based on a deep neural network. The non-uniform image motion blur removing method comprises two main steps of training deep neural network parameters, and estimating and removing motion blur by applying a deep network to an image. The deep network structure consists of a convolution network layer and a forward network layer; the network model training process comprises the following steps: generating a blur image block and a blur kernel pair by using a natural image, and training the deep neural network model parameters by using the data; providing a motion blur image, decomposing the image into an image block set with overlapped areas, inputting each image block into motion blur probability distribution corresponding to deep neural network output image blocks, and further acquiring different motion blur kernels per pixel points of the image by optimizing a Markov random field model; finally, acquiring a blur removed image by using a deconvolution algorithm based on the estimated motion blur kernels. Due to good learning capability of the deep neural network, non-uniform motion blur of the image can be precisely estimated, and clear images can be further obtained.

The present invention provides an image motion compensation method for a space optical remote sensor, relating to an image motion compensation method and solving the problem that the current image motion velocity vector calculation method used in image motion compensation cannot satisfy complex imaging tasks and the calculation result is not accurate. The process of the image motion compensation method is as follows: creating five coordinate systems starting from ground targets to image points, transferring the coordinates for a plurality of times according to the rotation and translation principles among vectors, describing the positions of the targets and the image points in the camera coordinate systems, obtaining the image motion velocity vector calculation formula and the calculation method when the satellite forms images of the targets, then obtaining the image motion velocity vector used in the image motion compensation of the space optical remote sensor. The image motion compensation method overcomes the deficiency in the prior art, dependently calculates the target positions needed in the image motion velocity vector calculation and integrally considers the orbit and attitude parameters, besides. The image motion compensation method is suitable for complex imaging tasks and general satellite orbit, and is used in the fields such as atmospheric environment monitoring, resources exploration, disaster prevention and the like.

The present invention provides a method and a system for high performance image signal processing of continuous images in real time. The system comprising a focal plane array for generating continuous source image frames in real time. The focal plane array divided logically into blocks of sub-frames. The system also comprising an analog to digital converter (ADC) layer having an array of ADC elements for converting the source image frames into a digital data. The system further comprising a digital processor layer having an array of processing elements for processing the digital data and an interconnecting layer for connecting each one of the ADC elements and the digital processing elements substantially vertically to the focal plane and substantially parallel to one another. The processing comprising reducing image motion blur, increasing image dynamic range, increasing image depth of field and obtaining features of the images.

A document image capture (scanning) system and control method are described for scanning and processing document images received live from a camera. A motion detector detects image motion between two image frames. When the image is stationary, image processing (such as OCR) is carried out automatically and made available to the operator. In one form, when movement is detected, the image processing results are discarded until the image is newly stationary, whereupon new image processing is carried out on the new image. In another form, the degree of movement is evaluated; if the movement is small, then at least some of the previous image processing results are re-used by re-mapping on to the new image.

A method and system of performing real-time video superresolution. A decoder receives a data stream representing a low resolution video and including global motion vectors relating to image motion between frames of the low resolution video. The decoder uses the global motion vectors from the received data stream and multiframe processing algorithms to derive a high resolution video from the low resolution video. The sharpness of the high resolution video may be enhanced.

A video coding or decoding method using inter-image prediction to encode input video data in which each chrominance component has 1 / Mth of the horizontal resolution of the luminance component and 1 / Nth of the vertical resolution of the luminance component, where M and N are integers equal to 1 or more, comprises: storing one or more images preceding a current image; interpolating a higher resolution version of prediction units of the stored images so that the luminance component of an interpolated prediction unit has a horizontal resolution P times that of the corresponding portion of the stored image and a vertical resolution Q times that of the corresponding portion of the stored image, where P and Q are integers greater than 1; detecting inter-image motion between a current image and the one or more interpolated stored images so as to generate motion vectors between a prediction unit of the current image and areas of the one or more preceding images; and generating a motion compensated prediction of the prediction unit of the current image with respect to an area of an interpolated stored image pointed to by a respective motion vector; in which the interpolating step comprises: applying a xR horizontal and xS vertical interpolation filter to the chrominance components of a stored image to generate an interpolated chrominance prediction unit, where R is equal to (U×M×P) and S is equal to (V×N×Q), U and V being integers equal to 1 or more; and subsampling the interpolated chrominance prediction unit, such that its horizontal resolution is divided by a factor of U and its vertical resolution is divided by a factor of V, thereby resulting in a block of MP×NQ samples.

A method for removing undesired motion from a sequential plurality of related images utilizes adaptive filtering of image motion to determine image shifts. Differences between sequential image motions are taken with respect to a reference frame and a smoothing filter is applied to such differences of a sample of images adjacent a test image. Image shift values are calculated by subtracting the difference associated with a test frame from a filtered sample that includes the test frame. The image shift values are compared to an image shift parameter and sample sizes adjusted and image shift values calculated in accordance with the adjusted sample sizes so that image stability is obtained without boundary flicker.

A system is described for generating a rectified mosaic image from a plurality of individual images, the system comprising a quadrangular region defining module, a warping module and a mosaicing module. The quadrangular region defining module is configured to define in one individual image a quadrangular region in relation to two points on a vertical anchor in the one individual image and mappings of two points on a vertical anchor in at least one other individual image into the one individual image. The warping module is configured to warp the quadrangular region to a rectangular region. The mosaicing module configured to mosaic the quadrangular region to the mosaic image. The system further generates a mosaic from a plurality of panoramic images, the system comprising a motion determining module, a normalizing module, a strip selection module, and a mosaicing module. The motion determining module is configured to determine image motion between two panoramic images. The normalizing module is configured to normalize respective columns in the panoramic images in relation to the ratio of the image motion thereof to the image motion of a selected column, thereby to generate normalized panoramic images. The strip selection module is configured to select strips of the normalized panoramic images. The mosaicing module is configured to mosaic the selected strips together.

The invention discloses an image motion compensation method for aviation full-frame transferring area CCD camera, accomplishing image motion compensation in aviation photography by combining mechanical shutter and electric shutter and the pure-electricity image motion compensation method of changing CCD line frequency driving according to aircraft speed-altitude ratio. Compared with common mechanical compensation technology, studying cost and complicated degree of area aviation camera are decreased greatly. In image motion compensation, flight altitude, exposure jitter and staring model so on are considered fully to strengthen compensation effect. Because compensation circuit adopts multi-phase driving method electric compensation accuracy can achieve sub-pixel level and improve image definition furthermore.

A system, method, and computer program product for selecting qualifying frames from an image sequence for use in subsequent stitching into a composite panoramic image are disclosed. Incoming frames from any source may be cropped and downscaled prior to evaluation against qualifying criteria relating to image overlap and local motion. Qualifying images are saved and / or output. The resulting panoramic image generally uses fewer qualifying images and appears smoother and has fewer artifacts than those of the prior art. The qualifying criterion for image overlap is a predetermined overlap margin or percentage between a current image and a previous image from the sequence. The qualifying criterion for image motion includes a maximum amount of local motion, often due to passing objects. The embodiments may process incoming images in real time or from stored sequences. Problems may trigger user warnings.

The invention discloses a low SNR(Signal to Noise Ratio) motion small target tracking and identification method. The method comprising the following steps: providing a method of extracting a target from a single frame image of a video sequence, and influences of backgrounds and noises can be reduced or eliminated; providing weak target motion information extracting and state predicting modeling; establishing an incidence matrix of the image motion small target between two frames; based on information fusion of overlapped multi-frame images, providing a large-scale image and video image motion small target tracking algorithm and an identification method by using fuzzy push-down automation chain slot stack recursion calculation. The low SNR(Signal to Noise Ratio) motion small target tracking and identification method is advantageous in that the target identification and image processing personnel can be aware of the target motion law, the active level, and the influence on other targets conveniently, and then can give the corresponding decisions, and therefore the searching, the inhibiting, and the eliminating of the influences of the bad factors on other important targets can be very necessary, and in addition, the important experiences and the important references can be provided for the target identification and tracking in the military field, the civil field, the public security system, and the road traffic field based on the video system.

A method for estimating image-to-image motion of a pixel block in a stream of images which includes a current image which includes the pixel block and a reference image, the method including performing a hierarchical search in a search area of the reference image, including producing a decimated reference image and a decimated pixel block, searching for a location in the search area of the decimated reference image which best fits the decimated pixel block, repeating the producing and the searching for more than one level of hierarchy, determining a first candidate location in the reference image which corresponds to the best fitting location, determining a second candidate location in the reference image by a method other than the hierarchical search, performing a search in the reference image for refined locations of the first and the second candidate locations, selecting one final location from the refined candidate locations, and using the final location for estimating the motion. Related apparatus and methods are also described.

A method of operating a mobile device with a camera, a display and a position sensor to provide a display of supplementary information aligned with a view of a scene. One or more image obtained from the camera is uploaded to a remote server together with corresponding data from the position sensor. Image processing is then performed to track image motion between that image and subsequent images obtained from the camera, determining a mapping between the uploaded image and a current image. Data is then received via the network indicative of a pixel location for display of supplementary information within the reference image. The mapping is used to determine a corresponding pixel location for display of the supplementary information within the current image, and the supplementary information is displayed on the display correctly aligned with the view of the scene.

An electro-optical roll-framing camera is described in which successive overlapping frames of scene imagery are generated by an electro-optical imaging array. Image motion compensation is performed electronically to stop or freeze image motion caused by the roll motion. The image motion compensation is performed by the array during the generation of the frames of imagery. The successive frames of imagery are made during a continuous roll motion of the entire camera (including the array). The image motion due to roll is stopped or frozen without mechanically stopping the roll motion, such as found in prior art step frame cameras. The roll framing cycles of the camera generate sweeping coverage of the terrain of interest. The roll rate for a given electro-optical array is a function of the frame size and the framing rate, and is controllable by a master camera control computer.

Systems, including apparatus and methods, for obtaining and / or correcting images, particularly from atmospheric and / or other distortions. These corrections may involve, among others, collecting two or more sets of image data corresponding to images of the same scene in different wavelength regimes, and using correlations between wavelength and expected distortion to distinguish apparent image motion due to distortion from apparent image motion due to object or scene motion. These systems may be useful in any suitable imaging context, including navigation, targeting, search and rescue, law enforcement, commercial video cameras and / or surveillance, among others.

Provided is sub-block motion estimation that includes a full search with a reduced search area around a motion vector predictor. Also provided are a single (or unified) motion vector predictor and a function similar to a rate-distortion cost function. Also provided is a scanning order that can reduce or substantially eliminated redundant data loading and / or that can achieve different data re-use ratio. Further, provided herein is a reconfigurable multi-resolution motion vector re-use hardware architecture based on a single motion vector predictor and a function similar to a rate-distortion cost function. Further, through utilization of the disclosed aspects, only a small number of past motion vectors are propagated and the disclosed aspects can be reconfigured for video with different spatial resolution.