2351 results about "Inter frame" patented technology

A process and device for detecting colon cancer by classifying and annotating clinical features in video data containing colonoscopic features by applying a probabilistic analysis to intra-frame and inter-frame relationships between colonoscopic features in spatially and temporally neighboring portions of video frames, and classifying and annotating as clinical features any of the colonoscopic features that satisfy the probabilistic analysis as clinical features. Preferably the probabilistic analysis is Hidden Markove Model analysis, and the process is carried out by a computer trained using semi supervised learning from labeled and unlabeled examples of clinical features in video containing colonoscopic features.

Video coding and decoding methods and video encoder and decoder are provided. The video encoding method includes determining one of inter predictive coding and intra predictive coding mode as a coding mode for each block in an input video frame, generating a predicted frame for the input video frame based on predicted blocks obtained according to the determined coding mode, and encoding the input video frame based on the predicted frame. When the intra predictive coding mode is determined as the coding mode, an intra basis block composed of representative values of a block is generated for a block and the intra basis block is interpolated to generate an intra predicted block for the block.

Provided is an apparatus and method for encoding and decoding using alternative transform units according to the correlation of residual signals. The video encoding apparatus includes a first transforming unit for performing discrete cosine transform (DCT), first quantization, first inverse quantization, and inverse DCT on a block basis onto residual coefficients generated after intra frame prediction or inter frame prediction; a second transforming unit for performing discrete sine transform (DST), second quantization, second inverse quantization, and inverse DST on a block basis onto the residual coefficients; a selecting unit for selecting one having a high compression rate between the first and second transforming units for each block through performing rate-distortion optimization; and a flag marking unit for recording information about the selected transforming unit at a flag bit provided on a macroblock basis.

A video coding algorithm supports both lossy and lossless coding of video while maintaining high color fidelity and coding efficiency using an in-loop, reversible color transform. Accordingly, a method is provided to encode video data and decode the generated bitstream. The method includes generating a prediction-error signal by performing intra / inter-frame prediction on a plurality of video frames; generating a color-transformed, prediction-error signal by performing a reversible color-space transform on the prediction-error signal; and forming a bitstream based on the color-transformed prediction-error signal. The method may further include generating a color-space transformed error residual based on a bitstream; generating an error residual by performing a reversible color-space transform on the color-space transformed error residual; and generating a video frame based on the error residual.

Video images of objects in a real-world environment are taken from the perspective of a viewer. The user's field of view may be captured in the video images that are processed to select a segment of the video image or an object depicted in the video image. An image such as a computer-generated annotation or graphic overlay way be registered to the segment, and therefore track the segment from the user's field of view of the segment, without prior knowledge of the spatial relationship of the segment to the real-world environment according to a centroid for an interframe difference of the video image associated with the selected object. The image may be displayed in the user's field of view or in the video image. The computer-generated image tracks the movement of the segment with respect to the video image.

The invention discloses a real-time panoramic image stitching method of aerial videos shot by an unmanned plane. The method comprises the steps of: utilizing a video acquisition card to acquire images which are transmitted to a base station in real time by an unmanned plane through microwave channels, carrying out key frame selection on an image sequence, and carrying out image enhancement on key frames; in the image splicing process, firstly carrying out characteristic detection and interframe matching on image frames by adopting an SURF (speeded up robust features) detection method with good robustness; then reducing the series-multiplication accumulative errors of images in a frame-to-mosaic image transformation mode, determining images which are not adjacent in time sequence but adjacent in space on a flight path according to the GPS (global positioning system) position information of the unmanned plane, optimizing the frame-to-mosaic transformation relation, determining image overlapping areas, thereby realizing image fusion and the panoramic image construction and realizing real-time effect of carrying out flying and stitching simultaneously; and in image transformation, based on adjacent frame information in a vision field and adjacent frame information in airspace, optimizing image transformation to obtain the accurate panoramic images. The stitching method has good real-time performance, is fast and accurate and meets the requirements of application occasions in multiple fields.

An object of the present invention is to allow portions which are subjected to a coding in inter-frame prediction mode and portions which are subjected to coding in intra-frame prediction mode to be mixed in one macro block without changing the framework of macro blocks. The present invention provides an encoder which encodes each of first image blocks of a video. The encoder includes prediction mode selection information generating means for generating prediction mode selection information which indicates that a first prediction mode for reducing temporal redundancy is applied to each of second image blocks or that a second prediction mode for reducing spatial redundancy is applied to each of the second image blocks. The second image blocks are obtained by dividing the first image blocks. The encoder includes predictive residual signal generating means for generating a predictive residual signal by applying the selected first or second prediction mode to each of the second image blocks. The encoder includes transmitting means for transmitting the prediction mode selection information in association with the predictive residual signal.

An imaging device having nonconventional and a completely new imaging method and an image generation method of the imaging device, wherein the imaging device has an image processing section generating a first compressed image compressed high image data with intra-frame compression in capturing single moving image data and a second compressed image compressed low image data with inter-frame compression in a front period and / or in a rear period of a period generating the first compressed image as one stream, where the imaging device generates still image data having high-resolution indicating one screen designated by decompression and decoding by the second compressed image and the other compressed image including the first compressed image when one screen of a second compressed image is designated.

A method of inter prediction encoding of an image, the method including: searching for a first reference block in a reference picture by using a current block, and estimating a first motion vector in a first pel unit in regards to the first reference block; estimating a second motion vector by using pixels included in a pre-encoded area adjacent to the current block, and pixels adjacent to the first reference block, and determining a second reference block based on the second motion vector; and encoding the current block based on the first motion vector and the second reference block.

A coding control unit (110) and a mode selection unit (109) are included. The coding control unit (110) determines the coding order for a plurality of consecutive B-pictures located between I-pictures and P-pictures so that the B-picture whose temporal distance from two previously coded pictures is farthest in display order is coded by priority, so as to reorder the B-pictures in coding order. When a current block is coded in direct mode, the mode selection unit 109 scales a forward motion vector of a block which is included in a backward reference picture of a current picture and co-located with the current block, so as to generate motion vectors of the current block, if the forward motion vector has been used for coding the co-located block.

The invention relates to a self-adaptive background modeling and moving target detecting method which comprises the following steps: establishing an initial background, extracting a moving target binary mask, updating a self-adaptive background and detecting a moving target: firstly, determining the pixel gray value of the initial background by using an inter-frame difference method; successively, carrying out binarization treatment on a difference image by using a self-adaptive threshold valve when a difference image is obtained by a current frame image minus a background image and post-treating of morphological filtering and the like to obtain the moving target binary mask; then, carrying out dynamic update on the gray value of a pixel which is not corresponding to the moving target binary mask in the background image by adopting an region-based background updating method; and finally, carrying out logic 'and' operation by using the moving target binary mask and the current frame input image to detect the moving target. The invention can effectively establish the reliable initial background and carry out real-time dynamic update on the background to solve the problem that the detection accuracy of the moving target is influenced by background disturbance and illumination change.

The invention discloses a remote obstacle detection method based on laser radar multi-frame point cloud fusion. A local coordinate system and a world coordinate system are established, an extraction feature point of each laser point is calculated on an annular scanning line of the laser radar according to the original point cloud data under the local coordinate system, and the global pose of the current position relative to the initial position and the de-distortion point cloud in the world coordinate system are obtained through inter-frame feature point matching and map feature point matching; the de-distortion point clouds of the current frame and the previous frame are fused to obtain more compact de-distortion point cloud data, which is unified to the local coordinate system, then projection is performed on two-dimensional grids, and an obstacle is screened according to the height change features of each two-dimensional grid. According to the method in the invention, the problem that the detection rate of the remote barrier caused by sparse laser point clouds is low is solved, the remote barriers can be effectively detected, the error detection rate and the leak detection rateare low, and the system cost can be greatly reduced.

The quality of digital images recovered from compressed data in an inter-frame redundancy-removing scheme is enhanced using a self-adaptive feedback scheme in an image compression / decompression system so as to provide for the compensation of the distortion component from prior frame compression in subsequent difference frame compression. Each transmitted frame is stored after a full compress / decompress cycle, and difference data (which includes the inverse of the distortion component from compression of the transmitted frame) representing the difference between the stored frame and the incoming new frame is transmitted. Consequently, the quality of static regions in the recovered images may be improved with each subsequent iteration by taking the distortion component in the prior frame into consideration along with the inter-frame motion information. The feedback loop thus forms a self-adaptive iterative cycle.

A coding control unit (110) and a mode selection unit (109) are included. The coding control unit (110) determines the coding order for a plurality of consecutive B-pictures located between I-pictures and P-pictures so that the B-picture whose temporal distance from two previously coded pictures is farthest in display order is coded by priority, so as to reorder the B-pictures in coding order. When a current block is coded in direct mode, the mode selection unit 109 scales a forward motion vector of a block which is included in a backward reference picture of a current picture and co-located with the current block, so as to generate motion vectors of the current block, if the forward motion vector has been used for coding the co-located block.

The present invention provides a technique for performing one or more aspects of video coding such as quantization, intra prediction coding or inter prediction coding in dependence on a perceptual model taking into account human sensitivity to data in the video signal. The perceptual model may relate to spatial frequency, temporal frequency, contrast sensitivity, colour sensitivity, a structural metric, and / or one or more parameters affecting perception such as motion in the video, the distance of a recipient user from the screen, and the size, aspect ratio or resolution of the screen of the recipient terminal.

A coding apparatus which codes moving image signals into block units, is configured from a signal processing element which performs motion compensation for moving image signals for over a plural number of frames or fields and codes inter-image signals, and a transfer element which recombines coded information for each block coded by said processing element, into macroblock units which are a plural number of block units of each type of coded information, and transfers them. In addition, a decoding apparatus for moving image signals which have been coded in block units is configured from a detector element which detects transfer code errors for each type of coded information, and a processing element which performs motion compensation and inter-image processing of the coded information using only correct frames which do not include transfer code errors, and without using frames which have transfer code errors, by changing a method of inter-frame processing for motion compensation in accordance with the transfer coding errors in the coded information which has been detected for each type.

The present invention relates to an architecture for stack robust fine granularity scalability (SRFGS), more particularly, SRFGS providing simultaneously temporal scalability and SNR scalability. SRFGS first simplifies the RFGS temporal prediction architecture and then generalizes the prediction concept as the following: the quantization error of the previous layer can be inter-predicted by the reconstructed image in the previous time instance of the same layer. With this concept, the RFGS architecture can be extended to multiple layers that forming a stack to improve the temporal prediction efficiency. SRFGS can be optimized at several operating points to fit the requirements of various applications while the fine granularity and error robustness of RFGS are still remained. The experiment results show that SRFGS can improve the performance of RFGS by 0.4 to 3.0 dB in PSNR.

A coding control unit (110) and a mode selection unit (109) are included. The coding control unit (110) determines the coding order for a plurality of consecutive B-pictures located between I-pictures and P-pictures so that the B-picture whose temporal distance from two previously coded pictures is farthest in display order is coded by priority, so as to reorder the B-pictures in coding order. When a current block is coded in direct mode, the mode selection unit 109 scales a forward motion vector of a block which is included in a backward reference picture of a current picture and co-located with the current block, so as to generate motion vectors of the current block, if the forward motion vector has been used for coding the co-located block.

A coding control unit (110) and a mode selection unit (109) are included. The coding control unit (110) determines the coding order for a plurality of consecutive B-pictures located between I-pictures and P-pictures so that the B-picture whose temporal distance from two previously coded pictures is farthest in display order is coded by priority, so as to reorder the B-pictures in coding order. When a current block is coded in direct mode, the mode selection unit 109 scales a forward motion vector of a block which is included in a backward reference picture of a current picture and co-located with the current block, so as to generate motion vectors of the current block, if the forward motion vector has been used for coding the co-located block.

A video encoder and corresponding methods are provided for selecting the mode of a current macroblock of an inter-coded frame, including one or more of checking first modes for a subset of macroblock modes, selectively checking other modes in response to motion vector information of the checked first modes, and selecting the mode for the current macroblock in response to the checked modes; checking the macroblock mode of at least one neighboring macroblock, and selecting the mode for the current macroblock in response to the macroblock mode of the at least one checked neighboring macroblock; checking the cost of a subset of macroblock modes, further checking only intra-coded modes if the checked cost meets a preset criteria, and selecting the mode for the current macroblock in response to the checked modes; and adjusting an early-stopping threshold in response to checked macroblock modes, and selecting the mode for the current macroblock in response to the checked macroblock modes if the adjusted early-stopping threshold is met.

A system and method for endoscopic measurement and mapping of internal organs, tumors and other objects. The system includes an endoscope with a plurality of light sources and at least one camera; a processor; a memory; and a program stored in the memory. The program, when executed by the processor, carries out steps including projecting light beams from the plurality of light sources so light points associated with the light beams appear on an object; and generating at least one image frame of the object based on the light points. The program, when executed by the processor, can further carry out steps including converging positions of the light points and determining a measurement of the object. The determining step can further include using a “shape from motion” process, a “shape from shading” process, and an inter-frame correspondence process, and can be performed by a third party for a transactional accommodation.

There are provided methods and apparatus for determining expected distortion in decoded video blocks. An apparatus includes a distortion calculator for calculating an expected distortion for an image block, included in a picture of a video sequence and sent over a lossy channel, using a motion vector for the image block when the motion vector has a non-integer value. The distortion calculator calculates the expected distortion based upon a propagated distortion of at least two neighboring integer pixel positions in a reference picture with respect to the motion vector having the non-integer value. The image block is coded in an inter mode or a SKIP mode.

The invention discloses a self-adaption dividing method for code units in high-efficiency video coding, which mainly solves the problems that a largest code unit and a smallest code unit in the division of the code units in the prior art can not be regulated according to the characteristics of video content, and the dividing mode quantity of blocks on the boundary of a video frame is few. The method comprises the steps of: firstly, adopting the rate distortion rule or the relativity among video frames to self-adaptively determine the largest code unit and the smallest code unit in each video frame; secondly, expanding a rectangular block within the video frame in the largest code unit on the boundary of a video frame into a square block, and dividing the square block; then, marking the rectangular blocks after dividing, and carrying out frame prediction to the rectangular blocks after dividing; and finally, transforming, quantizing and entropy coding to prediction residuals. The invention has the advantage of high video compression efficiency, and can be applied to high-performance video coding standards.

A unified frame structure for filter bank multi-carrier (FBMC) and orthogonal frequency division multiplexed (OFDM) waveforms may allow FBMC and OFDM frames to be communicated over a common channel without significant inter-frame gaps. The unified frame structure may set an FBMC frame duration to an integer multiple of an OFDM frame element duration to enable alignment of FBMC frames and OFDM frames in the time domain. The unified frame structure may also map control channels in the FBMC and OFDM frames to common resource locations so that the respective control channels are aligned in the time and / or frequency domains. The unified frame structure may also share synchronization channels between FBMC and OFDM frames. Additionally, overhead in an FBMC time division duplexed (TDD) communications channel can be reduced by overlapping time windows appended to FBMC blocks.

Disclosed is an encoding / decoding method and apparatus related to adaptive deblocking filtering. There is provided an image decoding method performing adaptive filtering in inter-prediction, the method including: reconstructing, from a bitstream, an image signal including a reference block on which block matching is performed in inter-prediction of a current block to be encoded; obtaining, from the bitstream, a flag indicating whether the reference block exists within a current picture where the current block is positioned; reconstructing the current block by using the reference block; adaptively applying an in-loop filter for the reconstructed current block based on the obtained flag; and storing the current block to which the in-loop filter is or is not applied in a decoded picture buffer (DPB).

The temporal and / or spatial characteristics of a macroblock are analyzed in order to reduce the number of modes for which motion estimation and rate distortion efficiency calculations are to be performed. In one embodiment, macroblock mean and variance characteristics are analyzed to merge sub-blocks together within the macroblock. These merged sub-blocks may be used to identify both inter and intra modes for the macroblock.

A multimedia compression system for generating frame rate scaleable data in the case of universally scaleable data. Universally scaleable data is scaleable across all of the relevant characteristics of the data (e.g., frame rate, resolution, and quality for video). The scaleable data generated by the compression system includes multiple additive layers for each characteristic across which the data is scaleable. For video, the frame rate layers are additive temporal layers, the resolution layers are additive base and enhancement layers, and the quality layers are additive index planes of embedded codes. Various techniques can be used for generating these layers (e.g., Laplacian pyramid decomposition or wavelet decomposition for generating the resolution layers; tree structured vector quantization or tree structured scalar quantization for generating the quality layers). The system further provides for embedded inter-frame compression in the context of frame rate scalability, and non-redundant layered multicast network delivery of the scaleable data.

An audio / video production system facilitates professional quality image manipulation and editing using an enhanced general-purpose hardware. A program input may be translated into any of a variety of graphics or television formats, including NTSC, PAL, SECAM and HDTV, and stored as data-compressed images, using any of several commercially available methods such as Motion JPEG, MPEG, etc. While being processed, the images may be re-sized to produce a desired aspect ratio or dimensions using conventional techniques such as pixel interpolation. Frame rate conversion to and from conventional formats is performed by using the techniques employed for film-to-NTSC and film-to-PAL transfers, or by inter-frame interpolation, all well known in the art. By judicious selection of the optimal digitizing parameters, the system allows a user to establish an interrelated family of aspect ratios, resolutions, and frame rates, yet remain compatible with currently available and planned graphics and television formats.

The present disclosure relates to a method and apparatus for improving the encoding efficiency by adaptively changing the resolution of the motion vector in the inter prediction encoding and inter prediction decoding of a video. The video encoding / decoding apparatus includes: a video encoder for determining a motion vector resolution of each area or motion vector of a video and performing an inter prediction encoding of the video by using a motion vector according to the motion vector resolution determined for each area or motion vector; and a video decoder for reconstructing a resolution by extracting resolution information from a bitstream, and then performing an inter prediction decoding by using a motion vector according to the motion vector resolution of each reconstructed area or motion vector.