3377 results about "Image synthesis" patented technology

An improved method of taking pictures to capture a precise picture composition is provided. The invention is implemented in a digital camera as an operation mode or feature. When this mode is activated, the camera captures a series of images including a precise picture composition desired by the user. From the series of images describing a chronological sequence of events, the user can select a best-timed shot.

An image pickup device is constituted by a handset of cellular phone, wherein an image pickup unit photographs a user as first object, to output image data of a first image frame. A facial region detecting circuit retrieves a facial image portion of the user as first object according to image data of the first image frame. An image synthesizing circuit is supplied with image data of a second image frame including persons as second object. The facial image portion is synthesized in a background region being defined outside the persons as second object within the second image frame.

A still image generation apparatus of the invention includes an image acquisition module that obtains multiple first image data arrayed in a time series among multiple lower-resolution image data, an image storage module that stores the multiple first image data obtained by the image acquisition module, and a correction rate estimation module that estimates correction rates for eliminating positional shifts between images of the respective first image data, based on the multiple first image data stored in the image storage module. The still image generation apparatus further includes an image composition module that corrects the multiple first image data with the estimated correction rates to eliminate the positional shifts between the images of the respective first image data, and combines the multiple corrected first image data to generate higher-resolution second image data as resulting still image data. This arrangement of the invention desirably shortens the total processing time in the process of combining multiple image data.

Methods, apparatus, and computer-readable storage media for video completion that may be applied to restore missing content, for example holes or border regions, in video sequences. A video completion technique applies a subspace constraint technique that finds and tracks feature points in the video, which are used to form a model of the camera motion and to predict locations of background scene points in frames where the background is occluded. Another frame where those points were visible is found, and that frame is warped using the predicted points. A content-preserving warp technique may be used. Image consistency constraints may be applied to modify the warp so that it fills the hole seamlessly. A compositing technique is applied to composite the warped image into the hole. This process may be repeated until the missing content is filled on all frames.

To provide an image processing technique for easy initial settings when a video image feature is used as an input interface. This is an image processor having an image combining section 106 for combining a mirrored video image feature that includes an image of an operator as a portion thereof and an object image of an object that is associated with a predetermined event, to generate a combined image, and being adapted to provide production of the combined image on a display device. This image processor has a detection section 109 for detecting the position of an image of an operator included in the mirrored video image feature. The image combining section 106 is adapted to combine the object image and the mirrored video image feature in such a manner that the object image is displayed in a range that an image of a hand of the operator can reach, depending on the position of the image of the operator detected by the detection section 109.

Some embodiments of the invention provide a mobile device that captures and produces images with high dynamic ranges. To capture and produce a high dynamic range image, the mobile device of some embodiments includes novel image capture and processing modules. In some embodiments, the mobile device produces a high dynamic range (HDR) image by (1) having its image capture module rapidly capture a succession of images at different image exposure durations, and (2) having its image processing module composite these images to produce the HDR image.

The present invention discloses an interactive presentation system which allows a presenter to perform a presentation while having various interactions directly with presentation material images in real time through a gesture or / and voice. The interactive presentation system comprises: an active infrared camera; a command recognition system connected to the active infrared camera; and an image synthesis system connected to the active infrared camera and the command recognition system. The presentation system may further comprises a stereo camera set for properly synthesizing a presenter in a 3D image and a 3D motion system. By this configuration, it is possible to embody an interactive presentation system in which a command through a presenter's gesture or voice is processed in real time and the image of the presenter is synthesized in a presentation material screen in real time, and accordingly the audiovisual effect is maximized.

An image management method which creates and records two or more real images and two or more thumbnail images from two or more images by viewpoints photographed by two or more image pickup devices corresponding to the viewpoints, wherein the real images include a stereoscopic image including the images by viewpoints, a common image range cut from the images by viewpoints and a whole image synthesized from the images by viewpoints, and the thumbnail images include two or more thumbnail images y each viewpoint corresponding to each of images by viewpoints, a 3D thumbnail image corresponding to the stereoscopic image, and a whole thumbnail image corresponding to the whole image.

An added information encoding part repeatedly arranges two kinds of copy inhibition code arrays of the unit two-dimensional arrays to which copy inhibition codes are assigned, and condition code arrays of the unit two-dimensional arrays to which codes for removing the copy inhibition are assigned, into a two-dimensional array according to given rules. A background image formation part generates a background image in which copy inhibition pattern image areas and condition pattern image areas are repeatedly and two-dimensionally arranged according to given rules, while referring to this array, and the pattern images corresponding to respective codes stored in the background image formation part, and stores the generated background image into a background image buffer. An image composing part reads out document images from a document image buffer, and the background image from the background image buffer, and superimposes them into a composite image.

Provided are a method and apparatus for taking images using a mobile communication terminal with a plurality of camera lenses, that can visually emphasize the shape of an object by photographing a specific object and its surrounding background using a zoom lens and a wide-angle lens, respectively, and combining the photographed images. The method includes setting the mobile communication terminal to an image-taking mode, entering into an image-combining mode, operating the plurality of camera lenses, setting an object, taking images using the plurality of camera lenses, and combining together the images obtained using the plurality of lenses. The method and apparatus enables visual emphasis of a specific object in an entire image by photographing the specific object with a zoom lens and a background containing the object with a wide-angle lens, and then combining the photographed images so as to display the specific object at a higher magnification ratio than that of the background.

An image processing apparatus includes: a shaking estimating unit configured to estimate the shaking information of an image generated within a predetermined period of time; a short-time-exposure shaking correcting unit configured to correct the shaking of a plurality of short-time-exposure images generated due to intermittent exposure within the predetermined period of time based on the estimated shaking information; a long-time-exposure shaking correcting unit configured to correct the shaking of a long-time-exposure image generated due to consecutive exposure within the predetermined period of time based on the estimated shaking information; and an image synthesizing unit configured to synthesize the corrected short-time-exposure images and the corrected long-time-exposure image.

Systems and methods for providing convolutional neural network based image synthesis using localized loss functions is disclosed. A first image including desired content and a second image including a desired style are received. The images are analyzed to determine a local loss function. The first and second images are merged using the local loss function to generate an image that includes the desired content presented in the desired style. Similar processes can also be utilized to generate image hybrids and to perform on-model texture synthesis. In a number of embodiments, Condensed Feature Extraction Networks are also generated using a convolutional neural network previously trained to perform image classification, where the Condensed Feature Extraction Networks approximates intermediate neural activations of the convolutional neural network utilized during training.

An image processing apparatus includes: an imaging information calculation unit acquiring a first image and higher-resolution second images, and calculating coordinate positions of the second images to the first image and differences in imaging direction between second cameras and a first camera; an eyepoint conversion unit generating eyepoint conversion images obtained by converting the second images based on the differences in imaging direction so that eyepoints of the second cameras coincide with an eyepoint of the first camera and matching the first image with the eyepoint conversion images to calculate phase deviations of the eyepoint conversion images from the first image; and an image synthesizing unit extracting high-frequency images, having frequency components higher than or equal to a predetermined frequency band, from the second images, and pasting the high-frequency images at the coordinate positions in correspondence with the first image to eliminate the phase deviations to generate a synthesized image.

In exhibition of a synthesized image which is obtained by synthesizing a virtual world image with a real world image observed from a viewpoint position and direction of a user, data representing a position and orientation of a user is acquired, a virtual image is generated based on the data representing the position and orientation of the user, and the virtual image is synthesized with a real image corresponding to the position and orientation of the user. Based on a measurable area of the position and orientation of the user, area data is set. Based on the data representing the position of the user and the area data, notification related to the measurable area is controlled.

The present invention allows the positional relationship among a plurality of image layers constituting a composed image to be precisely recognized. More specifically, the present invention is directed to an image composition processing apparatus which generates a composed image which is a superposition of a plurality of image layers and displays it within a window of the screen. When the user designates one of the image layers and moves the pointer into the displayed composed image, the image composition processing apparatus converts only a predetermined area of the image layers above the designated image layer, for example, the area which is superposed in the range of a radius of m picture elements centering the coordinate of the pointer in the composed image, to a translucent state. When the image composition processing apparatus superposes the image layers a part of which is made translucent, a composed image which indicates to the user what position do the image layers above the designated image layer take with respect to those below the designated image layer in the periphery of the pointer is obtained.

The present invention provides a three-dimensional digital entity magnifying glass technique-assisting and training / educational distribution system incorporating three-dimensional visual training functions by means of image composition that enables a three-dimensional visual instruction containing a depth when giving visual instructions to an HMD worn by a medical practitioner to thereby display only images of a pointing device or various kinds of instruments among image information of the instructor's CCD camera and synchronously and compositely displaying a three-dimensional visual training image output from an image-processing apparatus that can display an after-image of the image for an arbitrary time setting into image information of the CCD camera, thereby providing equal-scaling display of image information to which an instruction and a comment by use of a visual display / instruction image are added three-dimensionally as well as an instrument actually used by the instructors (groups of lecturers) on the three-dimensional HMD of the medical practitioner.

A vehicle periphery viewing apparatus for capturing a vehicle-peripheral image includes: an image capturing device disposed on predetermined position; a display device disposed within the vehicle; and an image processing device performing an image division of the original image into a first image and a second image. The image capturing device captures an original image from the predetermined position. The display device displays the captured vehicle-peripheral image. The image processing device performs a coordinate conversion into a plan view coordinate by using a geometrical correction for the first image. The image processing device performs a predetermined image synthesis for the first image and the second image. The image processing device displays a synthesized image on the display device.

The invention relates to a novel three-dimensional image shooting module which can achieve synchronous focusing control over portable electronic product dual lens or multiple lens and three-dimensional image shooting. The module comprises a plurality of camera modules fixed on a voice coil motor, the voice coil motor which can bear the camera modules at the same time, an image sensor which is used for collecting shot image information, a control circuit and back end processing software which can carry out grey level weighting and three-dimensional image synthesis. The camera modules have the same parameters and are borne on the same voice coil motor, synchronous focusing can be carried out, the number of the image sensor can be one or more, the back end processing software carries out weighting according to a preset factor through the grey levels of two images during a focusing process, and feedback fine focusing is carried out after a comprehensive grey level is obtained. The shooting module can be used on a micromation portable electronic product conveniently for three-dimensional image shooting, and quality and shooting effect can be improved.

A vehicle surrounding monitoring device include at least one camera 2 installed in an own vehicle to image a video around the own vehicle, an obstacle sensor 3 for detecting an obstacle within an imaging range of the camera 2, a pixel synthesis unit 13 for receiving a camera image imaged by the camera 2 and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and a display device 4 for displaying the view point conversion image converted by the pixel synthesis unit 13. Simultaneously when a warning is given by a warning sound upon entry of an obstacle within an obstacle detection range of the obstacle sensor 3, an image of the obstacle detection range is synthesized with an obstacle image imaged by the camera 2 and included in the view point converted image to be in contact therewith.

An image generation device that enhances visual recognizability between a recognized 3D (three-dimensional) object and a substitute image synthesized in an area of a 3D object image which is a photographed image of the 3D object includes an image synthesis section that recognizes a 3D object present in the peripheral area of a vehicle and outputs 3D object attribute information indicative of attributes of this 3D object, determines a 3D object image area as an image area of the 3D object in the photographed image based on position information included in the 3D object attribute information, outputs at least one of a substitute image of the 3D object applied with a color based on the color information and a substitute image of the 3D object under a specified directional posture of the 3D object specified based on type information and directional posture information and generates a bird's-eye view image with a substitution image in which the substitution image outputted from a substitution image output section is synthesized at the position of the 3D object image area.

The synthesized image generation method for generating synthesized image data by extracting face images of characters contained in image data and synthesizing the extracted face images with a template into a plurality of synthesis positions which have been set in advance on the template, the method comprising the steps of: forming groups of the synthesis positions by combining the adjacent synthesis positions; determining an order of the groups according to number of synthesis positions belonging to each of the groups; detecting the face images of the characters contained in the image data; detecting a relationship between the detected face images; distributing the face images to the groups in the determined order according to the relationship between the face images; and generating the synthesized image data by synthesizing the distributed face images with the template into the synthesis positions of the groups.

An image composition unit outputs a composition image of a physical space and virtual space to a display unit. The image composition unit calculates, as difference information, a half of the difference between an imaging time of the physical space and a generation completion predicted time of the virtual space. The difference information and acquired position and orientation information are transmitted to an image processing apparatus. A line-of-sight position prediction unit updates previous difference information using the received difference information, calculates, as the generation completion predicted time, a time ahead of a receiving time by the updated difference information, and predicts the position and orientation of a viewpoint at the calculated generation completion predicted time using the received position and orientation information. The virtual space based on the predicted position and orientation, and the generation completion predicted time are transmitted to a VHMD.

Generating 3D representations of a scene represented by a first video stream captured by video cameras. Identifying a transition between cameras, retrieving parameters of a first set of viewing configurations, providing 3D video representations representing the scene at several sets of viewing configurations different from the first set of viewing configurations, and generating an integrated video stream enabling 3D display of the scene by integration of at least two video streams having respective sets of viewing configurations, which are mutually different. Another provided process is for synthesizing an image of an object from a first image, captured by a certain camera at a first viewing configuration. Assigning a 3D model to a portion of a segmented object, calculating a modified image of the portion of the object from a viewing configuration different from the first viewing configuration, and embedding the modified image in a frame for stereoscopy.

A character screen information generating unit (34) has a function also serving as a spotlight information generating unit and outputs spotlight information for brightness toward a brightness information converting unit (30). The brightness information converting unit (30) uses this spotlight information for brightness to convert brightness information. A shading computation unit (24) uses the converted brightness information and color information of an object to determine color information to be displayed on a display at each pixel. A depth cueing computation unit (26) uses depth information to make a depth cueing computation relative to the determined color information. Thus, a pattern such as headlight can be displayed in the form of spotlight. Further, such a spotlight display can reflect by the depth information. There may further be provided a depth information converting unit for converting the depth information by the use of spotlight information for depth.

An image synthesis apparatus includes a right infrared camera and a left infrared camera; a right visible light camera and a left visible light camera; and a first image synthesis processing device for synthesizing data output from the right infrared camera and from the left infrared camera and data output from the right visible light camera and from the left visible light camera so that a three-dimensional thermal image and a three-dimensional visible light image are observed by an observer as overlapping each other.

A system and method for generating custom geospatial information maps and precision corrected images allows real-time interactive production of a desired output image by incorporating user selectable parameters that define various image synthesizing operations. A graphical user interface allows a user to specify parameters that define the desired output image via a remote computing device over a public access network such as the Internet. The parameters define image synthesizing operations such as area, projection, datum, fusion, masking, blending, mosaiking, resampling, and others. The desired output image is processed by an image assembly server according to the parameters and a variety of geospatial image data sources, and electronically delivered to a user via a public access network. The geospatial information may also be correlated with non-georeferenced data such that relevant associations between non-georeferenced data and the geospatial data are integrated in the output information product.

An image processor including an object extracting device extracting an object region from original image data; an object separating device separating the object region from the other region; a first filter subjecting the object region to out-of-focus filtering processing to output first image data; a second filter subjecting the other region to out-of-focus filtering processing to output second image data; an image synthesizing device synthesizing the first and second image data; a displaying device displaying the synthesized image data and original image data; a region splitting device splitting the synthesized image data into plural regions; a high-frequency component obtaining device obtaining high-frequency components in each of the plural regions; a high-frequency component analyzing device analyzing the high-frequency components; and a zooming device zooming a region among the plural regions having higher frequency components.

Certain embodiments of the present invention provide systems and methods for image composition. Certain embodiments include acquiring a first image of an object using an imager, obtaining first positional information for the imager with respect to the object, acquiring a second image of the object using the imager, obtaining second positional information for the imager with respect to the object, and creating a composed image using the first and second images. A spatial relationship between the images is maintained using the positional information. A composed image may be created by constructing a memory map of image data related to the object and inserting the images into the memory map based on the positional information, for example. A composed image may be created by combining the images based on the positional information, for example.

An image synthesization method, whereby a plurality of images, each of which has a partially overlapping image area, are synthesized to create a single synthetic image, comprises a determination step of inputting a plurality of image data sets that correspond to the plurality of images that are input, and of determining whether or not an image in the partially overlapping image area of each of images that are indicated by the plurality of image data sets includes mainly characters an image processing step of performing, for the plurality of image data sets that are input, image processing in consonance with a result of a determination performed at the determination step and an image synthesization step of synthesizing images that are indicated by the resultant plurality of image data, for which the image processing has been performed at the image processing step. With this arrangement, a plurality of images can be easily and effectively synthesized.