1306 results about "Image synthesis" patented technology

Methods, apparatus, and computer-readable storage media for video completion that may be applied to restore missing content, for example holes or border regions, in video sequences. A video completion technique applies a subspace constraint technique that finds and tracks feature points in the video, which are used to form a model of the camera motion and to predict locations of background scene points in frames where the background is occluded. Another frame where those points were visible is found, and that frame is warped using the predicted points. A content-preserving warp technique may be used. Image consistency constraints may be applied to modify the warp so that it fills the hole seamlessly. A compositing technique is applied to composite the warped image into the hole. This process may be repeated until the missing content is filled on all frames.

An added information encoding part repeatedly arranges two kinds of copy inhibition code arrays of the unit two-dimensional arrays to which copy inhibition codes are assigned, and condition code arrays of the unit two-dimensional arrays to which codes for removing the copy inhibition are assigned, into a two-dimensional array according to given rules. A background image formation part generates a background image in which copy inhibition pattern image areas and condition pattern image areas are repeatedly and two-dimensionally arranged according to given rules, while referring to this array, and the pattern images corresponding to respective codes stored in the background image formation part, and stores the generated background image into a background image buffer. An image composing part reads out document images from a document image buffer, and the background image from the background image buffer, and superimposes them into a composite image.

Provided are a method and apparatus for taking images using a mobile communication terminal with a plurality of camera lenses, that can visually emphasize the shape of an object by photographing a specific object and its surrounding background using a zoom lens and a wide-angle lens, respectively, and combining the photographed images. The method includes setting the mobile communication terminal to an image-taking mode, entering into an image-combining mode, operating the plurality of camera lenses, setting an object, taking images using the plurality of camera lenses, and combining together the images obtained using the plurality of lenses. The method and apparatus enables visual emphasis of a specific object in an entire image by photographing the specific object with a zoom lens and a background containing the object with a wide-angle lens, and then combining the photographed images so as to display the specific object at a higher magnification ratio than that of the background.

An image processing apparatus includes: a shaking estimating unit configured to estimate the shaking information of an image generated within a predetermined period of time; a short-time-exposure shaking correcting unit configured to correct the shaking of a plurality of short-time-exposure images generated due to intermittent exposure within the predetermined period of time based on the estimated shaking information; a long-time-exposure shaking correcting unit configured to correct the shaking of a long-time-exposure image generated due to consecutive exposure within the predetermined period of time based on the estimated shaking information; and an image synthesizing unit configured to synthesize the corrected short-time-exposure images and the corrected long-time-exposure image.

Systems and methods for providing convolutional neural network based image synthesis using localized loss functions is disclosed. A first image including desired content and a second image including a desired style are received. The images are analyzed to determine a local loss function. The first and second images are merged using the local loss function to generate an image that includes the desired content presented in the desired style. Similar processes can also be utilized to generate image hybrids and to perform on-model texture synthesis. In a number of embodiments, Condensed Feature Extraction Networks are also generated using a convolutional neural network previously trained to perform image classification, where the Condensed Feature Extraction Networks approximates intermediate neural activations of the convolutional neural network utilized during training.

An image processing apparatus includes: an imaging information calculation unit acquiring a first image and higher-resolution second images, and calculating coordinate positions of the second images to the first image and differences in imaging direction between second cameras and a first camera; an eyepoint conversion unit generating eyepoint conversion images obtained by converting the second images based on the differences in imaging direction so that eyepoints of the second cameras coincide with an eyepoint of the first camera and matching the first image with the eyepoint conversion images to calculate phase deviations of the eyepoint conversion images from the first image; and an image synthesizing unit extracting high-frequency images, having frequency components higher than or equal to a predetermined frequency band, from the second images, and pasting the high-frequency images at the coordinate positions in correspondence with the first image to eliminate the phase deviations to generate a synthesized image.

The present invention provides a three-dimensional digital entity magnifying glass technique-assisting and training/educational distribution system incorporating three-dimensional visual training functions by means of image composition that enables a three-dimensional visual instruction containing a depth when giving visual instructions to an HMD worn by a medical practitioner to thereby display only images of a pointing device or various kinds of instruments among image information of the instructor's CCD camera and synchronously and compositely displaying a three-dimensional visual training image output from an image-processing apparatus that can display an after-image of the image for an arbitrary time setting into image information of the CCD camera, thereby providing equal-scaling display of image information to which an instruction and a comment by use of a visual display/instruction image are added three-dimensionally as well as an instrument actually used by the instructors (groups of lecturers) on the three-dimensional HMD of the medical practitioner.

A vehicle surrounding monitoring device include at least one camera 2 installed in an own vehicle to image a video around the own vehicle, an obstacle sensor 3 for detecting an obstacle within an imaging range of the camera 2, a pixel synthesis unit 13 for receiving a camera image imaged by the camera 2 and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and a display device 4 for displaying the view point conversion image converted by the pixel synthesis unit 13. Simultaneously when a warning is given by a warning sound upon entry of an obstacle within an obstacle detection range of the obstacle sensor 3, an image of the obstacle detection range is synthesized with an obstacle image imaged by the camera 2 and included in the view point converted image to be in contact therewith.

The synthesized image generation method for generating synthesized image data by extracting face images of characters contained in image data and synthesizing the extracted face images with a template into a plurality of synthesis positions which have been set in advance on the template, the method comprising the steps of: forming groups of the synthesis positions by combining the adjacent synthesis positions; determining an order of the groups according to number of synthesis positions belonging to each of the groups; detecting the face images of the characters contained in the image data; detecting a relationship between the detected face images; distributing the face images to the groups in the determined order according to the relationship between the face images; and generating the synthesized image data by synthesizing the distributed face images with the template into the synthesis positions of the groups.

An image composition unit outputs a composition image of a physical space and virtual space to a display unit. The image composition unit calculates, as difference information, a half of the difference between an imaging time of the physical space and a generation completion predicted time of the virtual space. The difference information and acquired position and orientation information are transmitted to an image processing apparatus. A line-of-sight position prediction unit updates previous difference information using the received difference information, calculates, as the generation completion predicted time, a time ahead of a receiving time by the updated difference information, and predicts the position and orientation of a viewpoint at the calculated generation completion predicted time using the received position and orientation information. The virtual space based on the predicted position and orientation, and the generation completion predicted time are transmitted to a VHMD.

Generating 3D representations of a scene represented by a first video stream captured by video cameras. Identifying a transition between cameras, retrieving parameters of a first set of viewing configurations, providing 3D video representations representing the scene at several sets of viewing configurations different from the first set of viewing configurations, and generating an integrated video stream enabling 3D display of the scene by integration of at least two video streams having respective sets of viewing configurations, which are mutually different. Another provided process is for synthesizing an image of an object from a first image, captured by a certain camera at a first viewing configuration. Assigning a 3D model to a portion of a segmented object, calculating a modified image of the portion of the object from a viewing configuration different from the first viewing configuration, and embedding the modified image in a frame for stereoscopy.

A character screen information generating unit (34) has a function also serving as a spotlight information generating unit and outputs spotlight information for brightness toward a brightness information converting unit (30). The brightness information converting unit (30) uses this spotlight information for brightness to convert brightness information. A shading computation unit (24) uses the converted brightness information and color information of an object to determine color information to be displayed on a display at each pixel. A depth cueing computation unit (26) uses depth information to make a depth cueing computation relative to the determined color information. Thus, a pattern such as headlight can be displayed in the form of spotlight. Further, such a spotlight display can reflect by the depth information. There may further be provided a depth information converting unit for converting the depth information by the use of spotlight information for depth.

An image synthesis apparatus includes a right infrared camera and a left infrared camera; a right visible light camera and a left visible light camera; and a first image synthesis processing device for synthesizing data output from the right infrared camera and from the left infrared camera and data output from the right visible light camera and from the left visible light camera so that a three-dimensional thermal image and a three-dimensional visible light image are observed by an observer as overlapping each other.

A system and method for generating custom geospatial information maps and precision corrected images allows real-time interactive production of a desired output image by incorporating user selectable parameters that define various image synthesizing operations. A graphical user interface allows a user to specify parameters that define the desired output image via a remote computing device over a public access network such as the Internet. The parameters define image synthesizing operations such as area, projection, datum, fusion, masking, blending, mosaiking, resampling, and others. The desired output image is processed by an image assembly server according to the parameters and a variety of geospatial image data sources, and electronically delivered to a user via a public access network. The geospatial information may also be correlated with non-georeferenced data such that relevant associations between non-georeferenced data and the geospatial data are integrated in the output information product.

An image processor including an object extracting device extracting an object region from original image data; an object separating device separating the object region from the other region; a first filter subjecting the object region to out-of-focus filtering processing to output first image data; a second filter subjecting the other region to out-of-focus filtering processing to output second image data; an image synthesizing device synthesizing the first and second image data; a displaying device displaying the synthesized image data and original image data; a region splitting device splitting the synthesized image data into plural regions; a high-frequency component obtaining device obtaining high-frequency components in each of the plural regions; a high-frequency component analyzing device analyzing the high-frequency components; and a zooming device zooming a region among the plural regions having higher frequency components.

An image synthesization method, whereby a plurality of images, each of which has a partially overlapping image area, are synthesized to create a single synthetic image, comprises a determination step of inputting a plurality of image data sets that correspond to the plurality of images that are input, and of determining whether or not an image in the partially overlapping image area of each of images that are indicated by the plurality of image data sets includes mainly characters an image processing step of performing, for the plurality of image data sets that are input, image processing in consonance with a result of a determination performed at the determination step and an image synthesization step of synthesizing images that are indicated by the resultant plurality of image data, for which the image processing has been performed at the image processing step. With this arrangement, a plurality of images can be easily and effectively synthesized.

The invention provides a medical image synthesis method based on double generative adversarial networks. The method comprises the main content of performing data management, generating the generativeadversarial networks, training a U-NET, establishing assessment indexes and obtaining processed pictures, wherein first, a DRIVE database is used to manage a first-stage GAN, then the first-stage GANgenerates a partitioning mask representing variable geometry of a dataset, a second-stage GAN converts the mask produced at the first stage into an image with a sense of reality, an generator minimizes a loss function of the true data in classification through a descriminator, then the U-NET is trained to assess the reliability of synthetic data, and finally the assessment indexes are establishedto measure a generated model. According to the method, by use of a pair of generative adversarial networks to create a new image generation path, the problem that the synthetic image contains a fake shadow and noise is solved, the stability and the sense of reality of the image are improved, and meanwhile image details are clearer.

Two-dimensional or three-dimensional, time-resolved CT frame images are acquired during a dynamic study of a subject. A composite image is produced and this is used to reconstruct each CT frame image by weighting the backprojection of each projection view acquired for that image frame by the corresponding value in the composite image. This weighted backprojection enables artifact-free image frames to be produced with far fewer projection views of the subject. The composite image may be reconstructed from views acquired separately, or it may be produced by combining views acquired during the course of the dynamic study.

Systems and methods for interactive image compositing may integrate image searching using visual search criteria (e.g., color, composition, tonal distribution, or lighting effects), non-destructive image compositing, and high-performance rendering using a fast gradient solver to provide an efficient workflow for users. An image compositing application, executable by a CPU and/or GPU, may employ a sketch-and-refine approach, whereby a user draws a rough perimeter around an object of interest in an image and (following an initial application of the fast gradient solver to a lower-resolution version of the image) receives a preview of how it would fit into a composition. The fast gradient solver may differentiate between the object and its background by applying artificial intelligence techniques and/or dependent on user-supplied hints. In a second stage, the fast gradient solver may refine the solution for a final rendering of the composite image by operating on successively higher-resolution versions of the image.

Among pickup image data items of multiple frames picked up at different time instants, an image of a certain frame is regarded as a synthesizing base image. The synthesizing base image and an image of another frame are used to perform synthesizing processing. Specifically, an object-of-synthesis area is designated in the frame image regarded as the synthesizing base image, and processing of replacing pixel data in the object-of-synthesis area with pixel data in another frame is carried out. For example, if a person having his/her eyes closed appears in the synthesizing base image that is a group-photograph image, the part of the person's face is regarded as the object-of-synthesis area. As another frame, an image in which the person has his/her eyes left open is searched. Pixel data in the facial image part showing the open eyes is fetched and synthesized with the synthesizing base image. Thus, a group photograph in which all people have their eyes left open is produced.

There is disclosed an image synthesizing apparatus for producing a synthetic image that consists of a background image and at least a main image superimposed on the back ground image. An input image is displayed in a main display area of a control screen, whereas an outer frame and at least an inner frame are displayed in a sub display area of the control screen in accordance with a selected template. First a crop boundary having a similar shape to the outer frame is displayed on the image in the main display section. The crop boundary is movable on the image and changeable in size. After pasting a cropped area of the image as the background image in the outer frame, a second image is selected and displayed in the main display area. Then, a crop boundary having a similar shape to the inner frame is displayed on the second image, so a cropped area of the second image is pasted in the inner frame, to be printed as the main image.

A mixed reality space image generation apparatus for generating a mixed reality space image formed by superimposing virtual space images onto a real space image obtained by capturing a real space, includes an image composition unit (109) which superimposes a virtual space image, which is to be displayed in consideration of occlusion by an object on the real space of the virtual space images, onto the real space image, and an annotation generation unit (108) which further imposes an image to be displayed without considering any occlusion of the virtual space images. In this way, a mixed reality space image which can achieve both natural display and convenient display can be generated.

The invention discloses a shooting method of a mobile terminal and the mobile terminal. The shooting method comprises the steps that after shooting is started, a camera collects an image every preset time; image synthesizing is conducted according to brightness information of the current image and brightness information of the previous images to form a synthesized image. The image synthesizing technology is adopted to simulate long-time exposure and a star trajectory shooting function is added to the mobile terminal so that a user can use the mobile terminal to shoot the moving trajectories of stars or apply the mobile terminal to similar application occasions and can also preview shooting effects in real time, therefore, the diversified requirements of the user are met and user experience is improved. The pre-positioned camera of the mobile terminal can further be used for conducting trajectory shooting, mirror processing is conducted on the image to enable the synthesized image to be completely the same as the actual trajectory picture, and due to the fact that when the pre-positioned camera is used for shooting, a screen faces upwards, the user can preview the shooting effects conveniently in real time.

A three-dimensional computer graphics model which represents a measurable range of a position and orientation sensor is prepared in advance. A composite image is generated by superimposing an image of a virtual object which represents the measurable range of the position and orientation sensor on an actually-sensed image in real space where the position and orientation sensor is placed. The composite image, when displayed, makes it possible to visually recognize the measurable range of the position and orientation sensor.

An augmented field of view imaging system includes a microscope, an image sensor system arranged to receive images of a plurality of fields of view from the microscope as the microscope is moved across an object being viewed and to provide corresponding image signals, an image processing and data storage system configured to communicate with the image sensor system to receive the image signals and to provide augmented image signals, and at least one of an image injection system or an image display system configured to communicate with the image processing and data storage system to receive the augmented image signals and display an augmented field of view image. The image processing and data storage system is configured to track the plurality of fields of view in real time and register the plurality of fields of view to calculate a mosaic image. The augmented image signals from the image processing and data storage system provide the augmented image such that a live field of view from the microscope is composited with the mosaic image.

A camera has a provisional photographing mode in which a human model image is displayed on a through image in an overlapping manner on a display, and the user moves the human model image to a desired position in the through image and records a composition indicating image representing the conditions of the through image with the human model image at the desired position. After the provisional photographing process, the through image is synthesized with the recorded composition indicating image in a semi transparent manner, to display a synthesized image in place of the through image on the display. When a shutter is operated, a normal photographing process is performed to record an image.

The invention discloses a face mage super-resolution method which fuses global features and local detail information. The invention can synthesize a high-resolution face image according to a low-resolution face image based on a sample image. Firstly, a local maintaining mapping algorithm and a radial basic function return algorithm are combined together to get a global high-resolution face image; then a neighborhood reconstruction method is adopted to synthesize a high-resolution face residual image block and consequently form a high-resolution face residual image by combination; finally, the high-resolution face residual image is overlapped to the high-resolution face image to obtain a final super-resolution effect. The technology provided by the invention can synthesize the clearer high-resolution face image, improve the recognition of the face image and have important application significances on video monitoring, face recognition and other aspects.

A normal light CCD 11 is driven via a normal light CCD control section 25 by a timing signal from a timing circuit section 29 of a video processor 20. At the same time, a fluorescence CCD 12 is driven via a fluorescence CCD control section 26. Then, an image pickup signal according to an RGB frame sequential method from the normal light CCD 11 is processed by a normal light image video circuit section 27 and a normal color image is created while an image pickup signal from the fluorescence CCD 12 is processed by a fluorescence image video circuit section 28, and an image pickup signal of a subject excited by blue illumination light and transmitted through a fluorescence transmitting filter 13 is extracted to create a fluorescence image of the subject. The normal color image and the fluorescence image of the subject are synthesized by an image synthesizing circuit section 30 and outputted to a monitor 2, whereby the normal light image and the fluorescence image is displayed side by side or on top of each other.

An image synthesizing apparatus which generates, from plural images with differing resolutions and lighting conditions, a synthesized image in which the resolution of the original image is improved and the lighting conditions match those of the original image. The image synthesizing apparatus includes: a camera which acquires an original image and plural reference images, the reference images being obtained by capturing the same object shown in the original image under differing lighting conditions; a reference image conversion unit which converts the resolution of the acquired plural reference images to the same resolution as the original image; a coefficient calculation unit which calculates, based on the original image and plural reference images, which now have the same resolution, a conversion coefficient used in performing linear combination on the plural converted reference images and generating an original image; and an image synthesizing unit which generates plural converted reference images by converting the plural reference images to a target resolution, generates a linear-converted image by performing linear combination on the generated plural converted reference images using the conversion coefficient, and outputs, as a synthesized image, the generated linear-converted image or an image in which the adjusted linear-converted image has been adjusted.

A specific object such as a human body can be visualized in a wide range in a relation to its background night and day to definitely identify a location of the object in relation to the background as well in the infrared image captured by the infrared camera. The present invention provides an imaging device including a color camera unit for making color imaging with the imaging direction being sequentially adjusted for each of unit images forming together a panoramic image, an infrared camera for imaging by infrared radiation measurement with the imaging direction being sequentially adjusted for each of unit images forming together a panoramic infrared image, a server for storing/managing a panoramic color image produced by overlaying a plurality of unit images captured in colors by the color camera unit one on the other and a panoramic infrared image produced by overlaying a plurality of unit images captured by infrared radiation measurement by the infrared camera one on the other, an image synthesizer for overlaying, on an image of an object imaged by controlling the direction of imaging by the infrared camera to a desired one in a range of the imaging, a color image corresponding to a location, where the object has been imaged by the infrared camera, in a panoramic color image stored/managed in the server, and an image display for displaying an image produced by the overlaying by the image synthesizer.