3031 results about "Stereo image" patented technology

The present invention provides a system (method and apparatus) for creating photorealistic 3D models of environments and/or objects from a plurality of stereo images obtained from a mobile stereo camera and optional monocular cameras. The cameras may be handheld, mounted on a mobile platform, manipulator or a positioning device. The system automatically detects and tracks features in image sequences and self-references the stereo camera in 6 degrees of freedom by matching the features to a database to track the camera motion, while building the database simultaneously. A motion estimate may be also provided from external sensors and fused with the motion computed from the images. Individual stereo pairs are processed to compute dense 3D data representing the scene and are transformed, using the estimated camera motion, into a common reference and fused together. The resulting 3D data is represented as point clouds, surfaces, or volumes. The present invention also provides a system (method and apparatus) for enhancing 3D models of environments or objects by registering information from additional sensors to improve model fidelity or to augment it with supplementary information by using a light pattern projector. The present invention also provides a system (method and apparatus) for generating photo-realistic 3D models of underground environments such as tunnels, mines, voids and caves, including automatic registration of the 3D models with pre-existing underground maps.

A medical robotic system provides 3D telestration over a 3D view of an anatomical structure by receiving a 2D telestration graphic input associated with one of a pair of stereoscopic images of the anatomical structure from a mentor surgeon, determining a corresponding 2D telestration graphic input in the other of the pair of stereoscopic images using a disparity map, blending the telestration graphic inputs into respective ones of the pair of stereoscopic images, and providing the blended results to a 3D display so that a 3D view of the telestration graphic input may be displayed as an overlay to a 3D view of the anatomical structure to an operating surgeon.

A technique for enhancing audio signals generated from compressed digital audio files is described. The technique uses a Bass Maximizer module, a Harmonic Exciter module and a Quasi Stereo module. The Bass Exciter module enhances the intensity, depth and punch of the bass audio content by creating harmonic sequences from low frequency components contained in the original input signal. The Harmonic Exciter module adds to the treble audio content of the original input signal by generating harmonic series from the high frequency components contained in the input signal. The Quasi Stereo Module creates a stereo image of the enhanced input signal by adding and subtracting delayed and filtered versions of the enhanced input signal with itself to create left and right channeled stereo-like outputs. The technique provides a useful tool to regenerate from an audio signal more pleasant and joyful sounds.

A method of producing a stereo image of a (real or simulated) scene using at least one (real or simulated) camera, which creates the impression of being a 3D image when viewed on a display by a user, wherein the depth of the scene is mapped onto a maximum perceived depth of the image on the display, and the maximum perceived depth is chosen to provide comfortable viewing for the user.

There is disclosed a depth information generation apparatus capable of acquiring high-precision depth information within a short computation time. A depth information generation apparatus of this invention generates depth information at the capture position of a reference image from the reference image, and at least one peripheral image that forms a stereo image pair with the reference image, and has a high-speed stereo processor (30) for generating depth information at high speed from the reference image and peripheral image, and a high-precision stereo processor (40) for generating high-precision depth information. A motion detector (20) detects a motion in an image, and instructs an image composition unit (50) to select the output from the high-speed stereo processor (30) for a portion with a large motion, and the output from the high-precision stereo processor (40) for other portions. The image composition unit (50) composites the outputs from the high-speed stereo processor (30) and high-precision stereo processor (40) in accordance with an instruction from the motion detector (20), and outputs a depth map as final depth information.

Systems and methods for stereo imaging with camera arrays in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating depth information for an object using two or more array cameras that each include a plurality of imagers includes obtaining a first set of image data captured from a first set of viewpoints, identifying an object in the first set of image data, determining a first depth measurement, determining whether the first depth measurement is above a threshold, and when the depth is above the threshold: obtaining a second set of image data of the same scene from a second set of viewpoints located known distances from one viewpoint in the first set of viewpoints, identifying the object in the second set of image data, and determining a second depth measurement using the first set of image data and the second set of image data.

A surgical instrument is inserted through a guide tube. The surgical instrument exits at an intermediate position of the guide tube and is oriented to be substantially parallel to the guide tube's longitudinal axis as it exits. A stereoscopic image capture component is on the guide tube between the intermediate position and the guide tubers distal end. The image capture component's field of view is generally perpendicular to the guide tube's longitudinal axis. The guide tube is jointed to allow the image capture component to be moved. The surgical instruments and the guide tube are telemanipulatively controlled.

The present invention relates to an apparatus and a method for processing three-dimensional (3D) image data of a portable terminal, and particularly, to an apparatus and a method for enabling contents sharing and reproduction (playback) between various 3D devices using a file structure for effectively storing a 3D image obtained using a plurality of cameras, and a stored 3D related parameter, and sharing and reproduction between various 3D devices are possible using a file structure for effectively storing a 3D image (for example, a stereo image) obtained using a plurality of cameras, and a stored 3D related parameter.

The present invention relates to a face recognition and/or iris recognition system and method using a mobile device equipped with a stereo camera, which acquire a stereo image of a user's face using at least two cameras or a method corresponding thereto and, even when the size of the stereo image is varied according to distance, correct the size of the stereo image. The stereo camera uses a single-focus lens with a long depth of focus to acquire a focused iris image over a wider range. When the user is not located at a position suitable for iris recognition, a message is sent to the user such that an iris image suitable for recognition is acquired. Furthermore, an iris image correction process according to distance is performed to prevent recognition rate from decreasing even when the size of the iris image is changed.

A multiple path stereoscopic projection system is disclosed. The system comprises a polarizing splitting element configured to receive image light energy and split the image light energy received into a primary path and a secondary path, a reflector in the secondary path, and a polarization modulator or polarization modulator arrangement positioned in the primary path and configured to modulate the primary path of light energy. A polarization modulator may be included within the secondary path, a retarder may be used, and optional devices that may be successfully employed in the system include elements to substantially optically superimpose light energy transmission between paths and cleanup polarizers. The projection system can enhance the brightness of stereoscopic images perceived by a viewer. Static polarizer dual projection implementations free of polarization modulators are also provided.

An autostereoscopic multi-user display comprising a sweet-spot unit which is directionally controlled by a tracking and image control device (160), wherein an illumination matrix (120) is provided with separately activatable illuminating elements (11 . . . 56), in addition to an imaging device used to alternatingly image active illuminating elements, for making expanded sweet spots (SRI/SR2) visible to various eye positions (EL1/ERI, EL2/ER2) of viewers observing alternating images or a stereoscopic image sequence on a transmissive image matrix (140) with the aid of directed beams (B1R . . . B5L). According to the invention, the imaging device comprises an imaging matrix (110) provided with a plurality of lens elements (111 115) whose focal length is small in order to image the active illuminating elements in an enlarged manner onto the sweet spots (SRI/SR2), and a field lens (171), which follows the imaging matrix (110), in order to keep the distances of the activated illuminating elements between adjacent beams (B1, B2,B4, B5) as constant as possible and in order to assist selection of the directions (D1. . . D5) with the illumination matrix (120) for the beams.

A system of linked digital cameras for an image capture system is disclosed. A first and second digital camera can be linked to capture a first images and a second image that are used to form a stereo image. A first data port on the first digital camera and a second data port on the second digital camera intercommunicate data between each other when the cameras are linked. The data can include the first and second image data, camera control data, and camera synchronization data. After capturing the first and second images, the image from one of the cameras can be transferred to the other camera so that both the first and second images reside in the other camera. The system allows a user who wishes to capture stereo images the ability to do so with out having to purchase two digital cameras. A compatible digital camera can be borrowed from another user for the purpose of stereo image capture. After the stereo image is captured, the user transfers both images to his camera and returns the borrowed camera. The cameras can be equipped with viewfinders that allow a user of the cameras to view the image being captured in stereo. The viewfinders can be adjustable to accommodate variations in user interpupillary distance. A digital camera operating system (OS) can be customized to enable stereo image capture, image data handling, image processing, and camera control for the linked digital cameras.

Two stereo images are created by splitting a single image into two images using a field of view dividing splitter. The two images can be displayed side by side so that they can be viewed directly using stereopticon technology, heads-up display, or other 3-D display technology, or they can be separated for individual eye viewing. The two images focus on one imager such that the right image appears on the right side of the monitor and the left image appears on the left side of the monitor. The view of the images is aimed to converge at a given object distance such that the views overlap 100% at the object distance. Measurement is done with at least one onscreen cursor.

Methods and systems to process stereo images and video information, and, in particular, to methods and devices to transfer and/or transform stereo content to decrease eye fatigue of a user during viewing of 3D video. The methods and systems can compute an initial map of disparity/depth for stereo images from 3D video, smooth a depth map, change depth perception parameters according to the estimation of eye fatigue, and generate new stereo image according to the depth perception parameters.

A 2D/3D switchable display system having a selector for selecting a two-dimensional (2D) or a three-dimensional (3D) image processing path; a first processor for processing image data through the two-dimensional image processing path; a second processor, independent of the first processor, for processing image data through the three dimensional image processing path; a first set of at least three emitters having corresponding first wavelengths; a second set of at least three emitters having corresponding second wavelengths; and a controller that during a 2D operation activates both first and second sets of emitters to present a single image, while during a 3D operation activates the first set of emitters to present a first image having one half of stereo image information and activates the second set of emitters to present a second image having a second half of stereo image information.

The present invention makes it possible to perform transmission of stereo image data between devices in a favorable manner. A source device (disc player 210) receives E-EDID from a sink device (television receiver 250) via DDC of an HDMI cable 350. This E-EDID contains information on 3D image data transmission modes that can be supported by the sink device. On the basis of the information on 3D image data transmission modes from the sink device, the source device selects a predetermined transmission mode from among the 3D image data transmission modes that can be supported by the sink device. The sink device transmits 3D image data in the selected transmission mode to the sink device. For the convenience of processing in the sink device, the source device transmits information on the transmission mode for the 3D image data transmitted, to the sink device by using an AVI InfoFrame packet or the like. The sink device processes the 3D image data received from the source device in accordance with its transmission mode, thereby obtaining left eye and right eye image data.

A two-dimensional image is displayed and a grey level image is drawn on said two-dimensional image defining a depth map. A stereo image pair is generated based on the depth map and an anaglyph image of the stereo image pair is displayed. Edits of the depth map are displayed by anaglyph image. A plurality of projection frames are generated based on the depth map, and interlaced and printed for viewing through a micro optical media. Optionally, a layered image is extracted from the two-dimensional image and the plurality of projection frames have an alignment correction shift to center the apparent position of the image. A measured depth map is optionally input, and a stereo pair is optionally input, with a depth map calculated based on the pair. The user selectively modifies the calculated and measured depth map, and the extracted layers, using painted grey levels. A ray trace optionally modifies the interlacing for optimization to a particular media.

In the three-dimensional display, a two-dimensional display section generates a two-dimensional display image based on an image signal, and a lens array converts the wavefront of the display image light from the two-dimensional display section into a wavefront having a curvature which allows the display image light to focus upon a focal point where an optical path length from an observation point to the focal point is equal to an optical path length from the observation point to a virtual object point, so a viewer can obtain information about an appropriate focal length in addition to information about binocular parallax and a convergence angle. Therefore, consistency between the information about binocular parallax and a convergence angle and the information about an appropriate focal length can be ensured, and a desired stereoscopic image can be perceived without physiological discomfort.

A scanning camera with a rotating drum has one or more sensors characterized by a non-radial optical axis. With two sensors on opposite sides of the drum and facing in substantially the same direction, stereoscopic recording of a panorama is accomplished as the drum rotates. The adjustment of convergence between stereoscopic viewpoints is described that improves the viewing and interpretation of stereoscopic images. Rapid rotation of the scanning camera produces panoramic motion picture recording, with the final frame speed dependent on the sensitivity and speed of the sensor, the resolution desired, and the capabilities of the recording device. The preferred embodiment employs rotating fisheye lenses for a substantially full-sphere field of view. Additional sensors in the same arrangement are used to increase resolution and light sensitivity through multiplexed or additive recording of the image data. Recording image information using film, either internal or external to the camera drum, is also described as a cost-effective alternative to digital media storage.

The invention presents a single lens auto focus system of stereo image generation and a method thereof. The stereo three-dimensional (3D) image capturing method of a single lens auto focus camera, includes the steps of a) taking plural multi-focus images; b) estimating the plural multi-focus images to obtain a depth map and an all-in-focus image; c) mixing the depth map with plural background depth maps to obtain a mixed depth map; d) obtaining respectively a left image for left eye of user and a right image for right eye of user by means of depth image based rendering (DIBR); and e) outputting the left image and the right image, thereby displaying a stereo image onto a 3D display.