1784results about "Stereoscopic photography" patented technology

A system projects a user-viewable, computer-generated or -fed image, wherein a head-mounted projector is used to project an image onto a retro-reflective surface, so only the viewer can see the image. The projector is connected to a computer that contains software to create virtual 2-D and or 3-D images for viewing by the user! Further, on projector each is mounted on either side of the user's head, and, by choosing for example a retro angle of less than about 10 degrees, each eye can only see the image of one of the projectors at a give distance up to 3 meters, in this example, from the retro-reflective screen. The retro angle used may be reduced with larger viewing distance desired. These projectors use lasers to avoid the need for focusing, and in some cases there projectors use instead of lasers highly collimated LEO light sources to avoid the need for focusing.

Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In several embodiments, detecting parallax involves using competing subsets of images to estimate the depth of a pixel location in an image from a reference viewpoint. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.

Methods and apparatus to create and display stereoscopic and panoramic images are disclosed. Apparatus is provided to control the position of a lens in relation to a reference lens. Methods and apparatus are provided to generate multiple images that are combined into a stereoscopic or a panoramic image. An image may be a static image. It may also be a video image. A controller provides correct camera settings for different conditions. An image processor creates a stereoscopic or a panoramic image from the correct settings provided by the controller. A panoramic video wall system is also disclosed.

There are many inventions described herein. Some aspects are directed to methods and/or apparatus to provide relative movement between optics, or portion(s) thereof, and sensors, or portion(s) thereof, in a digital camera. The relative movement may be in any of various directions. In some aspects, relative movement between an optics portion, or portion(s) thereof, and a sensor portion, or portion(s) thereof, are used in providing any of various features and/or in the various applications disclosed herein, including, for example, but not limited to, increasing resolution, optical and electronic zoom, image stabilization, channel alignment, channel-channel alignment, image alignment, lens alignment, masking, image discrimination, range finding, 3D imaging, auto focus, mechanical shutter, mechanical iris, multi and hyperspectral imaging, and/or combinations thereof. In some aspects, movement is provided by actuators, for example, but not limited to MEMS actuators, and by applying appropriate control signal thereto.

A method and system for automated production of stereoscopic and animated images and hardcopies can utilize a light-sensitive lenticular material employing a conventional or non-conventional photographic emulsion or an instant-developing material. An automated printer can produce autostereoscopic and animated hardcopies in multiple formats from digital and non-digital sources, including single images, stereopairs, and multiple-image sets of negatives, transparencies, or prints. The printer, which includes a projection device and a material plate that can rotate around two perpendicular axes, can utilize software to automate viewing angle calculation, printer control, multiple-image alignment, distortion correction, and image processing and conversion. A digital camera can capture stereoscopic and animated images and record them digitally or on photographic film. A non-digital camera can record stereoscopic and animated images directly onto light-sensitive lenticular material employing a conventional or non-conventional photographic emulsion or an instant-developing material. The printer and cameras can utilize autostereoscopic monitors to preview parallax.

A method of producing a stereo image of a (real or simulated) scene using at least one (real or simulated) camera, which creates the impression of being a 3D image when viewed on a display by a user, wherein the depth of the scene is mapped onto a maximum perceived depth of the image on the display, and the maximum perceived depth is chosen to provide comfortable viewing for the user.

An imaging system for producing stereoscopic panoramic images using multiple coplanar pairs of image capture devices with overlapping fields of view held in a rigid structural frame for long term calibration maintenance. Pixels are dynamically adjusted within the imaging system for position, color, brightness, aspect ratio, lens imperfections, imaging chip variations and any other imaging system shortcomings that are identified during calibration processes. Correction of pixel information is implemented in various combinations of hardware and software. Corrected image data is then available for storage or display or for separate data processing actions such as object distance or volume calculations.

Apparatus for projecting a pattern includes a first diffractive optical element (DOE) configured to diffract an input beam so as to generate a first diffraction pattern on a first region of a surface, the first diffraction pattern including a zero order beam. A second DOE is configured to diffract the zero order beam so as to generate a second diffraction pattern on a second region of the surface such that the first and the second regions together at least partially cover the surface.

A panoramic camera system includes a plurality of camera units mounted in a common, e.g., horizontal, plane and arranged in a circumferential array. Each camera unit includes one or more lenses for focusing light from a field of view onto an array of light-sensitive elements. A panoramic image generator combines electronic image data from the multiplicity of the fields of view to generate electronic image data representative of a first 360-degree panoramic view and a second 360-degree panoramic view, wherein the first and second panoramic views are angularly displaced. A stereographic display system is provided to retrieve operator-selectable portions of the first and second panoramic views and to display the user selectable portions in human viewable form. In a further aspect, a video display method is provided.

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to light-fields captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

In one aspect, the present invention relates to a stereoscopic projection system including a projection device with at least one filter which filters a parameter of the light in a color selective manner. The at least one filter which filters a parameter of the light in a color selective manner has a spectral characteristic for transmitting light in a first wavelength band or set of wavelength bands and for reflecting light in a second wavelength band or set of wavelength bands. The projection device includes a device, such as e.g. a rotating wheel or a sliding filter, for fast synchronized switching between light in different wavelength bands or sets of wavelength bands. In a further aspect, a stereoscopic projection system is provided in which a combination of a first and a second filter mechanism are used, the first filter mechanism being a filter which filters a parameter of the light in a color selective manner, such as a color selective filter or a color selective retarder, and the second filter mechanism preferably being a polarizer or a shutter.

The present invention is a system and method for the use of a 3D sensor in an image capture device. In one embodiment, a single 3D sensor is used, and the depth information is interspersed within the information for the other two dimensions so as to not compromise the resolution of the two-dimensional image. In another embodiment, a 3D sensor is used along with a 2D sensor. In one embodiment, a mirror is used to split incoming light into two portions, one of which is directed at the 3D sensor, and the other at the 2D sensor. The 2D sensor is used to measure information in two dimensions, while the 3D sensor is used to measure the depth of various portions of the image. The information from the 2D sensor and the 3D sensor is then combined, either in the image capture device or in a host system.

An omnidirectional sensor array system, for example a panoptic camera, comprising a plurality of sensors arranged on a support of predetermined shape to acquire data, wherein said sensors are directional and wherein each sensor is attached to a processing node which comprises integrated electronics that carries out at least a portion of the signal processing algorithms locally in order to reduce the computational load of a central hardware unit.

A stereoscopic imaging system incorporates a plurality of imaging devices or cameras to generate a high resolution, wide field of view image database from which images can be combined in real time to provide wide field of view or panoramic or omni-directional still or video images.

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to flats captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

Methods and apparatus for capturing and rendering images with focused plenoptic cameras employing different filtering at different microlenses. In a focused plenoptic camera, the main lens creates an image at the focal plane. That image is re-imaged on the sensor multiple times by an array of microlenses. Different filters that provide different levels and/or types of filtering may be combined with different ones of the microlenses. A flat captured with the camera includes multiple microimages captured according to the different filters. Multiple images may be assembled from the microimages, with each image assembled from microimages captured using a different filter. A final image may be generated by appropriately combining the images assembled from the microimages. Alternatively, a final image, or multiple images, may be assembled from the microimages by first combining the microimages and then assembling the combined microimages to produce one or more output images.

A catadioptric camera creates images light fields from a 3D scene by creating ray images defined as 2D arrays of ray-structure picture-elements (ray-xels). Each ray-xel capture light intensity, mirror-reflection location, and mirror-incident light ray direction. A 3D image is then rendered from the ray images by combining the corresponding ray-xels.

A multiple path stereoscopic projection system is disclosed. The system comprises a polarizing splitting element configured to receive image light energy and split the image light energy received into a primary path and a secondary path, a reflector in the secondary path, and a polarization modulator or polarization modulator arrangement positioned in the primary path and configured to modulate the primary path of light energy. A polarization modulator may be included within the secondary path, a retarder may be used, and optional devices that may be successfully employed in the system include elements to substantially optically superimpose light energy transmission between paths and cleanup polarizers. The projection system can enhance the brightness of stereoscopic images perceived by a viewer. Static polarizer dual projection implementations free of polarization modulators are also provided.

An exemplary camera module array includes lens modules, a first holder, image sensors, a second holder, an optical element, and an image processor. The lens modules are threadedly coupled to the first holder. The image sensors are in optical alignment with the lens modules in one-to-one relation. The image sensors are received in the second holder. The optical element is sandwiched between the first holder and the second holder. The image processor is electrically connected with the image sensors. The image processor is configured for processing image signals from the image sensors and thereby obtaining a compound image.

An autostereoscopic multi-user display comprising a sweet-spot unit which is directionally controlled by a tracking and image control device (160), wherein an illumination matrix (120) is provided with separately activatable illuminating elements (11 . . . 56), in addition to an imaging device used to alternatingly image active illuminating elements, for making expanded sweet spots (SRI/SR2) visible to various eye positions (EL1/ERI, EL2/ER2) of viewers observing alternating images or a stereoscopic image sequence on a transmissive image matrix (140) with the aid of directed beams (B1R . . . B5L). According to the invention, the imaging device comprises an imaging matrix (110) provided with a plurality of lens elements (111 115) whose focal length is small in order to image the active illuminating elements in an enlarged manner onto the sweet spots (SRI/SR2), and a field lens (171), which follows the imaging matrix (110), in order to keep the distances of the activated illuminating elements between adjacent beams (B1, B2,B4, B5) as constant as possible and in order to assist selection of the directions (D1. . . D5) with the illumination matrix (120) for the beams.

A system of linked digital cameras for an image capture system is disclosed. A first and second digital camera can be linked to capture a first images and a second image that are used to form a stereo image. A first data port on the first digital camera and a second data port on the second digital camera intercommunicate data between each other when the cameras are linked. The data can include the first and second image data, camera control data, and camera synchronization data. After capturing the first and second images, the image from one of the cameras can be transferred to the other camera so that both the first and second images reside in the other camera. The system allows a user who wishes to capture stereo images the ability to do so with out having to purchase two digital cameras. A compatible digital camera can be borrowed from another user for the purpose of stereo image capture. After the stereo image is captured, the user transfers both images to his camera and returns the borrowed camera. The cameras can be equipped with viewfinders that allow a user of the cameras to view the image being captured in stereo. The viewfinders can be adjustable to accommodate variations in user interpupillary distance. A digital camera operating system (OS) can be customized to enable stereo image capture, image data handling, image processing, and camera control for the linked digital cameras.

A multi-segment optical retarder that can be used with or within a single projector for creating 3D images. The multi-segment optical retarder is coupled to an actuator used to effect some predetermined linear, rotary, or oscillating movement of the multi-segment optical retarder such that a fast axis orientation of each segment is substantially constant relative to itself over time and for a given area of incidence.

A digital micro-mirror device (DMD) format conversion system for outputting a stereoscopic encoded optical signal using a DMD and a color wheel is provided. The DMD format conversion system includes a 3D data formatter for receiving an input signal and a DMD data formatter for receiving an output signal having stereoscopic image information and control information from the 3D data formatter and for outputting a DMD output signal having stereoscopic image information and control information. A color wheel control signal and output digital micro-mirror device data are synchronized based on an output frame rate generated by the 3D data formatter independent of the original input frame rate.

The invention presents a single lens auto focus system of stereo image generation and a method thereof. The stereo three-dimensional (3D) image capturing method of a single lens auto focus camera, includes the steps of a) taking plural multi-focus images; b) estimating the plural multi-focus images to obtain a depth map and an all-in-focus image; c) mixing the depth map with plural background depth maps to obtain a mixed depth map; d) obtaining respectively a left image for left eye of user and a right image for right eye of user by means of depth image based rendering (DIBR); and e) outputting the left image and the right image, thereby displaying a stereo image onto a 3D display.

A stereo camera includes a pair of photographing optical systems arranged in a common plane so that a common photographing coverage occurs between a pair of photographing areas taken by the pair of photographing optical systems, an object distance measuring device, a convergence angle adjustment mechanism adapted to vary an angle of convergence defined by, and between, the optical axes of the pair of photographing optical systems, so as to adjust an amount of common photographic coverage of the pair of photographing optical systems, and a controller adapted to control the convergence angle adjustment mechanism in accordance with object distance data obtained by the object distance measuring device.

The present invention provides a three-dimensional image display capable of presenting stereoscopic display in a true sense not only for a still image but also for a dynamic image without any need for a dedicated eyeglass or coherent light.

A multiplicity of screen dots (11) formed by LCDs which allows simple changes of the contents of an image are arranged on a three-dimensional display screen (10), and object images formed by the LCDs are projected in a space to form a multiplicity of point light source images (P) that form a three-dimensional image (R) to be displayed. A viewer (Q) can view the same as a stereoscopic image.

The digital 3D/360° camera system is an omnidirectional stereoscopic device for capturing image data that may be used to create a 3-dimensional model for presenting a 3D image, a 3D movie, or 3D animation. The device uses multiple digital cameras, arranged with overlapping fields of view, to capture image data covering an entire 360° scene. The data collected by one, or several, digital 3D/360° camera systems can be used to create a 3D model of a 360° scene by using triangulation of the image data within the overlapping fields of view.

Microlens sheetings with composite images are disclosed, in which the composite image floats above or below the sheeting, or both. The composite image may be two-dimensional or three-dimensional. Methods for providing such an imaged sheeting, including by the application of radiation to a radiation sensitive material layer adjacent the microlenses, are also disclosed.

A light valve such as an active matrix LCD between crossed polarizers, utilizing, for instance, individual transistors to control each "pixel area" of the LCD and storage elements to store video signal data for each pixel, with optically shielded "dead spaces" between pixels to eliminate electric field cross-talk and non-information-bearing light bleed-through, is illuminated with a bright independent light source which creates a video image projected via specialized projection optics onto an internal or external screen without distortions, regardless of the angle of projection onto the screen. Use of heat sinks, IR reflective coatings, heat absorbing optics, optional fluid and a thermistor controlled pixel transistor bias voltage injection servo circuit stabilizes image performance, maintaining accurate color and contrast levels as the LCD changes temperature. In one embodiment of the invention, use of a multi-color LCD with a stepped cavity, producing different thicknesses of LCD for the different wavelengths that pass through it, allows a linear correspondence between the wavelengths passing through the LCD to produce true black, high contrast and CRT-like color rendition. A dichroic mirror arrangement is used to overlap differently colored pixels in the projected image. Use of striped mirrors duplicate pixels, where necessary, eliminating spaces between pixels, creating a continuous image with no apparent stripes or dots. A special venetian-blind type of screen is also disclosed and methods for using the system to view three-dimensional video are also explained.

A color wheel assembly for use in a projector for stereoscopic imaging. The color wheel assembly includes a first portion able to polarize light in a first orientation and a second portion able to polarize light in a second orientation. The first and second portions allow the color wheel assembly, when in an image projector, to produce separate polarized images to achieve a stereoscopic image.