182 results about "Multiple viewpoint" patented technology

Methods and apparatus for defining a view path through at least one wide-angle video stream and for creation of a resultant unwarped video stream responsive to the view path. Aspects of the invention allow an operator to monitor the wide-angle video stream(s) and select which portion of the wide-angle frame to unwarp in real-time. Further, the operator can stop the playback of the wide-angle video stream and dwell within a particular wide-angle frame to create special effects such as camera tilt, pan and zoom operations in a stop action situation.

A device for rendering to multiple viewpoints of a stereoscopic display is provided. The device includes vertex shaders which receive vertices corresponding to primitives and process viewpoint dependent information. The device also includes a primitive replication unit which replicates primitives according to a number of viewpoints supported by the stereoscopic display. The primitive replication unit adds unique view tags to each of the primitives which identify the viewpoint that the respective primitive is destined for. Each replicated primitive is processed by a rasterizer and converted into pixels. The rasterizer adds a view tag to the rasterized pixels so that the pixels identify a respective primitive and identify a respective pixel buffer that the pixel is destined for. The pixels can then be processed by a pixel processing unit and written to a pixel buffer corresponding to a respective viewpoint. The pixels are subsequently output to the stereoscopic display.

The invention discloses a method for acquiring a range image by stereo matching of multi-aperture photographing based on color segmentation. The method comprises the following steps of: (1) carrying out image correction on all input images; (2) carrying out the color segmentation on a reference image, and extracting an area with consistent color in the reference image; (3) respectively carrying out local window matching on the multiple input images to obtain multiple parallax images; (4) removing mismatched points which are generated during the matching by applying a bilateral matching strategy; (5) synthesizing the multiple parallax images into a parallax image, and filling parallax information of the mismatched points; (6) carrying out post-treatment optimization on the parallax image to obtain a dense parallax image; and (7) converting the parallax image into a range image according to the relationship between parallax and depth. By acquiring range information from multiple viewpoint images and utilizing image information provided by the multiple viewpoint images, the invention can not only solve the problem of mismatching brought by periodic repetitive textural features and shelter and the like in the images, but also can improve matching precision and obtain an accurate range image.

A system is disclosed that provides a goal based learning system utilizing a rule based expert training system to provide a cognitive educational experience. The system provides the user with a simulated environment that presents a training opportunity to understand and solve optimally. Mistakes are noted and remedial educational material presented dynamically to build the necessary skills that a user requires for success in the business endeavor. The system utilizes an artificial intelligence engine driving individualized and dynamic feedback with synchronized audio, video, graphics and animation used to simulate real-world environment and interactions. Multiple “correct” answers are integrated into the learning system to allow individualized learning experiences in which navigation through the system is at a pace controlled by the learner. Multiple “roles” are also available for the student to learn from each simulated environment from multiple viewpoints. A robust business model provides support for realistic activities and allows a user to experience real world consequences for their actions and decisions and entails realtime decision-making and synthesis of the educational material. A dynamic feedback system is utilized that narrowly tailors feedback and focuses it based on the performance and characteristics of the student to assist the student in reaching a predefined goal.

An automatic “photo booth” for capturing images of objects including but not limited to motor vehicles provides consistent and rapid image capture from multiple viewpoints. Ultrasonic sensors or other positional sensing devices are used to both position the object with the photo booth enclosure and calculate field of view parameters controlling digital cameras to provide appropriate image scaling / cropping at time of image capture. The enclosure provides automatic entry / exit door opening / closure and a controlled interior space to provide a controlled environment for image capture. Captured images may be rapidly uploaded to a server for electronic distribution over the World Wide Web or other appropriate network.

An automatic “photo booth” for capturing images of objects including but not limited to motor vehicles provides consistent and rapid image capture from multiple viewpoints. Ultrasonic sensors or other positional sensing devices are used to both position the object with the photo booth enclosure and calculate field of view parameters controlling digital cameras to provide appropriate image scaling / cropping at time of image capture. The enclosure provides automatic entry / exit door opening / closure and a controlled interior space to provide a controlled environment for image capture. Captured images may be rapidly uploaded to a server for electronic distribution over the World Wide Web or other appropriate network.

An image processing device includes a viewpoint separating unit configured to separate multi-viewpoint image data, including images of multiple viewpoints and representing intensity distribution of light and the direction of travel of light according to positions and pixel values of pixels, into a plurality of single-viewpoint image data for each of the individual viewpoints; and a parallax control unit configured to control amount of parallax between the plurality of single-viewpoint image data obtained by separation into individual viewpoints by the viewpoint separating unit.

A method models a three-dimensional object by first acquiring alpha mattes of the object for multiple viewpoints. The alpha mattes are then projected onto a surface hull completely enclosing the object to construct an opacity hull storing opacity values of the surface of the object. The object is illuminated for various lighting conditions while images are acquired. The images are projected onto the opacity hull to render the object under arbitrary lighting conditions for arbitrary viewpoints.

In the case of a conventional image apparatus that generates refocus image on the occasion of image display, there is a waiting time because the image apparatus generates the refocus image in response to an operation of a user and requires the time to generate the refocus image. To address this situation, an image apparatus determines ranks of targets to be in focus based on history information indicating operation history, and generates sequentially combined image data from multi-viewpoint image data obtained by capturing images from multiple viewpoints, by focusing on the targets in accordance with the determined ranks.

Video data may be extremely useful in online property commerce. However, the current methods of handling this video data fail to provide users of the data with effective and convenient ways of conveying and consolidating footage of multiple viewpoints and other property features. Among other things, embodiments of the invention address these failures by providing methods and systems for better handling of video data for property marketing, reporting, and analysis.

A target-viewpoint position in a first-medical-image having multiple viewpoints is determined. Information about an anatomical structure and / or a lesion in the first-medical-image is obtained, as first information. Further, information about an anatomical structure and / or a lesion in a finding with respect to at least one second-medical-image of the same examined person as the first-medical-image, the information being related to the first information, is obtained, as second information, from image-reading-report information including the finding. Each of the at least one second-medical-image has multiple viewpoints, and was obtained at different time from the first-medical-image. The image-reading-report information is correlated with an image of a viewpoint position at which the finding was prepared. An image of a corresponding viewpoint position, which corresponds to the target-viewpoint position, is determined based on the viewpoint position of the image correlated with the image-reading-report information from which the second information has been obtained.

Methods and apparatus are described for monocular 3D human pose estimation and tracking, which are able to recover poses of people in realistic street conditions captured using a monocular, potentially moving camera. Embodiments of the present invention provide a three-stage process involving estimating (10, 60, 110) a 3D pose of each of the multiple objects using an output of 2D tracking-by detection (50) and 2D viewpoint estimation (46). The present invention provides a sound Bayesian formulation to address the above problems. The present invention can provide articulated 3D tracking in realistic street conditions.The present invention provides methods and apparatus for people detection and 2D pose estimation combined with a dynamic motion prior. The present invention provides not only 2D pose estimation for people in side views, it goes beyond this by estimating poses in 3D from multiple viewpoints. The estimation of poses is done in monocular images, and does not require stereo images. Also the present invention does not require detection of characteristic poses of people.

A method for reconstructing a 3D shape model of an object by using multi-view image information, includes: inputting multi-view images obtained by photographing the object from multiple viewpoints in a voxel space, and extracting silhouette information and color information of the multi-view images; reconstructing visual hulls by silhouette intersection using the silhouette information; and approximating polygons of cross-sections of the visual hulls to a natural geometric shape of the object by using the color information. Further, the method includes expressing a 3D geometric shape of the object by connecting the approximated polygons to create a mesh structure; extracting color textures of a surface of the object by projecting meshes of the mesh structure to the multi-view image; and creating a 3D shape model by modeling natural shape information and surface color information of the object.

Methods and apparatus for mapping images obtained using a multiple-viewpoint imaging system are disclosed. According to one aspect of the present invention, a method for projecting an image using a panoramic imaging device which includes a first camera includes selecting a single viewpoint that is near a plurality of virtual viewpoints associated with the device. Once the single viewpoint is selected, an optical ray which intersects a surface of the device at a first angle is selected from the plurality of optical rays. The optical ray is then moved or otherwise displaced so that it intersects the single viewpoint while substantially maintaining the first angle. Once the optical ray is displaced, an image is formed using the displaced optical ray to create a reprojection from the single viewpoint. In one embodiment, the panoramic imaging device includes a spherical mirror, and the first camera includes a perspective lens. By reprojecting an image from a single viewpoint, the distortion associated with a multiple-viewpoint system may be reduced.

A multiview face capture system may acquire detailed facial geometry with high resolution diffuse and specular photometric information from multiple viewpoints. A lighting system may illuminate a face with polarized light from multiple directions. The light may be polarized substantially parallel to a reference axis during a parallel polarization mode of operation and substantially perpendicular to the reference axis during a perpendicular polarization mode of operation. Multiple cameras may each capture an image of the face along a materially different optical axis and have a linear polarizer configured to polarize light traveling along its optical axis in a direction that is substantially parallel to the reference axis. A controller may cause each of the cameras to capture an image of the face while the lighting system is in the parallel polarization mode of operation and again while the lighting system is in the perpendicular polarization mode of operation.

To provide a summary of a search result in an associative search system based on multiple viewpoints. By indexing one document database in plural ways, a summary of a search result can be displayed from multiple viewpoints. By managing documents in indexed versions of the document database by common identifiers, summaries of a document set obtained as a search result can be created using the different indexes.

Systems and methods for tracking human hands by performing parts based template matching using images captured from multiple viewpoints are described. One embodiment includes a processor, a reference camera, an alternate view camera, and memory containing: a hand tracking application; and a plurality of edge feature templates that are rotated and scaled versions of a finger template that includes an edge features template. In addition, the hand tracking application configures the processor to: detect at least one candidate finger in a reference frame, where each candidate finger is a grouping of pixels identified by searching the reference frame for a grouping of pixels that have image gradient orientations that match one of the plurality of edge feature templates; and verify the correct detection of a candidate finger in the reference frame by locating a grouping of pixels in an alternate view frame that correspond to the candidate finger.

An image signal encoding unit 107 generates image encoded data by encoding a plurality of images from multiple viewpoints different from each other. A depth information encoding unit (e.g., a depth signal encoding unit 108) generates depth information encoded data by encoding depth information that indicates the depth of a specific space from at least one viewpoint. A unitization unit 109 generates an encoded stream including the image encoded data and depth information encoded data, which are respectively generated by the image signal encoding unit 107 and the depth information encoding unit.

A method and apparatus for digital video capturing and compression supports multi-viewpoint interactive video applications. Multiple (typically hundreds of) video cameras centripetally placed in a three dimensional space acquire real-time visual pictures of the same 3D scene from multiple viewpoints at the rate of 20˜30 frames per second (fps). Parallel Multi-Viewpoint Video Capturing and Compression (PMVCC) supports the operation of the apparatus. In an exemplary realization, a Multi-DSP Array (MDA) architecture uses hundreds of high-performance digital signal processors (DSPs) working in parallel to obtain a sustained computation power of hundreds of GIPS (Giga Instructions Per Second).

Various embodiments of the present disclosure relate generally to systems and methods for generating multi-view interactive digital media representations in a virtual reality environment. According to particular embodiments, a plurality of images is fused into a first content model and a first context model, both of which include multi-view interactive digital media representations of objects. Next, a virtual reality environment is generated using the first content model and the first context model. The virtual reality environment includes a first layer and a second layer. The user can navigate through and within the virtual reality environment to switch between multiple viewpoints of the content model via corresponding physical movements. The first layer includes the first content model and the second layer includes a second content model and wherein selection of the first layer provides access to the second layer with the second content model.

The invention discloses a multiple viewpoints three-dimensional scene reconstructing method fusing single viewpoint scenario analysis and system thereof. The method includes: multiple viewpoint based information extraction and single viewpoint based information extraction are respectively carried out on the input original image sequence to acquire initial semantic information and geometric information; parameter estimation is carried out based on prior probability model and likelihood probability model according to the initial semantic information and geometric information; and three-dimensional model of the scene in which the original image sequence is located is reconstructed according to the result of parameter estimation. The invention solves the difficult problems that sparse matching is caused by weak texture region and structure of scene is complex in the traditional reconstructing method.

A multi-viewpoint image display device is provided, which includes an image panel including a plurality of pixels configured to be arranged in a plurality of rows and columns, a backlight unit configured to provide light to the image panel, a parallax portion configured to be arranged in front of the image panel, and a mask portion configured to be arranged between the image panel and the backlight unit to partially mask the plurality of pixels. Accordingly, resolution balance can be matched without interference.

A three-dimensional (3D) image display apparatus and method are provided. The 3D image display apparatus includes an image generating unit configured to generate an image, an active optical device configured to change a propagation path of light containing the generated image, and provide the generated image to multiple viewpoints that are located along a first direction parallel to the image generating unit, and a varifocal lens configured to vary a focal position of the generated image along a second direction away from the image generating unit.

A multiple viewpoint endoscope system having a multiple viewpoint camera setup and / or an intelligent or cognitive image control system and display device particularly adapted for localizing internal structures within a cavity or an enclosing structure, such as an animal body, for instance the abdomen of an animal or human, or for localizing a real or synthetic image of such internal structures within an overview image or on an overview 3D model.

Systems and methods for tracking human hands by performing parts based template matching using images captured from multiple viewpoints are described. One embodiment of the invention includes a processor, a reference camera, an alternate view camera, and memory containing: a hand tracking application; and a plurality of edge feature templates that are rotated and scaled versions of a finger template that includes an edge features template. In addition, the hand tracking application configures the processor to: detect at least one candidate finger in a reference frame, where each candidate finger is a grouping of pixels identified by searching the reference frame for a grouping of pixels that have image gradient orientations that match one of the plurality of edge feature templates; and verify the correct detection of a candidate finger in the reference frame by locating a grouping of pixels in an alternate view frame that correspond to the candidate finger.

Various embodiments of the present disclosure relate generally to systems and methods for generating multi-view interactive digital media representations in a virtual reality environment. According to particular embodiments, a plurality of images is fused into a first content model and a first context model, both of which include multi-view interactive digital media representations of objects. Next, a virtual reality environment is generated using the first content model and the first context model. The virtual reality environment includes a first layer and a second layer. The user can navigate through and within the virtual reality environment to switch between multiple viewpoints of the content model via corresponding physical movements. The first layer includes the first content model and the second layer includes a second content model and wherein selection of the first layer provides access to the second layer with the second content model.

The invention puts forward a vehicle video speed measurement method based on a multi-viewpoint camera, and is used for solving the problem of big error of vehicle speed detection since the measurementdistance of a single camera is unstable. The method comprises the following steps that: calibrating a plurality of cameras; carrying out rectification on an image coordinate and a world coordinate; according to multiple viewpoints, positioning a vehicle target; and according to positioning data, measuring the movement distance and the movement speed of the vehicle. By use of the method, through multi-camera calibration, monitoring picture collection and a method based on statistical learning, the target is accurately positioned, vehicle speed is calculated to realize the speed measurement ofthe video, the positioning accuracy of the target vehicle in video collection data is improved, in addition, an inspection missing problem in the single-camera target detection is avoided and reduced,the calculation amount of the image coordinate and the world coordinate is small, the real-time detection of video monitoring can be realized, and an alarm is given. The method is high in measurementand wide in applicable ranges, a situation that single camera detection is not integral can be avoided, and a severe environment is coped.

This technology relates to an image processing device and an image processing method capable of collectively encoding a color image and a depth image of different resolutions.An image frame converting unit converts the resolution of the depth image to the same resolution as that of the color image. An additional information generating unit generates additional information including information to specify the color image, or information to specify the depth image, image frame conversion information indicating an area of a black image included in the depth image, the resolution of which is converted, and resolution information to distinguish whether the resolutions of the color image and the depth image are different from each other. This technology may be applied to the image processing device of images of multiple viewpoints, for example.

Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they preferably use correctly filtered content from multiple viewpoints. The filtered content, however, may not be easily obtained with current stereoscopic production pipelines. The proposed method and system takes a stereoscopic video as an input and converts it to multi-view and filtered video streams that may be used to drive multi-view autostereoscopic displays. The method combines a phase-based video magnification and an interperspective antialiasing into a single filtering process. The whole algorithm is simple and may be efficiently implemented on current GPUs to yield real-time performance. Furthermore, the ability to retarget disparity is naturally supported. The method is robust and works transparent materials, and specularities. The method provides superior results when compared to the state-of-the-art depth-based rendering methods. The method is showcased in the context of a real-time 3D videoconferencing system.