674 results about "Augmented reality systems" patented technology

Systems and methods for dynamically controlling vergence and focus for a see-through head-mounted display (ST-HMD) used as part of an augmented reality (AR) system are disclosed. The ST-HMD (40) allows a user (30) to view left and right images (150L, 150R) through corresponding left and right eyepieces (104L, 104R) so that a single virtual object (150V) based on the right and left images as seen at a real object such as a screen (20). When the user moves relative to the real object, however, the vergence changes and the virtual object does not appear in focus at the real object. Changes in the vergence are compensated by tracking the user's head position with a tracking unit (350) and providing the tracking data to a controller (180). Based on the tracking data and the interpupilary distance (IPD) of the user, the controller calculates the offset (H) needed to be imparted to the images formed in the eyepieces to maintain the vergence of the virtual object at the real object even when the user's position changes relative to the real object.

An augmented reality system comprising: a camera (19) for capturing an image, the camera being movably locatee at a local site, a registering unit (9), generating graphics and registering the generated graphics to the image from the camera, to provide a composite augmented reality image, a display device (5) located at a remote site, physically separated from the local site, for displaying a view comprising the composite augmented reality image, and a communication link (1), for communication of information between the local and the remote site, and a specifying unit (7), for specification of a position and an orientation in the remote site. The registering unit is adapted for registering the generated graphical representation to the image in dependence of the specified position and orientation, and the camera is arranged such that its position and orientation is dependent on the specified position and orientation.

A system, method, and computer program product for automatically combining computer-generated imagery with real-world imagery in a portable electronic device by retrieving, manipulating, and sharing relevant stored videos, preferably in real time. A video is captured with a hand-held device and stored. Metadata including the camera's physical location and orientation is appended to a data stream, along with user input. The server analyzes the data stream and further annotates the metadata, producing a searchable library of videos and metadata. Later, when a camera user generates a new data stream, the linked server analyzes it, identifies relevant material from the library, retrieves the material and tagged information, adjusts it for proper orientation, then renders and superimposes it onto the current camera view so the user views an augmented reality.

System and methods are provided for augmented reality displays for medical and physiological monitoring. Augmented reality user interfaces are virtually pinned to a physical device, a location, or to a patient. An augmented reality position determination process determines the presentation of user interfaces relative to reference positions and reference objects. Detection of gestures causes the augmented reality users interfaces to be updated, such as pinning a user interface to a device, location, or patient. Looking away from an augmented reality user interface causes the user interface to minimize or disappear in an augmented reality display. An augmented reality gesture detection process determines gestures based on captured image data and computer vision techniques performed on the image data.

An augmented reality system, an assembling method for assembling a first set-up component to a second set-up component under the assistance of an augmented reality system, a method for monitoring a set-up component and a method for transmitting data from or to a set-up component are provided. The augmented realty system may capture a variable marker associated with the respective set-up component. The augmented reality system can recognize the location and/or status of the variable marker and thus decide whether the connection between the first and second set-up component is established correctly or not. Further, data can be transmitted by the variable marker monitored by the augmented reality system.

Systems and methods for measuring overlay error in a video-based augmented reality enhanced surgical navigation system are presented. In exemplary embodiments of the present invention the system and method include providing a test object, creating a virtual object which is a computer model of the test object, registering the test object, capturing images of control points on the test object at various positions within an augmented reality system's measurement space, and extracting positions of control points on the test object from the captured images, calculating the positions of the control points in virtual image, and calculating the positional difference of positions of corresponding control points between the respective video and virtual images of the test object. The method and system can further assess if the overlay accuracy meets an acceptable standard. In exemplary embodiments of the present invention a method and system are provided to identify the various sources of error in such systems and assess their effects on system accuracy. In exemplary embodiments of the present invention, after the accuracy of an AR system is determined, the AR system may be used as a tool to evaluate the accuracy of other processes in a given application, such as registration error.

Methods of manufacturing a liquid crystal device including depositing a layer of liquid crystal material on a substrate and imprinting a pattern on the layer of liquid crystal material using an imprint template are disclosed. The liquid crystal material can be jet deposited. The imprint template can include surface relief features, Pancharatnam-Berry Phase Effect (PBPE) structures or diffractive structures. The liquid crystal device manufactured by the methods described herein can be used to manipulate light, such as for beam steering, wavefront shaping, separating wavelengths and/or polarizations, and combining different wavelengths and/or polarizations.

An augmented reality system in which video imagery of a physical environment is combined with video images output by a game engine by the use of a traveling matte which identifies portions of the visible physical environment by techniques such as Computer vision or chroma keying and replaces them with the video images output by the video game engine. The composited imagery of the physical environment and the video game imagery is supplied to a trainee through a headmounted display screen. Additionally, peripheral vision is preserved either by providing complete binocular display to the limits of peripheral vision, or by providing a visual path to the peripheral vision which is matched in luminance to higher resolution augmented reality images provided by the binocular displays. A software/hardware element comprised of a server control station and a controller onboard the trainee performs the modeling, scenario generation, communications, tracking, and metric generation.

Aspects of the present invention relate to methods and systems for a head-worn computer with a content display where the head-worn computer can be changed from an augmented reality system where there is relatively high see-through transmission through the display to a virtual reality system where the is no or relatively little see-through transmission through the display.

A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include capturing an image and spatial data with a body mounted camera and sensor array, receiving input indicating a first anchor surface, calculating parameters with respect to the body mounted camera and displaying a virtual object such that the virtual object appears anchored to the selected first anchor surface. Further rendering operations may include receiving a second input indicating a second anchor surface within the captured image that is different from the first anchor surface, calculating parameters with respect to the second anchor surface and displaying the virtual object such that the virtual object appears anchored to the selected second anchor surface and moved from the first anchor surface.

In an exemplary embodiment, an augmented reality system for traffic control combines data from a plurality of sensors to display, in real time, information about traffic control objects, such as airplanes. The sensors collect data, such as infrared, ultraviolet, and acoustic data. The collected data is weather-independent due to the combination of different sensors. The traffic control objects and their associated data are then displayed visually to the controller regardless of external viewing conditions. The system also responds to the controller's physical gestures or voice commands to select a particular traffic control object for close-up observation or to open a communication channel with the particular traffic control object.

An augmented reality system provides enhanced situational information to personnel located within an environment. A tracking system obtains viewpoint information corresponding to a real-time view of said environment. A processing system receives information from one or more sensors. Information includes sensor location information and status information about the environment and personnel therein. The processing system generates graphics using the sensor location information and the viewpoint information. Graphics include visual representations of said status information. A display displays the generated graphics on a display at a supervisor station that is outside of said environment such that graphics are superimposed on the real-time view.

An augmented reality system with mobile and interactive functions for multiple users includes two major portions: a computer system for handling augmented reality functions, and a user system for each user. The computer system for handling augmented reality functions has very powerful functionality for processing digital image data and transforming the digital image data into a three-dimensional virtual image for each user system. The user system mainly includes a Head-Mounted Display (HMD), a microphone and a PDA. A user can see the virtual image from the HMD and use the microphone or the PDA for communication with other users.

A head mounted device provides an immersive virtual or augmented reality experience for viewing data and enabling collaboration among multiple users. Rendering images in a virtual or augmented reality system may include performing operations for capturing an image of a scene in which a virtual object is to be displayed, recognizing a body part present in the captured image, and adjusting a display of the virtual object based upon the recognized body part. The rendering operations may also include capturing an image with a body mounted camera, capturing spatial data with a body mounted sensor array, recognizing objects within the captured image, determining distances to the recognized objects within the captured image, and displaying the virtual object on a head mounted display.

The present invention relates to a real-time interactive system and method regarding an interactive technology between miniatures in real environment and digital contents in virtual environment, and a recording medium storing a program for performing the method. An exemplary embodiment of the present invention provides a real-time interactive augmented reality system including: an input information acquiring unit acquiring input information for an interaction between real environment and virtual contents in consideration of a planned story; a virtual contents determining unit determining the virtual contents according to the acquired input information; and a matching unit matching the real environment and the virtual contents by using an augmented position of the virtual contents acquired in advance. According to the present invention, an interaction between the real environment and the virtual contents can be implemented without tools, and improved immersive realization can be obtained by augmentation using natural features.

An augmented reality display system includes a pair of variable focus lens elements that sandwich a waveguide stack. One of the lens elements is positioned between the waveguide stack and a user's eye to correct for refractive errors in the focusing of light projected from the waveguide stack to that eye. The lens elements may also be configured to provide appropriate optical power to place displayed virtual content on a desired depth plane. The other lens element is between the ambient environment and the waveguide stack, and is configured to provide optical power to compensate for aberrations in the transmission of ambient light through the waveguide stack and the lens element closest to the eye. In addition, an eye-tracking system monitors the vergence of the user's eyes and automatically and continuously adjusts the optical powers of the pair of lens elements based on the determined vergence of those eyes.

An augmented reality system for integrating video imagery of an actual dental restoration into a computer-implemented display of a model (that represents a preparation, mesial/distal neighbors, and opposing occlusion) that has been generated from a 3D scan of a patient. The 3D scan data may be generated at a dental office remote from a location at which the augmented reality system is implemented. In one embodiment, the 3D scan data is provided to the augmented reality system as a digital impression.

Augmented reality systems and methods for user health analysis. Methods for user health analysis may include collecting data for an initial prediction model and continuing to collect additional data based on one or more data criteria. The methods may further include updating the initial prediction model based on the additional data to produce a revised prediction model or causing an intervention to occur based on the additional data. The data may be collected by a display system including one or more sensors configured to collect user-specific data and a display device configured to present virtual content to a user. The display device may be configured to output light with variable wavefront divergence.

An augmented reality system and method for diagnosing and fixing a fault in a device. A mobile communication device can be operatively connected with a networked rendering device by reading a two-dimensional bar code associated with the rendering device. An image with respect to the rendering device can be captured by an image-capturing unit associated with the mobile communication device. The image can be augmented with additional information and a target area can be highlighted in order to indicate a fault component. An action to be taken with respect to the target area can be displayed on the mobile communication device. Such an approach permits an end user to address the device issue with increased quality of information and accuracy.

A detection method is based on a statistical analysis of the appearance of model patches from all possible viewpoints in the scene, and incorporates 3D geometry during both matching and pose estimation processes. By analyzing the computed probability distribution of the visibility of each patch from different viewpoints, a reliability measure for each patch is estimated. That reliability measure is useful for developing industrial augmented reality applications. Using the method, the pose of complex objects can be estimated efficiently given a single test image. In a fast method to detect objects in a given image or video sequence, a series of hierarchical feature descriptors permit balancing between the complexity of feature extraction and cost of combinatorial matching. The feature descriptors are derived from the 3D model of the object of interest along with the available calibrated real-life images or videos. The variability of the real-life images defines the granularity of the feature descriptors.