37 results about "Augmented reality systems" patented technology

A method, system and product including obtaining a frame from a frame sensor of an Augmented Reality (AR) system comprising an AR device; executing a first skin on the frame or portion thereof to obtain a first overlay; executing a second skin on the frame or portion thereof to obtain a second overlay, wherein the first and second skins are configured to provide an augmented overlay to be used by the AR system in determining an AR view, wherein said executing the second skin is performed without providing the first overlay to the second skin; determining whether the second overlay can be utilized for providing the AR view; generating the AR view based on the first overlay and based on said determining whether the second overlay can be utilized for providing the AR view; and providing the AR view via the AR device.

In one embodiment, a method includes rendering, for one or more displays of a XR display device, a first output image of an XR object within an XR environment in a field of view (FOV) of a first user, where the XR object has a first form, detecting a change in a context of the user with respect to the XR object, determining, based on the detected change in the context of the user, whether to invoke an attention system with respect to the XR object, and rendering, for the one or more displays of the XR display device, a second output image of the XR object responsive to invoking the attention system, where the XR object is morphed to have a second form indicating a first attention state, where the first attention state indicates a status of the XR object to interact with one or more first voice commands.

An image generation system and method for displaying an Augmented Reality “AR” image of a real-world environment having one of more objects located therein and one or more AR objects each corresponding to a respective object, the system comprising: a display on which the image of the real-world environment and the AR objects are displayed; a processing and control module configured to: receive, from one or more sensors, data relating to the real-world environment and objects therein; create the one or more AR objects from the objects by determining additional information relating to the object which is represented by at least one of symbols, annotations and fonts to be attached to the AR object to act as a displayed component: displaying the AR image comprising the real-world image and one or more AR objects; wherein the AR objects once created are stored for future retrieval based on a unique identifier for the AR object which remains active as long as the object is of interest.

An apparatus to analyze and manipulate biofeedback data is described. The apparatus includes a display that renders a simulated environment. The simulated environment is experienced by a user. The simulated environment is generated by a software program executing on a computer. A biofeedback sensor is coupled to the scalp of the user. The biofeedback sensor measures the electrical activity of the brain of the user when the user experiences the simulated environment. The biofeedback sensor generates electrical signals corresponding to the electrical activity such that the user is able to modify the simulated environment by manipulating the electrical activity in the brain.

A method for generating an augmented reality image (ARB), wherein: - a real image (RB) of a real object is captured using a real camera; - an edge image of the real object is generated from the real image (RB) of the real object, wherein the position of a virtual image component (VIRT) relative to the real image (RB) captured by the real camera is determined using the edge image; and - the virtual image component (VIRT) is combined with at least a part of the real image (RB) to form an augmented reality image (ARB), wherein, for markerless tracking of the edge image, - an initialization phase is provided for the initialization of the markerless tracking, in which an initialization edge image (KB) of the real object is generated depending on the pose of the real object from the perspective of the real camera, by - providing a database in which images of the object in different poses are stored.where each image is assigned a pose, - a real initialization image (RB) of the real object is captured using the real camera, whereby the image from the database that is most similar to the initialization image is automatically selected, and - the pose assigned to the selected image from the database is selected to generate the initialization edge image (KB) by transforming the edge image of the real object into the selected pose.

A method for aligning a patient's anatomical features using augmented reality is provided. This includes a system for aligning a patient's anatomical features, comprising an imaging system, a tracking device, an augmented reality system, and a computer system. The imaging system can be configured to image the patient and generate an imaging dataset. The tracking device can be configured to generate a tracking device dataset. The augmented reality system can be configured to display an imaging volume hologram in augmented reality. The computer system can communicate with the augmented reality system, the imaging system, and the tracking device. The computer system can generate an imaging volume dataset based on a first and second axis plane, render the imaging volume dataset into an imaging volume hologram, and project the imaging volume hologram into augmented reality.

An augmented reality system generates computer-mediated reality on a client device. The client device has sensors including a camera configured to capture image data of an environment. The augmented reality system generates a first 3D map of the environment around the client device based on captured image data. The server receives image data captured from a second client device in the environment and generates a second 3D map of the environment. The server links the first and second 3D together in a singular 3D map. The singular 3D map may be a graphical representation of the real world using nodes that represent 3D maps generated by image data captured at client devices and edges that represent transformations between the nodes.

This invention discloses an augmented reality system for remote emergency medical guidance in ambulances based on edge computing, relating to the field of medical emergency information technology. It includes: a digital twin construction module: acquiring a field digital twin space constructed by edge computing nodes deployed within the ambulance, the field digital twin space containing a three-dimensional structural model of the ambulance's interior, personnel location information, and equipment distribution information; and an instruction receiving module: acquiring a first collaborative instruction sent by a remote guidance terminal, the first collaborative instruction containing a sequence of hand gestures performed by a remote expert in a three-dimensional scene. This invention constructs a three-dimensional digital twin space within the ambulance using edge computing nodes, mapping the hand gestures of the remote expert into the digital twin space in real time, enabling the remote expert to convey operational intentions to on-site medical personnel through intuitive gestures.

A method for displaying virtual content to a user, the method includes determining an accommodation of the user's eyes. The method also includes delivering, through a first waveguide of a stack of waveguides, light rays having a first wavefront curvature based at least in part on the determined accommodation, wherein the first wavefront curvature corresponds to a focal distance of the determined accommodation. The method further includes delivering, through a second waveguide of the stack of waveguides, light rays having a second wavefront curvature, the second wavefront curvature associated with a predetermined margin of the focal distance of the determined accommodation.

This invention discloses a fast relocalization method based on tight coupling between sparse semantic anchors and inertial sensing, belonging to the fields of augmented reality and computer vision. It constructs a lightweight sparse semantic map by extracting sparse feature points with stable geometric and semantic attributes from the environment as sparse semantic anchors. When device tracking is unstable or lost, inertial navigation and visual matching threads based on sparse anchors are activated in parallel. The core PnP algorithm is used to quickly recover the visual pose, and the method is tightly coupled with inertial data for optimization, ultimately outputting a high-precision, smooth six-DOF pose. This solves the problem of excessively long relocalization time and experience interruption in traditional visual SLAM scenarios with fast motion and weak textures, achieving millisecond-level, user-unnoticed tracking recovery, significantly improving the robustness and user experience of augmented reality systems.

The application provides a kind of optical perspective augmented reality system color characterization method, by the full field of view measurement of different ambient light conditions and OST AR virtual stimulus color, the mathematical relationship between the virtual display color that AR display should output and human eye perceived color and ambient light is established, the mathematical relationship can describe how AR display adjusts its color output under different light conditions to compensate for the influence of ambient light on the final perceived color, so as to improve the accuracy and consistency of color reproduction, that is, the application aims to correct the nonlinear influence of ambient light on AR virtual display content through the nonlinear mixing compensation model of ambient light measurement and OST AR virtual stimulus color, correct the human eye perceived color deviation of OST AR device under complex lighting environment, improve the color consistency of OST AR display under lighting environment and the color restoration ability of OST AR system under different lighting conditions, realize more natural virtual-real fusion effect.

Managing controller connection, including: determining whether at least one controller is connected to a game system, and performing and repeating the following until transitioned into a one-handed operation or two-handed operation of a user: (a) if more than one controller connection is detected, transitioning into the two-handed operation; (b) if no controller connection is detected, requesting the user to connect the at least one controller; (c) if connection of only a first controller is detected, requesting the user to connect a second controller; (d) if connection of the second controller is not detected, transitioning into the one-handed operation, wherein the transition into the one-handed operation is made after determining and deciding to continue with only the first controller.

Systems and methods provide real-time guidance for a user performing a task by integrating sensor measurements with augmented-reality (AR) presentation. One or more sensors, including external sensors integrated with tools, devices, or packaging, generate measurement data associated with physical quantities. A processor receives the measurement data and, using spatial parameters corresponding to locations associated with the measurements, generates a virtual representation of at least a portion of the user's environment and one or more overlays indicating a status or guidance for one or more areas of the environment. An AR device displays the overlays in spatial registration with the environment to guide the user during task execution. In some embodiments, computer vision and machine-learning inference recognize objects, orientation, or task context to adapt the overlays and guidance.

A method and apparatus to integrate a display subarray into an eyeglass lens is disclosed, where the display subarray includes an emissive array and a reflective optical component that redirects light from the emissive array. In addition, the shield also reflects ambient light. An augmented reality system with an integrated display subarray is also disclosed.

A method of operating an eyepiece waveguide of an augmented reality system includes projecting virtual content using a projector assembly and diffracting the virtual content into the eyepiece waveguide via a first order diffraction. A first portion of the virtual content is clipped to produce a remaining portion of the virtual content. The method also includes propagating the remaining portion of the virtual content in the eyepiece waveguide, outcoupling the remaining portion of the virtual content out of the eyepiece waveguide, and diffracting the virtual content into the eyepiece waveguide via a second order diffraction. A second portion of the virtual content is clipped to produce a complementary portion. The method further includes propagating the complementary portion of the virtual content in the eyepiece waveguide and outcoupling the complementary portion of the virtual content out of the eyepiece waveguide.

A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.

Described herein are embodiments of apparatuses for an augmented reality system wherein a wearable augmented reality apparatus may be constructed to have multiple chambers with circuitry elements that are physically and electrically connected. The embodiments may further include a structure for a circuitry chamber that protects sensitive components from external factors. The embodiments may further include arrangements for subsections and components in a wearable augmented reality apparatus that allow for an overall compliant housing while reducing potential shearing force on embedded components.

Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (mobile phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event. In a tabletop presentation, video of the event can be displayed with augmented reality graphics overlays at a remote location.

Providing virtual and augmented reality systems and methods having improved diffraction grating structures. [Solution] An improved diffraction structure for a 3D display system is disclosed. The improved diffraction structure includes an intermediate layer between a waveguide substrate and an upper grating surface. The upper grating surface comprises a first material corresponding to a first refractive index value, the lower layer comprises a second material corresponding to a second refractive index value, and the substrate comprises a third material corresponding to a third refractive index value. In one embodiment, the waveguide substrate, the lower layer, and the surface grating all correspond to different refractive index values. In one embodiment, the surface grating corresponds to a surface grating refractive index higher than the lower layer diffraction coefficient, and the lower layer diffraction coefficient is higher than the waveguide refractive index.

Embodiments of the present disclosure may include a method for planning and performing an interventional procedure on a patient, the method including steps of providing an augmented reality system, a tracked instrument, a first image acquisition system, a second image acquisition system, and a computer system with a processor and a memory, the tracked instrument having a plurality of sensors to provide a tracked instrument dataset, the first image acquisition system, and the computer system in communication with the augmented reality system, the tracked instrument, the first image acquisition system, and the second image acquisition system. Embodiments may also include acquiring, by the first image acquisition system, the first holographic image dataset from the patient. Embodiments may also include acquiring, by the second image acquisition system, the second holographic image dataset from the patient.

The augmented reality (AR) system includes a display, a camera device, and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera device and configured to receive camera device data from the camera device, wherein, during operation of the AR system, the camera device only sends camera device data to the sandbox system, and wherein the sandbox system includes an execution environment configured to restrict the execution of instructions to a predefined memory address range. The secure data vault system also includes a display and rendering system operatively coupled to the sandbox system and configured to render images based on camera device data processed via instructions and display the images via the display, wherein the display is configured to display both the images and the real-world environment surrounding the AR system.

Embodiments of the present disclosure generally relate to augmented reality systems. More specifically, embodiments described herein provide for a waveguide with at least one ophthalmic lens, an augmented reality system, a method of fabricating waveguides with ophthalmic lenses, and an assembly for fabricating waveguides with ophthalmic lenses are shown and described herein.