160 results about "Ar system" patented technology

The present invention relates to an advanced augmented reality, AR, apparatus featuring a video see-through AR, VST-AR, device that captures images of a real-world environment and displays augmented versions on a screen. The system includes a corporal entity, such as an empty laboratory vessel, equipped with a unique identification marker. This marker provides real-time spatial data for generating visual augmentations representing virtual matter within the vessel. The apparatus integrates various sensors, including an inertial measurement unit, IMU, capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass, ERM, motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components. This AR system is particularly valuable for educational and laboratory settings, offering realistic, interactive simulations.

The invention discloses an online fire-fighting training simulation training system and a training method thereof. The system comprises a sensing module, a virtual environment module, an interaction and feedback module and a learning recording and suggestion module. According to the invention, multiple sensory experiences such as smell, temperature, wind feeling and the like are comprehensively introduced into fire-fighting simulation training, the limitation that a traditional VR / AR system purely depends on vision and hearing is broken, the sense of reality and immersion of training are greatly improved, and the coping ability of students in a real fire scene is effectively improved; the state of a trainee is analyzed in real time through an AI algorithm, a self-adaptive threshold intervention mechanism is combined, a virtual AI coach can provide dynamic and personalized guidance in different training scenes, and intelligent intervention based on real-time data greatly improves the fire-fighting training effect; the system not only pays attention to the short-term training effect of the student, but also makes a personalized continuous learning plan through the learning recording and suggestion module, and promotes the long-term progress of the student.

Disclosed herein is an augmented reality (AR) system that provides information about purchasing alternatives to a user who is about to purchase an item or product (e.g., a target product) in a physical retail location. In some variations, offers to purchase the product and / or an alternative product are provided by the merchant and / or competitors via the AR system. An offer negotiation server (ONS) aggregates offer data provided various external parties (EPs) and displays these offers to the user as the user is considering the purchase of a target product. In some variations, an AR system may be configured to facilitate the process of purchasing items at a retail location.

An augmented reality (AR) system for generating augmented reality reservation content using an AR computing device and an AR display device operated by a user is disclosed. The AR system is configured to receive, from the AR display device, image data, at least one user input, and geolocation data. The AR computing device is configured to process the image data using object recognition and the geolocation of the user to identify at least one object The AR computing device is further configured to communicate with an application programming interface (API) to obtain reservation data associated with the identified at least one object. The AR computing device is further configured to generate AR content associated with the received reservation data. The AR display device is configured to display the AR content on a display screen of the AR display device.

An AR system enables creation and viewing of AR content for sharing of information relating to a physical environment. The AR environment may include one or more virtual objects, which may be pinned to specific locations in the real-world physical environment. The virtual objects may provide information (or access to such information) relating to the object or region of interest. To create pinned virtual objects, the AR system maps a localized physical space and enables tracking of an AR device with respect to the mapped physical space. The AR device may then be physically positioned at the desired location in the physical space and a pinning action may be initiated to generate a pinned virtual object associated with the selected position.

A gesture-based text input user interface for an augmented reality (AR) device is provided. The AR system detects a start text input gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides the virtual keyboard user interface to the user. The AR system determines a user's selection of one or more selected virtual keys of the plurality of virtual keys using the one or more camera devices, and generates input text data based on the one or more selected virtual keys. The AR system provides input text data to a user using a display of the AR system.

The disclosure relates to a medical AR system (1) for intraoperative planning with a movable visualization unit (2) whose position and orientation are adjustable, and which creates and digitally provides a real-time image (18) of the patient (7), in particular an intracorporeal image, a visual display device (10) and a navigation system (6) with a data provisioning unit which digitally provides stored preoperative 3D images of the patient (7), wherein the navigation system (6) is adapted to capture a position and orientation of the visualization unit (2) in a global coordinate system relative to the registered patient (7).The medical AR system (1) further comprises a control unit (12) adapted to generate a section plane in relation to the position and orientation of the visualization unit (2), to generate a section view (16) of the preoperatively generated 3D images of the patient (7) based on the section plane, to generate an AR overlay display (14) with the current image (18) and the generated section view (16) of the 3D image data, and to output this display via the visual display device (10). The disclosure also relates to an intraoperative planning method as well as a computer-readable storage medium and computer program according to the dependent claims.

The present invention relates to an augmented reality system (AR system) for teaching a user of an application. The AR system comprises a detection unit that detects a real environment and provides it as environmental data, wherein at least one work unit is arranged in the environment; a communication unit that receives process data from the work unit; a control unit that processes the process data and environmental data, wherein a virtual image can be created based on the process data; and a display unit that displays the real environment and the virtual image in relation to one another to a user. The AR system further comprises an audio output unit that, on the basis of the process data, outputs audio signals for instructing a user, wherein the audio signals are preferably matched to the virtual image.

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An AR system for a spectator event involving moving participants in a real space, each participant having a participant field of view of said real space through a screen, said spectator event involving cameras, each camera having a camera field of view of said real space, said AR system comprising: (a) a computer presentation system for generating virtual space corresponding to said real space and a virtual object in said virtual space; (b) a participant display configured to overlay an image of a portion of said virtual space corresponding to said participant field of view of said real space on said field of view of said real space for each participant; and (c) a spectator display configured overlay an image of a portion of said virtual space corresponding to said camera field of view of said real space on said camera field of view of said real space.

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.

An Augmented Reality (AR) system is provided. The AR system generates a text scene object including virtual text objects based on a text and detect a text selection gesture made by a user of the AR system. The AR system generates a selection line based on a landmark of the user's hand. The AR system detects a confirmation gesture made by the user and sets a text selection start point at an intersection of the selection line with a start virtual text object of the one or more virtual text objects. The AR system detects a subsequent confirmation gesture made by the user, sets a text selection end point, and selects selected text from the text based on the text selection start point and the text selection end point.

A hand tracking input pipeline adjustment system for an AR system is provided. The AR system deactivates the hand tracking input pipeline and places camera components of the hand tracking input pipeline in a limited mode of operation. The AR system uses the camera component to detect initiation of a gesture by a user of the AR system, and in response to detecting the initiation of the gesture, the AR system activates a hand tracking input pipeline and places the camera component in a full operating mode.

The present disclosure pertains to an information processing device and an information processing method that make it possible to improve operability with respect to a 3D object. An axis posture determination unit determines a posture of an adjustment axis serving as a reference for performing adjustment processing on a 3D object disposed in a three-dimensional space of a computer graph to be superimposed on a real space, based on a posture of a user's finger, and modifies and fixes the posture of the adjustment axis. The adjustment processing unit performs adjustment processing on the 3D object in response to an operation by a user in accordance with an axial direction of the adjustment shaft whose posture has been fixed. The present technology can be applied, for example, to an AR system for displaying a 3D object superimposed on a real space.

The invention relates to the technical field of colored drawing systems, and discloses an intelligent wall surface colored drawing system and method based on multi-modal fusion positioning, and the system comprises the following components: a module M1 and an intelligent base station array; the module M2 is an AR intelligent operation system; the module M3 is a cloud management platform; a module M4 which is a multi-modal fusion positioning model; the method comprises the following steps: S1, in an initialization stage, scanning a wall surface through an intelligent base station array; s2, in a path planning stage, the cloud platform analyzes the colored drawing scheme data; s3, in a real-time operation stage, the AR system calculates the pose in real time through a multi-mode fusion positioning model; and S4, a quality control stage. According to the invention, real-time high-precision pose calculation is realized, and a spraying track is generated based on a wall point cloud map through a dynamic path planning module; and the system can compensate the angle error of the mechanical arm joint in real time, so that the problem of deviation of a complex wall surface spraying track is effectively solved.

The invention relates to the technical field of medical training, and discloses a lumbar puncture simulation teaching system based on an AR technology, and the system comprises an AR content generation module which collects a lumbar medical image and carries out the tissue segmentation and focus recognition; performing three-dimensional geometric modeling based on the tissue segmentation result and the focus recognition result to generate a lumbar vertebra 3D model; the AR display interaction module develops an interaction function of the lumbar vertebra 3D model by using a Unity platform and AR equipment; interactive operation of the user is monitored, and feedback is conducted in real time; and the operation evaluation module is used for evaluating the interaction operation of the user and assigning an improvement suggestion according to an evaluation result. A three-dimensional visual scene is constructed through the AR technology, a user can observe the needle inserting process from different angles according to the complex anatomical structure of the lumbar vertebra part, and dynamic effects such as cerebrospinal fluid pressure change are simulated; in the lumbar puncture simulation training, the AR system can feed back operation data in real time, such as the needle inserting angle, the puncture strength and the puncture depth, and the user is helped to accurately master operation skills.

A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and / or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and / or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.

A text entry process for an Augmented Reality (AR) system. The AR system detects, using one or more cameras of the AR system, a start text entry gesture made by a user of the AR system. During text entry, the AR system detects, using the one or more cameras, a symbol corresponding to a fingerspelling sign made by the user. The AR system generates entered text data based on the symbol and provides text in a text scene component of an AR overlay provided by the AR system to the user based on the entered text data.

A gesture-based text entry user interface for an Augmented Reality (AR) system is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system detects a hold of an enter text gesture made by the user. While the user holds the enter text gesture, the AR system collects continuous motion gesture data of a continuous motion as the user makes the continuous motion through the virtual keys of the virtual keyboard. The AR system detects a release of the enter text gesture by the user and generates entered text data based on the continuous motion gesture data.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention discloses a three-dimensional notation coding method and system based on spatio-temporal data fusion, and belongs to the technical field of data fusion, and the method comprises the steps: collecting geographic coordinates and environment voiceprints through Beidou, GPS positioning and COMSOL acoustic modeling, and constructing a sound-space correlation model; through OpenPose and MEMS sensors, limb motions, vocal organ motions and foot stamping intensity parameters are quantified, digital conversion of body memory is completed, and a three-dimensional music score visualization framework is constructed through AR and VR systems; the AR system uses the scanning mark as an interaction entrance, body movement guidance of the Shaanbei folk song and a stage movement design visual interface are matched through a space positioning technology, and dynamic association of a performer and a virtual scene is matched; the VR system generates personalized teaching feedback based on the motion capture data, and optimizes a learning path through real-time data analysis; and the virtual human model inputs action parameters of a three-dimensional notation method to realize automatic performance of non-peoples and folk songs.

An object is to provide an eye image acquisition system that is mounted on a VR system, an AR system, or the like and where a reduction in size can be achieved and a structure is also simple. The eye image acquisition system includes: an infrared source that emits infrared light to an eyeball of a user; a light guide unit that guides the infrared light emitted from the infrared source and reflected from the eyeball; an emission element that emits the infrared light guided in the light guide unit from the light guide unit; an imaging unit that images the infrared light emitted from the light guide unit; and a reflection element that reflects the infrared light emitted from the infrared source and reflected from the eyeball and collimates the reflected light to guide the collimated infrared light in the light guide unit.

An augment reality (AR) system captures an image of a physical environment. The AR system identifies an object in the captured image to serve as an anchor point. The AR system calculates a distance between the identified object and an AR display device that comprises left and right displays. The AR system identifying a virtual object associated with the anchor point. The AR system then generates for simultaneous display: (a) a first separate image of the virtual object on the left display of the AR device, and (b) a second separate image of the virtual object on the right display of the AR device, such that apparent distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated distance between the identified object and the AR display device.

An Augmented Reality (AR) system is provided. The AR system generates a text scene object including virtual text objects based on a text and detect a text selection gesture made by a user of the AR system. The AR system generates a selection line based on a landmark of the user's hand. The AR system detects a confirmation gesture made by the user and sets a text selection start point at an intersection of the selection line with a start virtual text object of the one or more virtual text objects. The AR system detects a subsequent confirmation gesture made by the user, sets a text selection end point, and selects selected text from the text based on the text selection start point and the text selection end point.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention provides a color characterization method for an optical perspective augmented reality system, and the method comprises the steps: carrying out the full-view-field measurement of different environment illumination conditions and OST AR virtual stimulation colors, building a mathematic relation between a virtual display color which should be outputted by AR display, a human eye perception color, and ambient light, and enabling the mathematic relation to describe the color characterization of the virtual display color under different illumination conditions. According to AR display, how to adjust own color output is used for compensating the influence of ambient light on final perception colors, so that the accuracy and consistency of color reproduction are improved; that is to say, the nonlinear influence of the ambient light on the AR virtual display content is corrected through the nonlinear mixed compensation model of the ambient light measurement and the OST AR virtual stimulation color, and the human eye perception color deviation of the OST AR equipment in the complex illumination environment is corrected. The color consistency of OST AR display in an illumination environment and the color rendition capability of an OST AR system under different illumination conditions are improved, and a more natural virtual-real fusion effect is achieved.

The present invention discloses a mixed reality system comprising a display and an optical system that projects the image into a viewer's eye where the display is convex or a concave optical component. The display may further be comprising of smaller displays bunched together to create optical functions. In addition, the display pixels of further comprise of sub-pixels.

A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.

The invention discloses a real-time display method and device for an electric power underground concealed project based on AR glasses. The method comprises the following steps: acquiring an RTK geographic positioning coordinate through an RTK positioning module integrated with the AR glasses; constructing a coordinate conversion relation through an RTK geographic positioning coordinate, an AR system coordinate and an AR geographic due north correction angle theta; extracting a geographic coordinate set of the target model from the underground engineering model database, and establishing a relative position mapping relation from the geographic coordinates of the model to the current RTK coordinate system; based on the established coordinate conversion relation, converting the geographic coordinates of the underground engineering model into relative coordinates under the coordinate system of the AR system; and dynamically binding the calculated relative coordinates to a physical space through a visual tracking module of AR glasses, and generating an underground model holographic image consistent with the perspective relationship of a real earth surface scene. The method aims at achieving high-precision and stable visualization of the three-dimensional model of the electric power underground hidden project and improving the safety level of electric power inspection and construction.