114 results about "Ar system" patented technology

The present invention relates to an advanced augmented reality, AR, apparatus featuring a video see-through AR, VST-AR, device that captures images of a real-world environment and displays augmented versions on a screen. The system includes a corporal entity, such as an empty laboratory vessel, equipped with a unique identification marker. This marker provides real-time spatial data for generating visual augmentations representing virtual matter within the vessel. The apparatus integrates various sensors, including an inertial measurement unit, IMU, capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass, ERM, motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components. This AR system is particularly valuable for educational and laboratory settings, offering realistic, interactive simulations.

The present invention relates to an augmented reality system (AR system) for teaching a user of an application. The AR system comprises a detection unit that detects a real environment and provides it as environmental data, wherein at least one work unit is arranged in the environment; a communication unit that receives process data from the work unit; a control unit that processes the process data and environmental data, wherein a virtual image can be created based on the process data; and a display unit that displays the real environment and the virtual image in relation to one another to a user. The AR system further comprises an audio output unit that, on the basis of the process data, outputs audio signals for instructing a user, wherein the audio signals are preferably matched to the virtual image.

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An AR system for a spectator event involving moving participants in a real space, each participant having a participant field of view of said real space through a screen, said spectator event involving cameras, each camera having a camera field of view of said real space, said AR system comprising: (a) a computer presentation system for generating virtual space corresponding to said real space and a virtual object in said virtual space; (b) a participant display configured to overlay an image of a portion of said virtual space corresponding to said participant field of view of said real space on said field of view of said real space for each participant; and (c) a spectator display configured overlay an image of a portion of said virtual space corresponding to said camera field of view of said real space on said camera field of view of said real space.

An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

An Augmented Reality (AR) system is provided. The AR system generates a text scene object including virtual text objects based on a text and detect a text selection gesture made by a user of the AR system. The AR system generates a selection line based on a landmark of the user's hand. The AR system detects a confirmation gesture made by the user and sets a text selection start point at an intersection of the selection line with a start virtual text object of the one or more virtual text objects. The AR system detects a subsequent confirmation gesture made by the user, sets a text selection end point, and selects selected text from the text based on the text selection start point and the text selection end point.

The invention relates to the technical field of colored drawing systems, and discloses an intelligent wall surface colored drawing system and method based on multi-modal fusion positioning, and the system comprises the following components: a module M1 and an intelligent base station array; the module M2 is an AR intelligent operation system; the module M3 is a cloud management platform; a module M4 which is a multi-modal fusion positioning model; the method comprises the following steps: S1, in an initialization stage, scanning a wall surface through an intelligent base station array; s2, in a path planning stage, the cloud platform analyzes the colored drawing scheme data; s3, in a real-time operation stage, the AR system calculates the pose in real time through a multi-mode fusion positioning model; and S4, a quality control stage. According to the invention, real-time high-precision pose calculation is realized, and a spraying track is generated based on a wall point cloud map through a dynamic path planning module; and the system can compensate the angle error of the mechanical arm joint in real time, so that the problem of deviation of a complex wall surface spraying track is effectively solved.

The invention relates to the technical field of medical training, and discloses a lumbar puncture simulation teaching system based on an AR technology, and the system comprises an AR content generation module which collects a lumbar medical image and carries out the tissue segmentation and focus recognition; performing three-dimensional geometric modeling based on the tissue segmentation result and the focus recognition result to generate a lumbar vertebra 3D model; the AR display interaction module develops an interaction function of the lumbar vertebra 3D model by using a Unity platform and AR equipment; interactive operation of the user is monitored, and feedback is conducted in real time; and the operation evaluation module is used for evaluating the interaction operation of the user and assigning an improvement suggestion according to an evaluation result. A three-dimensional visual scene is constructed through the AR technology, a user can observe the needle inserting process from different angles according to the complex anatomical structure of the lumbar vertebra part, and dynamic effects such as cerebrospinal fluid pressure change are simulated; in the lumbar puncture simulation training, the AR system can feed back operation data in real time, such as the needle inserting angle, the puncture strength and the puncture depth, and the user is helped to accurately master operation skills.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention discloses a three-dimensional notation coding method and system based on spatio-temporal data fusion, and belongs to the technical field of data fusion, and the method comprises the steps: collecting geographic coordinates and environment voiceprints through Beidou, GPS positioning and COMSOL acoustic modeling, and constructing a sound-space correlation model; through OpenPose and MEMS sensors, limb motions, vocal organ motions and foot stamping intensity parameters are quantified, digital conversion of body memory is completed, and a three-dimensional music score visualization framework is constructed through AR and VR systems; the AR system uses the scanning mark as an interaction entrance, body movement guidance of the Shaanbei folk song and a stage movement design visual interface are matched through a space positioning technology, and dynamic association of a performer and a virtual scene is matched; the VR system generates personalized teaching feedback based on the motion capture data, and optimizes a learning path through real-time data analysis; and the virtual human model inputs action parameters of a three-dimensional notation method to realize automatic performance of non-peoples and folk songs.

An object is to provide an eye image acquisition system that is mounted on a VR system, an AR system, or the like and where a reduction in size can be achieved and a structure is also simple. The eye image acquisition system includes: an infrared source that emits infrared light to an eyeball of a user; a light guide unit that guides the infrared light emitted from the infrared source and reflected from the eyeball; an emission element that emits the infrared light guided in the light guide unit from the light guide unit; an imaging unit that images the infrared light emitted from the light guide unit; and a reflection element that reflects the infrared light emitted from the infrared source and reflected from the eyeball and collimates the reflected light to guide the collimated infrared light in the light guide unit.

An augment reality (AR) system captures an image of a physical environment. The AR system identifies an object in the captured image to serve as an anchor point. The AR system calculates a distance between the identified object and an AR display device that comprises left and right displays. The AR system identifying a virtual object associated with the anchor point. The AR system then generates for simultaneous display: (a) a first separate image of the virtual object on the left display of the AR device, and (b) a second separate image of the virtual object on the right display of the AR device, such that apparent distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated distance between the identified object and the AR display device.

An Augmented Reality (AR) system is provided. The AR system generates a text scene object including virtual text objects based on a text and detect a text selection gesture made by a user of the AR system. The AR system generates a selection line based on a landmark of the user's hand. The AR system detects a confirmation gesture made by the user and sets a text selection start point at an intersection of the selection line with a start virtual text object of the one or more virtual text objects. The AR system detects a subsequent confirmation gesture made by the user, sets a text selection end point, and selects selected text from the text based on the text selection start point and the text selection end point.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention provides a color characterization method for an optical perspective augmented reality system, and the method comprises the steps: carrying out the full-view-field measurement of different environment illumination conditions and OST AR virtual stimulation colors, building a mathematic relation between a virtual display color which should be outputted by AR display, a human eye perception color, and ambient light, and enabling the mathematic relation to describe the color characterization of the virtual display color under different illumination conditions. According to AR display, how to adjust own color output is used for compensating the influence of ambient light on final perception colors, so that the accuracy and consistency of color reproduction are improved; that is to say, the nonlinear influence of the ambient light on the AR virtual display content is corrected through the nonlinear mixed compensation model of the ambient light measurement and the OST AR virtual stimulation color, and the human eye perception color deviation of the OST AR equipment in the complex illumination environment is corrected. The color consistency of OST AR display in an illumination environment and the color rendition capability of an OST AR system under different illumination conditions are improved, and a more natural virtual-real fusion effect is achieved.

The present invention discloses a mixed reality system comprising a display and an optical system that projects the image into a viewer's eye where the display is convex or a concave optical component. The display may further be comprising of smaller displays bunched together to create optical functions. In addition, the display pixels of further comprise of sub-pixels.

A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.

The invention discloses a real-time display method and device for an electric power underground concealed project based on AR glasses. The method comprises the following steps: acquiring an RTK geographic positioning coordinate through an RTK positioning module integrated with the AR glasses; constructing a coordinate conversion relation through an RTK geographic positioning coordinate, an AR system coordinate and an AR geographic due north correction angle theta; extracting a geographic coordinate set of the target model from the underground engineering model database, and establishing a relative position mapping relation from the geographic coordinates of the model to the current RTK coordinate system; based on the established coordinate conversion relation, converting the geographic coordinates of the underground engineering model into relative coordinates under the coordinate system of the AR system; and dynamically binding the calculated relative coordinates to a physical space through a visual tracking module of AR glasses, and generating an underground model holographic image consistent with the perspective relationship of a real earth surface scene. The method aims at achieving high-precision and stable visualization of the three-dimensional model of the electric power underground hidden project and improving the safety level of electric power inspection and construction.

This invention discloses an AI-interactive AR (Augmented Reality) cultural wall system for cultural tourism, belonging to the field of AR system technology. The surface of the cultural wall is equipped with a pre-embedded feature set, including visual markers, differentiated texture features, 3D depth variation areas, and specifically designed interactive hotspots. These features provide the system with stable visual benchmarks, semantic distinction criteria, depth cues, and precise positioning anchors. The system includes: a feature point acquisition module, used to collect the feature set on the cultural wall through a multimodal feature extraction algorithm to construct a 3D spatial map with semantic annotations; a user positioning and pose estimation module; an AI content generation engine; and a spatial adaptation and rendering module. Through the cultural wall feature set and the multi-module collaborative system, precise spatial integration of virtual content and the physical wall surface is achieved, along with intelligent dynamic content generation based on user behavior, effectively enhancing the immersion, interactivity, and personalization of the AR cultural experience.

A method, system and product including obtaining a frame from a frame sensor of an Augmented Reality (AR) system comprising an AR device; executing a first skin on the frame or portion thereof to obtain a first overlay; executing a second skin on the frame or portion thereof to obtain a second overlay, wherein the first and second skins are configured to provide an augmented overlay to be used by the AR system in determining an AR view, wherein said executing the second skin is performed without providing the first overlay to the second skin; determining whether the second overlay can be utilized for providing the AR view; generating the AR view based on the first overlay and based on said determining whether the second overlay can be utilized for providing the AR view; and providing the AR view via the AR device.

An augmented reality (AR) system includes a wearable device comprising a display inside the wearable device and operable to display virtual content and an imaging device mounted to the wearable device. The AR system also includes a handheld device comprising handheld fiducials affixed to the handheld device and a computing apparatus configured to perform localization of the handheld device with respect to the wearable device.

The present invention discloses a mixed reality system comprising a display and an optical system that projects the image into a viewer's eye where the display is convex or a concave optical component. The display may further be comprising of smaller displays bunched together to create optical functions. In addition, the display pixels of further comprise of sub-pixels.

A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

The application provides a kind of based on user behavior perception's augmented reality content recommendation and expressive presentation method, including constructing the state representation of multiple virtual roles in augmented reality scene;Joint objective function for evaluating virtual role layout rationality is constructed;According to the attribute information of virtual role, the adaptive weight is generated by the weight prediction model constructed in advance, and the adaptive weight is used to adjust the cost item related to the importance of role in the space cost function;Based on the joint objective function, the position and orientation of all virtual roles are iteratively optimized to obtain an optimized layout;Expressive presentation is carried out in the augmented reality scene The optimized layout is realized in three-dimensional space Automatic optimization of role position and orientation, avoid visual conflict, improve the naturalness, coordination and semantic expression ability of layout, thereby significantly enhance the interactive experience and information transmission effect of AR system.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.

This invention discloses a high-precision gesture tracking method and system based on hand and controller fusion, belonging to the field of virtual reality and augmented reality technology. It addresses the technical problems in existing VR / AR systems, such as unknown extrinsic parameter estimation for hands and controllers, difficulty in tightly coupling low-frequency vision with high-frequency IMU, and self-occlusion issues in handheld states. The method includes: determining the grip state between the controller and hand based on acquired multi-source data; if the grip state is unoccluded or low-occlusion, performing optimal solution calculations under relevant kinematic constraints to obtain the wrist 6-DoF pose; if the grip state is high-occlusion, performing regression mapping processing on the infrared spot data and controller IMU data based on relevant spatiotemporal feature sequences; dynamically switching the gesture tracking between the controller and hand, and outputting the final hand posture data.

A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.

A location-based, multiuser, collaborative augmented reality (AR) system employs individual AR devices for viewing real-world anchors, that is, physical models that are recognizable to the camera and image processing module of the AR device. Multiple, distinct AR sessions can coexist at the same physical site, and those sessions can be offered to AR devices at the site. Session initiators can manage who can join and / or to whom invitations to join are extended. The system permits collaborative AR to span multiple sites, by associating a portal with an anchor at each site. Using the location of their corresponding AR device as a proxy for their position, AR renditions of the other participating users are provided. This AR system is particularly well suited for games.

An augmented reality (AR) node location and activation technique for use in an AR system in a process plant or other field environment quickly and easily detects an AR node in a real-world environment

A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.