40 results about "Ar system" patented technology

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention discloses a real-time display method and device for an electric power underground concealed project based on AR glasses. The method comprises the following steps: acquiring an RTK geographic positioning coordinate through an RTK positioning module integrated with the AR glasses; constructing a coordinate conversion relation through an RTK geographic positioning coordinate, an AR system coordinate and an AR geographic due north correction angle theta; extracting a geographic coordinate set of the target model from the underground engineering model database, and establishing a relative position mapping relation from the geographic coordinates of the model to the current RTK coordinate system; based on the established coordinate conversion relation, converting the geographic coordinates of the underground engineering model into relative coordinates under the coordinate system of the AR system; and dynamically binding the calculated relative coordinates to a physical space through a visual tracking module of AR glasses, and generating an underground model holographic image consistent with the perspective relationship of a real earth surface scene. The method aims at achieving high-precision and stable visualization of the three-dimensional model of the electric power underground hidden project and improving the safety level of electric power inspection and construction.

This invention discloses an AI-interactive AR (Augmented Reality) cultural wall system for cultural tourism, belonging to the field of AR system technology. The surface of the cultural wall is equipped with a pre-embedded feature set, including visual markers, differentiated texture features, 3D depth variation areas, and specifically designed interactive hotspots. These features provide the system with stable visual benchmarks, semantic distinction criteria, depth cues, and precise positioning anchors. The system includes: a feature point acquisition module, used to collect the feature set on the cultural wall through a multimodal feature extraction algorithm to construct a 3D spatial map with semantic annotations; a user positioning and pose estimation module; an AI content generation engine; and a spatial adaptation and rendering module. Through the cultural wall feature set and the multi-module collaborative system, precise spatial integration of virtual content and the physical wall surface is achieved, along with intelligent dynamic content generation based on user behavior, effectively enhancing the immersion, interactivity, and personalization of the AR cultural experience.

A method, system and product including obtaining a frame from a frame sensor of an Augmented Reality (AR) system comprising an AR device; executing a first skin on the frame or portion thereof to obtain a first overlay; executing a second skin on the frame or portion thereof to obtain a second overlay, wherein the first and second skins are configured to provide an augmented overlay to be used by the AR system in determining an AR view, wherein said executing the second skin is performed without providing the first overlay to the second skin; determining whether the second overlay can be utilized for providing the AR view; generating the AR view based on the first overlay and based on said determining whether the second overlay can be utilized for providing the AR view; and providing the AR view via the AR device.

The present invention discloses a mixed reality system comprising a display and an optical system that projects the image into a viewer's eye where the display is convex or a concave optical component. The display may further be comprising of smaller displays bunched together to create optical functions. In addition, the display pixels of further comprise of sub-pixels.

The application provides a kind of based on user behavior perception's augmented reality content recommendation and expressive presentation method, including constructing the state representation of multiple virtual roles in augmented reality scene;Joint objective function for evaluating virtual role layout rationality is constructed;According to the attribute information of virtual role, the adaptive weight is generated by the weight prediction model constructed in advance, and the adaptive weight is used to adjust the cost item related to the importance of role in the space cost function;Based on the joint objective function, the position and orientation of all virtual roles are iteratively optimized to obtain an optimized layout;Expressive presentation is carried out in the augmented reality scene The optimized layout is realized in three-dimensional space Automatic optimization of role position and orientation, avoid visual conflict, improve the naturalness, coordination and semantic expression ability of layout, thereby significantly enhance the interactive experience and information transmission effect of AR system.

This invention discloses a high-precision gesture tracking method and system based on hand and controller fusion, belonging to the field of virtual reality and augmented reality technology. It addresses the technical problems in existing VR / AR systems, such as unknown extrinsic parameter estimation for hands and controllers, difficulty in tightly coupling low-frequency vision with high-frequency IMU, and self-occlusion issues in handheld states. The method includes: determining the grip state between the controller and hand based on acquired multi-source data; if the grip state is unoccluded or low-occlusion, performing optimal solution calculations under relevant kinematic constraints to obtain the wrist 6-DoF pose; if the grip state is high-occlusion, performing regression mapping processing on the infrared spot data and controller IMU data based on relevant spatiotemporal feature sequences; dynamically switching the gesture tracking between the controller and hand, and outputting the final hand posture data.

A hand-tracking platform generates gesture components for use as user inputs into an application of an Augmented Reality (AR) system. In some examples, the hand-tracking platform generates real-world scene environment frame data based on gestures being made by a user of the AR system using a camera component of the AR system. The hand-tracking platform recognizes a gesture component based on the real-world scene environment frame data and generates gesture component data based on the gesture component. The application utilizes the gesture component data as user input in a user interface of the application.

An augmented reality (AR) system includes a wearable device including: a frame, a projector coupled to the frame, a display optically coupled to the projector, and an eye tracking system. The AR system also includes a memory and a processor configured to: receive an eye gaze location from the eye tracking system, generate an image, and generate a foveation map based on the eye gaze location. The foveation map includes a first region of the image and a second region of the image. The processor is also configured to compress the first region of the image using a first quality setting and the second region of the image using a second quality setting. The first quality setting (e.g., a setting of 100%) can be greater than the second quality setting.

The invention provides an augmented reality content recommendation and expressive presentation method based on user behavior perception. The method comprises the following steps: constructing state representations of a plurality of virtual characters in an augmented reality scene; constructing a joint objective function for evaluating the layout rationality of the virtual character; according to the attribute information of the virtual role, generating a self-adaptive weight through a pre-constructed weight prediction model, and using the self-adaptive weight to adjust a cost item related to role importance in the space cost function; based on the joint objective function, performing iterative optimization on the positions and orientations of all the virtual characters to obtain an optimized layout; the optimized layout is expressed and presented in an augmented reality scene, the role position and orientation are automatically optimized in a three-dimensional space, visual conflicts are avoided, and the naturalness, coordination and semantic expression ability of the layout are improved, so that the interactive experience and information transmission effect of an AR system are remarkably enhanced.

Described herein are processes and techniques to identify encrypted content within a field of view of a user of a VR / AR system and to appropriately handle the encrypted content. A user of a VR / AR technology can have protected content within the user's field of view. Encrypted content is mapped to one or more protected surfaces on a display device. Content mapped to a protected surface can be rendered on the display device, but is prevented from being copied from the display device.

The application relates to the technical field of color drawing systems, and discloses an intelligent wall surface color drawing system and method based on multi-modal fusion positioning, which comprises the following components: module M1, an intelligent base station array; module M2, an AR intelligent operation system; module M3, a cloud management platform; and module M4, a multi-modal fusion positioning model; the method comprises the following steps: step S1, an initialization stage, in which the intelligent base station array scans a wall surface; step S2, a path planning stage, in which the cloud platform analyzes color drawing scheme data; step S3, a real-time operation stage, in which the AR system solves a pose in real time through the multi-modal fusion positioning model; and step S4, a quality control stage.The application realizes real-time high-precision pose solving, and generates a spraying track based on a wall surface point cloud map through a dynamic path planning module; the system can compensate for joint angle errors of a mechanical arm in real time, thereby effectively solving the problem that a spraying track deviates from a complex wall surface.

The application provides a kind of optical perspective augmented reality system color characterization method, by the full field of view measurement of different ambient light conditions and OST AR virtual stimulus color, the mathematical relationship between the virtual display color that AR display should output and human eye perceived color and ambient light is established, the mathematical relationship can describe how AR display adjusts its color output under different light conditions to compensate for the influence of ambient light on the final perceived color, so as to improve the accuracy and consistency of color reproduction, that is, the application aims to correct the nonlinear influence of ambient light on AR virtual display content through the nonlinear mixing compensation model of ambient light measurement and OST AR virtual stimulus color, correct the human eye perceived color deviation of OST AR device under complex lighting environment, improve the color consistency of OST AR display under lighting environment and the color restoration ability of OST AR system under different lighting conditions, realize more natural virtual-real fusion effect.

The invention relates to the technical field of AR intelligent glasses, in particular to an AR intelligent glasses system based on brain-like visual processing. The system comprises a visual data acquisition module, a visual feature extraction module, a semantic construction module, a behavior intention prediction module and a visual interaction module. Visual images and environment information are acquired through a multi-mode sensor, and spatial-temporal feature coding is performed through a pulse neural network to generate a brain-like visual feature sequence; constructing a semantic expression vector based on a graph structure method; a comparative learning model is adopted to complete behavior intention prediction; and the visual interaction module generates AR (Augmented Reality) content according to a prediction result, so that real-time interaction presentation is realized. According to the method, multi-modal perception precision, behavior understanding intelligence and interaction personalization enhancement are realized, and the perception, understanding and response capabilities of an AR system in a complex application scene are comprehensively improved.

The invention discloses an AR (Augmented Reality) system cognitive security interaction method based on multi-modal large language model reasoning and bidirectional individuation, which utilizes a cross attention mechanism guided by an inertial measurement unit signal to explicitly model and eliminate electroencephalogram signal motion artifacts, and compared with the existing method of directly using electroencephalogram signals or simple filtering, the method has the advantages that the method is simple and convenient to implement, and the efficiency is high. The anti-interference capability of personalized attention perception is high, attention recognition is more accurate, the distraction moment of the user can be accurately captured, and the false alarm rate is reduced. Besides, personalized preference configuration information is generated through man-machine alignment and is embedded into the reasoning process of the multi-modal large language model, so that the subjective preference of the user to the risk is read, the problem of alarm fatigue is solved, and user trust is established. According to the method, a real agent closed loop is realized, and the method is a complete agent architecture with perception (physiological denoising)-cognition (LLM reasoning combined with preference)-action (self-adaptive interaction), and can adapt to physiological features and psychological preferences of different users.

The application discloses a personnel information management method and device based on an AR system, equipment and a medium, and is used for solving the technical problems that personnel tracking is not real-time and effective, and personnel information management and interaction are not systematic and comprehensive in the current AR scene. The method comprises the following steps: real-time tracking of position information of a target personnel in a monitoring area, and performing coordinate transformation of the position information based on UWB origin alignment to obtain real-time positioning coordinates in an AR terminal coordinate system; extracting a UWB number from the position information, and querying personnel information of the target personnel according to the UWB number; extracting target display information from the personnel information based on the association relationship between the target personnel and personnel bound with the AR terminal; and displaying the target display information in real time on the real-time positioning coordinates of the AR terminal based on the information display priority corresponding to the association relationship.

An augmented reality (AR) system for generating and displaying an enhanced situation visualization (ESV) is provided. The AR system may include an ESV computing device, a user computing device operated by a user and a reference database. The user computing device may transmit a reference request message to the ESV device, the reference request message including an image representative of a current view of a user. The ESV computing device may determine a subject of the image, retrieve reference information associated with the subject from the reference database, and determine situation information specific to the subject. The reference and situation information may be displayed on the user computing device to provide an ESV of the subject. The ESV may be used for insurance-related activities, such as handling, adjusting, and / or generating homeowner's insurance claims, and / or for instructional guidance.

An augmented reality (AR) system is provided, the AR system comprising one or more sensors, storage, one or more communication modules, and one or more processors. The one or more sensors generate sensing data representative of at least a portion of an environment in which the AR system is located. The one or more communication modules transmit positioning data to be used to determine a position and orientation of the AR system. The one or more processors are arranged to: obtain the sensing data representative of the environment in which the AR system is located; process the sensing data to identify a first portion of the sensing data representative of redundant information; derive positioning data, wherein the positioning data is derived from the sensing data and the first portion is obfuscated during derivation of the positioning data; and transmit at least a portion of the positioning data using the one or more communication modules.

The invention discloses an eye movement tracking processing method and system based on real-time prediction, and relates to the technical field of man-machine interaction and computer vision, and the method comprises the steps: collecting an eye movement event flow of an event camera, converting the eye movement event flow into a space-time voxel grid, and extracting motion features and time correlation entropy; fusing the predicted rendering time consumption fed back by the rendering module and the display remaining time, and generating a system state snapshot; carrying out constraint optimization solution, and dynamically determining a prediction target time point and a calculation resource quota; selecting a prediction model from the personalized model pool according to the quota and the eye movement state, and calculating a fixation point coordinate of the target time point; writing the result into a shared buffer area for a rendering thread to use; finally, a prediction error is calculated based on the real fixation point coordinates, online parameter optimization is conducted on the model, the problem that precision and real-time performance cannot be considered at the same time due to the fact that an existing eye movement prediction method is single in model and disjointed with the state of a rendering system is solved, and the visual experience and immersion in a VR / AR system are remarkably improved.

A methodology is described that provides access to an augmented reality (AR) component maintained by a messaging server system directly from a web view application. When a user activates, from a web view application executing in the messaging client, a user selectable element that references an AR component, a web view AR system obtains the identification of the AR component, performs validation of the identification and of any additional launch data, and launches a camera view user interface (UI) with the AR component loaded in the camera view UI. Content captured from the camera view UI can be shared to other computing devices.

The present disclosure relates to a medical AR system (1) for intraoperative planning, having a movable visualization unit (2), the position and orientation of which are settable, and which creates and digitally provides time real-time photographs (18), in particular in vivo photographs, of a patient (7), the medical AR system has a visual presentation device (10) and a navigation system (6) with a data providing unit that digitally provides a stored pre-operative 3D image of a patient (7), in which the navigation system (6) is adapted to detect the position and orientation of the visualization unit (2) in a global coordinate system relative to the registered patient (7). Here, the medical AR system (1) also has a control unit (12) which is adapted to generate a cross-section with respect to the position and orientation of the visualization unit (2), based on which a pre-operatively generated 3D-recorded cross-sectional view (16) of the patient (7) is generated, and to generate a 3D-recorded cross-sectional view (16) of the patient (7) based on the 3D-recorded cross-sectional view (16). An AR overlay presentation (14) is generated using the temporally real-time recording (18) and the generated cross-sectional view (16) of the 3D recording data and is output by the visual presentation device (10). Furthermore, the present disclosure relates to an intra-surgical planning method according to the paratactic claims as well as a computer-readable storage medium and a computer program.

A system state for switching an augmented reality (AR) interface between different display modes, a configuration user interface for input and output devices of an AR system, and methods and AR devices containing such functionality are disclosed. A method of switching an augmented reality (AR) user interface state on an AR head-mounted device. The method includes causing the AR head-mounted device to present a glanded user interface element at a first portion of a display of the AR head-mounted device. The method further includes, in response to a first request from a user of the AR head-mounted device to display the follow-up user interface element, causing the AR head-mounted device to present the follow-up user interface element in a second portion of the display, where the second portion is larger than the first portion. The method further includes, in response to a second request from a user of the AR head-mounted device to display the homepage user interface element, causing the AR head-mounted device to present the homepage user interface element in a third portion of the display, where the third portion is larger than the second portion.

The augmented reality (AR) system includes a display, a camera device, and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera device and configured to receive camera device data from the camera device, wherein, during operation of the AR system, the camera device only sends camera device data to the sandbox system, and wherein the sandbox system includes an execution environment configured to restrict the execution of instructions to a predefined memory address range. The secure data vault system also includes a display and rendering system operatively coupled to the sandbox system and configured to render images based on camera device data processed via instructions and display the images via the display, wherein the display is configured to display both the images and the real-world environment surrounding the AR system.

Interactive experiences are generated using an augmented reality (AR) system that leverages the native input and output capabilities of AR devices to generate immersive and interactive experiences in smart spaces that combine visually-represented programming logic, AR content, and IoT devices. The system connects IoT devices with each other in a native AR environment, provides virtual content and logic gates, scripts sequences and loops of actions, solves visibility issues for IoT devices that are far apart, and designs logic gates and flow circuits that best support user intentions when generating interactive experiences in smart spaces. The interactive experience is produced by generating a program of behaviors of selected IoT devices using logic gates and control circuits connected to the IoT devices in a visual programming interface of the AR device. Once completed, the program of behaviors is executed by a runtime module to control the IoT devices during the interactive experience.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.

A method of switching between augmented-reality (AR) user interface states at an AR headset. The method includes, causing the AR headset to present a glance user interface element at a first portion of a display of the AR headset. The method further includes, in response to a first request from a user of the AR headset to display a follow user interface element, causing the AR headset to present the follow user interface element at a second portion of the display, wherein the second portion is larger than the third portion. The method further includes, in response to a second request from the user of the AR headset to display a home user interface element, causing the AR headset to present the home user interface element at a third portion of the display, wherein the third portion is larger than the second portion.

The application relates to resource allocation, in particular to an AR multi-task resource allocation optimization method, which determines the types and total amount of available resources in an AR system, collects task information of resources to be allocated, determines a solution space, a target function and a constraint condition of multi-task resource allocation optimization, constructs a resource allocation optimization model, adopts an adaptive dynamic balance of a loach and a pike optimization algorithm to solve the resource allocation optimization model, obtains an optimal resource allocation scheme, and applies the optimal resource allocation scheme to the AR system to realize efficient allocation of multi-task resources; the technical scheme provided by the application can effectively overcome the defects that the prior art cannot realize reasonable, accurate and efficient allocation of multi-task resources in the AR system.

This invention proposes a method for assisting engineering measurement and verification based on BIM models and AR systems. The method includes: establishing a BIM model using BIM software; collaborating the BIM model with an AR system; scanning the real-world scene using the AR system and aligning and overlaying the BIM model with the scene using reference points; generating a 3D image (1.0) of the overlaid BIM model and scene using the AR system; collecting and calibrating the required measurement and verification data using the AR system; generating a 3D image (2.0) of the overlaid BIM model and scene using the AR system; and exporting, transmitting, or saving the 3D image (2.0) and the collected data using the AR system. All of these steps can be completed by a single worker, saving manpower. Furthermore, having a single worker responsible for the entire process ensures a high level of project understanding, operational proficiency, and saves time and effort. The AR system automatically identifies the dimensions, location, and other data of the real-world scene through scanning, ensuring high accuracy. Continuous calibration during the data collection process further guarantees data precision.

Described are methods and systems for computer aided surgery (CAS) comprising an augmented reality (AR) system configured to display augmented reality information including a virtual control element, a position tracking system separate from the AR system, wherein the position tracking system is configured to track positions of a physical object for interacting with the virtual control element, a controller configured to: receive planning information for a surgical procedure; determine a first input indicating that the physical object is interacting with the virtual control element; determine a change in position of the physical object interacting with the virtual control element indicating a first adjustment to a parameter of the planning information; receive a second input that either indicates a second adjustment to a parameter of the planning information different from the first adjustment or confirms the first adjustment to the planning information; and store the adjustment to the planning information.

Systems, methods, and other embodiments for a personal protective equipment (“PPE”) adapter system for use with an augmented / virtual / mixed reality (“AR”) devices, including an AR system having an AR viewing device and a headband operatively connected to the AR viewing device, a PPE adapter system, and a PPE hood operatively connected to the PPE adapter system, wherein the PPE hood includes a face shield, wherein the face shield is removably connected to the PPE adapter system.