75 results about "Ar system" patented technology

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An AR system for a spectator event involving moving participants in a real space, each participant having a participant field of view of said real space through a screen, said spectator event involving cameras, each camera having a camera field of view of said real space, said AR system comprising: (a) a computer presentation system for generating virtual space corresponding to said real space and a virtual object in said virtual space; (b) a participant display configured to overlay an image of a portion of said virtual space corresponding to said participant field of view of said real space on said field of view of said real space for each participant; and (c) a spectator display configured overlay an image of a portion of said virtual space corresponding to said camera field of view of said real space on said camera field of view of said real space.

The invention relates to the technical field of medical training, and discloses a lumbar puncture simulation teaching system based on an AR technology, and the system comprises an AR content generation module which collects a lumbar medical image and carries out the tissue segmentation and focus recognition; performing three-dimensional geometric modeling based on the tissue segmentation result and the focus recognition result to generate a lumbar vertebra 3D model; the AR display interaction module develops an interaction function of the lumbar vertebra 3D model by using a Unity platform and AR equipment; interactive operation of the user is monitored, and feedback is conducted in real time; and the operation evaluation module is used for evaluating the interaction operation of the user and assigning an improvement suggestion according to an evaluation result. A three-dimensional visual scene is constructed through the AR technology, a user can observe the needle inserting process from different angles according to the complex anatomical structure of the lumbar vertebra part, and dynamic effects such as cerebrospinal fluid pressure change are simulated; in the lumbar puncture simulation training, the AR system can feed back operation data in real time, such as the needle inserting angle, the puncture strength and the puncture depth, and the user is helped to accurately master operation skills.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

The invention discloses a real-time display method and device for an electric power underground concealed project based on AR glasses. The method comprises the following steps: acquiring an RTK geographic positioning coordinate through an RTK positioning module integrated with the AR glasses; constructing a coordinate conversion relation through an RTK geographic positioning coordinate, an AR system coordinate and an AR geographic due north correction angle theta; extracting a geographic coordinate set of the target model from the underground engineering model database, and establishing a relative position mapping relation from the geographic coordinates of the model to the current RTK coordinate system; based on the established coordinate conversion relation, converting the geographic coordinates of the underground engineering model into relative coordinates under the coordinate system of the AR system; and dynamically binding the calculated relative coordinates to a physical space through a visual tracking module of AR glasses, and generating an underground model holographic image consistent with the perspective relationship of a real earth surface scene. The method aims at achieving high-precision and stable visualization of the three-dimensional model of the electric power underground hidden project and improving the safety level of electric power inspection and construction.

This invention discloses an AI-interactive AR (Augmented Reality) cultural wall system for cultural tourism, belonging to the field of AR system technology. The surface of the cultural wall is equipped with a pre-embedded feature set, including visual markers, differentiated texture features, 3D depth variation areas, and specifically designed interactive hotspots. These features provide the system with stable visual benchmarks, semantic distinction criteria, depth cues, and precise positioning anchors. The system includes: a feature point acquisition module, used to collect the feature set on the cultural wall through a multimodal feature extraction algorithm to construct a 3D spatial map with semantic annotations; a user positioning and pose estimation module; an AI content generation engine; and a spatial adaptation and rendering module. Through the cultural wall feature set and the multi-module collaborative system, precise spatial integration of virtual content and the physical wall surface is achieved, along with intelligent dynamic content generation based on user behavior, effectively enhancing the immersion, interactivity, and personalization of the AR cultural experience.

A method, system and product including obtaining a frame from a frame sensor of an Augmented Reality (AR) system comprising an AR device; executing a first skin on the frame or portion thereof to obtain a first overlay; executing a second skin on the frame or portion thereof to obtain a second overlay, wherein the first and second skins are configured to provide an augmented overlay to be used by the AR system in determining an AR view, wherein said executing the second skin is performed without providing the first overlay to the second skin; determining whether the second overlay can be utilized for providing the AR view; generating the AR view based on the first overlay and based on said determining whether the second overlay can be utilized for providing the AR view; and providing the AR view via the AR device.

The present invention discloses a mixed reality system comprising a display and an optical system that projects the image into a viewer's eye where the display is convex or a concave optical component. The display may further be comprising of smaller displays bunched together to create optical functions. In addition, the display pixels of further comprise of sub-pixels.

The application provides a kind of based on user behavior perception's augmented reality content recommendation and expressive presentation method, including constructing the state representation of multiple virtual roles in augmented reality scene;Joint objective function for evaluating virtual role layout rationality is constructed;According to the attribute information of virtual role, the adaptive weight is generated by the weight prediction model constructed in advance, and the adaptive weight is used to adjust the cost item related to the importance of role in the space cost function;Based on the joint objective function, the position and orientation of all virtual roles are iteratively optimized to obtain an optimized layout;Expressive presentation is carried out in the augmented reality scene The optimized layout is realized in three-dimensional space Automatic optimization of role position and orientation, avoid visual conflict, improve the naturalness, coordination and semantic expression ability of layout, thereby significantly enhance the interactive experience and information transmission effect of AR system.

An augmented reality (AR) system includes a display, a camera; and a secure data vault system. The secure data vault system includes a sandbox system operatively coupled to the camera and configured to receive camera data from the camera, wherein in operations of the AR system, the camera only sends camera data to the sandbox system, and wherein the sandbox system comprises an execution environment configured to restrict execution of instructions to a predefined memory address range. The secure data vault system additionally includes a display and rending system operatively coupled to the sandbox system and configured to render an image based on the camera data processed via the instructions and to display the image via the display, wherein the display is configured to show both the image and a real-world environment surrounding the AR system.

This invention discloses a high-precision gesture tracking method and system based on hand and controller fusion, belonging to the field of virtual reality and augmented reality technology. It addresses the technical problems in existing VR / AR systems, such as unknown extrinsic parameter estimation for hands and controllers, difficulty in tightly coupling low-frequency vision with high-frequency IMU, and self-occlusion issues in handheld states. The method includes: determining the grip state between the controller and hand based on acquired multi-source data; if the grip state is unoccluded or low-occlusion, performing optimal solution calculations under relevant kinematic constraints to obtain the wrist 6-DoF pose; if the grip state is high-occlusion, performing regression mapping processing on the infrared spot data and controller IMU data based on relevant spatiotemporal feature sequences; dynamically switching the gesture tracking between the controller and hand, and outputting the final hand posture data.

A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.

A gesture-based text entry user interface for an Augmented Reality (AR) device is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system determines using the one or more cameras, the user's selection of one or more selected virtual keys of the plurality of virtual keys and generates entered text data based on the one or more selected virtual keys. The AR system provides the entered text data to the user using a display of the AR system.

A hand-tracking platform generates gesture components for use as user inputs into an application of an Augmented Reality (AR) system. In some examples, the hand-tracking platform generates real-world scene environment frame data based on gestures being made by a user of the AR system using a camera component of the AR system. The hand-tracking platform recognizes a gesture component based on the real-world scene environment frame data and generates gesture component data based on the gesture component. The application utilizes the gesture component data as user input in a user interface of the application.

A virtual camera augmented reality (AR) system detects selection of a virtual camera added as an extension in an internet browser, generates a new canvas element for the virtual camera, and accesses video frames captured by a hardware camera coupled with a computing device. The virtual camera AR system detects selection of an AR option and applies the AR option to each video frame of at least a subset of the accessed video frames, at a predefined rate. The virtual camera AR system provides each video frame of at least the subset of video frames comprising the applied AR option to the new canvas element and causes display, of each video frame of at least the subset of video frames comprising the applied AR option in the new canvas element, on a user interface of the computing device.

An augmented reality (AR) system for generating augmented reality reservation content using an AR computing device and an AR display device operated by a user is disclosed. The AR system is configured to receive, from the AR display device, image data, at least one user input, and geolocation data. The AR computing device is configured to process the image data using object recognition and the geolocation of the user to identify at least one object The AR computing device is further configured to communicate with an application programming interface (API) to obtain reservation data associated with the identified at least one object. The AR computing device is further configured to generate AR content associated with the received reservation data. The AR display device is configured to display the AR content on a display screen of the AR display device.

An augmented reality (AR) system includes a wearable device including: a frame, a projector coupled to the frame, a display optically coupled to the projector, and an eye tracking system. The AR system also includes a memory and a processor configured to: receive an eye gaze location from the eye tracking system, generate an image, and generate a foveation map based on the eye gaze location. The foveation map includes a first region of the image and a second region of the image. The processor is also configured to compress the first region of the image using a first quality setting and the second region of the image using a second quality setting. The first quality setting (e.g., a setting of 100%) can be greater than the second quality setting.

The invention provides an augmented reality content recommendation and expressive presentation method based on user behavior perception. The method comprises the following steps: constructing state representations of a plurality of virtual characters in an augmented reality scene; constructing a joint objective function for evaluating the layout rationality of the virtual character; according to the attribute information of the virtual role, generating a self-adaptive weight through a pre-constructed weight prediction model, and using the self-adaptive weight to adjust a cost item related to role importance in the space cost function; based on the joint objective function, performing iterative optimization on the positions and orientations of all the virtual characters to obtain an optimized layout; the optimized layout is expressed and presented in an augmented reality scene, the role position and orientation are automatically optimized in a three-dimensional space, visual conflicts are avoided, and the naturalness, coordination and semantic expression ability of the layout are improved, so that the interactive experience and information transmission effect of an AR system are remarkably enhanced.

The utility model belongs to the technical field of AR, and particularly relates to an AR (augmented reality) art display system which comprises a mounting plate, the middle of the top wall of the mounting plate is concaved inwards to form a mounting groove used for containing an intelligent LED lamp strip, and the two sides of the mounting groove are communicated with the outside and allow the intelligent LED lamp strip to penetrate through. A locking plate used for covering the top of the mounting groove is detachably arranged at the top of the mounting plate, side folding plates are symmetrically and rotationally arranged on the left side and the right side of the locking plate, clamping tongues are arranged on the sides, close to the mounting plate, of the lower half portions of the side folding plates in a protruding mode, and clamping grooves allowing the clamping tongues to be inserted therein are formed in the left side wall and the right side wall of the mounting plate. According to the utility model, the thumb and the index finger of a user respectively press the upper half parts of the side folding plates, so that the torsional spring is further compressed, the clamping tongue is pulled out of the clamping groove, the locking plate can be detached, and the lamp strip is convenient to detach and replace.

This invention provides a digital immersive exhibition hall, comprising an exhibition hall frame, double-layer curtain wall panels, equipment components, and a central control system. The double-layer curtain wall panels are detachably mounted on the exhibition hall frame (excluding the exhibition hall door frame), forming at least one equipment room at the top of the frame and at least one performance room inside the frame. The equipment components include projectors, lighting fixtures, a VR / AR system, and power supply equipment. The central control system controls the equipment components, and the projectors, power supply equipment, and central control system are located within the equipment room. This invention utilizes multiple prefabricated beams and columns that are detachably connected to form the exhibition hall frame. The projectors, lighting fixtures, VR / AR system, power supply equipment, and other equipment components, along with the central control system, can be quickly and seamlessly integrated with the exhibition hall frame and double-layer curtain wall panels, forming a highly integrated, prefabricated product. This achieves the functions of a portable, mobile, quickly assembled / disassembled, immersive, and intelligently interactive offline immersive interactive space.

Described herein are processes and techniques to identify encrypted content within a field of view of a user of a VR / AR system and to appropriately handle the encrypted content. A user of a VR / AR technology can have protected content within the user's field of view. Encrypted content is mapped to one or more protected surfaces on a display device. Content mapped to a protected surface can be rendered on the display device, but is prevented from being copied from the display device.

A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

The invention relates to the technical field of furniture installation, in particular to a furniture installation remote guidance AR system and a control method, and the method comprises the following steps: A, system initialization: a field client establishes communication with a remote expert terminal, and carries out the internal reference calibration of a field camera; b, environment pre-scanning: acquiring a multi-angle image of a to-be-installed area by an on-site client, and constructing an environment point cloud or plane model; c, three-dimensional model loading: according to a furniture model selected by a user, downloading a corresponding step-by-step assembly three-dimensional model from the cloud model library; according to the method, high-precision FAST + DBSCAN + RANSAC pose alignment, periodic error detection and automatic re-registration, multi-angle environment pre-scanning and multi-modal gesture / head interaction are realized, and remote bidirectional labeling synchronization and operation log real-time recording and cloud analysis are combined, so that the precision, efficiency and reliability of furniture installation are remarkably improved; and a sustainable optimization intelligent remote guidance closed loop is constructed.

The application relates to the technical field of color drawing systems, and discloses an intelligent wall surface color drawing system and method based on multi-modal fusion positioning, which comprises the following components: module M1, an intelligent base station array; module M2, an AR intelligent operation system; module M3, a cloud management platform; and module M4, a multi-modal fusion positioning model; the method comprises the following steps: step S1, an initialization stage, in which the intelligent base station array scans a wall surface; step S2, a path planning stage, in which the cloud platform analyzes color drawing scheme data; step S3, a real-time operation stage, in which the AR system solves a pose in real time through the multi-modal fusion positioning model; and step S4, a quality control stage.The application realizes real-time high-precision pose solving, and generates a spraying track based on a wall surface point cloud map through a dynamic path planning module; the system can compensate for joint angle errors of a mechanical arm in real time, thereby effectively solving the problem that a spraying track deviates from a complex wall surface.

The application provides a kind of optical perspective augmented reality system color characterization method, by the full field of view measurement of different ambient light conditions and OST AR virtual stimulus color, the mathematical relationship between the virtual display color that AR display should output and human eye perceived color and ambient light is established, the mathematical relationship can describe how AR display adjusts its color output under different light conditions to compensate for the influence of ambient light on the final perceived color, so as to improve the accuracy and consistency of color reproduction, that is, the application aims to correct the nonlinear influence of ambient light on AR virtual display content through the nonlinear mixing compensation model of ambient light measurement and OST AR virtual stimulus color, correct the human eye perceived color deviation of OST AR device under complex lighting environment, improve the color consistency of OST AR display under lighting environment and the color restoration ability of OST AR system under different lighting conditions, realize more natural virtual-real fusion effect.

To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.

The invention relates to the technical field of AR intelligent glasses, in particular to an AR intelligent glasses system based on brain-like visual processing. The system comprises a visual data acquisition module, a visual feature extraction module, a semantic construction module, a behavior intention prediction module and a visual interaction module. Visual images and environment information are acquired through a multi-mode sensor, and spatial-temporal feature coding is performed through a pulse neural network to generate a brain-like visual feature sequence; constructing a semantic expression vector based on a graph structure method; a comparative learning model is adopted to complete behavior intention prediction; and the visual interaction module generates AR (Augmented Reality) content according to a prediction result, so that real-time interaction presentation is realized. According to the method, multi-modal perception precision, behavior understanding intelligence and interaction personalization enhancement are realized, and the perception, understanding and response capabilities of an AR system in a complex application scene are comprehensively improved.

An augmented reality (AR) system for generating and displaying a pre-disaster Enhanced Situation Visualization (ESV) is provided. The AR system may include an ESV computing device, a user computing device operated by a user and a reference database. The user computing device may transmit a reference request message to the ESV device, the reference request message including an image and / or GPS location of a property. The ESV computing device may determine the subject of the image is the property, retrieve reference information including peril maps associated with the property from the reference database, and determine situation information specific to the subject. The reference and situation information including a loss estimate may be displayed on the user computing device to provide an ESV of the property. The ESV may be used for insurance-related activities, such as handling, adjusting, and / or generating an insurance policy, premium, and / or discount, and / or generating insurance-related recommendations.

The invention discloses an AR (Augmented Reality) system cognitive security interaction method based on multi-modal large language model reasoning and bidirectional individuation, which utilizes a cross attention mechanism guided by an inertial measurement unit signal to explicitly model and eliminate electroencephalogram signal motion artifacts, and compared with the existing method of directly using electroencephalogram signals or simple filtering, the method has the advantages that the method is simple and convenient to implement, and the efficiency is high. The anti-interference capability of personalized attention perception is high, attention recognition is more accurate, the distraction moment of the user can be accurately captured, and the false alarm rate is reduced. Besides, personalized preference configuration information is generated through man-machine alignment and is embedded into the reasoning process of the multi-modal large language model, so that the subjective preference of the user to the risk is read, the problem of alarm fatigue is solved, and user trust is established. According to the method, a real agent closed loop is realized, and the method is a complete agent architecture with perception (physiological denoising)-cognition (LLM reasoning combined with preference)-action (self-adaptive interaction), and can adapt to physiological features and psychological preferences of different users.