802 results about "Augmented reality" patented technology

Example implementations are directed to recapturing or realigning a room or scene in an artificial reality (XR) environment as a three dimensional (3D) space. To initially capture a room, a user manually annotates, using an XR system, one or more walls around the XR system. The XR system then aligns or localizes itself relative to the room. Once a room is captured and stored, and the user in the future enters the room again, the XR system may not be able to align itself in the room due to, for example, lighting conditions. Rather than require the user to manually recapture every wall captured during the initial room capture, the XR system can select one wall for recapture and, after receiving an annotation or marking of the one wall from the user, use the selection to realign the XR system relative to the room.

The invention relates to the technical field of artificial intelligence and data analysis processing, and provides a smart home complex scene object analysis method based on multi-modal fusion. The method specifically comprises the steps of performing standardization processing on input data, and extracting multi-scale features of local textures and global semantics; generating a candidate box and a category score by a YOLO model, and adaptively generating a box prompt, a point prompt and a category / text prompt according to the confidence coefficient and the target scale; and inputting the prompt information and the multi-scale features into a mask decoder together, generating a high-precision instance mask in the candidate region, and checking to obtain a final output. According to the method, repeated coding is avoided, the performance of a small object and the performance of a complex boundary target are effectively distinguished, the real-time performance and the resource efficiency are considered at the same time, and the method is suitable for scenes of smart home, indoor navigation, security monitoring, augmented reality and the like.

The invention discloses a large-span truss hoisting and splitting system and method based on digital twinning, and belongs to the technical field of building construction, and the system comprises a physical entity unit, a data acquisition and transmission unit, a digital twinning model unit, a function service and data analysis unit and an application and interaction unit. According to the invention, through real-time sensing of a physical entity state, multi-source data fusion transmission, high-precision digital twinning modeling, intelligent simulation analysis and decision optimization, and fusion of multi-modal man-machine interaction, a virtual control system which is in whole-course synchronous mapping and bidirectional interaction with a physical entity is constructed; according to the method, real-time visual monitoring, trend prediction and risk early warning of the hoisting and splitting process can be achieved, scheme preview and dynamic optimization are supported, virtual-real fusion operation guidance is achieved through the AR technology, and the safety, precision and efficiency of hoisting and splitting operation of the large-span truss are improved.

The invention relates to the technical field of auxiliary training, and discloses an AR auxiliary training system for improving the diagnosis and treatment capability of general practitioners on undifferentiated diseases, and an immersive training environment is constructed by adopting an augmented reality technology. The system comprises an environment sensing module, a space positioning module, a case data module, a virtual rendering module, an interactive acquisition module, an intelligent response module, a state control module and an evaluation calculation module. The environment sensing module adopts an RGB-D camera and an inertial measurement unit to collect environment and head movement data of a user; the spatial positioning module determines a virtual patient placement position based on an SLAM algorithm; the virtual rendering module renders a three-dimensional virtual patient in a real environment; the interaction acquisition module supports voice and gesture multi-mode interaction; the intelligent response module generates an intelligent patient answer; the evaluation calculation module carries out comprehensive evaluation from three dimensions. The invention provides a highly immersive and intelligent training environment, and has the advantages of low cost, reusability and high standardization degree.

A system and method for generating and updating a posegraph for multi-user augmented reality experiences. The system receives initial pose data from multiple client devices and generates a posegraph based on this data. When client devices come within proximity of each other, the system detects this and receives relative pose observations from the devices. The system then updates the posegraph based on these observations, assigning confidence values to improve accuracy. This approach enables efficient synchronization of spatial information across devices, allowing for seamless shared AR experiences in large-scale environments without the need for complete map sharing or pre-mapped areas.

The invention relates to the technical field of forest steppe fire emergency command, and discloses a forest steppe fire comprehensive monitoring and emergency command method and system. The method comprises the following steps: acquiring multi-source monitoring data of a satellite, an unmanned aerial vehicle and a ground sensor, and constructing a fire scene multi-dimensional feature vector through cooperative training and feature fusion; inputting the feature vectors into a physical simulation model to generate fire scene spreading speed and temperature gradient data; analyzing a terrain obstacle coefficient based on the spreading speed data and generating a helicopter no-fly zone coordinate and a passing attenuation factor; and solving and outputting a rescue unit deployment instruction through the scheduling matrix, and projecting a holographic image by using an augmented reality terminal to realize dynamic closed-loop feedback. Through deep fusion of a physical mechanism and reinforcement learning, the problem of separation of traditional fire prediction and resource scheduling is solved, intelligent decision-making of fire accurate prediction and emergency response is realized, and the accuracy and timeliness of fire prevention and control are remarkably improved.

The invention discloses a dynamic rendering method and system for virtual reality, a storage medium and electronic equipment, and relates to the technical field of virtual reality, augmented reality and computer graphics. Therefore, the frequency and time sequence change of the sight focus of the user hitting the surface of the virtual object in the virtual scene are analyzed, so that the relative motion trend and observation intention of the user and the object are pre-judged, predictive and adaptive scheduling of rendering resources is realized, and optical feedback conforming to the physical law, namely, dynamic material, is triggered at the sight focus, so that the real-time performance of the user is improved. Therefore, the interaction fineness in the process of interaction between the user and the VR system is improved.

A system and method for contextual three-dimensional messaging in augmented reality (AR) environments is disclosed. The system receives chat messages with specified real-world destinations and stores them associated with those locations. When a user wearing an AR device enters a destination location, the system detects their presence using techniques like GPS, Wi-Fi positioning, or computer vision. It then generates a 3D visual representation of the message and determines an appropriate spatial position within the physical environment based on environmental analysis and object detection. The 3D message is displayed at the determined position in the AR view. The system can analyze message content to identify topics and match them to detected real-world objects for contextual placement. Users can interact with displayed messages through gestures or voice commands to reply, forward, delete, or reposition messages. This enables immersive, location-aware messaging experiences that seamlessly blend digital content with the physical world.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

Disclosed are a three-dimensional reconstruction method and apparatus based on augmented reality. The method comprises: displaying at least one virtual closed auxiliary line surrounding a target object, and a movable cursor; in response to the movable cursor moving along the virtual closed auxiliary line, determining in real time whether the real-time pose of an image collection device matches a panoramic capture reference point adjacent to the movable cursor; in response to the real-time pose of the image collection device matching the panoramic capture reference point, acquiring a target object image frame corresponding to the panoramic capture reference point and the real-time pose of the image collection device, so as to form image frame-pose pair data; and at least on the basis of the image frame-pose pair data corresponding to each panoramic capture reference point, executing three-dimensional reconstruction for the target object. The three-dimensional reconstruction method based on augmented reality according to some embodiments of the present application can effectively guide the panoramic capture process of an image, thereby improving the quality, efficiency, angle coverage rate, overlap rate, etc. of image collection for three-dimensional reconstruction.

The invention discloses infrared night vision AR (Augmented Reality) intelligent glasses based on multispectral fusion, and relates to the technical field of infrared intelligent application. High-precision scene perception in a low-light / light-free environment is realized by fusing dual-channel data of low-light imaging and infrared thermal imaging and combining cross-modal feature matching and dynamic pose compensation; an environment detail structure is restored by a low-light image enhancement technology, thermal feature targets such as organisms are accurately recognized through thermal imaging target segmentation, and a three-dimensional environment model with space geometric information and target attributes is constructed through heterogeneous feature fusion; and dynamically adjusting the display transparency of the key target in the AR view field through a virtual information layer adaptive mixing mechanism driven by a hot target attribute, and finally outputting a virtual-real fused enhanced view, thereby breaking through the illumination limitation of the traditional AR glasses, and improving the visual effect of the AR glasses. And immersive augmented reality experience with panoramic detail perception and hot target accurate positioning is provided for the user in a dark environment.

Provided are a service guarantee method and apparatus, a communication device, a storage medium and a program product, applied to the technical field of communications, the method comprising: receiving first information sent by a second node device, the first information comprising at least one of service bandwidth data of a target service and congestion data of a base station corresponding to the target service, the target service comprises an augmented reality XR service; determining a service guarantee strategy of the target service according to the first information; and sending the service guarantee strategy of the target service to third node equipment. According to the method, based on service bandwidth data of a target service and congestion data of a base station corresponding to the target service, flexible service guarantee strategies of a flow level (whether to establish a communication resource allocation channel for the target service) and a frame level (whether to open frame function guarantee for the target service) are formulated for the target service; therefore, the use of the network resources and the quality guarantee of the target service are balanced, and the target service can be better presented.

In some embodiments, a display system comprising a head-mountable, augmented reality display is configured to perform a neurological analysis and to provide a perception aid based on an environmental trigger associated with the neurological condition. Performing the neurological analysis may include determining a reaction to a stimulus by receiving data from the one or more inwardly-directed sensors; and identifying a neurological condition associated with the reaction. In some embodiments, the perception aid may include a reminder, an alert, or virtual content that changes a property, e.g. a color, of a real object. The augmented reality display may be configured to display virtual content by outputting light with variable wavefront divergence, and to provide an accommodation-vergence mismatch of less than 0.5 diopters, including less than 0.25 diopters.

The invention provides a vehicle remote control driving system and method integrating AR virtual path projection, and relates to the technical field of vehicle remote control. The system constructs a high-precision three-dimensional environment model through cooperative work of an environment sensing module and a data processing and decision module; the AR path generation unit generates a collision-free virtual path and a vehicle dynamic rehearsal picture, and the collision-free virtual path and the vehicle dynamic rehearsal picture are visually presented in an augmented reality mode through the remote control terminal outside the vehicle, so that a driver can obtain comprehensive situation awareness beyond a physical visual field outside the vehicle; and after the virtual path is confirmed or adjusted in combination with the interaction control, the vehicle control strategy unit automatically generates a cooperative control command adapting to the road condition, and an execution mechanism is driven to perform accurate execution. According to the system, the safety and operation confidence of remote control driving are improved, the blind area collision risk is effectively avoided, the trafficability of the vehicle in a complex environment is enhanced, meanwhile, the operation difficulty is greatly reduced through AR visual interaction, and intelligent and user-friendly vehicle exterior remote control driving experience is achieved.

A visual synthesis-based virtual or augmented reality pain treatment apparatus and device. In the apparatus, an interaction control unit generates a pain stimulation scheme matching a current patient to be treated and sends the pain stimulation scheme to a data processing unit. The data processing unit, on the basis of the received pain stimulation scheme, generates a virtual reality environment and a virtual stimulation source visible to the patient in the virtual reality environment. A display unit displays the virtual reality environment and the virtual stimulation source to said patient. The data processing unit, on the basis of a pain category to be induced, determines a stimulation target of a limb and parameters of the virtual stimulation source. The display unit drives the virtual stimulation source to implement a visual approaching motion to the stimulation target of the patient so as to achieve non-real stimulation. The somatosensory system of the patient is activated by means of a vision-nerve coupling mechanism to induce the patient to feel a tactile sensation, a thermal sensation, and / or a cold sensation at the stimulation target and in a nearby area thereof, thereby achieving neuromodulation therapy of a pain pathway.

The invention discloses a Rhatish culture VRAR virtual-real fusion interaction method based on eye movement tracking, and particularly relates to the technical field of virtual reality and augmented reality man-machine interaction. The method comprises the following steps: acquiring an eye image of a user through a near-infrared image acquisition unit, and inputting the eye image into a double-branch convolutional neural network model to estimate a two-dimensional fixation point of a screen; performing nonlinear correction on a fixation point based on the user personalized sight line offset correction model established in the offline calibration stage; in the online interaction stage, the corrected fixation point is combined with equipment pose data to be converted into three-dimensional space rays, the distance and angle relation between the three-dimensional space rays and an interaction target is calculated, and an interaction instruction is triggered when a threshold condition is continuously met. According to the method and the system, accurate, stable and natural eye movement interaction of the virtual contents of the Rhatish culture and the entity exhibits in the VR / AR environment is realized, and the user experience and the system robustness are improved.

Methods and systems are disclosed for performing operations for providing a shared augmented reality experience in a video chat. A video chat can be established between a plurality of client devices. During the video chat, videos of users associated with the client devices can be displayed. During the video chat, a request from a first client device to activate a first AR experience can be received, and in response, and body parts of users depicted in the videos are modified to include one or more AR elements associated with the first AR experience.

The invention relates to the technical field of intelligent photography, discloses an intelligent composition auxiliary method and system for tourism photography, and aims to solve the problems that scene semantics cannot be deeply understood and dynamic active composition guidance is difficult to provide in the prior art. The method comprises the following steps: acquiring multi-modal data such as images, geographic coordinates, equipment postures and the like in real time; constructing a scene semantic map for describing visual elements and relationships thereof; outputting a current composition score and an optimization gradient through a pre-trained composition aesthetics quantitative evaluation model; and generating a dynamic visual servo guidance instruction, and superposing the instruction on a view-finding interface in an augmented reality mode to guide a user to adjust the pose and focal length of the camera. The system comprises a multi-modal data acquisition module, a map construction module, an aesthetic evaluation module, a guide generation module and an AR rendering module. According to the method and the device, the crossing from a static reference line to semantization and closed-loop intelligent composition assistance is realized, the operation burden of a user is remarkably reduced, and the imaging aesthetic quality is improved.

The invention discloses a naked-eye 3D augmented reality interactive display system, and relates to the technical field of naked-eye 3D display and reality interaction. According to the invention, the multi-source depth data acquisition module acquires and fuses a user limb depth image, the parallax physical depth mapping module completes depth and parallax mapping and visual angle correction, the occlusion relation determination module divides regions to determine the occlusion type, and the adaptive mask layer generation module generates a dynamic smooth mask layer. The shielding effect fusion display module is used for overlapping and synthesizing the shielding layer and the multi-view virtual image and then displaying the overlapped and synthesized shielding layer and the multi-view virtual image; the problems that in naked eye 3D interaction, the occlusion relation between the limbs of the user and the virtual object is not accurate, and the vision is abrupt are effectively solved, the space consistency and the vision fluency of interaction are remarkably improved, and the real and natural naked eye 3D augmented reality interaction experience is achieved.

The invention provides a robot hospital guide method based on multi-modal data and an intelligent hospital guide robot, and relates to the technical field of robots. The intelligent hospital guide robot comprises a multi-mode sensing module, an intention understanding and decision center module and a behavior execution and guide module. The method is applied to the intelligent hospital guide robot, and comprises the following steps: collecting multi-modal data through a multi-modal sensing module; performing information fusion and intention understanding on the acquired multi-modal data through an intention understanding and decision-making center module, and generating a decision-making instruction; executing a decision instruction through a behavior execution and guidance module, so as to execute personification interaction by controlling joint movement of the intelligent hospital guide robot and / or execute visual guidance by rendering and superposing an augmented reality navigation arrow on a display screen of the intelligent hospital guide robot; the problems of unfriendly interaction, single perception, rigid planning and the like in the prior art are solved, and the triage accuracy, the user experience and the adaptability in complex medical scenes are remarkably improved.

Disclosed is a surveillance camera capable of detecting a color of a vehicle using vehicle logo detection. This specification describes a method that, instead of processing an entire image of a vehicle, detects the vehicle's logo and expands a bounding box of the detected logo to analyze a dominant color within the expanded bounding box for higher accuracy. During a dominant color analysis process, color correction may be performed based on metadata, environmental factors, and a lighting condition. In addition, more accurate vehicle color detection may be achieved through color distance measurement. According to this specification, at least one of a surveillance camera, an autonomous vehicle, a user terminal, and a server may be associated with an Artificial Intelligence (AI) module, a robot, an Augmented Reality (AR) device, a Virtual Reality (VR) device, and a 5G service.

The invention discloses a feature matching method based on double-branch feature extraction and channel feature enhancement, which is used for improving the feature expression capability and global perception capability of a lightweight feature matching network. The method comprises the following steps: after preprocessing an input image, respectively extracting local details and global structure features through a parallel backbone network and a dynamic channel kernel feature extraction branch; a channel feature enhancement module is used for carrying out progressive strength enhancement on multiple levels; a self-adaptive convolution kernel is generated for each channel through a dynamic channel kernel attention module, and spatial attention modeling of the key area is achieved; a multi-scale feature fusion module is adopted to fuse local and global features, and finally a dense feature map, a key point heat map and a reliability heat map are output; according to the method, the calculation efficiency is ensured, the feature matching precision and robustness in a complex scene are remarkably improved, and the method is suitable for lightweight application scenes of real-time vision SLAM, augmented reality and unmanned aerial vehicle navigation.

Embodiments of the present invention provide a trackable device system comprising a modular housing integrated with personal or enterprise assets. The system includes a chipset with wireless communication modules (e.g., BLE, UWB, GPS, or cellular), a processor, location modules, memory, and power management components. The processor supports proximity detection, geofencing, motion-triggered alerts, lost-mode activation, and SOS signaling to emergency contacts. Integration with mobile platforms enables real-time tracking, augmented reality overlays, and compatibility with networks like Apple Find My™ and Google Find My Device. Security features include encrypted memory, tamper detection, secure pairing, and a secure enclave for sensitive data. In enterprise settings, the system supports blockchain-based inventory logging, role-based access, and RFID / NFC inventory control. The device adapts to diverse form factors and deployment scenarios, ensuring reliable location tracking, anti-tamper protection, and secure asset management for consumer, industrial, and institutional applications.

The invention discloses an AR (Augmented Reality) tourist train immersive voice guide device based on holographic projection, belongs to the technical field of augmented reality and holographic projection, and particularly relates to the AR tourist train immersive voice guide device based on holographic projection. The AR tourist train immersive voice guide device based on holographic projection aims at solving the problems that a traditional tourist train guide system is single in interaction, static in content and insufficient in scene immersion, and the AR tourist train immersive voice guide device based on holographic projection is provided to achieve the functions of virtual and real scene fusion, voice explanation self-adaptive pushing and multi-mode interaction. The system comprises a holographic projection module, an AR processing module, a voice guide system, an environment perception module, a user interaction module and a data storage and communication module. Holographic projection and AR technologies are combined, the limitation of traditional two-dimensional display is broken through, and three-dimensional scene navigation is achieved.

The invention relates to the technical field of augmented reality, in particular to an AI-based Unity engine AR scene persistence and sharing editing method. According to the method, a real scene is perceived and understood in real time through an integrated AI module, and scene semantic information is generated; an AR scene is constructed in a Unity engine, and accurate registration of a virtual object and a real environment is realized based on semantic information; performing structured coding and versioning persistent storage on the scene data; establishing a multi-user shared editing network architecture, and transmitting an editing instruction by adopting an event-driven protocol; and coordinating operation of each client through a synchronization engine, and implementing a conflict detection and solution mechanism to maintain data consistency. According to the system, user authority management, a space anchoring system and a self-adaptive optimization module are integrated at the same time, a visual editing interface and an extensible plug-in architecture are supported, high-precision construction, reliable persistence and efficient multi-user collaborative editing of an AR scene are achieved, and the stability, compatibility and user experience of the system are improved.

Provided are an augmented reality device for providing an augmented reality service matched to a real-world space, and an operating method thereof. The augmented reality device may recognize a plurality of objects in a real-world space from an image obtained through a camera, recognize a relative position relationship including positions and directions between the plurality of recognized objects, and display, at a preset position, a virtual object representing information related to the plurality of recognized objects, based on information about a prestored relative position relationship.

An anamorphic near-eye display apparatus comprises a spatial light modulator with asymmetric pixels; an input transverse anamorphic lens; and an extraction waveguide that passes input light in a first direction to a lateral anamorphic reflector arranged to reflect the light back through the waveguide. Partially reflective extraction elements are arranged between the rear and front guide surfaces of the waveguide to extract the reflected light towards the pupil of an observer, maintaining the directionality of the fan of light rays from the spatial light modulator and anamorphic imaging system. A thin, transparent and efficient anamorphic display apparatus for Augmented Reality and Virtual Reality displays is provided.

The invention relates to the technical field of augmented reality image processing, and discloses a traditional Chinese medicine acupuncture auxiliary positioning system based on an AR technology, which comprises a body surface anatomical feature intelligent extraction module, a personalized meridian model adaptive deformation module, a dynamic virtual-real registration tracking module and an AR visual rendering and quality closed loop module, according to the method, a thin-plate spline transformation algorithm is adopted to elastically deform a standard meridian model to the body surface of an individual, the individualized cun unit length is dynamically calculated in combination with a bone degree cun method, virtual-real registration is optimized through an iterative nearest point algorithm, movement and breathing deviation of a patient are compensated, the positioning quality is evaluated through a confidence coefficient thermodynamic diagram, closed-loop reacquisition optimization is driven, and the positioning accuracy is improved. Accurate AR-assisted positioning of acupuncture points of the whole body is realized.

The invention belongs to the technical field of augmented reality, and particularly discloses an offline store inspection authenticity verification method based on AR environment feature point matching, and the method comprises the steps: scanning a specific region of a store through a mobile terminal, collecting environment visual feature points and pose parameters to construct and upload a sparse point cloud map, and generating a uniquely bound AR scene model; setting a virtual punch-in point in the model, and recording an anchor point coordinate under a world coordinate system of the virtual punch-in point; when the inspection is executed, the mobile terminal preloads a corresponding AR scene model based on a geographic position, extracts feature points by collecting images in real time, and matches the feature points with feature points in the model; and after successful matching, calculating a real space distance between the mobile terminal and the virtual clock-in point, and if the real space distance is smaller than a threshold value, unlocking the inspection task. According to the method, a dual verification mechanism based on pose difference and dynamic visual guidance are introduced, so that the defects of low positioning precision and easiness in counterfeiting in the prior art are overcome fundamentally, and high-precision and high-anti-counterfeiting authenticity verification of offline inspection behaviors is realized.