2230 results about "Augment reality" patented technology

The invention discloses an illness state tracking management system and method based on a lingual face diagnosis instrument, and belongs to the technical field of traditional Chinese medicine tongue diagnosis and modern information technology fusion. The system comprises a multi-modal data acquisition module, a data processing and analysis module and an augmented reality visualization module; according to the method, illness state tracking is achieved through the steps of multi-modal data acquisition, data preprocessing and feature fusion, personalized digital twinborn model establishment, augmented reality visualization presentation and the like, multi-dimensional data such as tongue picture macroscopic features and tongue surface microorganism distribution can be integrated, dynamic association between the data is revealed, the health state and the intervention effect are visually displayed, and the method is suitable for being popularized and applied. The method is suitable for the fields of traditional Chinese medicine health management and chronic disease monitoring.

The invention discloses a power equipment dynamic health degree assessment and predictive maintenance method, and belongs to the technical field of railway power system operation and maintenance. The method comprises the following steps: constructing a parameterized digital twinborn body of power equipment, and collecting real-time operation data, resume data and environment data; based on the parameterized digital twins and the collected data, equipment health degree components are calculated through a multi-model cooperation method, and a comprehensive health index is generated through fusion; performing equipment life prediction and maintenance decision generation according to the comprehensive health index, and outputting an optimal maintenance strategy; and performing visual virtual rehearsal and augmented reality auxiliary execution on the optimal maintenance strategy to form a closed-loop maintenance system. According to the method, the problems of data and model separation, model static stiffness and health assessment deficiency in the prior art are solved, dynamic perception, accurate assessment and predictive maintenance of the equipment state are realized, and the operation and maintenance efficiency and the system reliability are improved.

The invention relates to the technical field of data processing, discloses a digital twin adaptive decision platform for TBM tunneling and a control method, and aims to solve the problems of single sensing dimension, mutual separation of physical and data models, disjunction of early warning and control links and low man-machine interaction efficiency in the prior art. According to the scheme, the method mainly comprises the steps that multi-source real-time data is collected through a hardware sensing layer, after the multi-source real-time data is processed through a data management and fusion layer, a digital twin model layer constructs a physical-data fusion model and completes risk assessment, finally risk visualization is achieved through an augmented reality interaction layer, and an intelligent control decision-making layer generates a control instruction and outputs the control instruction to a TBM main control system. According to the integrated intelligent decision-making platform and the control method, multi-source perception deep fusion, physical and data model online coupling, risk assessment and equipment control second-level closed loop can be realized, and visual interaction can be realized through augmented reality.

The invention discloses an augmented reality intelligent navigation and operation quantitative evaluation method and system in an operating room, and the method comprises the steps: collecting multispectral image data and depth point cloud data of an operation region in the operating room in real time, and generating a multidimensional perception data set; performing feature extraction and spatial registration on the multi-dimensional perception data set, and decomposing the dynamic three-dimensional augmented reality model into an anatomical structure feature layer and an instrument interaction feature layer; performing dynamic matching and real-time rendering on the anatomical structure feature layer and the instrument interaction feature layer based on a digital twinning technology to generate augmented reality navigation information and an operation guidance scheme; and performing multi-dimensional quantitative analysis on the surgical operation process according to the augmented reality navigation information and the operation guidance scheme, and outputting a quantitative evaluation result. By utilizing the embodiment of the invention, augmented reality navigation guidance which is synchronous with a real operation scene in real time can be provided, meanwhile, accurate quantitative evaluation is carried out on the operation operation, and the accuracy, the safety and the trainability of the operation are improved.

The invention relates to the technical field of intelligent medical treatment, and discloses a cataract surgery navigation control method based on multi-modal fusion, which comprises the following steps: carrying out lightweight preprocessing on an eye fundus image, ultrasonic probe data, a corneal topographic map and intraocular pressure parameters through an edge computing architecture, and constructing an efficient feature extraction network by adopting a knowledge distillation technology; self-adaptive feature fusion is realized based on an uncertainty quantification mechanism, real-time structure recognition is provided by utilizing an augmented reality technology, an intelligent navigation strategy is generated by pre-training a reinforcement learning model, an instrument control system with multilayer safety guarantee is established, and continuous optimization of the system is realized by adopting an online learning mechanism. According to the invention, the precision and safety of the operation are effectively improved, and an effective technical scheme is provided for intelligent navigation control of the cataract operation.

The invention discloses an immersive interactive system and method integrating pet robot perception and AR rendering, and the system carries out the visual-inertial combined mapping and anchor point generation, the coding and network transmission of visual frames and spatial data, the synchronous decoding and coordinate system alignment of a terminal side, virtual object anchoring, and spatial mapping and AR rendering through a robot side. User intention analysis, control issuing and robot control, and low-delay synchronization, timeline alignment and closed-loop consistent maintenance are carried out; according to the method, the first visual angle image collected by the front camera of the pet robot can be utilized, the augmented reality technology is combined, and the user is substituted into the visual angle of the robot, so that the user can'personally feel 'the observation and action process of the pet robot, and the immersion and immediacy of human-pet interaction are remarkably enhanced; and human-machine-virtual object ternary space interaction is realized.

This disclosure describes an interactive augmented reality system for improving surgeon's view and context awareness during laparoscopic and video assisted surgeries. Instead of purely relying on computer vision algorithms for image registration between pre-operation (or intra-operation) images / models and later intra-operation scope images, the system can implement an interactive mechanism where surgeons may provide supervised information in initial calibration phase of the augmented reality function, thus achieving high accuracy in image registration. Besides the initialization phase before operation starts, interaction between surgeon and the system can also happens during the surgery. Specifically, patient tissue might move or deform during surgery, caused by for example cutting. The augmented reality system can re-calibrate during surgery when image registration accuracy deteriorates, by seeking additional supervised labeling from surgeons. The augmented reality system can improve surgeon's view during surgery, by utilizing surgeon's guidance sporadically to achieve high image registration accuracy.

The invention relates to the technical field of mine equipment intelligent operation and maintenance and augmented reality, in particular to a forklift predictive maintenance and repair guidance system based on augmented reality, which comprises a multi-source data acquisition module, a mining area operation analysis module, a predictive maintenance engine, an AR intelligent repair guidance module and a resource dynamic scheduling center, a multi-source sensor is used for collecting equipment state and environment data, and mineral characteristics, path characteristics and load changes are dynamically analyzed in combination with working conditions of a mining area; the predictive maintenance engine constructs a fault prediction model based on a deep belief network, and dynamically corrects a working condition adaptive threshold; the AR module is used for positioning and superposing three-dimensional maintenance guidance through SLAM (Simultaneous Localization and Mapping), and adapting to the skill And the resource scheduling center generates spare part, personnel and alternative equipment scheduling schemes as required. According to the method, the whole process from fault prediction to maintenance execution is intelligentized, the fault early warning accuracy and the maintenance efficiency are improved, and the method is suitable for operation and maintenance management of mining forklifts under complex working conditions.

The invention discloses a badminton player action posture analysis system and method based on multi-sensor fusion, and relates to the technical field of athletic training auxiliary systems.The system comprises a wearable sensing subsystem, an environment sensing subsystem and a central processing and feedback subsystem; the wearable sensing subsystem is arranged on an inertia measurement unit and a pressure sensing insole of a body to collect movement inertia and plantar pressure data; the environment perception subsystem collects global videos through multiple cameras. The central processing and feedback subsystem performs synchronous processing on multi-source data, adopts a hierarchical fusion algorithm, restrains inertia integral drift by utilizing a plantar contact state, reconstructs a three-dimensional skeleton posture and a motion trail in combination with visual key points and skeleton restraint, drives a digital twin model, compares with a standard motion model, and performs three-dimensional motion control on the three-dimensional skeleton posture and the motion trail. Quantitative evaluation results such as joint angle deviation, time sequence difference and pressure center track are generated, and visual feedback is performed through a display device and an augmented reality terminal for badminton training evaluation and technical deviation correction.

The invention discloses a transformer substation wiring construction guidance method and system based on GIM and AR, electronic equipment and a readable storage medium, and relates to the technical field of transformer substation wiring construction. The problem of low wiring accuracy and efficiency caused by lack of real-time verification of field real-time construction guidance and misconnection prevention and control in existing substation wiring construction is solved. According to the invention, a graphical interface module GIM and augmented reality AR equipment are fused, the graphical interface module GIM is taken as a data center, and a digital wiring scheme is established, so that the planning and verification basis of each cable laying path is realized; the AR equipment serves as a field guiding tool, a wiring scheme is superposed to a construction scene, and interactive operation navigation of a construction field is achieved; and in combination with verification mechanisms such as identity comparison of the cable and the terminal, wiring error alarm prompt, final on-off test and the like, wiring construction guidance is completed. The method is mainly used for transformer substation wiring construction.

The invention discloses a nuclear power plant bolt installation method and system based on augmented reality, and belongs to the field of bolt intelligent installation, and the method comprises the steps: collecting nuclear power plant environment data based on an environment monitoring sensor, and obtaining environment adaptation parameters through anti-radiation reinforcement processing; generating an installation guidance sequence containing specifications and torque values based on the environment adaptation parameters and the bolt identification result; bolt image features in the installation guidance sequence are analyzed through an image processing algorithm, position and angle deviation indexes are extracted, and deviation calibration data are obtained; collecting a fastening torque signal based on a torque measurement sensor, and fusing the fastening torque signal and the deviation calibration data to obtain a torque deviation correction value; updating calibration parameters based on the torque deviation correction value, obtaining the corrected mounting position and angle, and determining the accuracy of the bolt in-position state; bolt surface defects and fastening degree characteristics are extracted through image analysis, and a bolt installation quality evaluation result is generated.

A head-worn augmented reality (AR) device system includes cameras, display devices, and processors, along with a memory that stores specific instructions. When these instructions are executed by the processors, they enable the device to perform several operations. First, the device accesses a two-dimensional (2D) camera image taken by its camera. The device then generates a first set of three-dimensional (3D) tracked points using the device's odometry system applied to this 2D image. Optionally, a second set of tracked 3D points is created based on one or more images captured by the camera. These 3D points are projected onto the 2D camera image to create a sparse depth image. Finally, this 2D camera image, along with the newly formed depth image, is fed into a first machine learning model to generate a metric depth estimation.

The invention discloses a landscape object identification and explanation method and system, a medium and a product, and relates to the technical field of augmented reality. The method comprises the following steps: when the head motion state of a user is stable, triggering a camera to collect and recognize a single-frame image, matching a recognition result with a regional knowledge base, and generating a candidate object list and coarse-grained poses which are sorted according to spatial probability and historical popularity; performing feature point matching on a current frame and an ideal frame in the video stream, and calculating a fine-grained pose of a target landscape in the candidate object list relative to a camera coordinate system according to a matched target feature point; according to the fine-grained pose and the real-time eye movement data, determining a drop point part of the sight line of the user on the target landscape, forming a multi-dimensional query vector according to the drop point part, the intention of the user and the environment context parameters, and generating multimedia explanation content; and carrying out fusion rendering on the multimedia explanation content and the real-time video stream, and outputting and displaying. By implementing the technical scheme, the personalized multimedia explanation content can be generated.

The AutoWrap Robotics Humanoid Service Center System is an innovative AI platform that autonomously manages vehicle service centers using a fleet of humanoid robots. It coordinates customer interaction, advanced diagnostics (including for EVs / SDVs) with Explainable AI, and autonomous vehicle repairs, alongside facility and outdoor maintenance. Integrating cutting-edge humanoid robots with sophisticated AI, machine learning, and multi-modal sensing, the platform provides semantic understanding of complex environments. It boosts service quality, reduces labor demands, and dramatically increases operational efficiency, transforming underperforming properties into highly productive autonomous centers. Key features include augmented reality interfaces, robust cybersecurity for in-vehicle networks and robot operations, predictive maintenance, and real-time, socially adaptive humanoid-mediated customer communication. Delivered as a scalable Software-as-a-Service (SaaS) solution, the system provides essential AI intelligence for fully autonomous, comprehensive, and sustainable vehicle servicing.

The invention discloses a multi-machine collaborative three-dimensional map updating method based on mobile augmented reality, and belongs to the technical field of three-dimensional reconstruction, and the method comprises the following steps: carrying out the collection of initial collection data of a plurality of target regions through the wearing of AR glasses by a plurality of people; performing frame extraction on the original video image, and calculating to obtain a data grouping result; a sparse pairing list is generated by adopting a hybrid pairing strategy, and sparse point cloud data is obtained by combining incremental SfM calculation; performing distortion removal processing on the frame extraction image, and obtaining pure dense point cloud data through a multi-view solid geometry algorithm, a clustering algorithm and statistical filtering; a triangular mesh model is generated through Poisson surface reconstruction, and a high-precision three-dimensional model is obtained through Markov random field optimization view selection; and constructing a unified space-time reference conversion matrix to obtain a real-time AR visual navigation and map updating result. By adopting the method, the problems that the three-dimensional map is poor in current situation, virtual and real registration is misplaced, the modeling efficiency is low and the precision is insufficient are solved.

A multi-camera, multimodal gesture detection system for augmented reality devices combines outputs from multiple image sensors, using different modalities, to generate fused gesture detection trigger signals and gesture detection release signals. The system processes fused trigger signals using a trigger suspension component, which suppresses false triggers based on hand velocity, position of a detected hand within a field of view of an image sensor, and visibility of key hand landmarks. The system processes fused release signals using a release suspension component, which suppresses false release signals based on hand velocity, position of a detected hand within a field of view of an image sensor, and visibility of key hand landmarks. This approach enhances gesture detection accuracy and reliability in challenging environments.

The invention relates to the technical field of intelligent positioning of building construction, in particular to an intelligent positioning method and system for fabricated building laminated slabs based on AR and UWB. According to the method, a physical monitoring network comprising a UWB positioning base station and a visual positioning target is constructed, a digital operation instruction generated by analysis of a cloud BIM model is converted into a virtual contour superposed on a real operation plane by using an AR augmented reality technology, and further, the position deviation is calculated in real time and a sound-light alarm mechanism is combined, so that the real-time positioning of the cloud BIM model is realized. A construction quality closed-loop control system of real-time monitoring, alarming, adjusting and compliance is established, it is ensured that the laminated slab meets the design precision requirement in the installation process, and later reworking and rectification caused by installation errors are effectively avoided; meanwhile, based on data interaction of the cloud BIM management platform, full-process digital management from design model issuing to final installation position data returning is achieved, and reliable data support is provided for construction quality tracing and acceptance of the fabricated building.

The invention discloses a tunnel face geological information acquisition and image processing method based on machine vision, which belongs to the technical field of image processing, and comprises the following steps: resolving the pose of a terminal in real time through a visual inertial odometer, generating augmented reality guide information, and guiding the terminal to move to a standard acquisition point; at each acquisition point, performing multi-stage verification of scene semantic compliance, motion blur and defocus and illumination uniformity on the image flow to ensure the acquisition quality; for tunnel high-dynamic illumination, adopting an adaptive brightness segmentation and multi-resolution fusion technology based on an improved Otsu algorithm to perform high-dynamic range reconstruction on a single-frame image so as to recover details; and finally, performing clustering optimization based on the feature matching similarity, and screening out an optimal image subset for three-dimensional reconstruction. According to the method, the problems of subjective and random acquisition process, many image quality defects, detail loss under extreme illumination and large image data redundancy are solved.

Methods and systems are disclosed for applying augmented reality animations to an image. The methods and systems access an image and select an augmented reality (AR) experience to apply to the image, the AR experience comprising one or more AR element animations. The methods and systems repeatedly apply the AR experience to the image over a specified time interval to overlay the one or more AR element animations on the image. The methods and systems generate a video having a duration corresponding to the specified time interval in response to repeatedly applying the AR experience to the image, the video depicting the one or more AR element animations on the image.

The invention relates to the technical field of digital twinning and computer simulation, in particular to a power transmission and transformation project optical cable connection information operation and maintenance system based on a logic model, which comprises a model fusion module for constructing a digital twinning anchor point set by fusing a three-dimensional physical model and a secondary system logic model of a power transmission and transformation project; when the simulation analysis module receives a logic loop alarm, the physical path is reversely traced based on anchor point data, physical field simulation operation is executed, and a physical degradation risk point is output; the augmented reality module realizes spatial registration of a three-dimensional physical model and a live scene through a spatial computing technology, and visually presents logic loop and risk point information. According to the method, the space-time twin anchor points are constructed, the physical field simulation operation is driven, and the diagnosis result and the operation and maintenance instruction are superposed on the live scene through the augmented reality technology, so that the intelligent operation and maintenance closed loop of the optical cable connection information of the power transmission and transformation project is realized, and the troubleshooting efficiency and accuracy are improved.

The embodiment of the invention provides an augmented reality board game system and a control method, and relates to the technical field of augmented reality. The system comprises at least two interaction subsystems in communication connection, each interaction subsystem comprises a physical game device, an image acquisition device, a data processing unit and an augmented reality display device, the physical game device comprises a datum reference structure and a plurality of physical game components, the image acquisition device is used for acquiring image data of the physical game device, and the data processing unit is used for processing the image data. The data processing unit is used for calculating coordinate information of the entity game component in a three-dimensional world coordinate system based on the image data, and the augmented reality display device is used for rendering a virtual image of the entity game device according to the coordinate information of the game components of the local interaction subsystem and other interaction subsystems in the three-dimensional world coordinate system. Therefore, a plurality of different-place players can be supported to operate the entity game component through real touch control, and share the same augmented reality fused board game scene in real time.

A method for calibrating a sensor and projector with respect to a work area, the method including positioning a projector to project light indicators at locations in the work area and positioning a sensor with respect to the projector such that the sensor's field of view includes a selected portion of the work area. The sensor captures video or encoded data of activities at the work area. The sensor and projector are aimed at a set of coordinates upon the work area and the associated aim-point coordinates of the sensor and projector are recorded. The sensor and projector are aimed at additional sets of coordinates upon the work area, and the associated aim-point coordinates are recorded until a sufficient quantity of aim-point coordinates have been collected to form a calibration data set sufficient to calibrate the sensor and projector to the work area.

Systems and methods generate and adapt a three-dimensional face mesh representing a user's unique facial points and features. Further, the systems and methods allow the user to refine the characterization of the user's facial points and features, via a variety of feedback mechanisms, (e.g., augmented reality). User feedback is utilized to validate and / or adapt technologies used to generate three-dimensional face meshes (e.g., by validating / adapting machine learning models), thereby iteratively improving the precision and usefulness of three-dimensional face mesh technology in a variety of contexts, such as in virtual cosmetic tutorials and in generation of personalized recommendations.

The embodiment of the invention discloses a service guiding method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality. The method comprises the following steps: determining a target service, and obtaining preparatory work required by the target service from a target system of the target service; intelligently guiding the user to complete preparatory work based on the AR technology, and detecting whether the preparatory work is completed or not; sending an online queuing request of a user to a target system, obtaining number calling information returned by the target system, and displaying the number calling information in real time by using a virtual screen of the AR equipment; and when the number calling information is about to call the user and the preparatory work is completed, displaying a virtual navigation element in a real environment through a virtual screen so as to guide the user to go to a providing place of the target service. Therefore, the scheme can effectively improve the service efficiency.

An example device for communicating augmented reality (AR) media data includes: a memory configured to store AR media data; and a processing system implemented in circuitry and configured to: invoke a function of an application programming interface (API) to determine one or more supported tracking schemes of an augmented reality (AR) runtime; send data representative of the one or more supported tracking schemes to a receiving device with which an AR media communication session is to be performed; receive, from the receiving device, data representative of a selected one of the one or more supported tracking schemes; create a tracking session with the AR runtime using the selected one of the one or more supported tracking schemes; and send an animation stream representing tracking information conforming to the selected one of the one or more supported tracking schemes to the receiving device.

The subject technology detects a location and a position of a representation of a finger in a set of frames captured by a camera of a client device. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders the first virtual object within a first scene. The subject technology detects a first collision event corresponding to a first collider of the first virtual object intersecting with a second collider of a second virtual object. The subject technology modifies a set of dimensions of the second virtual object to a second set of dimensions. The subject technology renders the second virtual object based on the second set of dimensions within a second scene. The subject technology provides for display the rendered second virtual object within the second scene.

The invention discloses an experiment teaching system based on augmented reality and machine vision, which relates to the field of laboratory teaching systems and comprises an augmented reality visualization module, a machine vision recognition module, a task flow control module, an error judgment and prompt feedback module, a teaching data acquisition and evaluation module and a teacher control terminal. The experiment steps and the three-dimensional model of the equipment are overlaid in an actual scene in real time through the augmented reality technology, student operation images are collected through a machine vision algorithm, a state vector is generated, matching degree calculation is conducted on the state vector and a standard vector, misoperation is recognized, and visual prompt is given; the recognition robustness is improved by adopting a moving average mechanism, and the teaching process is dynamically controlled through a task graph; and the scoring module comprehensively evaluates student performance based on indexes such as a misoperation rate, completion time and a prompt response rate, updates a personalized knowledge graph and realizes a teaching feedback closed loop. The visual, normative and intelligent level of experiment teaching is improved, and good practicability and popularization value are achieved.