6724 results about "Augment reality" patented technology

The invention relates to the technical field of communication command, in particular to an intelligent emergency command system and method based on scene twinning. Comprising a data acquisition module, a scene twinborn management module, an emergency situation analysis module, an emergency response decision module and a resource scheduling command module. Multi-source data of an emergency scene are collected through a sensor network, a scene twinning model is constructed by using augmented reality and digital twinning technologies, and real-time rendering of a virtual scene is realized. According to the method, emergency situation analysis, risk detection and trend prediction are performed in combination with a random matrix theory and a graph neural network algorithm, an emergency response strategy is generated by using a decision tree based on an analysis report, resources are scheduled and allocated through a multi-objective optimization algorithm, and an optimal emergency command scheme is ensured. According to the invention, the efficiency and scientificity of emergency command are improved, and the rapidity and accuracy of emergency response are enhanced.

Aspects of the present disclosure relate to systems, devices and methods for performing a surgical step or surgical procedure with visual guidance using a head mounted display with systems, techniques and methods for improving the accuracy of an augmented reality display and / or for enhancing the 3D visualization of an augmented reality display.

The invention discloses a wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision-making and early warning method, and relates to the technical field of intelligent misoperation prevention of a power system, and the method comprises the following steps: collecting multi-source heterogeneous data, obtaining the data through a distributed sensor network, and carrying out the edge calculation preprocessing; performing data space-time alignment and fusion, performing equipment state evaluation, and constructing a deep belief network and Bayesian network hybrid model to calculate a health index; anti-misoperation rule modeling is carried out, and operation logic verification is carried out based on a Petri network and an expert knowledge base; risk early warning decision making: fusing multi-source early warning information to divide risk levels; intelligent locking control is carried out, and a locking strategy is optimized through reinforcement learning; and performing decision support and visualization, constructing a three-dimensional digital twinborn model, and displaying operation guidance and risk early warning in combination with an AR technology. Through multi-source data fusion and intelligent decision making, the anti-misoperation locking accuracy and efficiency are improved, and the safety and the operation and maintenance level of the booster station are remarkably enhanced by equipment fault early warning three months ahead of time.

The invention discloses a mechanical equipment state monitoring method and system based on multiple sensors, and the method comprises the five core steps: multi-modal data collection and preprocessing, dynamic feature fusion, adaptive threshold diagnosis, digital twin fault tracing and predictive maintenance decision. All-domain coverage of equipment is realized through a three-layer sensor network architecture, the problems of data synchronization and interference resistance are solved by utilizing a temperature and vibration integrated sensor, deep fusion and anomaly detection of multi-source data are realized in combination with an attention mechanism, a Gaussian mixture model, a three-dimensional convolutional neural network and the like, and finally a precise maintenance strategy is generated through digital twinning and reinforcement learning. The multi-sensor-based mechanical equipment state monitoring system comprises a sensor network layer, an edge computing layer, a cloud platform layer and a man-machine interaction layer, supports federated learning to protect data privacy, improves real-time diagnosis capability through edge-cloud collaboration, and enhances a reality interface to realize intelligent operation and maintenance interaction.

The invention relates to the technical field of construction progress monitoring, and discloses a construction progress monitoring method and system based on big data. The method comprises the following steps: forming a space-time alignment data set through multi-source data acquisition, filtering and quality evaluation; performing feature extraction and registration to generate a digital model; target detection classification is performed to form a completion state table; progress evaluation is achieved through component-task mapping; trend analysis and risk identification are performed to generate a prediction result; decision reference is provided for personalized information screening and augmented reality display. Through multi-source data acquisition, fusion and intelligent analysis, accurate perception, objective evaluation, scientific prediction and visual presentation of the actual state of the construction site are realized, so that a comprehensive, accurate and prospective construction progress monitoring method is provided, the construction period delay risk is effectively reduced, and the construction management efficiency is improved.

A system comprises a processor and a memory having computer readable instructions stored thereon, which, when executed by the processor, cause the system to display an image of a surgical environment. The image includes an information icon corresponding to an instrument in the surgical environment. The instructions further cause the system to display an image of a body part of a user. The image of the body part is used to interact with the information icon. The instructions further cause the system to receive a gesture of the body part, via a gesture-based input device registering movement of the body part, to cause the image of the body part to interact with the information icon. The instructions further cause the system to display an information menu in the image of the surgical environment based on the interaction between the image of the body part and the information icon.

A holographic augmented reality ultrasound needle guide system and method includes an augmented reality display such as a headset wearable by a user. The augmented reality display is configured to depict a virtual ultrasound image. The augmented reality display is further configured to allow a user to select a desired reference point on the virtual ultrasound image. The system is configured to depict a holographic needle guide based on the selection of the desired reference point. The system is also configured to adjust a trajectory of the holographic needle guide to avoid intersecting undesired anatomical structures. The augmented reality display is further configured to stamp the holographic needle guide into a selectively locked trajectory and position.

The invention relates to the technical field of emergency command, and discloses an emergency command system and method based on a BIM digital base, and the method comprises the steps: building a unified data model through expanding an IFC standard, carrying out the semantic mapping and entity alignment of BIM building information, GIS geographic space data, monitoring data and an emergency plan document, and carrying out the construction of a unified data model. The method comprises the steps of generating an emergency knowledge graph with BIM building information as nodes, coupling physical simulation and an LSTM prediction algorithm, injecting monitoring data into a BIM model to deduce a disaster process, outputting a risk thermodynamic diagram and an evacuation forbidden zone, and calculating space-time accessibility of emergency resources through a reinforcement learning model according to a deduction result. An optimization scheme including an unmanned aerial vehicle path, a personnel evacuation route and an equipment scheduling instruction is generated, the instruction is synchronized to an augmented reality individual soldier terminal and a mobile command shelter through an edge computing node, a resource deployment state is labeled in real time in a BIM model, multi-terminal operation is synchronized, the timeliness and accuracy of disaster situation sensing are remarkably improved, and the disaster situation sensing efficiency is improved. And disaster loss is effectively reduced.

The invention relates to the technical field of remote control, and discloses a remote control method and system based on gold wire bonding equipment, and the method comprises the steps: obtaining a high-precision multi-dimensional detection data set; processing the multi-modal original monitoring data to obtain a gold thread quality feature vector matrix; processing the multi-dimensional feature vector set to obtain unified quality index feature mapping; processing the uniform quality index feature mapping to obtain a multi-stage defect detection report; processing the historical quality data and the process parameters to obtain a parameter optimization suggestion report; processing the multi-source monitoring data to obtain an augmented reality interaction system; and the augmented reality interaction system receives an operation decision of a remote operator and remotely controls the gold wire processing equipment. By means of the remote control method and the high-precision remote control system based on the gold wire bonding equipment, millisecond-level response control over gold wire machining equipment is achieved, the instruction execution accuracy is improved, and operation delay is reduced; and potential quality problems are warned in advance.

The invention relates to the technical field of image processing, and discloses an AR technology-based precise positioning method and system for minimally invasive surgery of hepatobiliary surgery. The method comprises the steps that blood vessel network data are extracted through a medical image sequence, a three-dimensional structure diagram is generated, operation target points are marked, and a coordinate system is established; collecting dynamic data for mapping matching, and establishing a real-time tracking model; constructing an augmented reality scene and implanting a navigation path; acquiring an instrument position calculation track, and comparing with a navigation map to generate an instruction; constructing a projection interface to display the key area; recording the whole process and evaluating the operation quality. By establishing the real-time tissue deformation tracking model, a multi-source data fusion accurate positioning mechanism and an intelligent operation quality evaluation system, the accuracy and reliability of operation navigation are effectively improved.

The invention provides an augmented reality cooperation system for a cloud desktop, and the system comprises a cloud service module which generates a virtual desktop image, and carries out the resource monitoring and data storage; the AR equipment is used for collecting data and interacting with virtual reality; the collaborative rendering module is used for fusing AR rendering and virtual reality; the interaction module is used for a multi-modal interaction mode and personalized recommendation; the intelligent scheduling module is used for dynamic resource allocation, resource prediction and optimal management; the network optimization module is used for designing a layered edge architecture and introducing a QUIC protocol to carry out optimized transmission of data streams; the security module is used for carrying out encryption transmission and verifying the identity and access of the user; and the compatible module is used for defining standardized interfaces and protocols and realizing multi-platform support. Functions and resources can be deeply fused, the problems of network dependence, interaction precision, resource allocation and the like are solved, optimal AR presentation and experience effects are provided, and various application scenes are supported.

The invention relates to the technical field of data processing, and discloses an intelligent product page automatic generation method and system for the massive health industry. The method comprises the following steps: performing multi-modal analysis and augmented reality processing on a large health industry prototype graph and multi-source medical data to obtain augmented design information; performing dynamic knowledge graph mapping and causal reasoning on the enhanced design information to obtain semantic structure and knowledge associated data; performing adaptive micro-service deployment analysis on the semantic structure and knowledge associated data to obtain a containerized deployment strategy, and performing intention-driven API design and homomorphic encryption enhancement processing to obtain API interface specification data; performing component design and code generation processing on the API interface specification data to obtain a multi-modal interaction page code; and performing intelligent rendering and dynamic content filling on the multi-modal interaction page code to obtain a target product page. According to the method and the device, the efficiency and the accuracy of automatic generation of intelligent product pages in the large health industry are improved.

Devices and techniques are described for augmented reality virtual makeup try-on. In some examples, first image data representing at least a portion of a human face may be received. A selection of a first virtual makeup asset from a first catalog entry may be received. A first color value and a first finish type of the first virtual makeup asset may be determined. The first color value may be predicted from an image of the first virtual makeup asset in the first catalog entry. The first finish type may be predicted from first text data included in the first catalog entry. A first 3D model of an application of the first virtual makeup asset may be generated based on a 3D mesh of at least the portion of the human face. Second image data may be generated based on the first 3D model and the first image data.

A first image and a second image are accessed. The second image is generated by applying an augmented reality (AR) effect to the first image. The first image, the second image, and a prompt are provided to a visual-semantic machine learning model to obtain output describing at least one feature of the AR effect. A description of the AR effect is generated based on the output of the visual-semantic machine learning model. The description of the AR effect is stored in association with an identifier of the AR effect.

The invention discloses a cognitive impairment assessment system and method based on general artificial intelligence, and the method comprises the following steps: S1, collecting multi-modal data through a wearable device, a mobile application and an online tool; s2, carrying out preprocessing on the multi-modal data; s3, comprehensively analyzing the preprocessed data, evaluating cognitive competence, and identifying a cognitive impaired field; s4, a rehabilitation training plan is generated through a neural evolution algorithm, and the training content, sequence, difficulty and type are dynamically adjusted; s5, providing cognitive training and adjusting tasks in real time through virtual reality and augmented reality technologies; s6, predicting cognitive load and psychological state, and dynamically adjusting the intervention plan; and S7, protecting data privacy by using a block chain technology, monitoring a training effect, and generating a progress report. According to the method, the intervention plan and the privacy protection technology are dynamically adjusted through multi-modal data analysis based on general artificial intelligence, and a personalized and real-time cognitive impairment assessment and intervention scheme is provided.

Devices and techniques are described for dynamically disabling occlusion in augmented reality. Point cloud data representing a physical 3D environment may be generated. An occupancy grid including a plurality of cells representing the 3D physical environment may be generated including first occupancy data for a first cell of the occupancy grid. The first occupancy data may indicate that the first cell is occupied based on a point of the point cloud data being present in the first cell. First data representing a placement of a first 3D virtual object may be received, the placement corresponding to a first set of the plurality of cells. A first number of the first set of the plurality of cells with occupancy data indicating occupancy may be determined. The first 3D virtual object may be rendered on a display of the mobile device in front of any physical objects in the 3D physical environment.

Systems and methods for facilitating registration and validation of registration and / or transformation in connection with image-guided surgery or medical procedures are disclosed. The systems and methods may be used in connection with devices or systems including augmented reality near-eye displays.

A second input image is generated by applying a target augmented reality (AR) effect to a first input image. The first input image and the second input image are provided to a first visual-semantic machine learning model to obtain output describing at least one feature of the target AR effect. The first visual-semantic machine learning model is fine-tuned from a second visual-semantic machine learning model by using training samples. Each training sample comprises a first training image, a second training image, and a training description of a given AR effect. The second training image is generated by applying the given AR effect to the first training image. A description of the target AR effect is selected based on the output of the visual-semantic machine learning model. The description of the target AR effect is stored in association with an identifier of the target AR effect.

The invention discloses an AR intelligent photovoltaic inspection method and system, and the method comprises the following steps: S1, obtaining a panoramic image and heat distribution data of a photovoltaic module, and generating a data set; s2, multi-modal data preprocessing is carried out, key fault features are extracted, and fault areas are marked; s3, focusing and analyzing the marked area, and identifying a thermal abnormal point; s4, constructing an electrical topological graph, and generating a fault point priority; s5, performing ant colony optimization to adjust the inspection path, and marking the position of a fault point; s6, displaying the path, the fault point and the risk heat map in the AR equipment; and S7, generating an inspection report and performing feedback optimization. According to the invention, through multi-modal data fusion, dynamic path optimization and augmented reality technologies, efficient detection, accurate positioning and visual display of photovoltaic module faults are realized, and the inspection efficiency and the intelligent level are improved.

An event entertainment system, according to the present disclosure, includes one or more forms of augmented reality content, an accessory that may be attached to a piece of furniture and / or another location, and a matrix code that helps a user engage, access, interact, and / or play with the aforementioned augmented reality content. The event entertainment system may be used by entities, such as, but not limited to, venues, individuals, and businesses, that operate and / or host events that may involve people and users, such as, but not limited to, fans and participants of an event.

The invention discloses an intelligent switch fault monitoring system which comprises a multi-modal data acquisition module, an intelligent feature extraction module, a fault prediction root cause positioning module, an intelligent decision module, a digital twin operation and maintenance module, a security situation awareness module, a model optimization and self-learning module and an enhanced display visualization interaction module. The fault prediction root cause positioning module uses a lightweight hybrid encoder model to efficiently encode the fused features, learns spatial-temporal feature representation of the switch operation state, uses a gradient SHAP algorithm to calculate the contribution degree of each feature to fault occurrence, generates a fault root cause thermodynamic diagram, and sends the fault root cause thermodynamic diagram to the switch operation state; through deep integration of artificial intelligence, digital twinning and augmented reality technologies, a passive mode of traditional switch fault monitoring is thoroughly changed, an intelligent operation and maintenance system with self-sensing, self-decision and self-recovery capabilities is constructed, and all-around guarantee is provided for reliable operation of a data center and network infrastructures.

The invention provides a scene reproduction and augmented reality simulation training method for floating installation. The method comprises the following steps: acquiring an external environment and an equipment state in real time; acquiring operation behavior data of the trainee in the training process, performing timestamp matching on the operation behavior data and the dynamic simulation scene, constructing a synchronous model, calculating a key performance index based on the synchronized data to quantify the operation effect of the trainee, and obtaining an operation performance record; when it is detected that the student fails to operate, a failure scene of the student is reconstructed based on currently collected operation behavior data and a dynamic simulation scene, and a failure path is analyzed by using a reinforcement learning model; generating an optimized floating track and an optimized posture adjustment path according to the failure scene of the reconstructed student and the optimization suggestion; and the trainee completes the floating support installation operation according to the optimized path displayed by the augmented reality equipment. According to the invention, the efficiency and effect of floating support installation training can be greatly improved, and a more efficient and intelligent solution is provided for the ocean engineering field.

Head-mounted displays with waveguides comprising superimposed diffractive gratings and methods for fabricating said waveguides are described herein. In an embodiment, a head-mounted display comprises an optical element and an image source that provides an image beam to an optical element. The optical element comprises two gratings superimposed over each other, at least one of which comprising a buried diffractive grating. The buried diffractive grating comprises a high-refractive index material interspersed with a low-refractive index material or non-solid pockets, such as gas, air or vacuum. Light diffracted by a first of the two gratings is further diffracted by a second of the two gratings without interacting with a surface of the optical element between diffractions.

The invention discloses an illness state tracking management system and method based on a lingual face diagnosis instrument, and belongs to the technical field of traditional Chinese medicine tongue diagnosis and modern information technology fusion. The system comprises a multi-modal data acquisition module, a data processing and analysis module and an augmented reality visualization module; according to the method, illness state tracking is achieved through the steps of multi-modal data acquisition, data preprocessing and feature fusion, personalized digital twinborn model establishment, augmented reality visualization presentation and the like, multi-dimensional data such as tongue picture macroscopic features and tongue surface microorganism distribution can be integrated, dynamic association between the data is revealed, the health state and the intervention effect are visually displayed, and the method is suitable for being popularized and applied. The method is suitable for the fields of traditional Chinese medicine health management and chronic disease monitoring.

A method to employ a three-dimensional (3D) model is provided. The method may include: displaying, on a graphical user interface (GUI) of a display device, at least one selectable option corresponding to at least one 3D model stored in a storage, each of the at least one 3D model corresponding to a 3D data representation and a location tracking data representation; receiving a selection of an option from a user via the GUI, the selected option corresponding to a selected 3D model of a reference surface; in response to receipt of the selection of the option, switching to display a real-time camera view on the GUI; determining that the reference surface is present in the real-time camera view; and superimposing at least one of the 3D data representation or the location tracking data representation of the selected 3D model on the reference surface displayed in the real-time camera view.

The invention relates to the technical field of power system management, in particular to a Beidou-based power grid emergency wireless command system, which comprises a Beidou positioning communication terminal, a multi-source data fusion terminal, an intelligent decision-making terminal, a heterogeneous communication terminal and a visual command terminal. The Beidou positioning communication module accurately obtains the position of the power equipment and transmits an encryption instruction; the multi-source data fusion module integrates power, weather and geographic information, and provides support for decision making through data cleaning and space-time correlation analysis; the intelligent decision-making module generates a multi-target optimization decision by applying an improved multi-target genetic algorithm based on a digital twinborn dynamic plan library and a deep reinforcement learning algorithm; the heterogeneous communication module integrates various communication units, realizes mode dynamic switching and bandwidth aggregation, and ensures stable communication. And the visual command terminal displays the power grid situation and efficiently issues an instruction by means of augmented reality and multi-level authority management. The power grid emergency response and command efficiency is greatly improved, and power supply stability is powerfully guaranteed.

A head-mounted display system includes a frame; an adjustable strap assembly that includes a first side strap coupled to the frame; a second side strap coupled to the frame; and an adjustment mechanism configured to adjust a circumferential size defined by the first side strap, the second side strap, and the frame; a see-through display assembly pivotably coupled to the frame; a first temple housing pivotably coupled to the frame and slidably coupled to the first side strap; and a second temple housing pivotably coupled to the frame and slidably coupled to the second side strap.

The invention relates to the technical field of workpiece assembly, in particular to a digital twinning and augmented reality guided man-machine cooperation assembly method and system, and the method comprises the steps: collecting a multi-view image, mechanical arm sensing data and a first person image of AR glasses; fusing the data, generating scene assembly information, and constructing a digital twin model; configuring an operation standard, a standard assembly unit space state and a standard hand action template of each assembly process stage, judging a current assembly process stage, identifying an operation intention, predicting a next process in combination with the current assembly stage and the operation standard, and generating a man-machine instruction and simulation data; three-dimensional action guidance is displayed through AR glasses, a mechanical arm is driven to execute planning actions, and a digital twin interface feeds back the assembly state, precision data and prediction animation in real time. According to the method, man-machine standardized cooperation and high-precision assembly are achieved, pre-stored parameters are adaptive to multi-variety production, and the process consistency is improved through real-time feedback.

The invention relates to the technical field of geological informatization, in particular to a time-space sequence prediction and risk assessment model for geological disaster monitoring data, which comprises a data acquisition module, an edge processing module, a cloud analysis module, a mobile terminal module and a data processing module, the server is connected with the cloud analysis module through a WebSocket protocol, and is used for receiving the prediction result and the visual data; and displaying the three-dimensional illness state evolution graph on augmented reality (AR) equipment. Through the innovative technical scheme, comprehensive breakthrough is achieved in the aspects of multi-modal data fusion, dynamic feature extraction, accurate prediction, robustness design, visual display and the like. The innovation points cooperate with one another and promote one another, and an efficient, reliable and intelligent MS remote monitoring and prognosis prediction system is jointly constructed.