4844 results about "Augment reality" patented technology

The invention discloses a wind power plant booster station multi-source data fusion anti-misoperation locking intelligent decision-making and early warning method, and relates to the technical field of intelligent misoperation prevention of a power system, and the method comprises the following steps: collecting multi-source heterogeneous data, obtaining the data through a distributed sensor network, and carrying out the edge calculation preprocessing; performing data space-time alignment and fusion, performing equipment state evaluation, and constructing a deep belief network and Bayesian network hybrid model to calculate a health index; anti-misoperation rule modeling is carried out, and operation logic verification is carried out based on a Petri network and an expert knowledge base; risk early warning decision making: fusing multi-source early warning information to divide risk levels; intelligent locking control is carried out, and a locking strategy is optimized through reinforcement learning; and performing decision support and visualization, constructing a three-dimensional digital twinborn model, and displaying operation guidance and risk early warning in combination with an AR technology. Through multi-source data fusion and intelligent decision making, the anti-misoperation locking accuracy and efficiency are improved, and the safety and the operation and maintenance level of the booster station are remarkably enhanced by equipment fault early warning three months ahead of time.

The invention discloses a mechanical equipment state monitoring method and system based on multiple sensors, and the method comprises the five core steps: multi-modal data collection and preprocessing, dynamic feature fusion, adaptive threshold diagnosis, digital twin fault tracing and predictive maintenance decision. All-domain coverage of equipment is realized through a three-layer sensor network architecture, the problems of data synchronization and interference resistance are solved by utilizing a temperature and vibration integrated sensor, deep fusion and anomaly detection of multi-source data are realized in combination with an attention mechanism, a Gaussian mixture model, a three-dimensional convolutional neural network and the like, and finally a precise maintenance strategy is generated through digital twinning and reinforcement learning. The multi-sensor-based mechanical equipment state monitoring system comprises a sensor network layer, an edge computing layer, a cloud platform layer and a man-machine interaction layer, supports federated learning to protect data privacy, improves real-time diagnosis capability through edge-cloud collaboration, and enhances a reality interface to realize intelligent operation and maintenance interaction.

The invention relates to the technical field of construction progress monitoring, and discloses a construction progress monitoring method and system based on big data. The method comprises the following steps: forming a space-time alignment data set through multi-source data acquisition, filtering and quality evaluation; performing feature extraction and registration to generate a digital model; target detection classification is performed to form a completion state table; progress evaluation is achieved through component-task mapping; trend analysis and risk identification are performed to generate a prediction result; decision reference is provided for personalized information screening and augmented reality display. Through multi-source data acquisition, fusion and intelligent analysis, accurate perception, objective evaluation, scientific prediction and visual presentation of the actual state of the construction site are realized, so that a comprehensive, accurate and prospective construction progress monitoring method is provided, the construction period delay risk is effectively reduced, and the construction management efficiency is improved.

A holographic augmented reality ultrasound needle guide system and method includes an augmented reality display such as a headset wearable by a user. The augmented reality display is configured to depict a virtual ultrasound image. The augmented reality display is further configured to allow a user to select a desired reference point on the virtual ultrasound image. The system is configured to depict a holographic needle guide based on the selection of the desired reference point. The system is also configured to adjust a trajectory of the holographic needle guide to avoid intersecting undesired anatomical structures. The augmented reality display is further configured to stamp the holographic needle guide into a selectively locked trajectory and position.

The invention relates to the technical field of emergency command, and discloses an emergency command system and method based on a BIM digital base, and the method comprises the steps: building a unified data model through expanding an IFC standard, carrying out the semantic mapping and entity alignment of BIM building information, GIS geographic space data, monitoring data and an emergency plan document, and carrying out the construction of a unified data model. The method comprises the steps of generating an emergency knowledge graph with BIM building information as nodes, coupling physical simulation and an LSTM prediction algorithm, injecting monitoring data into a BIM model to deduce a disaster process, outputting a risk thermodynamic diagram and an evacuation forbidden zone, and calculating space-time accessibility of emergency resources through a reinforcement learning model according to a deduction result. An optimization scheme including an unmanned aerial vehicle path, a personnel evacuation route and an equipment scheduling instruction is generated, the instruction is synchronized to an augmented reality individual soldier terminal and a mobile command shelter through an edge computing node, a resource deployment state is labeled in real time in a BIM model, multi-terminal operation is synchronized, the timeliness and accuracy of disaster situation sensing are remarkably improved, and the disaster situation sensing efficiency is improved. And disaster loss is effectively reduced.

The invention relates to the technical field of remote control, and discloses a remote control method and system based on gold wire bonding equipment, and the method comprises the steps: obtaining a high-precision multi-dimensional detection data set; processing the multi-modal original monitoring data to obtain a gold thread quality feature vector matrix; processing the multi-dimensional feature vector set to obtain unified quality index feature mapping; processing the uniform quality index feature mapping to obtain a multi-stage defect detection report; processing the historical quality data and the process parameters to obtain a parameter optimization suggestion report; processing the multi-source monitoring data to obtain an augmented reality interaction system; and the augmented reality interaction system receives an operation decision of a remote operator and remotely controls the gold wire processing equipment. By means of the remote control method and the high-precision remote control system based on the gold wire bonding equipment, millisecond-level response control over gold wire machining equipment is achieved, the instruction execution accuracy is improved, and operation delay is reduced; and potential quality problems are warned in advance.

The invention relates to the technical field of image processing, and discloses an AR technology-based precise positioning method and system for minimally invasive surgery of hepatobiliary surgery. The method comprises the steps that blood vessel network data are extracted through a medical image sequence, a three-dimensional structure diagram is generated, operation target points are marked, and a coordinate system is established; collecting dynamic data for mapping matching, and establishing a real-time tracking model; constructing an augmented reality scene and implanting a navigation path; acquiring an instrument position calculation track, and comparing with a navigation map to generate an instruction; constructing a projection interface to display the key area; recording the whole process and evaluating the operation quality. By establishing the real-time tissue deformation tracking model, a multi-source data fusion accurate positioning mechanism and an intelligent operation quality evaluation system, the accuracy and reliability of operation navigation are effectively improved.

The invention provides an augmented reality cooperation system for a cloud desktop, and the system comprises a cloud service module which generates a virtual desktop image, and carries out the resource monitoring and data storage; the AR equipment is used for collecting data and interacting with virtual reality; the collaborative rendering module is used for fusing AR rendering and virtual reality; the interaction module is used for a multi-modal interaction mode and personalized recommendation; the intelligent scheduling module is used for dynamic resource allocation, resource prediction and optimal management; the network optimization module is used for designing a layered edge architecture and introducing a QUIC protocol to carry out optimized transmission of data streams; the security module is used for carrying out encryption transmission and verifying the identity and access of the user; and the compatible module is used for defining standardized interfaces and protocols and realizing multi-platform support. Functions and resources can be deeply fused, the problems of network dependence, interaction precision, resource allocation and the like are solved, optimal AR presentation and experience effects are provided, and various application scenes are supported.

Devices and techniques are described for augmented reality virtual makeup try-on. In some examples, first image data representing at least a portion of a human face may be received. A selection of a first virtual makeup asset from a first catalog entry may be received. A first color value and a first finish type of the first virtual makeup asset may be determined. The first color value may be predicted from an image of the first virtual makeup asset in the first catalog entry. The first finish type may be predicted from first text data included in the first catalog entry. A first 3D model of an application of the first virtual makeup asset may be generated based on a 3D mesh of at least the portion of the human face. Second image data may be generated based on the first 3D model and the first image data.

A first image and a second image are accessed. The second image is generated by applying an augmented reality (AR) effect to the first image. The first image, the second image, and a prompt are provided to a visual-semantic machine learning model to obtain output describing at least one feature of the AR effect. A description of the AR effect is generated based on the output of the visual-semantic machine learning model. The description of the AR effect is stored in association with an identifier of the AR effect.

The invention discloses a cognitive impairment assessment system and method based on general artificial intelligence, and the method comprises the following steps: S1, collecting multi-modal data through a wearable device, a mobile application and an online tool; s2, carrying out preprocessing on the multi-modal data; s3, comprehensively analyzing the preprocessed data, evaluating cognitive competence, and identifying a cognitive impaired field; s4, a rehabilitation training plan is generated through a neural evolution algorithm, and the training content, sequence, difficulty and type are dynamically adjusted; s5, providing cognitive training and adjusting tasks in real time through virtual reality and augmented reality technologies; s6, predicting cognitive load and psychological state, and dynamically adjusting the intervention plan; and S7, protecting data privacy by using a block chain technology, monitoring a training effect, and generating a progress report. According to the method, the intervention plan and the privacy protection technology are dynamically adjusted through multi-modal data analysis based on general artificial intelligence, and a personalized and real-time cognitive impairment assessment and intervention scheme is provided.

A second input image is generated by applying a target augmented reality (AR) effect to a first input image. The first input image and the second input image are provided to a first visual-semantic machine learning model to obtain output describing at least one feature of the target AR effect. The first visual-semantic machine learning model is fine-tuned from a second visual-semantic machine learning model by using training samples. Each training sample comprises a first training image, a second training image, and a training description of a given AR effect. The second training image is generated by applying the given AR effect to the first training image. A description of the target AR effect is selected based on the output of the visual-semantic machine learning model. The description of the target AR effect is stored in association with an identifier of the target AR effect.

The invention discloses an AR intelligent photovoltaic inspection method and system, and the method comprises the following steps: S1, obtaining a panoramic image and heat distribution data of a photovoltaic module, and generating a data set; s2, multi-modal data preprocessing is carried out, key fault features are extracted, and fault areas are marked; s3, focusing and analyzing the marked area, and identifying a thermal abnormal point; s4, constructing an electrical topological graph, and generating a fault point priority; s5, performing ant colony optimization to adjust the inspection path, and marking the position of a fault point; s6, displaying the path, the fault point and the risk heat map in the AR equipment; and S7, generating an inspection report and performing feedback optimization. According to the invention, through multi-modal data fusion, dynamic path optimization and augmented reality technologies, efficient detection, accurate positioning and visual display of photovoltaic module faults are realized, and the inspection efficiency and the intelligent level are improved.

An event entertainment system, according to the present disclosure, includes one or more forms of augmented reality content, an accessory that may be attached to a piece of furniture and / or another location, and a matrix code that helps a user engage, access, interact, and / or play with the aforementioned augmented reality content. The event entertainment system may be used by entities, such as, but not limited to, venues, individuals, and businesses, that operate and / or host events that may involve people and users, such as, but not limited to, fans and participants of an event.

The invention discloses an intelligent switch fault monitoring system which comprises a multi-modal data acquisition module, an intelligent feature extraction module, a fault prediction root cause positioning module, an intelligent decision module, a digital twin operation and maintenance module, a security situation awareness module, a model optimization and self-learning module and an enhanced display visualization interaction module. The fault prediction root cause positioning module uses a lightweight hybrid encoder model to efficiently encode the fused features, learns spatial-temporal feature representation of the switch operation state, uses a gradient SHAP algorithm to calculate the contribution degree of each feature to fault occurrence, generates a fault root cause thermodynamic diagram, and sends the fault root cause thermodynamic diagram to the switch operation state; through deep integration of artificial intelligence, digital twinning and augmented reality technologies, a passive mode of traditional switch fault monitoring is thoroughly changed, an intelligent operation and maintenance system with self-sensing, self-decision and self-recovery capabilities is constructed, and all-around guarantee is provided for reliable operation of a data center and network infrastructures.

The invention provides a scene reproduction and augmented reality simulation training method for floating installation. The method comprises the following steps: acquiring an external environment and an equipment state in real time; acquiring operation behavior data of the trainee in the training process, performing timestamp matching on the operation behavior data and the dynamic simulation scene, constructing a synchronous model, calculating a key performance index based on the synchronized data to quantify the operation effect of the trainee, and obtaining an operation performance record; when it is detected that the student fails to operate, a failure scene of the student is reconstructed based on currently collected operation behavior data and a dynamic simulation scene, and a failure path is analyzed by using a reinforcement learning model; generating an optimized floating track and an optimized posture adjustment path according to the failure scene of the reconstructed student and the optimization suggestion; and the trainee completes the floating support installation operation according to the optimized path displayed by the augmented reality equipment. According to the invention, the efficiency and effect of floating support installation training can be greatly improved, and a more efficient and intelligent solution is provided for the ocean engineering field.

Head-mounted displays with waveguides comprising superimposed diffractive gratings and methods for fabricating said waveguides are described herein. In an embodiment, a head-mounted display comprises an optical element and an image source that provides an image beam to an optical element. The optical element comprises two gratings superimposed over each other, at least one of which comprising a buried diffractive grating. The buried diffractive grating comprises a high-refractive index material interspersed with a low-refractive index material or non-solid pockets, such as gas, air or vacuum. Light diffracted by a first of the two gratings is further diffracted by a second of the two gratings without interacting with a surface of the optical element between diffractions.

The invention discloses an illness state tracking management system and method based on a lingual face diagnosis instrument, and belongs to the technical field of traditional Chinese medicine tongue diagnosis and modern information technology fusion. The system comprises a multi-modal data acquisition module, a data processing and analysis module and an augmented reality visualization module; according to the method, illness state tracking is achieved through the steps of multi-modal data acquisition, data preprocessing and feature fusion, personalized digital twinborn model establishment, augmented reality visualization presentation and the like, multi-dimensional data such as tongue picture macroscopic features and tongue surface microorganism distribution can be integrated, dynamic association between the data is revealed, the health state and the intervention effect are visually displayed, and the method is suitable for being popularized and applied. The method is suitable for the fields of traditional Chinese medicine health management and chronic disease monitoring.

The invention relates to the technical field of power system management, in particular to a Beidou-based power grid emergency wireless command system, which comprises a Beidou positioning communication terminal, a multi-source data fusion terminal, an intelligent decision-making terminal, a heterogeneous communication terminal and a visual command terminal. The Beidou positioning communication module accurately obtains the position of the power equipment and transmits an encryption instruction; the multi-source data fusion module integrates power, weather and geographic information, and provides support for decision making through data cleaning and space-time correlation analysis; the intelligent decision-making module generates a multi-target optimization decision by applying an improved multi-target genetic algorithm based on a digital twinborn dynamic plan library and a deep reinforcement learning algorithm; the heterogeneous communication module integrates various communication units, realizes mode dynamic switching and bandwidth aggregation, and ensures stable communication. And the visual command terminal displays the power grid situation and efficiently issues an instruction by means of augmented reality and multi-level authority management. The power grid emergency response and command efficiency is greatly improved, and power supply stability is powerfully guaranteed.

The invention relates to the technical field of workpiece assembly, in particular to a digital twinning and augmented reality guided man-machine cooperation assembly method and system, and the method comprises the steps: collecting a multi-view image, mechanical arm sensing data and a first person image of AR glasses; fusing the data, generating scene assembly information, and constructing a digital twin model; configuring an operation standard, a standard assembly unit space state and a standard hand action template of each assembly process stage, judging a current assembly process stage, identifying an operation intention, predicting a next process in combination with the current assembly stage and the operation standard, and generating a man-machine instruction and simulation data; three-dimensional action guidance is displayed through AR glasses, a mechanical arm is driven to execute planning actions, and a digital twin interface feeds back the assembly state, precision data and prediction animation in real time. According to the method, man-machine standardized cooperation and high-precision assembly are achieved, pre-stored parameters are adaptive to multi-variety production, and the process consistency is improved through real-time feedback.

The invention relates to the technical field of geological informatization, in particular to a time-space sequence prediction and risk assessment model for geological disaster monitoring data, which comprises a data acquisition module, an edge processing module, a cloud analysis module, a mobile terminal module and a data processing module, the server is connected with the cloud analysis module through a WebSocket protocol, and is used for receiving the prediction result and the visual data; and displaying the three-dimensional illness state evolution graph on augmented reality (AR) equipment. Through the innovative technical scheme, comprehensive breakthrough is achieved in the aspects of multi-modal data fusion, dynamic feature extraction, accurate prediction, robustness design, visual display and the like. The innovation points cooperate with one another and promote one another, and an efficient, reliable and intelligent MS remote monitoring and prognosis prediction system is jointly constructed.

The invention discloses a bronze ware ornamentation and pattern digital restoration method based on an image enhancement technology, and relates to the technical field of image restoration, and the method comprises the steps: building a space mapping matrix; extracting multi-modal data features by using the surface state of the topological insulator, and registering a joint data volume; forming a super-resolution image through super-resolution reconstruction; obtaining a material degradation coefficient by using a wavelet finite element method and a graph neural network; generating an adversarial network by utilizing physical constraints, and generating an embarrassment repairing result; a material sensing three-dimensional model is constructed by adopting a wavelet packet decomposition and neural radiation field fusion technology, texture mapping is dynamically adjusted based on a graphene Moire effect, and virtual-real fusion is performed through holographic waveguide AR; by combining advanced technologies such as a metamaterial lens, micro-distance laser scanning, a topological insulator film, a graphene heterojunction and a nerve radiation field, high-precision three-dimensional digital restoration and repair of bronze cultural relics are realized, and immersive augmented reality display experience is provided.

Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

The invention provides an intelligent actual measurement and quantity management method and system for a building. The method comprises the following steps: capturing environmental parameters, material circulation paths and spatial geometric information of key parts of a building in a construction process in real time to obtain a measurement data set; a distributed ledger technology is combined with a homomorphic encryption algorithm, a graph theory analysis technology is applied to evaluate a dependency relationship among operation points of a construction site, and a data log is generated; according to the data log, using an augmented reality technology to superpose a BIM model, introducing a support vector machine algorithm to carry out automatic classification and risk assessment processing on deviation data between measured data and preset standard data, and generating a rectification suggestion report; and a closed-loop quality management process is formed by continuously collecting rectification effect feedback. According to the technical scheme, high transparency and efficient quality control in the construction process are ensured.

The invention discloses an augmented reality head-up display system and a display method thereof, relates to the technical field of auxiliary driving, and aims at complex road conditions and diversified driving requirements. The comprehensive fusion analysis of the driving environment and the driver state is realized by sequentially executing the four steps of environment perception and multi-source data acquisition, situation analysis and information complexity judgment, dynamic content screening and display strategy generation and real-time monitoring and self-adaptive feedback closed loop. The method comprises the following steps of: marking and normalizing multi-dimensional sensing data to form an environment factor and a driving load factor, and judging the current information complexity by using a nonlinear algorithm; thirdly, screening the most critical content from the information pool according to the priority, and performing refined arrangement according to the display position and style; and if the HUD configuration deviation is monitored and detected, dynamic strategy updating is executed, so that the AR-HUD always ensures the accuracy and the conciseness of information display in different scenes, and the driving safety and the user experience are improved.

The invention relates to the technical field of risk management, and discloses an asset and risk management-oriented dynamic risk visual management method, which comprises the following steps of: automatically scanning to obtain asset information in a network, and classifying assets; based on the asset information, determining a connection relationship between assets, and constructing a network topology structure diagram; based on a vulnerability database, vulnerabilities existing in the assets are analyzed, an attack graph is generated, and a preset attack path is determined; analyzing a preset attack path to determine an attack path in combination with the network flow data and an attack technique; evaluating the security defense system in the attack path by using a simulated attack technology, and determining the defense efficiency; based on augmented reality and virtual reality technologies, vulnerabilities, attack paths and defense efficiency of each asset are dynamically displayed on a network topology structure diagram. The invention provides an efficient, intuitive and dynamic risk visualization management method by combining various technologies, and the asset management and risk response capabilities can be remarkably improved.

In various examples, each user of a hosted application may be modeled with a corresponding user-specific resource consumption model that predicts a measure of that user's anticipated (e.g., processing, memory or storage, and / or networking) resource utilization at some future time based on an input representation of one or more features of the user's current session, application (e.g., game) setup, skill or experience level, social media activity, some time series representing feature(s) for a series of interactions, the time of day, and / or other characteristics. As such, user-specific models may be used to predict resource demands at a future time and schedule resource allocations accordingly. The present techniques may be used to manage and reallocate resources for applications such as game streaming applications, remote desktop applications, simulation applications (e.g., an autonomous or semi-autonomous vehicle simulation), virtual reality (VR) and / or augmented reality (AR) streaming applications, and / or other application types.

The invention provides an audio processing device and method, an augmented reality device, equipment and a storage medium, and belongs to the technical field of virtual reality display and sensing. The audio processing device comprises a positioning device which is configured to track and position a user in a real space in real time, determine positioning information of the user and send the positioning information to a processor; the processor is configured to determine target positioning information of the user based on pre-established spatial information and the real-time positioning information of the user; determining association relationship information between the user and a virtual sound source in a virtual space based on pre-established space information and real-time target positioning information of the user; obtaining human body parameters of the user, and determining an audio filtering result matched with the user based on the association relationship information, the human body parameters and the audio frequency of the virtual sound source; and reconstructing the audio to be played based on the audio configured for the virtual sound source in advance and the audio filtering result.

Systems and methods are provided for facilitating an interactive artificial-reality activity. A method includes, after a user of a head-wearable device has opted-in to using an artificial-reality application to facilitate connecting with other participating users, determining, based on user-specific suggestion criteria, that a suggested user is located in an approved common space with the user and has opted-in to use the artificial-reality application. The method includes causing the head-wearable device to present an user interface (UI) element for linking the suggested user and the user. Upon the user selecting the UI element for linking the suggested user with the user, the method includes automatically causing the head-wearable device to provide visual-guidance UI elements to navigate the user to an interactive-activity location where the user and the suggested user will perform an artificial-reality activity while also displaying information about the artificial-reality activity to be performed.

The invention relates to the technical field of power management, in particular to a multi-source heterogeneous data three-dimensional fusion analysis method based on a power grid unified information model, which comprises the following steps of: performing timestamp alignment and space coordinate normalization processing on SCADA system real-time data, GIS geographic information data, equipment vibration spectrum data and infrared thermal imaging data; and constructing a unified three-dimensional attribute matrix, and fusing the multi-source data based on a power grid unified information model. A three-dimensional space interpolation algorithm is adopted to carry out topological reconstruction on the model, a three-dimensional space-time topological structure containing equipment connection relations, electrical parameters and space coordinates is generated, intelligent prediction is carried out on the equipment fault probability in combination with a depth prediction model, and an augmented reality display interface with prediction and early warning information is generated through a three-dimensional visualization engine. According to the invention, the accuracy and the real-time performance of power grid equipment monitoring are effectively improved, the fault early warning and decision support capability is enhanced, and the operation safety and the management efficiency of a power grid are improved.