3568 results about "Augment reality" patented technology

The invention discloses a mechanical equipment state monitoring method and system based on multiple sensors, and the method comprises the five core steps: multi-modal data collection and preprocessing, dynamic feature fusion, adaptive threshold diagnosis, digital twin fault tracing and predictive maintenance decision. All-domain coverage of equipment is realized through a three-layer sensor network architecture, the problems of data synchronization and interference resistance are solved by utilizing a temperature and vibration integrated sensor, deep fusion and anomaly detection of multi-source data are realized in combination with an attention mechanism, a Gaussian mixture model, a three-dimensional convolutional neural network and the like, and finally a precise maintenance strategy is generated through digital twinning and reinforcement learning. The multi-sensor-based mechanical equipment state monitoring system comprises a sensor network layer, an edge computing layer, a cloud platform layer and a man-machine interaction layer, supports federated learning to protect data privacy, improves real-time diagnosis capability through edge-cloud collaboration, and enhances a reality interface to realize intelligent operation and maintenance interaction.

The invention discloses an intelligent switch fault monitoring system which comprises a multi-modal data acquisition module, an intelligent feature extraction module, a fault prediction root cause positioning module, an intelligent decision module, a digital twin operation and maintenance module, a security situation awareness module, a model optimization and self-learning module and an enhanced display visualization interaction module. The fault prediction root cause positioning module uses a lightweight hybrid encoder model to efficiently encode the fused features, learns spatial-temporal feature representation of the switch operation state, uses a gradient SHAP algorithm to calculate the contribution degree of each feature to fault occurrence, generates a fault root cause thermodynamic diagram, and sends the fault root cause thermodynamic diagram to the switch operation state; through deep integration of artificial intelligence, digital twinning and augmented reality technologies, a passive mode of traditional switch fault monitoring is thoroughly changed, an intelligent operation and maintenance system with self-sensing, self-decision and self-recovery capabilities is constructed, and all-around guarantee is provided for reliable operation of a data center and network infrastructures.

The invention discloses an illness state tracking management system and method based on a lingual face diagnosis instrument, and belongs to the technical field of traditional Chinese medicine tongue diagnosis and modern information technology fusion. The system comprises a multi-modal data acquisition module, a data processing and analysis module and an augmented reality visualization module; according to the method, illness state tracking is achieved through the steps of multi-modal data acquisition, data preprocessing and feature fusion, personalized digital twinborn model establishment, augmented reality visualization presentation and the like, multi-dimensional data such as tongue picture macroscopic features and tongue surface microorganism distribution can be integrated, dynamic association between the data is revealed, the health state and the intervention effect are visually displayed, and the method is suitable for being popularized and applied. The method is suitable for the fields of traditional Chinese medicine health management and chronic disease monitoring.

The invention discloses a bronze ware ornamentation and pattern digital restoration method based on an image enhancement technology, and relates to the technical field of image restoration, and the method comprises the steps: building a space mapping matrix; extracting multi-modal data features by using the surface state of the topological insulator, and registering a joint data volume; forming a super-resolution image through super-resolution reconstruction; obtaining a material degradation coefficient by using a wavelet finite element method and a graph neural network; generating an adversarial network by utilizing physical constraints, and generating an embarrassment repairing result; a material sensing three-dimensional model is constructed by adopting a wavelet packet decomposition and neural radiation field fusion technology, texture mapping is dynamically adjusted based on a graphene Moire effect, and virtual-real fusion is performed through holographic waveguide AR; by combining advanced technologies such as a metamaterial lens, micro-distance laser scanning, a topological insulator film, a graphene heterojunction and a nerve radiation field, high-precision three-dimensional digital restoration and repair of bronze cultural relics are realized, and immersive augmented reality display experience is provided.

Technology is described for augmenting medical imaging for use in a medical procedure. The method can include the operation of receiving an image of patient anatomy captured by a visual image camera during the medical procedure. An acquired medical image associated with the patient anatomy can then be retrieved. Another operation can be associating the acquired medical image to the patient anatomy. An augmentation tag associated with a location in one layer of the acquired medical image can be retrieved. A further operation can be projecting the acquired medical image and the augmentation tag using an augmented reality headset to form a single graphical view as an overlay to the patient anatomy in either 2D, 3D or holographic form.

1. Name of the product in this design: Augmented Reality Smart Glasses Frame. 2. Purpose of this design: This design is an augmented reality smart glasses frame. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1. 5. Other situations requiring explanation: Part A in the 3D diagram 1 is made of transparent or semi-transparent material.

A system and method for using augmented reality device for use during a surgical procedure are described. A system may include an augmented reality device to present a virtual indication, such as a virtual indication of a surgical instrument, a force vector, a direction, or the like. The augmented reality device may present a virtual aspect of a procedure, such as a virtual animation of a step of a procedure. The augmented reality device may present a virtual object, indication, aspect, etc., within a surgical field while permitting the surgical field or aspects of the surgical field to be viewed through the augmented reality display (e.g., presenting virtual objects mixed with real objects).

Systems, devices, and methods for generating a customized content item, including: detecting a user interest of a user in an object; based on the detecting of the user interest, determining an interest level corresponding to the object; obtaining a content item to be presented to the user; based on the interest level corresponding to the object being greater than a predetermined threshold interest level, providing information about the object along with the content item to a generative artificial intelligence (AI) model to obtain the customized content item; and presenting the customized content item to the user using an augmented reality (AR) device.

The invention discloses a power equipment dynamic health degree assessment and predictive maintenance method, and belongs to the technical field of railway power system operation and maintenance. The method comprises the following steps: constructing a parameterized digital twinborn body of power equipment, and collecting real-time operation data, resume data and environment data; based on the parameterized digital twins and the collected data, equipment health degree components are calculated through a multi-model cooperation method, and a comprehensive health index is generated through fusion; performing equipment life prediction and maintenance decision generation according to the comprehensive health index, and outputting an optimal maintenance strategy; and performing visual virtual rehearsal and augmented reality auxiliary execution on the optimal maintenance strategy to form a closed-loop maintenance system. According to the method, the problems of data and model separation, model static stiffness and health assessment deficiency in the prior art are solved, dynamic perception, accurate assessment and predictive maintenance of the equipment state are realized, and the operation and maintenance efficiency and the system reliability are improved.

Disclosed is a image processing apparatus and a method for controlling the image processing apparatus. The image processing apparatus according to an embodiment of the present disclosure may identify an object from an acquired image, determine whether the object is hidden by another object by using an aspect ratio of a bounding box of the detected object, and based on the object being hidden, estimate an entire length of the object based on coordinate information of the bounding box. Accordingly, the size information of the hidden object may be efficiently identified while a large amount of database is applied or resources of the apparatus is minimized. The present disclosure may be in connection with a surveillance camera, an automotive driving vehicle, an artificial intelligence module of at least one of a user terminal or a server, a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to a 5G service, and the like.

The invention discloses a mechatronics product detection system based on an artificial intelligence image recognition technology, and relates to the technical field of artificial intelligence and mechatronics, and the mechatronics product detection system comprises an image acquisition module, a preprocessing module, a feature extraction module, a defect recognition module, a data management module, a result output module and a system control module, the preprocessing module has the functions of adaptive zooming and intelligent obstacle avoidance, and processes images by using a deep learning algorithm and a quantum filtering technology; a deep convolutional neural network is used for feature extraction, SVM and CNN are combined for defect recognition, a meta-learning mechanism is introduced, a distributed database and federated learning are adopted for data management, AR navigation and gesture interaction is used for result output, and a block chain intelligent contract is used for system control to deploy resources. The method has obvious advantages and high detection precision, and can accurately identify tiny and hidden defects; efficiency is greatly improved, and edge and cloud computing are combined to reduce processing time; operation is convenient, VR, AR and voice interaction are used, and the maintenance efficiency is improved.

The invention belongs to the technical field of project management and intelligent supervision, and discloses a project cost accounting management method and system for project supervision, and the method comprises the steps: inputting a preprocessing data packet into an edge calculation node, carrying out the dynamic data cleaning through employing a noise filtering matrix algorithm, and outputting a structured data set with a quality label; on the basis of the structured data set with the quality label, scanning a construction part through augmented reality glasses, comparing actual coordinates with building information model design coordinates in real time, and when a deviation accumulated value exceeds an early warning threshold value, generating an acceptance evidence chain which cannot be tampered; and accumulating the incremental cost of the plurality of standardized visa file packages, carrying out time sequence analysis through a long-short term memory prediction model, and outputting a project cost analysis report with a risk level. The problem of loss of acceptance evidence chains in traditional cost accounting is solved, and the strong dependence of a conventional prediction model on data distribution is broken through.

The invention relates to the technical field of data processing, discloses a digital twin adaptive decision platform for TBM tunneling and a control method, and aims to solve the problems of single sensing dimension, mutual separation of physical and data models, disjunction of early warning and control links and low man-machine interaction efficiency in the prior art. According to the scheme, the method mainly comprises the steps that multi-source real-time data is collected through a hardware sensing layer, after the multi-source real-time data is processed through a data management and fusion layer, a digital twin model layer constructs a physical-data fusion model and completes risk assessment, finally risk visualization is achieved through an augmented reality interaction layer, and an intelligent control decision-making layer generates a control instruction and outputs the control instruction to a TBM main control system. According to the integrated intelligent decision-making platform and the control method, multi-source perception deep fusion, physical and data model online coupling, risk assessment and equipment control second-level closed loop can be realized, and visual interaction can be realized through augmented reality.

An automation system controls an automated production process of an industrial plant. The industrial plant includes a plurality of equipment for performing the production process. The automation system includes an augmented reality system including augmented reality glasses, executable program logic and a database system including a task manager configured to store a list of processes associated with respective equipment, where each process includes one or more tasks to be performed with respect to the equipment. The executable program logic is configured to receive from the database system the list of processes for display to a user of the AR glasses, receive a selection of a displayed process assigned to the user, send the selected process to the database system, and receive from the database system additional data corresponding to the selected process.

The invention discloses irrigation area patrol equipment and method based on an augmented reality technology, and relates to the technical field of agricultural hydraulic engineering and informationization, and the equipment comprises a video collection module, a video and audio interaction module, a communication module, a central processor, a temperature and humidity sensor, a positioning module, and an AI intelligent support module. Through the function of comparing the data with theoretical data, the requirement of patrol on the professionality of patrol personnel is reduced; the invention further provides a working system of AR field perception-AI intelligent support-expert cooperative support-auxiliary operation guidance, basic information is collected and sent based on the head-mounted AR patrol equipment and transmitted to the AI intelligent support module, a theoretical value under normal operation is given through a digital twinborn irrigation area AI calculation function in the AI intelligent support module and compared with the collected information, and the theoretical value is calculated. And in addition, the method can be combined with an expert online study and judgment function, so that the discovery of real-time inspection problems and field study and judgment can be realized.

A dynamic experience curation platform utilizing AI and ML techniques, including neural networks and generative models, to enhance user interactions with content on the Internet. The platform employs an Experience Broker (EB) service to disintermediate user devices from the internet (or other content / information sources), improving security and user experience. It processes content requests, extracts relevant information, filters out unwanted content like ads, transforms, combines, and / or mutates existing content, and generates curated content consistent with user preferences and other constraints. The platform's generative AI process renders content into a user interface consistent with user preferences. It allows for personalized content delivery across devices, including virtual and augmented reality environments. The platform supports a spectrum of personalization, allowing users to fine-tune their content consumption experience. Additionally, it manages user sessions across devices and integrates various databases for storing user profiles, preferences, and other relevant information.

The invention discloses an augmented reality intelligent navigation and operation quantitative evaluation method and system in an operating room, and the method comprises the steps: collecting multispectral image data and depth point cloud data of an operation region in the operating room in real time, and generating a multidimensional perception data set; performing feature extraction and spatial registration on the multi-dimensional perception data set, and decomposing the dynamic three-dimensional augmented reality model into an anatomical structure feature layer and an instrument interaction feature layer; performing dynamic matching and real-time rendering on the anatomical structure feature layer and the instrument interaction feature layer based on a digital twinning technology to generate augmented reality navigation information and an operation guidance scheme; and performing multi-dimensional quantitative analysis on the surgical operation process according to the augmented reality navigation information and the operation guidance scheme, and outputting a quantitative evaluation result. By utilizing the embodiment of the invention, augmented reality navigation guidance which is synchronous with a real operation scene in real time can be provided, meanwhile, accurate quantitative evaluation is carried out on the operation operation, and the accuracy, the safety and the trainability of the operation are improved.

The invention relates to the technical field of data acquisition, in particular to a tidal play material acquisition method and system based on big data, and the method comprises the following steps: obtaining an augmented reality creation data stream uploaded by a user terminal through an authorization API interface; performing cross-device feature alignment on the creation data stream to generate a standardized culture gene unit, the culture gene unit comprising a visual expression vector, an interactive semantic tag and a group contribution coefficient; the connection strength between the network nodes of the dynamic culture topology network is jointly determined by the collaborative editing association degree of the user and the culture propagation entropy; and according to node betweenness centrality distribution of the dynamic culture topology network, activating the high-potential culture gene unit and generating a decentralized material acquisition queue. According to the method and the device, the timeliness of material acquisition and the system scheduling efficiency are improved, and the problems of response lag, resource waste, content redundancy and the like in a traditional material acquisition scheme are solved.

The embodiment disclose a wearable augmented reality eyewear system including a frame supporting left and right transparent lenses. A plurality of outward-facing cameras mounted on the frame have overlapping fields of view for capturing real-time images of the environment. A plurality of inward-facing cameras integrated in the frame or lenses detect pupil size, pupil dilation, and gaze direction using infrared imaging. A digital processor analyzes gaze direction and fixation based on virtual grid coordinates, initiates an object or person recognition routine using images from the outward-facing cameras, and compares detected features with records in a database. At least one lens includes an AR projection system embedded therein and configured to superimpose data about the recognized object or person in the user's field of view. An audio speaker positioned near the user's ear outputs related audio. A wireless communication module enables real-time data exchange with a cloud-based platform.

Example aspects include techniques for creating an augmented reality filter on a mobile device. These techniques may include receiving, in response to a selection of a primary augment reality filter template (ARFT), a primary ARFT package corresponding to the primary ARFT, and receiving, in response to the selection of a secondary ARFT, a secondary ARFT package corresponding to the secondary ARFT. In addition, the techniques may include loading the primary ARFT package and the secondary ARFT package to form a combined ARFT, and modifying, based on user input received via a user interface, the combined ARFT to create a customized augmented reality filter (CARF). Further, the techniques may include generating, for the CARF via the development engine, a configuration file that causes the mobile application to add custom perceptive information to visual data.

The invention discloses a brain wave monitoring visualization method and system, and the method comprises the following steps: obtaining original brain electrical signals of a user at different time points and task scenes, and carrying out filtering, denoising and segmented cleaning to obtain a preprocessing data set; performing frequency domain analysis on the data set, and extracting waveband power distribution; generating thermodynamic diagram data based on the power value, dynamically superposing the thermodynamic diagram data to the visual field of the user through an augmented reality technology, and displaying the activity intensity of the brain area; and accumulating data for a long time to construct a personalized baseline database, comparing the current power with a scene threshold value in real time, generating warning feedback by associating the thermodynamic diagram when the power is abnormal, and optimizing the baseline database. According to the method, the abstract electroencephalogram signals are converted into the visual thermodynamic diagrams, personalized baselines and dynamic feedback are combined, the problems that traditional monitoring data is difficult to understand, depends on group threshold misjudgment and is lack of dynamic optimization are solved, and the intuition, accuracy and practicability of electroencephalogram monitoring are improved.

The invention discloses a die temperature field coordinated regulation and control method based on digital twinning, and relates to the technical field of die temperature control. The method comprises the following steps: constructing a mold temperature field digital twin model covering macroscopic, mesoscopic and microscopic scales; a distributed optical fiber temperature sensor is deployed to realize continuous temperature field sensing; physical-digital real-time synchronous mapping is established through ensemble Kalman filtering; performing model prediction control based on the digital twinborn body; three-dimensional visualization and multi-modal man-machine interaction of the temperature field are realized by adopting an augmented reality technology; and reinforcement learning is used to enable the digital twinborn body to have an autonomous optimization capability. Through deep fusion of a physical space and a digital space, precise sensing, real-time mapping and intelligent control of a mold temperature field are realized, and the temperature control precision and the self-adaptive capability of the system are remarkably improved.

An augmented reality device for obtaining three-dimensional (3D) position information of a plurality of hand joints of a user includes a plurality of cameras configured to photograph the user's hand and obtain images; memory storing instructions; and at least one processor; the instructions, when executed, may cause the device to recognize the plurality of hand joints from the images; obtain two-dimensional (2D) joint coordinate values for feature points corresponding to the hand joints; retrieve, from a look up table (LUT), 3D position coordinate values corresponding to distortion model parameters of the cameras, a positional relationship between the cameras, and the 2D joint coordinate values; and output the 3D position information of the plurality of hand joints based on the 3D position coordinate values.

An assistance system includes: an augmented reality module configured to i) determine a path of a host vehicle, ii) detect one or more objects with one or more trajectories predicted to interfere with the path of the host vehicle, and iii) based on the one or more trajectories, generate a first digital gateway indicative that the host vehicle should yield for the one or more objects; a display control module configured to control an augmented reality head-up display to display the first digital gateway in a closed state over an environment forward of the host vehicle and along the path of the host vehicle; and a vehicle control module configured to yield to the one or more objects as the host vehicle approaches the first digital gateway.

The invention presents an advanced soccer training system designed to revolutionize traditional practice methods through a synergy of technology and interactivity. It features an integration of sensors, Artificial Intelligence, and Augmented Reality technologies, providing real-time feedback, immersive simulations, and personalized training experiences. The system promotes skill development via data-driven insights and dynamic training environments, supported by mobile application connectivity for customized training regimens and performance analysis. Additional attributes include energy-efficient design, user-friendly transport mechanisms, and extensive multimedia capabilities like video recording and photo capture for skill review, establishing a novel paradigm in athletic training and development.

Disclosed herein are systems and methods for distributed computing and / or networking for mixed reality systems. A method may include capturing an image via a camera of a head-wearable device. Inertial data may be captured via an inertial measurement unit of the head-wearable device. A position of the head-wearable device can be estimated based on the image and the inertial data via one or more processors of the head-wearable device. The image can be transmitted to a remote server. A neural network can be trained based on the image via the remote server. A trained neural network can be transmitted to the head-wearable device.

The disclosure relates to augmented reality devices based on a curved waveguide. An augmented reality device is provided. The augmented reality device includes a projection system to project an undistorted image, an input optical compensator located on the path of light rays out-coupled from the projection system, a curved waveguide comprising an input diffractive optical element and an output diffractive optical element. The output diffractive optical element performs the function of an output optical compensator that converts the light beams of a distorted image at the output of the waveguide into parallel light beams to output an undistorted image. Augmented reality glasses comprising an augmented reality device are also proposed. There is provided the ability to project a virtual image without aberrations, distortions and doubling of the image.

The invention discloses an application development method, an application development device and XR equipment, and relates to the technical field of augmented reality, and the method comprises the steps: receiving a preset XR scene component dragged by a user to an XR scene template through a visual editor; in response to a user request, calling an AIGC model to generate an XR content material, and inserting the XR content material into a specified position of a current XR scene; and receiving the configuration of the user on the interaction logic, converting the current XR scene and the interaction logic into an executable format of the target XR glasses through the adaptation layer, and outputting an application package adaptive to the target XR glasses. Visual development and AIGC automatic content generation are combined, so that the XR content creation threshold is reduced, the development efficiency is improved, and diversified application scenes are supported.

The invention relates to the technical field of intelligent medical treatment, and discloses a cataract surgery navigation control method based on multi-modal fusion, which comprises the following steps: carrying out lightweight preprocessing on an eye fundus image, ultrasonic probe data, a corneal topographic map and intraocular pressure parameters through an edge computing architecture, and constructing an efficient feature extraction network by adopting a knowledge distillation technology; self-adaptive feature fusion is realized based on an uncertainty quantification mechanism, real-time structure recognition is provided by utilizing an augmented reality technology, an intelligent navigation strategy is generated by pre-training a reinforcement learning model, an instrument control system with multilayer safety guarantee is established, and continuous optimization of the system is realized by adopting an online learning mechanism. According to the invention, the precision and safety of the operation are effectively improved, and an effective technical scheme is provided for intelligent navigation control of the cataract operation.

The invention provides an online video instance segmentation method and system based on mask propagation, and the method comprises the following steps: S1, achieving the cross-frame propagation of a target mask through a mask propagation model, obtaining a prediction mask of a current frame, and achieving the correlation of a target through the calculation of the intersection-union ratio of the prediction mask; and S2, performing back propagation on the target by using the mask propagation model so as to complement the missed target mask and enhance the continuity of the track. Objects between different frames are associated on the basis of a mask propagation mechanism and in combination with the intersection-to-union ratio of masks, and meanwhile, in order to relieve the scene that a segmentation model fails to segment shielded objects, non-significant objects and the like, a reverse mask propagation technology is provided to complement the failed frames. The method aims at performing fine segmentation and continuous tracking on various scenes such as intelligent monitoring, automatic driving, augmented reality and video editing on the target in the video, and has wide research and application prospects.