7795results about "Image data processing" patented technology

A three-dimensional preview of content can be generated and presented at an electronic device in a three-dimensional environment. The three-dimensional preview of content can be presented concurrently with a two-dimensional representation of the content in a content generation environment presented in the three-dimensional environment. While the three-dimensional preview of content is presented in the three-dimensional environment, one or more affordances can be provided for interacting with the one or more computer-generated virtual objects of the three-dimensional preview. The one or more affordances may be displayed with the three-dimensional preview of content in the three-dimensional environment. The three-dimensional preview of content may be presented on a three-dimensional tray and the one or more affordances may be presented in a control bar or other grouping of controls outside the perimeter of the tray and / or along the perimeter of the tray.

In some embodiments, a computer system facilitates the update of a spatial arrangement of one or more virtual objects in a three-dimensional environment from the viewpoint of a first user of the computer system while in a real-time communication session that includes a plurality of users. In some embodiments, updating the spatial arrangement of one or more virtual objects includes collectively moving the one or more virtual objects in the three-dimensional environment relative to the viewpoint of the first user.

In some embodiments, a computer system displays a user interface element corresponding to content shared with the computer system for interacting with the shared content in the three-dimensional environment. In some embodiments, a computer system displays one or more virtual control elements in a three-dimensional environment that are selectable to cause one or more corresponding operations involving a physical device to be performed.

The invention discloses a distributed intelligent warehouse scheduling system based on artificial intelligence, and belongs to the technical field of warehouse scheduling. Comprising a multi-source environment sensing module, a dynamic inventory management module, a distributed task scheduling module, an intelligent path planning module, a resource dynamic allocation module, an anomaly detection and emergency response module, an energy consumption optimization module, a supply chain collaboration module and a man-machine interaction and visualization module. A warehouse digital twinborn model is constructed, immersive display of a storage state and a scheduling strategy is realized, an AR scene is superposed through a color coding path, a thermodynamic diagram and a particle flow form, a manager can intuitively master inventory distribution, task progress and an abnormal region, eye movement tracking and a gesture recognition technology support an interactive decision, and the workload of the manager is reduced. The AR marking function can mark an abnormal area and synchronize the abnormal area to a decision making system, and through combination of AR and AI, a brand new interaction normal form is provided for intelligence and humanization of warehouse management.

The invention relates to the technical field of building engineering automation, and discloses a building robot collaborative operation system, a BIM modeling module is used for establishing a three-dimensional model of building engineering and dividing the three-dimensional model into a plurality of operation areas; the information acquisition module is used for acquiring state information and working environment information of the robot; the central control module is used for performing task allocation and operation planning by using an ant colony algorithm; the information sharing module is used for carrying out real-time communication between the robots through wireless communication in the operation process, and sharing operation progress, state information and environment information; the operation evaluation module is used for monitoring the operation progress and state of each robot in real time, evaluating the operation effect of the robot, adjusting task allocation and planning strategies in time according to the evaluation result, optimizing the collaborative operation process of the robot, and improving the operation efficiency of the robot. According to the invention, the problems of unreasonable task allocation, low communication efficiency, difficult operation coordination and the like in the collaborative operation of the existing building robot are solved.

The invention relates to the technical field of press monitoring, in particular to a digital twinning-based three-dimensional monitoring system for a precision servo press, which comprises a physical layer sensing module for acquiring real-time operating parameters, environment variables and workpiece processing data of the press; the dynamic twin construction module constructs a total-factor digital twin, and simulates a force-heat-deformation coupling effect by using finite element analysis and a multi-body dynamics algorithm based on physical attributes and process parameters; the intelligent analysis center identifies a potential fault mode of the press machine and locates an abnormal source through multi-physics field simulation data in combination with an improved CNN-LSTM model; the three-dimensional visual interaction unit constructs an interactive immersive three-dimensional virtual scene, renders a running state and a processing process in real time, and generates a maintenance strategy; and the self-adaptive regulation and control unit predicts the residual life of the key component and dynamically adjusts parameters according to a maintenance strategy and real-time monitoring data. Therefore, the problems of single monitoring dimension, disjunction of maintenance strategies and the like in the prior art are solved.

The invention provides an interaction method and system applied to painting and calligraphy exhibition, and relates to the technical field of data interaction, and the method comprises the steps: building a user exhibition watching behavior data set through real-time collection based on an exhibit region; traversing the exhibit area to carry out multi-dimensional image calibration, and establishing a coordinate-label mapping network; traversing the coordinate-label mapping network set according to the user exhibition viewing behavior data set to activate an exhibit identification module, identifying a target exhibit number to perform linkage display of painting and calligraphy on a target user, generating display information, starting an exhibit interaction module to perform deep interaction on the target user in combination with the display information, and generating a personalized painting and calligraphy display guide path. The technical problem that in the prior art, due to the lack of real-time perception and accurate recognition of exhibition watching behaviors of users, personalized exhibit linkage and dynamic guide cannot be achieved is solved, and the technical effect that the personalized guide path is generated based on the interests of the users, so that the exhibition watching immersion and interactive experience are improved is achieved.

In some embodiments, an electronic device emphasizes and / or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and / or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and / or physical environment of the electronic device.

Some examples of the disclosure are directed to object manipulators and associated processes for manipulating an object representation in a three-dimensional environment. The object representation may correspond to a scan of a real-world object in a real-world environment. The object manipulators may include an object cleanup manipulator and a text annotation manipulator. The object cleanup manipulator may be selectable to display one or more control affordances providing functionality for selectively removing portions of the object representation in the three-dimensional environment and / or selectively adjusting one or more parameters of the object representation in the three-dimensional environment. The text annotation manipulator may be selectable to display one or more control affordances providing functionality for selectively generating one or more text labels in the three-dimensional environment. The one or more text labels may be associated with the object representation in the three-dimensional environment.

The invention discloses a BIM-based two-dimensional data and three-dimensional model verification matching method and system. The system comprises a 2D drawing processing module, a 3D model processing module, a difference detection module and a report generation module. In the 2D drawing processing module, a user imports a process pipeline plan and a profile map, and through preprocessing and image semantic analysis, pipeline elevation labeling information is extracted and numbered. And the 3D model processing module loads a target BIM model, locates a process pipeline area, analyzes pipeline parameters and a space state, analyzes a pipeline topological relation and performs conflict verification. And the difference detection module binds the 2D drawing with a corresponding pipeline object in the 3D model, establishes a mapping relation, compares differences, and performs labeling and classification. And the report generation module is used for carrying out visual annotation in the 2D drawing and the 3D model based on the annotation difference, automatically generating a difference comparison table and outputting a report, so that efficient and accurate verification and matching of the two-dimensional data and the three-dimensional data are realized, the examination period is shortened, and the rapid collaborative correction efficiency of the construction team is improved.

The invention discloses a visual data-based automatic finite element modeling and performance evaluation method for an existing damaged hollow slab girder bridge. The method comprises the steps of S1, acquiring complete three-dimensional point cloud data of a multi-beam-slab model; s2, based on the three-dimensional point cloud data, extracting key geometric features of the structure by adopting a structure three-dimensional size automatic measurement method fusing plane projection and point cloud distortion correction; s3, for the damaged area of the multi-beam-slab structure, identifying the boundary of the damaged area and the non-damaged area of the multi-beam-slab structure through a point cloud neighborhood point height difference comparison and clustering analysis method, and carrying out detailed spatial position analysis on the damage; and S4, a damage unit set is automatically retrieved in combination with damage positioning quantitative information, and automatic updating of hinge joint damage of the multi-beam-slab structure is achieved through a life-death unit method failure damage area finite element grid. According to the method, automatic finite element modeling and evaluation of the existing hinge joint damage multi-beam-slab structure are achieved, and an efficient and accurate technical means is provided for health monitoring and performance evaluation of a bridge structure.

The invention relates to the technical field of augmented reality and industrial safety monitoring, in particular to an AR glasses dangerous state dynamic labeling method and system based on multi-source perception, and the method comprises the steps: synchronously collecting data such as a depth image and gas concentration through multi-source equipment such as a depth camera and a gas sensor; extracting rotation invariant point cloud features through an improved dangerous target detection model, and fusing multi-modal data to generate a dynamic danger level; based on VIO, realizing accurate spatial registration of annotation and a real scene, and generating a self-adaptive annotation style according to a danger level; and multi-device labeling pose synchronization is realized through an entropy weighting ICP algorithm, and labeling transparency and size are dynamically optimized in combination with a user fatigue value and environment illumination. According to the method, the comprehensiveness of danger identification and the accuracy of marking are improved, team collaborative operation is supported, the method is suitable for scenes such as electric power inspection and dangerous chemical transportation, and the operation safety and efficiency are guaranteed.

The invention relates to the technical field of physical education, in particular to a physical education method and system based on multimedia and holographic AR fusion, and the method comprises the following steps: collecting the motion data of a trainee based on a multi-source sensor array, constructing a motion parameterized model, and generating a holographic projection generation module through the cooperation with a standard motion database; a holographic AR teaching image is generated in real time, an environment perception module is combined to carry out adaptive projection on illumination and spatial layout, a spatial positioning module is used to establish coordinate mapping between a trainee and a virtual image, and a multi-channel feedback device is started to output visual, tactile and auditory signals. And finally, comparing the action parameters with the standard action data to automatically generate a training report containing wrong action labels and correction suggestions. According to the method, the motion capture precision and the interactive immersion can be effectively improved, and efficient and extensible technical support is provided for modern physical education and training.

In one embodiment, a method includes detecting a change in context of a computing system to a current context, changing a first registration status of a first set of actions with an assistant system associated with the computing system based on the change in context to the current context, where the first application is in a foreground of a user interface of the computing system, changing a second registration status of a second set of actions with the assistant system based on the change in context to the current context, where the second application is in a background of the user interface of the computing system, updating a list of registered actions for the assistant system based on the changed first and second registration statuses, and storing the updated list of registered actions on the computing system.

The invention provides an AR intelligent shopping guide interaction method and system applied to store management, and the method comprises the steps: firstly obtaining an interaction data set of a user in a store, covering a user position movement track, a commodity attention action sequence and voice consultation content, carrying out the user intention analysis of the interaction data set, and carrying out the user intention analysis of the interaction data set; the method comprises the steps of obtaining commodity demand characteristics and interaction preference characteristics, generating AR shopping guide interaction content, including commodity three-dimensional display information and an interaction guide instruction, adaptive to a user based on the commodity demand characteristics and the interaction preference characteristics, aligning and fusing the AR shopping guide interaction content with a store physical scene space, generating an AR shopping guide interaction scene capable of being displayed in real time, and displaying the AR shopping guide interaction scene in real time. And finally, responding to user interaction operation in the AR shopping guide interaction scene, generating feedback information and updating the interaction data set to trigger interactive process iterative optimization, thereby providing personalized and immersive shopping guide experience, and improving store operation efficiency and customer satisfaction.

The invention relates to the technical field of environment monitoring, and discloses a completion process data-based environment monitoring parameter comparison evaluation method, which comprises the following steps of: obtaining completion process data and environment monitoring data, and constructing a multi-dimensional data graph, mapping the completion process data and the environmental monitoring data to generate a standardized data set containing a construction feature vector and an environmental parameter vector; calculating a dynamic weight coefficient through a multi-objective optimization model based on the construction feature vector and the environment parameter vector in combination with the construction progress and the environment sensitivity, and outputting a weight matrix; the intelligent contract automatically triggers an evaluation process, generates a dynamic evaluation report containing an overproof event identifier, a compliance repair suggestion and a digital signature, and links an AR visualization system to be superposed to a BIM model to generate a three-dimensional thermodynamic diagram; and in combination with anomaly detection and a time sequence prediction model, identifying potential risks, generating a dynamic risk early warning map, and finally outputting a predictive evaluation report. According to the invention, the accuracy and real-time performance of environment monitoring evaluation can be improved.

According to the multi-mode visual stimulation and intelligent self-adaption combined myopia prevention and control system based on the AR glasses, all-weather, personalized and full-scene myopia suppression is realized through multi-module cooperation of sensory visual stimulation, visual function training, AI scene dynamic recognition and directional intervention, self-adaption closed-loop feedback, cloud / offline deployment and the like; through multi-dimensional visual stimulation and real-time physiological monitoring, eye axis growth is accurately regulated and controlled, myopia prevention and control precision is improved, out-of-focus and contrast setting are automatically optimized based on immediate refraction and adjustment feedback, personalized intervention is enhanced, lightweight AI and cloud pre-calculation are introduced, the endurance of equipment is effectively prolonged, an existing AR platform is compatible, the development process is simplified, and the development efficiency is improved. And the user compliance is enhanced.

The present technology provides methods and systems for enhanced email communication by generating sender-centric responses in an email client. The email client takes sender-specific data and data used to determine the relationship between the sender and receiver. This data is then used as input for a trained receiver-specific generative AI model. The generative AI model generates a custom response for a new inbound email which is displayed on the email client.

The invention relates to the technical field of transformer substation intelligent patrol, and provides a transformer substation three-dimensional fusion patrol method and system based on digital twinborn and autonomous identification. According to the method, a fused three-dimensional model is constructed through multi-source data acquisition and a three-dimensional Gaussian splash algorithm, and in combination with deep learning-based point cloud semantic segmentation and clustering, an equipment-patrol means coverage relationship is generated. Creating a virtual inspection proxy object based on a three-dimensional virtual environment, and controlling terminals such as an unmanned aerial vehicle to collect real-time video image data; the system carries out automatic identification on pictures, automatically completes equipment level alignment and standard point location identification, generates fine control of camera zooming, horizontal rotation, pitching and the like, and realizes standardized view finding and acquisition. By combining an enhanced recognition algorithm, traditional image processing and a deep learning model are fused, model self-evolution is realized through incremental learning, flexible expansion and collaboration of various patrol terminals are supported through a unified interface, and refined, real-time and intelligent patrol operation and maintenance requirements of an intelligent substation are met.

A system for providing an extended reality environment that incorporates real-world event data into 3D models representative of the real-world event within the extended reality environment includes an XR processing unit configured to dynamically download 3D hole models of the course, receive real-world live shot data of shots taken on the holes during a golf tournament; map the shot data to the 3D hole models; and cause a spatial computing device to render hole views and immersive views comprising the mapped shot data rendered directly on the 3D hole models in real-time in an interactive extended reality environment. The mapped shot data includes shot trails representative of the shots taken on the golf course, The hole views and immersive views may utilize the same source file.

The invention discloses a BIM model-based digital twinning and panoramic camera mapping method and system, and relates to the technical field of BIM and digital twinning, and the system is mainly composed of a data acquisition module, a data preprocessing module, a feature extraction and analysis module, a coordinate conversion and matching module, a digital twinning model module and a display module. Real-time and efficient integration of the video data and the BIM model is realized, and then the digital twin model capable of accurately reflecting the current state of the building is constructed. The model is of great significance to comprehensive monitoring and management of the building environment, and the intelligent level and the operation and maintenance efficiency of the building are remarkably improved.

The invention provides an immersive concert experience system based on virtual reality, and belongs to the technical field of virtual reality, and the system comprises a dynamic adjustment module which is used for predicting the preference of a user for stage arrangement, light effects and music types through a machine learning model according to the historical preference data of the user, and outputting the preference to the stage arrangement, light effects and music types; dynamically adjusting visual elements and sound field parameters of the virtual scene and a refresh rate and a field angle of the virtual scene in combination with the user physiological indexes and the user head motion trail which are acquired in real time; the action capture and feedback module is used for capturing an interaction instruction sent to the dynamically adjusted virtual scene by the limb action of the user in real time; and the interaction feedback module is used for enabling the virtual performer to respond to the interaction instruction of the user in real time based on the expression recognition and voice synthesis technology, and generating personalized interaction feedback content. A user constructs an immersive music interaction field domain, and experience logic of a virtual music meeting is completely reconstructed.

The invention provides an interaction method and device based on image recognition, and relates to the technical field of man-machine interaction, and the technical scheme is characterized in that the method comprises the steps: analyzing the moving speed and change frequency of target and non-target elements in a training scene, and calculating an environment dynamic factor; adjusting a high threshold value and a low threshold value of target identification confidence; comparing the target recognition confidence output by multi-modal image recognition with the adjusted high threshold and low threshold, and determining a visual feedback type; setting a visual feedback intensity parameter according to the determined visual feedback type and the target type; and displaying the set visual feedback in the visual field of the technical object in an overlapping manner. The interaction method and device based on image recognition provided by the invention have the advantages that the cognitive load of the technical object is reduced, and the rapid target recognition capability of the technical object in a complex and uncertain battlefield environment is improved.

The invention discloses an intelligent agriculture monitoring system based on augmented reality and Internet of Things, and relates to the technical field of monitoring analysis, and the system comprises a data collection module which is used for collecting environment feature data corresponding to an agricultural production region, and obtaining an agricultural scene dynamic data set; the data processing module is used for performing space-time alignment processing on the environment feature data and the agricultural scene dynamic data set to construct an agricultural scene augmented reality three-dimensional model; the prediction model construction module is used for confirming a hydrothermal interaction feature set and establishing a pest and disease risk prediction model based on the hydrothermal interaction feature set; and the early warning module is used for performing multi-dimensional data mapping on an output result of the pest risk prediction model and the augmented reality three-dimensional model, generating a visual risk labeling layer, performing risk grade division based on the visual risk labeling layer, establishing a real-time monitoring feedback data stream, and performing synchronous early warning on a terminal through an Internet of Things gateway. The agricultural monitoring method has the effect of improving the agricultural monitoring efficiency.

An apparatus, including a processor which provides an electronic forum which provides a video or audio broadcast of a sporting event and allows users to communicate with one another, post comments, place a bet or bets, receive information regarding bets available, betting odds, changes in betting odds, or analytics information, or report an instance of suspected game fixing, match fixing, or cheating, before, during, or after, the sporting event; a transmitter, which transmits the electronic forum to a user communication device; and a receiver which receives information transmitted from the user communication device. The processor processes an outcome of a bet on the sporting event and determines if the bet is a winning bet or losing bet. The apparatus generates a report and transmits the report to a computer associated with a sport governing body, governmental entity, gaming facility, analytics provider, social network, financial institution, or escrow agent.

The technology uses augmented reality (AR) elements for enhanced wayfinding with autonomous vehicle pickups and drop-offs. The approach includes generating, for presentation in a first region of a client device UI, trip information regarding a trip. Map information associated with the trip is generated for presentation in a second UI region, including at least one of a pickup location for a rider, a walking path from a current location of the rider to the pickup location, a planned route of the vehicle to the pickup location, or a current location of the vehicle. An AR indicator is generated for presentation in the second UI region. Upon selection of the indicator, the system modifies the second region into a first section to display at least a portion of the map information and a second section to display an augmented reality view, or replace the map information with the AR view.

The invention relates to a visual transformer substation intelligent inspection system and method based on a multi-mode large language model, and belongs to the technical field of power system intelligence. The system obtains image, temperature, vibration and noise data of substation equipment in real time through a multi-modal data acquisition module, and performs preprocessing and fusion. A high-precision three-dimensional semantic model is constructed by using a three-dimensional dynamic modeling module, and the device attributes are automatically labeled by fusing LLM semantic understanding capability. A multi-modal large language model (LLM) engine is combined with cross-modal feature extraction, a dynamic knowledge base and a self-adaptive reasoning unit to realize accurate diagnosis of equipment faults. An augmented reality (AR) interaction module displays the real-time state of equipment through AR glasses and supports natural language interaction. The self-interpretation decision support module generates interpretable fault reports and maintenance suggestions, and the communication and feedback module is responsible for data uploading and remote alarm. According to the method, multi-dimensional perception, dynamic knowledge reasoning and self-adaptive decision support of the equipment state are realized, the intelligent level of substation inspection is remarkably improved, the inspection efficiency is improved by more than 40%, the omission ratio is reduced to less than 1%, and rapid diagnosis of more than 95% of novel faults is supported.

The invention relates to the technical field of high-precision positioning, in particular to an outdoor immersive text and travel hybrid positioning and dynamic rendering optimization method, and the method comprises the steps: obtaining a positioning signal of a mobile terminal in a target service area through a hybrid positioning model; the positioning signals comprise an ultra-wideband ranging signal, a visual inertial odometer signal, a real-time carrier phase difference signal and an inertial navigation signal; processing the positioning signal through a multi-layer signal processing filtering model to obtain coordinate data, and generating a space coordinate; constructing a user movement situation prediction model based on the space coordinates, generating a navigation prediction track and navigation confidence, and generating a preloading strategy; acquiring geographical environment parameters of the target service area, and integrating the space coordinates, the geographical environment parameters, the preloading strategy and the virtual object through a multi-dimensional virtual-real fusion model to generate an augmented reality space scene; and analyzing the user movement track data and the augmented reality space scene through a multi-modal driving model to generate interactive content.

The present disclosure generally relates to managing live communication sessions. A computer system optionally displays an option to invite the respective user to join the ongoing communication session. A computer system optionally displays one or more options to modify an appearance of an avatar representing the user of the computer system. A computer system optionally transitions a communication session from a spatial communication session to a non-spatial communication session. A computer system optionally displays information about a participant in a communication session.