13018results about "Image data processing" patented technology

The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and / or a live collaboration session.

In some embodiments, a computer system changes visual appearance of visual representations of participants moving within a simulated threshold distance of a user of the computer system. In some embodiments, a computer system arranges representations of users according to templates. In some embodiments, a computer system arranges representations of users based on shared content. In some embodiments, a computer system changes a spatial arrangement of participants in accordance with a quantity of participants that are a first type of participant. In some embodiments, a computer system changes a spatial arrangement of elements of a real-time communication session to join a group of participants. In some embodiments, a computer system facilitates interaction with groups of spatial representations of participants of a communication session. In some embodiments, a computer system facilitates updates of a spatial arrangement of participants based on a spatial distribution of the participants.

In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on a viewpoint of a user in the three-dimensional environment. In some embodiments, an electronic device automatically updates the orientation of a virtual object in a three-dimensional environment based on viewpoints of a plurality of users in the three-dimensional environment. In some embodiments, the electronic device modifies an appearance of a real object that is between a virtual object and the viewpoint of a user in a three-dimensional environment. In some embodiments, the electronic device automatically selects a location for a user in a three-dimensional environment that includes one or more virtual objects and / or other users.

The disclosed system for interacting with objects in an extended reality (XR) environment generated by an XR system may include (1) neuromuscular sensors configured to sense neuromuscular signals from a wrist of a user and (2) at least one computer processor programmed to (a) determine, based at least in part on the sensed neuromuscular signals, information relating to an interaction of the user with an object in the XR environment and (b) instruct the XR system to, based on the determined information relating to the interaction of the user with the object, augment the interaction of the user with the object in the XR environment. Other embodiments of this aspect include corresponding apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.

A three-dimensional preview of content can be generated and presented at an electronic device in a three-dimensional environment. The three-dimensional preview of content can be presented concurrently with a two-dimensional representation of the content in a content generation environment presented in the three-dimensional environment. While the three-dimensional preview of content is presented in the three-dimensional environment, one or more affordances can be provided for interacting with the one or more computer-generated virtual objects of the three-dimensional preview. The one or more affordances may be displayed with the three-dimensional preview of content in the three-dimensional environment. The three-dimensional preview of content may be presented on a three-dimensional tray and the one or more affordances may be presented in a control bar or other grouping of controls outside the perimeter of the tray and / or along the perimeter of the tray.

The invention relates to the technical field of the Internet of Things, in particular to an intelligent construction site management method and system based on the Internet of Things. The method comprises the following steps: acquiring construction site environment monitoring data in real time based on multiple Internet of Things sensor nodes; performing real-time environment state change mining on the construction site environment monitoring data, performing global environment perception modeling, and constructing a construction site digital environment perception map; obtaining a construction site omnibearing monitoring video and construction site construction equipment state monitoring data; carrying out target dynamic optical flow tracking on the omnibearing monitoring video of the construction site one by one, carrying out dynamic operation state evolution, and constructing a real-time behavior portrait model of each worker; and performing operation state equipment temperature change trend analysis and dynamic load change evolution according to the state monitoring data of the construction site construction equipment, and generating comprehensive state characteristics of each piece of equipment. The construction site management efficiency and the construction site construction safety are improved.

In some embodiments, a computer system facilitates the update of a spatial arrangement of one or more virtual objects in a three-dimensional environment from the viewpoint of a first user of the computer system while in a real-time communication session that includes a plurality of users. In some embodiments, updating the spatial arrangement of one or more virtual objects includes collectively moving the one or more virtual objects in the three-dimensional environment relative to the viewpoint of the first user.

In some embodiments, a computer system displays a user interface element corresponding to content shared with the computer system for interacting with the shared content in the three-dimensional environment. In some embodiments, a computer system displays one or more virtual control elements in a three-dimensional environment that are selectable to cause one or more corresponding operations involving a physical device to be performed.

Systems and methods for providing visual indications of generative model responses can include obtaining a user input and processing the user input with a generative model to generate a model-generated-response. The systems and methods can process the model-generated response and an image of an environment to generate an augmented image. The augmented image can include visual indicators of the model-generated response, which can include annotating the image based on detected features within the image. Generation of the augmented image can include object detection and annotation based on the content of the model-generated response.

The invention relates to the technical field of agricultural product quality tracing, and discloses an agricultural product quality tracing system based on a block chain technology, and the system comprises a data collection module which is used for collecting environment data, quality detection data and position information of agricultural products in the links of planting, processing, transportation, storage and the like through Internet of Things equipment; the encryption module is used for performing preliminary symmetric encryption processing on the collected data and encrypting sensitive data through a homomorphic encryption algorithm; and the intelligent contract module is used for automatically executing data storage, authority control, zero-knowledge proof verification and cross-chain data management on the block chain. According to the method, the authenticity and security of data in each link are ensured through automatic execution of data storage and authority control by using a distributed account book and a tamper-resistant characteristic of the block chain and through an intelligent contract, and meanwhile, an I PFS distributed storage system is combined with the block chain, so that the integrity of the data is further ensured, and the security of the data is improved. Therefore, all parties can share and query the tracing information trustingly.

Some examples of the disclosure are directed to systems and methods for presenting content associated with a real-world user interface in an environment. A user interface of a first object in a physical environment can be detected by an electronic device. In some examples, in response to detecting the user interface of the first object, in accordance with one or more criteria being satisfied, the electronic device presents content associated with the user interface of the first object in the environment independent of a location of the first object in the physical environment. In some examples, the content associated with the user interface of the first object includes a timer. In some examples, the content associated with the user interface of the first object includes information corresponding to video content. The environment is optionally a computer-generated environment, and the electronic device optionally includes a head-mounted display.

The invention provides a middle and primary school multi-person foreign language situational teaching method and system based on VR, and relates to the technical field of virtual reality, and the method comprises the steps: obtaining a teaching task, constructing an immersive virtual teaching scene, setting a situational dialogue task and a self-adaptive difficulty adjustment mechanism, carrying out the semantic description and association mapping to form a multi-level semantic network, and carrying out the virtual teaching. Each student enters an immersive virtual teaching scene, participates in a scene dialogue task, collects multi-modal interaction data and transmits the data back to the edge computing server to obtain mother language voice of the student, translates the mother language voice to obtain a high-quality dialogue text and generates personalized dialogue feedback; performing multi-dimensional quantitative evaluation based on personalized dialogue feedback, generating an ability level portrait, determining the knowledge point mastering degree of each student, generating an knowledge mastering graph, constructing a language learning path optimization model, solving to obtain an optimal learning path, and generating an optimized teaching scheme.

The invention discloses a distributed intelligent warehouse scheduling system based on artificial intelligence, and belongs to the technical field of warehouse scheduling. Comprising a multi-source environment sensing module, a dynamic inventory management module, a distributed task scheduling module, an intelligent path planning module, a resource dynamic allocation module, an anomaly detection and emergency response module, an energy consumption optimization module, a supply chain collaboration module and a man-machine interaction and visualization module. A warehouse digital twinborn model is constructed, immersive display of a storage state and a scheduling strategy is realized, an AR scene is superposed through a color coding path, a thermodynamic diagram and a particle flow form, a manager can intuitively master inventory distribution, task progress and an abnormal region, eye movement tracking and a gesture recognition technology support an interactive decision, and the workload of the manager is reduced. The AR marking function can mark an abnormal area and synchronize the abnormal area to a decision making system, and through combination of AR and AI, a brand new interaction normal form is provided for intelligence and humanization of warehouse management.

A first image and a second image are accessed. The second image is generated by applying an augmented reality (AR) effect to the first image. The first image, the second image, and a prompt are provided to a visual-semantic machine learning model to obtain output describing at least one feature of the AR effect. A description of the AR effect is generated based on the output of the visual-semantic machine learning model. The description of the AR effect is stored in association with an identifier of the AR effect.

The invention discloses a cognitive function rehabilitation training system and method based on virtual reality, and the system comprises a cognitive function test unit which is used for carrying out the cognitive impairment test evaluation of a patient based on a virtual reality module, and generating a cognitive function evaluation report of the patient; the cognitive training unit is used for generating a personalized cognitive training scheme based on the cognitive function evaluation report, carrying out targeted cognitive training in a virtual reality environment, and collecting physiological data and training performance data of the patient in the cognitive training process; the feedback unit is used for comprehensively analyzing the physiological data and the training performance data and generating a staged feedback report; and the rehabilitation effect tracking unit is used for analyzing rehabilitation effects of the patient in different time periods based on the periodic feedback report and optimizing a subsequent cognitive training scheme based on an analysis result. And the interestingness and interactivity of rehabilitation training are improved.

A system and method for managing greenhouse gas emissions is described. In one aspect, the system and method are configured to receive real-time emission data from distributed data sources, including IoT sensors, optical character recognition systems, and augmented reality measurement devices. ML models are trained using ML engines based on historical data and the received emission data. The trained models process and validate the real-time emission data using ML engines. Timestamp blocks are generated using a proof of history blockchain architecture with a variable delay function. The validated emission data is stored and verified in the generated timestamp blocks. The verified emission data is transformed into standardized carbon credit tokens. Visualizations of greenhouse gas emissions are displayed on a user interface, showing information from a real-time emission report. The system and method enable automated collection, validation, storage, and visualization of greenhouse gas emission data using blockchain and ML technologies.

The invention relates to the technical field of building engineering automation, and discloses a building robot collaborative operation system, a BIM modeling module is used for establishing a three-dimensional model of building engineering and dividing the three-dimensional model into a plurality of operation areas; the information acquisition module is used for acquiring state information and working environment information of the robot; the central control module is used for performing task allocation and operation planning by using an ant colony algorithm; the information sharing module is used for carrying out real-time communication between the robots through wireless communication in the operation process, and sharing operation progress, state information and environment information; the operation evaluation module is used for monitoring the operation progress and state of each robot in real time, evaluating the operation effect of the robot, adjusting task allocation and planning strategies in time according to the evaluation result, optimizing the collaborative operation process of the robot, and improving the operation efficiency of the robot. According to the invention, the problems of unreasonable task allocation, low communication efficiency, difficult operation coordination and the like in the collaborative operation of the existing building robot are solved.

Disclosed herein is a method for facilitating tailoring experiences of users, in accordance with some embodiments. Accordingly, the method includes receiving, using a communication device, a data from a device. Further, the method includes analyzing, using a processing device, the data. Further, the method includes determining, using the processing device, a context associated with a user based on the analyzing of the data. Further, the method includes adjusting, using the processing device, at least one of a plurality of reality layers of an artificial environment based on the context. Further, the method includes provisioning, using the processing device, a content corresponding to at least one of the plurality of reality layers of the artificial environment based on the adjusting. Further, the method includes storing, using a storage device, the data and the context.

A computer system optionally displays a user interface object that reveals content based on whether the content is private or shared. A computer system optionally displays a user interface object that includes shared content based on whether participants have entitlement to the content. A computer system optionally displays a sharing indicator that indicates that the respective content is shared with one or more other participants.

The invention discloses an ophthalmologic operation real-time navigation system and method based on dynamic visual field tracking, and relates to the technical field of medical systems. Comprising the following steps: matching operation data closest to a current operation from a database, and generating standard operation navigation of the current operation; the real-time image of the operation process is compared with the image of the standard operation navigation in real time, the step of the current operation is determined, and meanwhile subsequent image navigation of the operation of the patient is displayed; generating a spatial mapping matrix between an eyeball movement track and a target region by combining target region boundary data of preoperative OCT image segmentation and an intra-operative navigation coordinate system; the virtual navigation path of the surgical instrument is dynamically corrected according to the real-time eyeball movement track, so that the surgical instrument is aligned with the target area, the spatial relation between the instrument and the target area can be visually mastered through the overlapping display of the three-dimensional virtual path and the real-time image, unconscious displacement or physiological tremor of a patient in an operation is actively adapted, and the operation accuracy is improved. And the continuous accuracy of the navigation path is ensured.

Aspects of the present disclosure are directed to providing assisted scene capture for an artificial reality (XR) environment. Some implementations can obtain an XR space model corresponding to a real-world space, including walls, the ceiling, and the floor, using an XR system. Some implementations can then scan the real-world space and display a mesh corresponding to the scanned area overlaid onto a view of the real-world space. Some implementations can perform post-processing on the displayed mesh, which can include A) collapsing variations in the mesh corresponding to the walls, ceiling, or floor onto the XR space model; B) clipping the mesh to the XR space model for open doorways, windows, etc.; C) simplifying the mesh corresponding to the walls, ceiling, or floor; D) determining that the mesh is complete by identifying that a threshold percentage of the XR space model is covered by the mesh; or any combination thereof.

The invention relates to the technical field of press monitoring, in particular to a digital twinning-based three-dimensional monitoring system for a precision servo press, which comprises a physical layer sensing module for acquiring real-time operating parameters, environment variables and workpiece processing data of the press; the dynamic twin construction module constructs a total-factor digital twin, and simulates a force-heat-deformation coupling effect by using finite element analysis and a multi-body dynamics algorithm based on physical attributes and process parameters; the intelligent analysis center identifies a potential fault mode of the press machine and locates an abnormal source through multi-physics field simulation data in combination with an improved CNN-LSTM model; the three-dimensional visual interaction unit constructs an interactive immersive three-dimensional virtual scene, renders a running state and a processing process in real time, and generates a maintenance strategy; and the self-adaptive regulation and control unit predicts the residual life of the key component and dynamically adjusts parameters according to a maintenance strategy and real-time monitoring data. Therefore, the problems of single monitoring dimension, disjunction of maintenance strategies and the like in the prior art are solved.

A generative artificial intelligence (AI) system includes a generative AI model configured to generate outputs based on a training data set. The AI system additionally includes a secure data vault system. The secure data vault system additionally includes a sandbox system storing the generative AI model and operatively coupled to the generative AI model to send inputs to generate the outputs from the generative AI model, wherein the sandbox system comprises an execution environment configured to restrict execution of the generative AI model to a predefined memory address range. The secure data vault system further includes a secure network service communicatively coupled to the sandbox system and configured to authenticate a connection to an external system and to download from the external system an update package for the generative AI model when the connection is authenticated.

A noninvasive patient-specific method is provided to aid in the analysis, diagnosis, prediction or treatment of hemodynamics of the cardiovascular system of a patient. Coronary blood flow and pressure can be predicted using a 3-D patient image-based model that is implicitly coupled with a model of at least a portion of the remaining cardiovascular system. The 3-D patient image-based model includes at least a portion of the thoracic aorta and epicardial coronaries of the patient. The shape of one or more velocity profiles at the interface of the models is enforced to control complex flow features of recirculating or retrograde flow thereby minimizing model instabilities and resulting in patient-specific predictions of coronary flow rate and pressure. The invention allows for patient-specific predictions of the effect of different or varying physiological states and hemodynamic benefits of coronary medical interventions, percutaneous coronary interventions and surgical therapies.

A method and edge computing system configured to generate or process extended reality (XR) data. Processors in the edge computing system receive, process, and analyze a sensory feed from an optical device to generate analysis results that include a relative position of the optical device from surrounding objects. The processors generate mapper output results (that include virtual coordinates) based on the analysis results, request and receive information (e.g., salient points of interest, etc.), and compare the generated mapper output results to the received information to identify a correlation between a feature included in the processed sensory feed and a feature included in the received information. The processors generate and send augmented information to a renderer and / or send the processed sensory feed to a cloud object recognizer for further processing.

The invention provides an interaction method and system applied to painting and calligraphy exhibition, and relates to the technical field of data interaction, and the method comprises the steps: building a user exhibition watching behavior data set through real-time collection based on an exhibit region; traversing the exhibit area to carry out multi-dimensional image calibration, and establishing a coordinate-label mapping network; traversing the coordinate-label mapping network set according to the user exhibition viewing behavior data set to activate an exhibit identification module, identifying a target exhibit number to perform linkage display of painting and calligraphy on a target user, generating display information, starting an exhibit interaction module to perform deep interaction on the target user in combination with the display information, and generating a personalized painting and calligraphy display guide path. The technical problem that in the prior art, due to the lack of real-time perception and accurate recognition of exhibition watching behaviors of users, personalized exhibit linkage and dynamic guide cannot be achieved is solved, and the technical effect that the personalized guide path is generated based on the interests of the users, so that the exhibition watching immersion and interactive experience are improved is achieved.

The invention relates to the technical field of interactive training, in particular to a virtual reality interactive training system and method based on multi-modal feedback. Comprising a multi-dimensional training scene construction unit, a multi-source data interaction unit and an operation deviation feedback unit. According to the method, the multi-dimensional training scene library and the two-channel semantic analysis engine are constructed through the distributed rendering architecture to interact and switch scenes, real-time rendering supporting large-scale scenes is achieved, the rendering efficiency and scene complexity are improved, meanwhile, the natural man-machine interaction capability is achieved, the operation deviation of a user is evaluated, and the user experience is improved. The intensity of the feedback signal is in direct proportion to the operation deviation, the deviation during user operation training is detected, the training result is evaluated according to the operation deviation, the user is reminded to conduct adjustment in time through the feedback signal, the automatic teaching function is achieved, meanwhile, the intensity of the deviation can be fed back through the intensity of the feedback signal, and the user experience is improved. And the user is further promoted to adjust.

In some embodiments, an electronic device emphasizes and / or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and / or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and / or physical environment of the electronic device.