368 results about "Virtual interaction" patented technology

The invention relates to the technical field of medical rehabilitation training, in particular to an intelligent hand training method and system, electronic equipment and a storage medium, and the method comprises the steps: receiving a training mode instruction selected by a user; real-time biomechanical data of the affected side hand are collected through a multi-source sensor array, the real-time biomechanical data comprise finger joint angles, electromyographic signal intensity and a touch pressure distribution matrix, and when the affected side hand is in a mirror image training mode, the six-degree-of-freedom motion trail of the uninjured side hand is synchronously collected; calling a corresponding algorithm model for processing based on the training mode, and generating a control instruction set containing pneumatic pressure parameters, electrical stimulation waveforms and virtual interaction instructions; the control instruction set is sent to a server side, a mechanical glove arranged on the hand of the affected side in a sleeving mode executes corresponding pneumatic-electric combined driving operation, and multi-sense feedback is synchronously presented. According to the application, the composite requirements of patients in different rehabilitation stages on training mode diversity, control accuracy and interactive immersion can be met.

The invention discloses an online curriculum recommendation method and system based on a large language model, and relates to the technical field of curriculum recommendation. The method is based on multi-level analysis of policy texts, the association between dominant changes and hidden skill requirements is accurately extracted, and the one-sidedness of traditional keyword matching is avoided; curriculum features with attenuation weights are generated through cross-modal alignment, recommendation priorities are dynamically adjusted in combination with policy release time and content update frequency, and recommendation deviation caused by curriculum update lag in the policy transition period is solved; an LLM is used to construct a cross-skill domain incidence matrix, and the secondary influence of policy change is automatically deduced; a virtual interaction data generation module is adopted to simulate a typical user behavior path, the stability of a recommendation system is maintained in the absence of real data, and the model iteration period after policy mutation is shortened.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: running a business application in a virtual machine, and obtaining a business application instruction set; the instruction type of the business application instruction set is an instruction type supported by a processor of the host machine; writing a service application instruction set in a virtual memory of the virtual machine into a shared physical memory in a virtual interaction device corresponding to the virtual machine, and generating writing notification information used for representing a writing completion state of the service application instruction set; the shared physical memory is a physical memory used for being jointly read and written by the virtual machine and the management program in the host machine; and in the management program, obtaining write-in notification information, obtaining the business application instruction set in the shared physical memory through the write-in notification information, and executing the business application instruction set through a processor of the host machine to obtain instruction execution data corresponding to the business application instruction set. By adopting the method and the device, the performance of running the business application by the virtual machine in the host machine can be improved.

The invention relates to the technical field of editing and special effect generation, in particular to a digital media content intelligent editing and special effect generation system based on artificial intelligence. Comprising a content understanding analysis module, an editing decision module, a special effect generation preview module, an audio processing module, a dynamic transition special effect module, a subtitle generation editing module, a virtual interaction module and a content distribution optimization module. The content understanding analysis module is used for video content identification and sentiment analysis; and the editing decision module is used for recommending an editing point and providing a dynamic editing strategy. The video content can be automatically analyzed, the editing point and the special effect adding position can be identified, the editing and special effect generation efficiency is greatly improved, the editing strategy and the special effect type can be dynamically adjusted according to the video content and the sentiment analysis result, the editing and the special effect can better meet the user requirement and the video content, and the user experience is improved. Abundant editing and special effect options are provided, and the editing and special effect generation process is simplified.

Embodiments of the present application provide a virtual object interaction method, an apparatus, a storage medium and a computer program product, and the virtual object interaction method includes: performing a live stream by using a first virtual streamer in a first live stream room of a live stream platform; making a virtual interactive object appear in the first live stream room for a preset time period during the live stream of the first live stream room, and the preset time period is shorter than a time period of the live stream in the first live stream room; where the first virtual streamer performs a live stream task set by the using party of the first live stream room, and the virtual interactive object performs an interactive task set by a manager of the live stream platform.

The invention relates to the technical field of virtual reality, in particular to an immersive virtual character interaction method based on virtual reality, which comprises the following steps: acquiring voice information input by a user and action information acquired by action capture equipment, processing and analyzing the voice information and the action information, and on the basis of the obtained initial performance state information, acquiring a virtual character interaction result. Adjusting the initial expression state information under the condition that the association degree of the initial text information and the initial expression state information meets a preset association degree standard, and adjusting the initial text information of the user according to the initial expression state information of the user to obtain target pronunciation information; therefore, the interactive voice and action represented by the virtual character better meet the requirements of the user, and the immersion of the user is improved. According to the method, the problem that the immersive experience of a user is poor due to the fact that the traditional virtual interaction method lacks recognition of postures of legs, feet and the like and the actions made by the user cannot be reflected in a virtual scene is solved.

The invention provides a self-supervised continuous 3D hand posture tracking method based on a lightweight inertial measurement unit, and the method specifically comprises the following steps: firstly, obtaining a hand motion signal by using a lightweight consumer-level IMU, and extracting features by using a multi-stage neural network containing a bidirectional long-short term memory (Bi-LSTM) module; the global displacement and orientation of the hand are processed through a wrist posture estimation module, and three-dimensional coordinates of hand skeleton points are solved and calculated by means of a finger motion chain; secondly, a self-supervised completion network is realized by combining a random mask and dual loss, and the features are processed to complete complete attitude reconstruction; and finally, combining network output with kinematics prior, generating a three-dimensional grid with reasonable anatomy, solving the problem that joint deformation is inconsistent with torque, and realizing accurate acquisition of a three-dimensional hand posture. For a dynamic hand motion tracking task, the method can adapt to a sparse IMU deployment scene and realize continuous high-precision tracking; the real-time performance demand of daily interaction can be met, and a low-cost solution can be provided for the fields such as medical rehabilitation and virtual interaction which have strict requirements on attitude precision.

The invention discloses a virtual experience interaction control method based on a virtual environment and a related device, and the method comprises the steps: loading a corresponding virtual interaction experience scene to a VR head-mounted display device based on a virtual experience game after an experience user wears the VR head-mounted display device and selects the virtual experience game; associating and generating a three-dimensional virtual character at a specified position of the virtual interaction experience scene based on the three-dimensional character model; acquiring a current motion trend based on capturing the current motion trend of the experiencing user; updating the position and the motion trend of the three-dimensional virtual character in the virtual interaction experience scene based on the current motion trend to obtain an updated position and an updated motion trend of the three-dimensional virtual character; and adjusting interactive experience elements in the virtual interactive experience scene based on the updated motion trend, the updated position and the gaze tracking result. In the embodiment of the invention, seamless connection between the virtual environment and the real action is realized, so that the interactive experience is more natural and smoother.

The invention relates to the technical field of optics and control, and discloses a light beam pointing stabilization method and system based on simulation environment driven reinforcement learning, and the method comprises the steps: dividing an integrated light path into a plurality of sub-light path links according to the serial connection relation of upper and lower levels in the integrated light path; the mirror surface deflection angle of the fast reflecting mirror group and light beam pointing drift data before and after swinging are recorded, and a sample data set is formed; constructing a simulation environment model based on a convolutional neural network based on the sample data set; the simulation environment model is used as a virtual interaction environment, a light beam pointing correction agent is constructed, and a reinforcement learning framework is used for training; the light beam pointing correction intelligent agent is used in the actual light path of the real environment, reinforcement learning training continues to be carried out through the actual light path of the real environment, and after training is completed, the light beam pointing correction intelligent agent is used for controlling the fast reflecting mirror set of the light beam pointing adjustment device of the real environment; according to the invention, the problem of light beam drift of a complex series coupling light path system in a multi-type interference environment can be solved.

The invention relates to the technical field of exhibition, and discloses an interaction method and device based on multi-modal communication, equipment and a storage medium, and the method comprises the steps: carrying out the behavior analysis of visitors, so as to obtain multi-modal input information; inputting the multi-modal input information into a multi-modal large model, and enabling the multi-modal large model to independently extract behavior characteristics of each visitor to obtain visitor identity information and visitor intention information; establishing an independent communication link between the multi-modal large model and the visitors according to the identity information of the visitors; generating a virtual interaction role according to the intention information of the visitor; carrying out an interaction activity according to the independent communication link and the virtual interaction role to generate an interaction result; by accurately distinguishing the operation behavior and the problem content of each visitor, the virtual interaction role is controlled to give feedback in time, information transmission disorder and interaction conflicts are avoided, and the problem that a traditional interaction system is difficult to process a large number of concurrent interaction requests during multi-visitor visiting is effectively solved.

The invention discloses an interaction method and system between a game virtual character and a scene, and relates to the technical field of virtual interaction, in a virtual game, the corresponding scene is determined based on the spatial position of the game virtual character and the task node of the game virtual character; according to the scene, the current task content of the game virtual character and the game map, interaction between the game virtual character and the scene is triggered, the accuracy of interaction between the game virtual character and the scene is ensured, and the interaction effect of the game virtual character in each scene is protected. In the interaction between the game virtual character and the scene, determining a real-time experience event according to the energy feature of the game virtual character, the object feature in the scene and the experience module of the head-mounted display; the interaction action of the game virtual character is determined based on the real-time experience event, the corresponding scene and the reaction action of the user, the reaction action of the user is synchronized, and the accuracy of the interaction action of the game virtual character is ensured.

A system, method, and computer programmable product for assessing a virtual interaction is provided. The system is configured to retrieve assessment data, wherein the assessment data comprises at least one of: a plurality of assessment parameters, and a weightage score associated with each of the plurality of assessment parameters. The system is further configured to retrieve response data of a candidate associated with the assessment data. The system is configured to generate, using a trained AI model, a score for the response data based on the assessment data. Further, the system is configured to obtain user input based at least on the score of the response data and update the weightage score associated with at least one of the plurality of assessment parameters based on the user input, wherein the AI model is re-trained based on the updated weightage score.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention relates to the technical field of robot control, in particular to a cross-modal perceptual driving body robot compliance control system which comprises the steps that a sensor is adopted to synchronously collect environment information, multi-source data bias is eliminated through a space-time alignment algorithm, a radial basis function neural network is adopted to analyze multi-modal fusion features, and a multi-modal model is obtained; human operation intention probability distribution is extracted to decompose a task into a path planning layer and a motion control layer, a collision-free trajectory is generated through an RRT algorithm, a high-fidelity physical engine is adopted to construct a virtual interaction scene, and robot learning results are shared through federal learning. According to the method, the problems of inaccurate perception, incoordination between intention recognition and interaction control, difficulty in control strategy verification, slow new task adaptation and difficulty in multi-robot learning result sharing caused by multi-source data deviation and large multi-modal semantic difference of the body robot in a complex environment are solved.

Example methods and systems for automatic suggestion and generation of meeting schedules are provided. A communication platform accesses virtual interaction data associated with a virtual interaction. The communication platform detects a meeting intent based on the virtual interaction data. The communication platform also predicts multiple meeting attendees, determines one or more meeting times, and generates a meeting title based on the virtual interaction data and other related data. The communication platform provides a meeting schedule suggestion to a participant in the virtual interaction. The meeting schedule suggestion includes the meeting title, identifications of the multiple attendees, and the one or more meeting times.

The invention discloses an engineering building remote monitoring system and method based on BIM and VR, and relates to the field of engineering building monitoring. Comprising a building virtual design optimization platform, a sensor data acquisition unit, a communication unit and a remote data processing center, the building virtual design optimization platform is used for building scheme optimization before construction and comprises a BIM three-dimensional modeling unit, a VR virtual interaction unit and an initial building virtual sharing model; the remote data processing center comprises a real-time building information fusion platform, a construction efficiency evaluation unit, a construction precision evaluation unit, an early warning unit and a data storage unit; the real-time building information fusion platform comprises a BIM three-dimensional modeling unit, a VR virtual interaction unit and a real-time building virtual sharing platform. According to the invention, the visualization and real-time performance of the building construction process can be improved, the construction quality and progress control can be enhanced, and the remote monitoring efficiency and intelligent level can be improved.

The invention discloses an intrusion prevention system used in a meta universe environment, which relates to the technical field of information security and comprises a virtual identity verification module, a virtual asset protection module, a virtual scene integrity verification module, a behavior analysis and threat detection module, a real-time response and recovery module and a security policy management module. According to the invention, by setting a multi-layer defense mechanism, through virtual identity verification, virtual asset protection, scene integrity verification, behavior analysis and other multi-layer defense mechanisms, the system can comprehensively cover various security threats in the universe, it is ensured that a user is protected in each link in the virtual world, and AI and ML technologies are introduced at the same time, so that the security of the user is improved. The system can dynamically adapt to complex virtual interaction scenes and detect and respond to threats in real time, meanwhile, the system can continuously optimize the protection model through the self-adaptive learning function so as to cope with new attack means, and high real-time performance and self-adaptability are achieved.

Aspects of the subject disclosure may include, for example, initiating a presence within first metaverse environment, wherein the presence includes a correlation between a physical stimulation of a human interface and first virtual stimuli occurring within the first metaverse environment. A virtual interconnection is initiated between the first metaverse environment and a second metaverse environment including second virtual stimuli occurring within the second metaverse environment. A virtual interaction is determined between the first metaverse environment and the second metaverse environment according to the virtual interconnection and an adjusted virtual stimulus occurring within the first metaverse environment is determined responsive to the virtual interaction between the first metaverse environment and the second metaverse environment. The presence is adjusted according to a correlation between the physical stimulation of the human interface and the adjusted virtual stimuli occurring within the first metaverse environment. Other embodiments are disclosed.

The invention discloses a multi-person interaction method based on a large-space computing technology, and relates to the technical field of multi-person interaction. In order to solve the technical problem that in the prior art, most of existing multi-user virtual interaction systems depend on a single interaction area, so that the user experience is poor when multiple users interact at the same time, the technical scheme provided by the invention is as follows: a multi-user interaction method based on a large-space computing technology is provided. Comprising the following steps: dividing a virtual space into a plurality of functional areas; controlling the temperature of the interaction area and the non-interaction area in real time; sharing of virtual roles is realized through the cloud computing platform; a sharing conflict coordination mechanism is introduced, an operation request of a user for a virtual role is managed, and conflicts are coordinated; creating a virtual computing space and dynamically allocating computing resources by combining distributed computing and a cloud platform; a digital co-construction and sharing platform is built through a 5G network and a holographic image technology, and multi-user interaction and co-construction and sharing of virtual articles are achieved. The method is suitable for being applied to virtual reality scene building work of multi-person interaction.

The invention belongs to the technical field of ship device training, and particularly relates to a ship device virtual reality training system. Comprising a scene virtual module, a training simulation module, a real-time rendering control module, a three-dimensional scene module and a virtual interaction module. The scene virtual module creates a culture model; the training simulation module provides a training interaction algorithm and generates interaction content; the three-dimensional scene module is used for tracking the three-dimensional posture of the motion camera and positioning the visual angle of a virtual scene; the virtual interaction module is used for generating tracking data according to the human-computer interaction information and generating virtual feedback information according to interaction content; the auxiliary module is used for generating training data according to training requirements and providing generation and output of contents such as training effects, notification information and evaluation information; the virtual reality training system for the ship device is mainly used for further improving the virtual reality training effect of the ship device and providing a technical route for expanding training content and optimizing a training scheme.

The invention relates to a virtual hand grasping perception and exoskeleton force feedback mapping method based on virtual-real interaction, and belongs to the technical field of virtual reality, the method comprises the following steps: building a hand exoskeleton, and reading joint data in real time; calculating the pose of each joint coordinate system of the virtual hand relative to the virtual world; according to the calculated poses of all the joints of the virtual hand, the virtual hand is driven to synchronously move with the hand exoskeleton in real time; collision and contact events of the virtual hand and the digital object are monitored in real time, and virtual interaction force generated when the virtual hand interacts with the digital object is calculated; calculating feedback torque required to be output by each hand exoskeleton motor of the hand exoskeleton, and driving the motors to output corresponding feedback force through a motor controller of the hand exoskeleton, so as to realize force feedback of the hand. According to the method, the interaction reality sense in the virtual reality application can be enhanced, the user can interact with the virtual environment more naturally in an immersive mode, and the user experience is improved.

The invention discloses an extracorporeal membrane oxygenation VR training system, which comprises a virtual scene construction module, and is characterized in that the virtual scene construction module carries out modeling on an operating room environment and ECMO equipment based on modeling software; the VR virtual interaction operation module performs virtual scene interaction between the trainee and the virtual scene and the virtual device through the interaction device; the ECMO pre-flushing operation process module generates standard steps and specification requirements based on the construction of the virtual scene and the interaction information of the VR virtual interaction operation module; the multi-person cooperation module is used for distributing persons participating in training according to different roles and playing different persons in a virtual scene for cooperative training; the training content management module is used for managing the ECMO training content of trainees; organic combination of practical training and cyclic training can be achieved, the situation that current ECMO professional medical talents are in shortage is effectively improved, and then the treatment success rate and the medical service quality of critical patients are improved.

Aspects of the subject disclosure may include, for example, initiating a presence within first metaverse environment, wherein the presence includes a correlation between a physical stimulation of a human interface and first virtual stimuli occurring within the first metaverse environment. A virtual interconnection is initiated between the first metaverse environment and a second metaverse environment including second virtual stimuli occurring within the second metaverse environment. A virtual interaction is determined between the first metaverse environment and the second metaverse environment according to the virtual interconnection and an adjusted virtual stimulus occurring within the first metaverse environment is determined responsive to the virtual interaction between the first metaverse environment and the second metaverse environment. The presence is adjusted according to a correlation between the physical stimulation of the human interface and the adjusted virtual stimuli occurring within the first metaverse environment. Other embodiments are disclosed.

The invention relates to the technical field of virtual interaction, in particular to a virtuality and reality combined multi-dimensional display interaction method based on a digital technology, which comprises the steps of S1, virtual fusion scene construction, S2, user behavior capture and data fusion, S3, dynamic instruction generation and response, and S4, multi-modal feedback and dynamic adjustment. According to the method, holographic projection, atomization imaging and AR / VR are fused to construct a virtual-reality seamless combined multi-dimensional interaction scene, and a user is supported to freely pass through a naked-eye 3D space; personalized content is dynamically generated, and somatosensory and acousto-optic multi-mode interaction is realized in combination with a sensor network; and meanwhile, through a block chain reward mechanism and distributed intelligent control, the immersion, expansibility and commercialization potential are remarkably improved, and the core problems of single interaction, scene splitting, response lag and the like in the traditional technology are solved.

The invention discloses a chat system with functions of user psychological exclusive virtual interaction and emotional value providing, and belongs to the field of virtual interaction. Comprising a registration and login module, a psychological analysis module, a personality generation module, an interaction matching module, an interaction cultivation module, an exclusive management module, a stage management module, a relation authentication module, an account logout module and an offline interaction module. According to the method, the interaction between the user and the most matched AI robot can be ensured, the real and stable social experience can be provided, the chapter interaction feeling is reduced, the user belonging feeling and the interaction viscidity are enhanced, and separation and new connection in real social contact can be simulated more truly.

The embodiment of the invention relates to a live broadcast interaction method and device, equipment and a storage medium. The method provided by the invention comprises the following steps: displaying an interaction entrance associated with a target application in a target interface associated with a live broadcast room; in response to the selection for the interaction entry, creating a virtual interaction scene in the target application; and displaying interaction information associated with the virtual interaction scene in an interaction panel of the target interface, the interaction information indicating a first user who joins in the virtual interaction scene via the live broadcast room, and / or a second user who applies for joining in the virtual interaction scene via the live broadcast room. In this way, the live broadcast interaction efficiency can be improved.

The invention provides a personnel state adjustment training method based on a brain-computer interface and virtual reality, an edge computing device and a medium, and relates to the technical field of human factor engineering.The method comprises the steps that an initial virtual environment is presented in the view field of a user; acquiring an electroencephalogram signal when the user is immersed in the initial virtual environment; identifying a personnel state when the user is immersed in the initial virtual environment based on the electroencephalogram signal to obtain a personnel state identification result; adjusting stimulation factors of the initial virtual environment according to the personnel state recognition result, wherein the stimulation factors are used for representing factors causing user state fluctuation; determining the change condition of the electroencephalogram signal of the user; when the change condition of the electroencephalogram signal meets the condition of personnel state improvement, presenting a virtual interaction scene in the view field of the user; identifying a personnel state when the user is immersed in the virtual interaction scene based on the electroencephalogram signal of the user; and when the personnel state of the user reaches the target state or the training duration reaches the ending duration, ending the training.

A handheld haptic device and method for providing haptic feedback during a virtual interaction with a virtual power tool is disclosed. The handheld haptic device has actuators configured to generate haptic vibrations. A haptic vibration database is provided having a plurality of haptic vibration profiles that are selected as a function of the or more state parameters including an operating speed of the virtual power tool, an orientation of the handheld haptic device, and a material of a virtual workpiece. The system leverages the haptic vibration database to generate authentic haptic vibrations with the handheld haptic device, depending on the state parameters.

The technology disclosed relates to a method of realistic simulation of real world interactions as virtual interactions between a control object sensed acting in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting motions of the virtual object by the 3D solid control object model.

The invention discloses a measurement production virtual interaction method and system based on a three-dimensional industrial simulation technology, and relates to the technical field of virtual reality, and the method comprises the steps: collecting the data of a production site in real time, and integrating the collected data to a three-dimensional simulation platform through a data interface, according to the actual layout of a production site and the shape of equipment, a three-dimensional modeling technology is used for simulation, production operation data is mapped to corresponding attributes of a three-dimensional model, construction of a virtual production site environment and dynamic operation display of the equipment are carried out in a simulation platform, and automatic control and optimal scheduling of the equipment are carried out according to an algorithm. And setting an equipment operation state monitoring threshold value, performing early warning, and performing optimization adjustment on the production plan and the equipment maintenance plan. According to the invention, production field data is collected in real time, simulation is carried out by using a three-dimensional modeling technology, and automatic control and an optimization scheduling algorithm are combined, so that high efficiency, accuracy and intelligentization of virtual interaction are realized, and the management level and production efficiency of metering production are improved.