286 results about "Virtual interaction" patented technology

The invention relates to the technical field of medical rehabilitation training, in particular to an intelligent hand training method and system, electronic equipment and a storage medium, and the method comprises the steps: receiving a training mode instruction selected by a user; real-time biomechanical data of the affected side hand are collected through a multi-source sensor array, the real-time biomechanical data comprise finger joint angles, electromyographic signal intensity and a touch pressure distribution matrix, and when the affected side hand is in a mirror image training mode, the six-degree-of-freedom motion trail of the uninjured side hand is synchronously collected; calling a corresponding algorithm model for processing based on the training mode, and generating a control instruction set containing pneumatic pressure parameters, electrical stimulation waveforms and virtual interaction instructions; the control instruction set is sent to a server side, a mechanical glove arranged on the hand of the affected side in a sleeving mode executes corresponding pneumatic-electric combined driving operation, and multi-sense feedback is synchronously presented. According to the application, the composite requirements of patients in different rehabilitation stages on training mode diversity, control accuracy and interactive immersion can be met.

The invention relates to the technical field of editing and special effect generation, in particular to a digital media content intelligent editing and special effect generation system based on artificial intelligence. Comprising a content understanding analysis module, an editing decision module, a special effect generation preview module, an audio processing module, a dynamic transition special effect module, a subtitle generation editing module, a virtual interaction module and a content distribution optimization module. The content understanding analysis module is used for video content identification and sentiment analysis; and the editing decision module is used for recommending an editing point and providing a dynamic editing strategy. The video content can be automatically analyzed, the editing point and the special effect adding position can be identified, the editing and special effect generation efficiency is greatly improved, the editing strategy and the special effect type can be dynamically adjusted according to the video content and the sentiment analysis result, the editing and the special effect can better meet the user requirement and the video content, and the user experience is improved. Abundant editing and special effect options are provided, and the editing and special effect generation process is simplified.

The invention provides a self-supervised continuous 3D hand posture tracking method based on a lightweight inertial measurement unit, and the method specifically comprises the following steps: firstly, obtaining a hand motion signal by using a lightweight consumer-level IMU, and extracting features by using a multi-stage neural network containing a bidirectional long-short term memory (Bi-LSTM) module; the global displacement and orientation of the hand are processed through a wrist posture estimation module, and three-dimensional coordinates of hand skeleton points are solved and calculated by means of a finger motion chain; secondly, a self-supervised completion network is realized by combining a random mask and dual loss, and the features are processed to complete complete attitude reconstruction; and finally, combining network output with kinematics prior, generating a three-dimensional grid with reasonable anatomy, solving the problem that joint deformation is inconsistent with torque, and realizing accurate acquisition of a three-dimensional hand posture. For a dynamic hand motion tracking task, the method can adapt to a sparse IMU deployment scene and realize continuous high-precision tracking; the real-time performance demand of daily interaction can be met, and a low-cost solution can be provided for the fields such as medical rehabilitation and virtual interaction which have strict requirements on attitude precision.

The invention discloses an interaction method and system between a game virtual character and a scene, and relates to the technical field of virtual interaction, in a virtual game, the corresponding scene is determined based on the spatial position of the game virtual character and the task node of the game virtual character; according to the scene, the current task content of the game virtual character and the game map, interaction between the game virtual character and the scene is triggered, the accuracy of interaction between the game virtual character and the scene is ensured, and the interaction effect of the game virtual character in each scene is protected. In the interaction between the game virtual character and the scene, determining a real-time experience event according to the energy feature of the game virtual character, the object feature in the scene and the experience module of the head-mounted display; the interaction action of the game virtual character is determined based on the real-time experience event, the corresponding scene and the reaction action of the user, the reaction action of the user is synchronized, and the accuracy of the interaction action of the game virtual character is ensured.

A system, method, and computer programmable product for assessing a virtual interaction is provided. The system is configured to retrieve assessment data, wherein the assessment data comprises at least one of: a plurality of assessment parameters, and a weightage score associated with each of the plurality of assessment parameters. The system is further configured to retrieve response data of a candidate associated with the assessment data. The system is configured to generate, using a trained AI model, a score for the response data based on the assessment data. Further, the system is configured to obtain user input based at least on the score of the response data and update the weightage score associated with at least one of the plurality of assessment parameters based on the user input, wherein the AI model is re-trained based on the updated weightage score.

The invention discloses a virtual interaction system for realizing multi-dimensional perception, which relates to the technical field of virtual interaction, and comprises a man-machine interaction unit, a mapping matching unit, a data processing unit and a data processing unit, and the coordinate matching module is responsible for establishing a coordinate matching relation of the virtual object in the virtual space according to the size, shape and attitude parameters of the virtual object. The interaction device is operated to control the intelligent mark point in the virtual interaction system to interact with the target object, according to the position relation in the interaction process, the position posture of the interaction object is collected to determine whether contact occurs, event triggering and target interaction are achieved through the triggering control unit, a user senses the event, and the interaction efficiency is improved. Interaction requirements can be met, multi-target interaction control requirements are met, and the purpose of saving system resources is achieved.

The invention relates to the technical field of robot control, in particular to a cross-modal perceptual driving body robot compliance control system which comprises the steps that a sensor is adopted to synchronously collect environment information, multi-source data bias is eliminated through a space-time alignment algorithm, a radial basis function neural network is adopted to analyze multi-modal fusion features, and a multi-modal model is obtained; human operation intention probability distribution is extracted to decompose a task into a path planning layer and a motion control layer, a collision-free trajectory is generated through an RRT algorithm, a high-fidelity physical engine is adopted to construct a virtual interaction scene, and robot learning results are shared through federal learning. According to the method, the problems of inaccurate perception, incoordination between intention recognition and interaction control, difficulty in control strategy verification, slow new task adaptation and difficulty in multi-robot learning result sharing caused by multi-source data deviation and large multi-modal semantic difference of the body robot in a complex environment are solved.

The invention discloses an engineering building remote monitoring system and method based on BIM and VR, and relates to the field of engineering building monitoring. Comprising a building virtual design optimization platform, a sensor data acquisition unit, a communication unit and a remote data processing center, the building virtual design optimization platform is used for building scheme optimization before construction and comprises a BIM three-dimensional modeling unit, a VR virtual interaction unit and an initial building virtual sharing model; the remote data processing center comprises a real-time building information fusion platform, a construction efficiency evaluation unit, a construction precision evaluation unit, an early warning unit and a data storage unit; the real-time building information fusion platform comprises a BIM three-dimensional modeling unit, a VR virtual interaction unit and a real-time building virtual sharing platform. According to the invention, the visualization and real-time performance of the building construction process can be improved, the construction quality and progress control can be enhanced, and the remote monitoring efficiency and intelligent level can be improved.

Aspects of the subject disclosure may include, for example, initiating a presence within first metaverse environment, wherein the presence includes a correlation between a physical stimulation of a human interface and first virtual stimuli occurring within the first metaverse environment. A virtual interconnection is initiated between the first metaverse environment and a second metaverse environment including second virtual stimuli occurring within the second metaverse environment. A virtual interaction is determined between the first metaverse environment and the second metaverse environment according to the virtual interconnection and an adjusted virtual stimulus occurring within the first metaverse environment is determined responsive to the virtual interaction between the first metaverse environment and the second metaverse environment. The presence is adjusted according to a correlation between the physical stimulation of the human interface and the adjusted virtual stimuli occurring within the first metaverse environment. Other embodiments are disclosed.

The invention relates to a virtual hand grasping perception and exoskeleton force feedback mapping method based on virtual-real interaction, and belongs to the technical field of virtual reality, the method comprises the following steps: building a hand exoskeleton, and reading joint data in real time; calculating the pose of each joint coordinate system of the virtual hand relative to the virtual world; according to the calculated poses of all the joints of the virtual hand, the virtual hand is driven to synchronously move with the hand exoskeleton in real time; collision and contact events of the virtual hand and the digital object are monitored in real time, and virtual interaction force generated when the virtual hand interacts with the digital object is calculated; calculating feedback torque required to be output by each hand exoskeleton motor of the hand exoskeleton, and driving the motors to output corresponding feedback force through a motor controller of the hand exoskeleton, so as to realize force feedback of the hand. According to the method, the interaction reality sense in the virtual reality application can be enhanced, the user can interact with the virtual environment more naturally in an immersive mode, and the user experience is improved.

The invention relates to the technical field of virtual interaction, in particular to a virtuality and reality combined multi-dimensional display interaction method based on a digital technology, which comprises the steps of S1, virtual fusion scene construction, S2, user behavior capture and data fusion, S3, dynamic instruction generation and response, and S4, multi-modal feedback and dynamic adjustment. According to the method, holographic projection, atomization imaging and AR / VR are fused to construct a virtual-reality seamless combined multi-dimensional interaction scene, and a user is supported to freely pass through a naked-eye 3D space; personalized content is dynamically generated, and somatosensory and acousto-optic multi-mode interaction is realized in combination with a sensor network; and meanwhile, through a block chain reward mechanism and distributed intelligent control, the immersion, expansibility and commercialization potential are remarkably improved, and the core problems of single interaction, scene splitting, response lag and the like in the traditional technology are solved.

The invention discloses a chat system with functions of user psychological exclusive virtual interaction and emotional value providing, and belongs to the field of virtual interaction. Comprising a registration and login module, a psychological analysis module, a personality generation module, an interaction matching module, an interaction cultivation module, an exclusive management module, a stage management module, a relation authentication module, an account logout module and an offline interaction module. According to the method, the interaction between the user and the most matched AI robot can be ensured, the real and stable social experience can be provided, the chapter interaction feeling is reduced, the user belonging feeling and the interaction viscidity are enhanced, and separation and new connection in real social contact can be simulated more truly.

The embodiment of the invention relates to a live broadcast interaction method and device, equipment and a storage medium. The method provided by the invention comprises the following steps: displaying an interaction entrance associated with a target application in a target interface associated with a live broadcast room; in response to the selection for the interaction entry, creating a virtual interaction scene in the target application; and displaying interaction information associated with the virtual interaction scene in an interaction panel of the target interface, the interaction information indicating a first user who joins in the virtual interaction scene via the live broadcast room, and / or a second user who applies for joining in the virtual interaction scene via the live broadcast room. In this way, the live broadcast interaction efficiency can be improved.

The invention provides a personnel state adjustment training method based on a brain-computer interface and virtual reality, an edge computing device and a medium, and relates to the technical field of human factor engineering.The method comprises the steps that an initial virtual environment is presented in the view field of a user; acquiring an electroencephalogram signal when the user is immersed in the initial virtual environment; identifying a personnel state when the user is immersed in the initial virtual environment based on the electroencephalogram signal to obtain a personnel state identification result; adjusting stimulation factors of the initial virtual environment according to the personnel state recognition result, wherein the stimulation factors are used for representing factors causing user state fluctuation; determining the change condition of the electroencephalogram signal of the user; when the change condition of the electroencephalogram signal meets the condition of personnel state improvement, presenting a virtual interaction scene in the view field of the user; identifying a personnel state when the user is immersed in the virtual interaction scene based on the electroencephalogram signal of the user; and when the personnel state of the user reaches the target state or the training duration reaches the ending duration, ending the training.

A handheld haptic device and method for providing haptic feedback during a virtual interaction with a virtual power tool is disclosed. The handheld haptic device has actuators configured to generate haptic vibrations. A haptic vibration database is provided having a plurality of haptic vibration profiles that are selected as a function of the or more state parameters including an operating speed of the virtual power tool, an orientation of the handheld haptic device, and a material of a virtual workpiece. The system leverages the haptic vibration database to generate authentic haptic vibrations with the handheld haptic device, depending on the state parameters.

A system and method for facilitating virtual human-animal interactions are disclosed in this disclosure. The system may include at least one camera unit configured to capture real-time video of an animal and an interaction module configured to perform an interactive action with the animal based on a user input. Further, an analysis module may receive user input, trigger the interaction module to perform the interactive action based on the user input, receive a real-time video of the animal from the camera unit, and feed all of it to a machine learning ML model. The ML model may be configured to detect behavior of the animal, in response to the interactive action, determine a compatibility score associated with compatibility of the animal with the user based on the behavior, and display the compatibility score on a user device.

The invention relates to the technical field of virtual digital humans, in particular to a virtual digital human real-time interaction system based on an AI (artificial intelligence) duplicate and a use method, comprising the following steps: step 1, acquiring original language signal data # imgabs0 # and text input data # imgabs1 # acquired by a microphone, inputting the acquired # imgabs2 # into a voice recognition module, and inputting the acquired # imgabs2 # into a voice recognition module; the voice is converted into a text T through an automatic voice recognition algorithm # imgabs3 # arranged in the voice recognition module, the calculation formula for converting the voice into the text T is # imgabs4 #, and text input data # imgabs5 # and the text T are combined to generate comprehensive text information T0; according to the method, AI technologies such as speech recognition, natural language understanding, semantic embedding, context reasoning and the like are fused, so that the virtual digital human can accurately recognize the intention of the user and naturally generate the response, and particularly has stronger semantic judgment and adjustment capability when processing multiple rounds of dialogues and ambiguous words; therefore, the accuracy and the natural fluency of virtual interaction are greatly improved, and the user experience is better.

Provided is a virtual interactive system for hull load identification and full-field safety assessment, which includes a structure strain and acceleration monitoring module, a hull motion monitoring module, a hull load identification module, a hull full-field structural response calculation module, a hull wave environment identification module, a ship response virtual interaction module, a ship response 3D visualization module, a real-time safety assessment module, and a system storage and output module.

The invention belongs to the technical field of gesture virtualization, and particularly discloses a virtual interaction method and system based on muscle electrical stimulation, and the method comprises the steps: S1, or a combination of S1 and S2: in a virtual reality environment, generating a virtual object, and controlling a non-habitual hand to make a gesture to simulate the virtual object by using muscle electrical stimulation; and S2, touching the virtual object with a conventional hand which touches a non-conventional hand simulating the virtual object to obtain tactile feedback of touching the virtual object. By adopting the technical scheme, the control feeling of the user on the hand is reduced by using the muscle electrical stimulation technology, so that the experience of the user on regarding the hand as a virtual object is enhanced.

The invention discloses a virtual interaction training method and device for a visual reconstruction brain-computer interface, and the method comprises the steps: generating a virtual reality scene, and extracting an importance representation related to a current task in the virtual reality scene; key visual information is extracted, and the key visual information is mapped to the spatial position of the cortex electrode array through a preset visual field-cortex topological mapping model; converting the mapped key visual information into space-time stimulation parameters of the cortical electrode based on a pre-acquired individualized perception function constraint; collecting behavior data of task execution of the user under the spatio-temporal stimulation parameters to calculate a behavior error comprehensive score; and dynamically adjusting difficulty parameters of the task according to the behavior error comprehensive score so as to complete closed-loop adaptive training. The problems of single training scene, subjective parameter adjustment, system closed-loop deficiency and insufficient evaluation standards are solved, and personalized and quantitative evaluation, safety and high efficiency of visual reconstruction brain-computer interface postoperative rehabilitation training are realized.

A content processing method and apparatus, a content recommendation method, an electronic device, and a storage medium, relating to the technical field of information processing. The content processing method comprises: obtaining a plurality of pieces of historical content data which have been subjected to social interaction positive feedback in a first virtual interaction scene by a target user, wherein the historical content data comprises words or characters representing content and the semantics of the content; generating a word vector used for representing the words or the characters in the plurality of pieces of historical content data, and a word position vector used for representing the position of the words or the characters; generating a word type vector used for representing the meaning of the words or the characters, and a content position vector used for representing the position of each piece of historical content data among the plurality of pieces of historical content data; generating a user sequence representation on the basis of the vectors; and obtaining a plurality of content sequence representations, and determining a candidate content sequence representation on the basis of the similarity between the user sequence representation and each content sequence representation, content corresponding to the candidate content sequence representation being used to be recommended to the target user.

The invention provides an ACLS first-aid comprehensive service management method and device based on virtual interaction, and the method comprises the steps: firstly reading first-aid information (age, gender, disease type, in-hospital first aid and / or out-of-hospital first aid) in a patient first-aid medical record on line when a first-aid service is needed, and searching and outputting a consistent VR first-aid service course; and sending the VR first-aid service course to the VR terminal, and playing the VR first-aid service course of the corresponding ACLS first-aid node by the VR terminal. Therefore, by combining with the VR technology, the VR emergency service course matched with the patient can be quickly retrieved for the medical staff according to the patient information and displayed, so that the medical staff is guided to implement a correct ACLS process through the VR course, the field emergency time is saved, and the ACLS emergency service is accurately implemented. According to the application, the field service efficiency and accuracy of the ACLS emergency service can be greatly improved, and the hospital emergency service quality is improved.

Example systems and methods for facilitating participant interactions during a virtual expo are provided. A video conference provider creates a virtual expo. The video conference provider receives, from a first client device associated with a first participant in the virtual expo, a request to interact with a second participant in the virtual expo. The video conference provider provides, to a second client device associated with the second participant, a notification of the request to interact. The video conference provider receives, from the second client device, an approval of the request. In response to receiving the approval, the video conference provider establishes a first virtual interaction session between the first participant and the second participant.

The invention discloses a charging pile ring network communication method based on a virtual interaction technology, and belongs to the technical field of electric vehicle charging. The method comprises the steps that a terminal charging management control unit TCCU and a plurality of terminal management units TMUs are connected through network cables to form an annular physical connection system, and an annular network topology is constructed; using the terminal charging management control unit TCCU as a server to configure a fixed IP address for the terminal charging management control unit TCCU; each TMU is used as a client, and a unique IP address and a unique MAC address are automatically allocated based on single-board dial-up of the TMU; the TMU sends an ARP (Address Resolution Protocol) message to obtain a server MAC (Media Access Control) address, then the TMU initiates a TCP / IP (Transmission Control Protocol / Internet Protocol) connection request, the TCP / IP connection request is forwarded through network ports of other TMUs on the ring network system, and a stable communication link is established after the TCCU responds to the TCP / IP connection request; and the TMU receives the network data through the network port and compares the target MAC address, and non-self data is forwarded to the next TMU through another network port until the data is sent to the server to complete communication.

The application provides a virtual object control method, a virtual object control device, a computer readable storage medium and an electronic device, and relates to the technical field of virtual interaction. In the method, a user can trigger a sliding operation from a first control to a second control to control a virtual object to perform a target action related to the first control and the second control. Compared with the related art, the user does not need to press the first control and the second control respectively to trigger the target action. The user only needs to slide from the first control to the second control to achieve "one-key" triggering of the target action (such as a continuous attack action). This can improve the casting efficiency of the target action and reduce the cost of the user learning to cast the target action.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. A first user of a first device is enabled to view a real-world environment that is visible to a second user via a second device by causing display, at the first device, of a live camera feed generated at the second device. The live camera feed comprises images of the real-world environment that is visible to the second user. Input data indicative of a selection by the first user of a virtual content item to apply to the real-world environment that is visible to the second user is received. The first device and second device present media objects overlaid on the real-world environment based on the input data.

The embodiment of the invention provides a touch screen control method, a touch chip and electronic equipment, and the method comprises the steps: detecting whether a touch screen of the electronic equipment receives a touch operation or not under the condition that the electronic equipment has touch noise; under the condition that the touch screen is not detected to receive the touch operation, acquiring timing time of a screen turn-off timer of the electronic equipment; and under the condition that the timing time is less than or equal to preset time, generating a virtual interaction event, and controlling the touch screen to keep bright based on the virtual interaction event. According to the embodiment of the invention, when the electronic equipment has touch noise and does not detect the touch operation, the touch screen is controlled to keep bright by generating the virtual interaction event, so that the firmware state of the touch chip is prevented from being emptied, and the touch performance of the touch screen is effectively improved.

The embodiment of the invention discloses a message display method and device and related equipment, and can be applied to the technical field of data processing. The method comprises the following steps: displaying an interaction message corresponding to a virtual interaction type on a first message page; the interactive message refers to a message received by the first client and sent by a second client; the virtual interaction type is configured through an interaction configuration page of the second client; the interaction configuration page is used for configuring interaction parameter information of a virtual interaction type; the interaction parameter information at least comprises a timing threshold value for triggering an interaction animation of a virtual interaction type; and when the timing duration corresponding to the interactive message reaches a timing threshold value, playing the interactive animation, and updating and displaying the message description content of the interactive message as the interactive description content corresponding to the interactive animation. By adopting the embodiment of the invention, the diversity of message display types can be enriched.

We provide the system. [Solution] An information terminal means for acquiring information about the user's interests and hobbies, A computer means for analyzing the user information and identifying similar users, An artificial intelligence means for forming a virtual communication space that enables anonymous communication among the identified users, A means of providing information that suggests activities and new hobbies in the aforementioned virtual interaction space, A means of providing behavioral information to notify elderly people of event information to promote their social lives, A system that includes this.

The invention discloses a virtual data packet transmission method and device, equipment, a storage medium and a program, and relates to the technical field of computers, and the method comprises the steps: determining a plurality of communication ports used for supporting the communication with an external network on a virtual interaction machine; performing extension processing on the structure fields corresponding to the plurality of communication ports to obtain extended structure fields, and determining a global identifier corresponding to each communication port according to hierarchical address information corresponding to the virtual interaction machine, in which extension processing is to add private fields corresponding to a remote direct data access function in the structure fields; under the condition that the virtual interaction machine receives a virtual data packet to be transferred through the virtual machine through the network interface, analyzing a packet header of the virtual data packet through the extension structure field; and determining whether to convert the virtual data packet or not according to an analysis result, and transmitting corresponding target data of the virtual data packet according to a conversion result, a mapping relationship between the plurality of communication ports and the physical storage device, and the global identifier.