491 results about "Interactive technology" patented technology

The embodiment of the invention provides a digital human interaction system and method based on multi-modal emotion recognition, and belongs to the technical field of digital human interaction. The system comprises a multi-modal sensing module used for collecting multi-modal data and preprocessing the multi-modal data to generate a standardized data stream; the cross-modal fusion and emotion recognition module is used for carrying out interactive modeling on the multi-modal features and outputting a current emotion label and emotion intensity; the reaction planning module is used for generating a composite reaction strategy; and the digital human rendering module is used for mapping the composite reaction strategy into control signals corresponding to the voice, the facial expression and the action respectively, and driving a digital human to execute corresponding voice output, facial expression change and limb action through the control signals so as to realize interaction. According to the method, multi-modal data are deeply fused through the cross-modal graph neural network and comparative learning, the weight is dynamically adjusted in combination with the modal confidence, and the emotion recognition accuracy and robustness are improved.

The invention discloses an AI digital human interactive response method based on a large language model, and relates to the technical field of digital human interaction, and the method comprises the steps: analyzing collected user voice data and visual data through a natural language processing method, generating a cross-modal feature vector, carrying out the cross-modal association analysis of the cross-modal feature vector, and carrying out the cross-modal association analysis of the cross-modal feature vector. Generating a semantic association topological graph; calculating a vertex coordinate and a joint activity threshold value of the semantic association topological graph through high-digital human correlation, inputting the vertex coordinate and the joint activity threshold value into a constructed coordinate index database to execute attention weight calibration, and outputting a multi-dimensional association graph; and performing information density analysis based on the multi-dimensional association map, generating an information density gradient vector field, and dividing a high-density core region and a low-density edge region, the high-density core region generating a semantic core coding tensor, and the low-density edge region generating an edge feature package. According to the method, the cross-modal fusion vector is converted into the cross-modal feature vector, so that the modeling of the cross-modal association relationship is realized.

The invention provides a context-based intelligent voice semantic understanding analysis method and system, and relates to the technical field of voice interaction, and the method comprises the steps: obtaining an input voice signal, extracting an acoustic feature, and decoding the acoustic feature to obtain a candidate text; constructing context semantic representation to carry out disambiguation processing; establishing a semantic dependency graph and carrying out multi-level correlation analysis; spreading context constraint information to perform multi-hop reasoning; and finally generating intention recognition and slot filling results and updating the session state. The semantic comprehension accuracy and the intelligent degree of the voice interaction system are improved by introducing the context information and the multi-level semantic dependency relationship.

The invention belongs to the technical field of computer graphics and virtual reality, and discloses a virtual-real fusion-based panoramic roaming construction method for a digital exhibition hall, which effectively solves the problems of easy drift and offset in a virtual environment in a traditional system through a multi-sensor fusion algorithm and a closed-loop optimization mechanism. Under the complex environment of people flow change, illumination fluctuation and the like in an exhibition hall, accurate alignment of virtual content and physical space can still be kept, it is ensured that a user obtains coherent and stable visual experience in the roaming process, and a reliable space reference is provided for virtual-real interaction; the light and shadow effect and the material performance of the virtual content are naturally fused with the physical environment through the physical rendering and multi-sensory interaction technology, and meanwhile, a multi-dimensional immersion sense is constructed in combination with the spatial sound effect and interaction feedback; when the user interacts with the virtual exhibit, sensory experience close to reality can be obtained, and the sense of substitution and attraction of the digital exhibition hall are remarkably improved.

The invention discloses an interactive commodity selection method and system based on augmented reality, and relates to the technical field of augmented reality interaction, and the method comprises the steps: obtaining the commodity three-dimensional information of a target commodity and the commodity attribute information corresponding to the commodity three-dimensional information; determining scene reference coordinates of the augmented reality scene and ambient light features matched with the scene reference coordinates according to the spatial perception data of the terminal device, and generating an augmented reality presentation object of the target commodity in the augmented reality scene; obtaining interaction behavior data according to the interaction action of the user in the augmented reality scene; performing association matching on the interaction behavior data and the commodity attribute information to generate a candidate commodity selection feature set; and according to a preset fusion criterion, performing fusion on the candidate product selection feature set to obtain a target product selection decision, and outputting interaction feedback information corresponding to the target product selection decision. According to the application, robust fusion and reliable decision of multi-modal interaction information are realized, and the accuracy and interaction consistency of an augmented reality product selection process are improved.

The invention provides a cross-culture teaching adaptive guiding method and system integrating narrative reasoning and digital interaction, and relates to the technical field of digital interaction. According to the method, the first feature vector is constructed by collecting the culture background and the emotional state of the learner, and the culture portrait label is generated in combination with the multi-dimensional culture evaluation; guiding to generate multi-modal narrative data, executing semantic reasoning and conflict identification, and generating a personalized interaction script; behavior feedback is deployed and monitored in real time in a digital interaction environment, dynamic iteration and closed-loop optimization of teaching content are realized, and culture sensitivity and teaching adaptability are improved.

The invention belongs to the technical field of intelligent interaction, particularly relates to an intelligent interaction method, system and device based on AI communication and a storage medium, and aims to solve the problems that in the prior art, AI scene coverage is narrow and is separated from a business process; the system comprises four modules: a context sensing and modeling module which collects multi-source context information in real time, and generates a three-dimensional context tensor through structured alignment and time sequence normalization; the intention analysis and reasoning module performs intention level decomposition by using a deep semantic model based on the tensor, and outputs an intention recognition result and probability distribution; the response generation and adaptation module is used for generating multi-mode responses such as texts, voices, images or equipment instructions in combination with intention and context tensors, and outputting the multi-mode responses after consistency verification; and the interactive feedback and optimization module collects user explicit and implicit feedback and is used for updating model parameters and strategy weights online to realize continuous optimization of the system.

The invention relates to the technical field of intelligent interaction, in particular to a multi-modal input agent decision interaction method and system. The system comprises a multi-modal input acquisition unit, an input processing unit, a decision strategy generation unit, an interactive execution unit and a data transmission unit. The multi-modal input acquisition unit acquires multi-modal input signal data of a target environment to realize multi-dimensional sensing of the environment; the input processing unit processes the signal data to obtain multi-modal feature data, and the characterization accuracy of the feature data on the environment information is improved by deeply fusing multi-source data to mine internal association; the decision-making strategy generation unit generates a decision-making strategy based on the feature data, and can adjust decision-making logic according to the real-time change of the environment; the interactive execution unit executes interactive actions according to a decision strategy to guarantee accurate conversion of decisions; and the data transmission unit transmits the interaction result data to external equipment to ensure real-time and reliable transmission. The system is suitable for various intelligent interaction scenes.

The invention provides a meta-universe virtual-reality interaction method based on causal invariance, belongs to the field of meta-universe virtual-reality interaction technologies, and is used for solving the problems of poor cross-domain adaptation, insufficient long-tail scene coverage and low dynamic robustness in related technologies. According to the method, through sensing layer causal kernel quality evaluation and data enhancement, reasoning layer causal invariance learning and cross-domain parameter migration, decision layer causal attention intention alignment, execution layer causal reinforcement learning control and iteration layer double-threshold knowledge updating, full-link parameter collaborative circulation is realized in combination with a causal data interface; and finally, the accuracy and the stability of virtual-real interaction of the element universe are improved, and efficient adaptation of cross-domain, long-tail and dynamic scenes is realized.

The invention discloses an electric power field operation guidance interaction system and method, and belongs to the technical field of electric power construction. The method comprises the steps that double-end communication connection is constructed, continuous supervision data and operation abnormal performance of target power equipment are acquired, a blank analysis space is constructed, and a suspended potential discharge abnormal signal is generated; according to the method, the core problems that a guidance scheme flows on the surface and interaction communication is low in efficiency and delayed are fundamentally solved, and sustainable and optimized intelligent supporting capacity of power field operation is formed through data driving and knowledge precipitation in the whole process; the early warning capability, the handling efficiency and the safety management and control level of potential faults of complex power equipment are remarkably improved, an innovative development direction of a power field operation guidance interaction technology is represented, and multi-source deep diagnosis, dynamic risk assessment and intelligent decision interaction are organically fused to achieve the purpose of improving the safety of the power field operation guidance interaction technology. And a closed-loop intelligent interaction system integrating monitoring, analysis, decision making and guidance is constructed.

The invention belongs to the technical field of intelligent property and digital interaction, and discloses a property service scene-oriented digital human all-in-one machine and a multi-mode interaction method. According to the invention, a cloud edge-end collaborative architecture is adopted, and a full-stack solution is constructed through a multi-modal sensing and interaction module, an edge computing and control module and a cloud collaborative platform; the core lies in four cooperative technologies: dynamic multi-modal fusion based on gated cross attention and online reinforcement learning, event-driven process management of a hierarchical state machine and persistent context, reliable cross-system cooperation of a sender box mode and transactional messages, and adaptive resource scheduling of environment compensation and multi-objective optimization. According to the invention, high-reliability intelligent service is realized, the interaction success rate in a complex environment is remarkably improved, the data consistency of the heterogeneous system is high, the performance is stable under extreme conditions, and the system can replace a manual foreground to adapt to various property service scenes such as office buildings and parks.

The invention belongs to the technical field of voice interaction, and discloses a department mark terminal voice interaction method based on intelligent AI. Comprising the following steps: carrying out multi-channel data acquisition on a vehicle-mounted environment in which a ministry mark terminal is located, and obtaining a clear voice signal through multi-stage perception enhancement and signal reconstruction; performing context dynamic perception and user identity modeling based on the clear voice signal, and constructing a personalized interaction context vector; semantic alignment and intention disambiguation are carried out on the voice signals, and a user instruction semantic map is constructed; a complete dialogue state vector is formed in combination with historical interaction records; performing task decomposition and execution planning according to the dialogue state vector and the terminal function interface specification, and generating a response strategy; performing voice feedback content generation and emotional intonation regulation and control based on the response strategy; and finally, performing multi-modal cooperative expression and interactive experience optimization on the personalized voice feedback content to obtain final feedback output, thereby remarkably improving the accuracy, naturalness and user experience of vehicle-mounted voice interaction.

The invention relates to the technical field of circular screen equipment interaction, and discloses a circular screen audio playing interface optimization method and system, a storage medium and equipment, and the method comprises the steps: obtaining physical parameters of a circular screen, and building a polar coordinate system with the center of the screen as an original point; dividing a screen display area into a plurality of functional areas according to radial distances; based on the polar coordinate system and the partitioning result, carrying out adaptive layout on a plurality of elements of an audio playing interface; a touch response area of the interaction element is expanded, and multiple interaction gestures including a rotation gesture are recognized and responded; dynamic visual feedback is triggered in the user interaction process, and according to the method, the adaptation problem of a traditional rectangular UI on the circular screen device is comprehensively solved through the technical means of establishing a special coordinate system for the circular screen, optimizing the interface element layout, fusing multi-modal interaction gestures, enriching the visual animation effect, achieving dynamic self-adaptive optimization of the interface and the like.

The invention discloses a mobile application interface interaction method and device, equipment and a storage medium, and relates to the technical field of interface interaction. The method comprises the following steps: acquiring touch data of a user, and determining a predicted touch position according to the touch data; based on the predicted touch position, generating a corresponding animation request and a rendering task, and loading required resources; acquiring the real-time frame rate of the equipment and the priority of the animation request, sequentially processing the animation request according to the priority, and determining the animation parameter of the interactive animation of the animation request according to the real-time frame rate of the equipment to obtain the interactive animation; rendering the rendering tasks of different classifications to obtain rendering data of the interface; and obtaining screen parameters of the equipment, determining layout information of the mobile application interface according to the screen parameters, the interactive animation and the rendering data, and updating the mobile application interface according to the layout information of the mobile application interface. According to the embodiment of the invention, the user experience of mobile application interface interaction is improved.

The invention relates to the technical field of digital human voice interaction, and discloses a digital human live voice interaction system fused with emotion calculation. The system constructs an emotional response time window by acquiring a user voice input data stream, the starting point of the emotional response time window is the end moment of the user voice input data stream, and the end point is obtained by subtracting the necessary duration of voice response synthesis from the preset maximum response cut-off moment. The system obtains an emotional state vector of the user in real time and judges whether the emotional state vector reaches an emotional intensity threshold value or not; and if so, predicting the total generation duration of the digital human voice response. And when the residual duration of the emotional response time window is equal to the total generation duration, taking the window starting point as a voice response starting moment, and controlling the digital human to start voice response generation. According to the system, the voice response matched with the emotional state of the user is generated through refined time window management and emotional state perception, invalid response and interaction delay are reduced, and the naturalness of digital human live broadcast voice interaction and the user experience are improved.

The invention relates to the technical field of virtual reality interaction, and particularly discloses a multi-modal fused virtual exhibition hall immersive interaction system, which comprises the following steps of: acquiring real-time multi-modal interaction data of a user and performing synchronous preprocessing; inputting the orientation semantic words into an interval type-2 fuzzy logic system to generate a three-dimensional space semantic membership field; according to the gesture pointing vector and the hand shaking amplitude, a pointing conical area is constructed, two-dimensional Gaussian distribution is established in a layered mode, and a gesture pointing probability field is generated; taking a semantic membership field, a gesture pointing probability field and a gaze point Gaussian kernel density field as independent evidences, introducing a wall boundary and a floor channel as spatial topology constraints, and fusing by adopting an evidence theory combination rule to generate a three-dimensional intention probability distribution field; carrying out gravity center defuzzification processing on the distribution field to extract a navigation target area, and planning a navigation path by taking the current position of the user as a starting point and taking a nearest floor channel entrance as a passing point; according to the method, the problems of multi-mode fuzzy intention understanding and space adaptation are solved.

The invention provides a general visual identification model based on a cue word interaction technology. The general visual identification model comprises an image encoder, a text cue word encoder, a visual cue word encoder, a multi-mode interaction module and a target decoding module, the multi-modal interaction module is a bidirectional interaction module and comprises a text and image interaction module, an image and text interaction module and an image and cue word interaction module. Key technologies such as the bidirectional multi-modal interaction module, the cue word detection mechanism and the interested area interaction mechanism are introduced; image features and text prompts can be subjected to deep bidirectional interaction, robust, stable and fine-grained feature support is provided for downstream tasks, and it is ensured that the model has higher accuracy and generalization performance; according to the method, a'detection cue word mechanism 'is used for positioning the target position, meanwhile, text-image modal matching is used for target semantic recognition, and the key effect is achieved in a plurality of visual understanding tasks.

The invention relates to the technical field of intelligent information interaction, in particular to an intelligent information interaction system and an intelligent information interaction method. The intelligent information interaction system comprises an electronic ink screen, a communication module, a communication base station and a cloud service platform, the cloud service platform is in communication connection with the communication module through the communication base station, and the communication module is in communication connection with the electronic ink screen; the communication module is used for receiving first to-be-displayed information sent by the cloud service platform or second to-be-displayed information sent by the user equipment, and sending the display information to the electronic ink screen; and the electronic ink screen is used for displaying the first to-be-displayed information or the second to-be-displayed information. According to the intelligent information interaction system provided by the invention, the cloud service platform or the user equipment can be adopted to update the display information on the electronic ink screen, the information updating efficiency is improved, and the electronic ink screen displays the information depending on the electronic waveform, so that the power consumption of the electronic paper display screen is relatively low, and the electric energy cost is saved.

The embodiment of the invention provides a ring-based earphone control method and system, and a storage medium, and relates to the technical field of human-computer interaction. The system comprises at least two target rings; each target ring comprises a motion state detection module, a wireless communication module and a control module; a target earphone; the wireless communication module of the target ring is in communication connection with the target earphone; the wireless communication module of each target ring is in communication connection with the wireless communication module of another target ring; the control module is electrically connected with the motion state detection module and the wireless communication module; the motion state detection module is used for collecting motion state data of the target ring; the wireless communication module is used for acquiring signal intensity among the target rings; and the control module is used for determining gesture recognition information according to the motion state data of each target ring and the signal intensity, and controlling the target earphone based on the gesture recognition information. According to the embodiment of the invention, the accuracy of the earphone control method can be improved.

The invention relates to the technical field of virtual digital human interaction, and discloses a multi-mode-based virtual digital human interaction method and system. The method comprises the following steps: constructing a semantic mapping network by fusing multi-modal perception data, and resolving in real time to generate a dynamic emotion field; utilizing the field intensity and vector change of the emotional field to drive a pre-training emotional state machine to realize the migration of the internal state of the digital human; based on the migrated emotional state, retrieving memory and predicting demands, and generating a priority behavior intention sequence; combining the basic behavior units to synthesize coherent behaviors with emotional expressive force, and analyzing matched touch intentions to activate local feedback animations; and finally, fusing behaviors and animations to generate a multi-modal response. According to the method, continuous dynamic modeling and interpretable state transition of user emotion are realized, so that digital human interaction has higher emotion coherence and feedback accuracy.

The invention provides a multimedia real-time interaction method and system based on generative large model mixing, and relates to the technical field of multimedia real-time interaction.The method comprises the steps that synchronization and time sequence alignment are conducted on multi-modal original data streams from a teaching end, decoupling is conducted according to modal types, and the multi-modal original data streams are obtained; distributing the data to a special generative model processing unit corresponding to the cloud side in parallel; each special generative model processing unit performs real-time analysis processing on the input data and outputs multiple groups of feature vectors; inputting the multiple groups of feature vectors into a cross-modal dynamic alignment fusion network to generate a multi-modal joint feature tensor; and mapping the multi-modal joint feature tensor into a high-dimensional semantic feature cloud, wherein each point in the high-dimensional semantic feature cloud represents a fused feature unit. According to the novel interaction method, highly accurate and synchronous virtual digital human behavior instructions can be generated, and the intelligence of multimedia real-time interaction in the financial field can be improved.

The invention relates to the technical field of semantic cognition modeling and natural language interaction, in particular to an electric power digital twin question-answer interaction generation method based on semantic cognition modeling, which comprises the following steps of: accessing a power grid topological data flow in real time, analyzing equipment hierarchy, power supply attribution and physical connection relationship, and constructing a dynamic topological knowledge graph; the method comprises the following steps of: establishing a topological change monitoring channel, mapping the topological change monitoring channel to a semantic cognition model, embedding a topological hierarchy field and an association constraint rule, generating an enhanced semantic cognition model with topological association constraints, and establishing a topological change monitoring channel to update an association relationship in real time; receiving user natural language query, identifying keywords, extracting power supply attribution constraint rules, filtering invalid entities, and converting implicit topological semantics into combined query statements; and executing query to obtain topological associated data, verifying the power supply attribution consistency of a result set, filtering homonymy matching errors, triggering model updating and secondary verification during topology adjustment, and outputting question and answer responses conforming to topology constraints, so that the interaction accuracy and timeliness are improved.

The invention discloses a multi-modal voice interaction large model training method and system based on voice acoustic feature regulation and control, terminal equipment and a medium, and relates to the technical field of multi-modal voice interaction.The method comprises the steps that a text token of a text training sample is obtained, a corresponding voice token is constructed, and pre-training data used for converting the text token into the voice token is obtained; in combination with the multi-modal input sample and the pre-training data, constructing fine-tuning training data for speech understanding and dialogue generation; constructing and pre-training a basic model by using the pre-training data; a multi-modal voice interaction large model is constructed based on a pre-training basic model, and fine tuning data is used for training, so that voice acoustic features can be regulated and controlled based on multi-modal input, and voice is output. According to the method, through alignment and staged training of the text token and the voice token, fine regulation and control of voice acoustic characteristics are realized, long voice continuity and interaction naturalness are improved, and a model is efficiently endowed with voice interaction capability of controllable timbre and emotion.

The invention provides an infrared induction intelligent interactive projection large screen and ground screen holographic device, and relates to the technical field of intelligent display interaction. The equipment is composed of a large projection screen, a ground screen, an infrared induction device, a data processing host, a feature extraction and intention recognition module, an environment perception and adaptive adjustment module and an intelligent feedback and multi-mode interaction fusion module, and the large projection screen is used for displaying holographic images and has the functions of high brightness, wide color gamut and touch control; the ground screen is made of a transparent holographic imaging material, can synchronously display interaction information and has a touch sensing function, and the infrared sensing device captures three-dimensional action information of a user through an emitter and a receiver which are arranged in a matrix mode. The problems that a traditional display device is poor in interaction experience and single in display effect are solved, natural and smooth long-distance human body action interaction and immersive visual experience are achieved, and the system is suitable for many fields such as science and technology exhibition, commercial exhibition and intelligent education.

The invention, which relates to the technical field of digital interaction, discloses a block-chain-based scenic spot digital creative and creative interaction method comprising the following steps: obtaining tourist block chain identity information and initializing a creative and creative interaction context; carrying out multi-point geographic space binding according to the interaction context to obtain a content triggering set; performing identity binding mapping according to the content triggering set to obtain a to-be-casted collection set; on-chain registration is carried out according to the to-be-cast collection set, and a right-confirmed collection set is obtained; performing multi-dimensional grouping and layering according to the right-confirmed collection set to obtain an associated collection relation graph; and carrying out interactive on-chain combination according to the associated collection relationship graph to obtain the composite cultural assets. According to the method, the distribution accuracy is improved, the exclusiveness and emotion recognition of the generated digital cultural and creative collections are increased, the irreplaceability and identity exclusiveness of the collections are improved, map nesting and layering of multi-dimensional grouping are realized, the structural hierarchy is increased, and the individuation degree of cultural assets of different tourists is improved.

The invention relates to a virtual reality and network interaction technology, and discloses a virtual space multi-person interaction synchronous control method oriented to an end-cloud collaborative architecture. Through combination of end-side prediction and cloud arbitration, low-delay transmission and global consistency of a multi-user interaction state are realized. The method specifically comprises the steps that an end side carries out prediction and feature extraction on action and voice data, and redundant transmission is reduced; the key state parameters are uploaded to a cloud end and are judged by a global consistency model and a conflict arbitration mechanism in a unified manner, and a synchronization instruction is generated; and the end side performs rendering and feedback according to a result. According to the method, end-cloud hierarchical prediction and arbitration, a priority-driven protocol and bandwidth adaptive control are combined, delay and conflicts are effectively reduced, and cooperation efficiency, immersion and network adaptability are improved. The method can be widely applied to the fields of universe, online education, remote collaboration, virtual simulation and the like.

The invention provides a vehicle-mounted large model protocol adaptation and streaming return method, system, medium and device, and belongs to the technical field of vehicle-mounted intelligent interaction.The method comprises the steps that a large model request initiated by a vehicle-mounted application layer is converted into a request of a unified format through a standardized protocol adaptation layer; in response to the request in the unified format, adopting a streaming processing engine to generate a streaming fragment result from the target vehicle-mounted large model based on a staged strategy; monitoring whether abnormity exists or not, if yes, recording breakpoint data and storing the breakpoint data to a local cache, re-initiating a request to the standardized protocol adaptation layer based on the breakpoint data and generating a request in a unified format, and returning to the previous step; if not, sending out a streaming fragment result; and adopting a result assembly module to perform real-time assembly on the received multiple streaming fragment results to generate a partial result, and feeding back the partial result to the vehicle-mounted application layer. The method can improve the development efficiency, improve the scenarized service response efficiency and improve the success rate of exception recovery.

The invention provides an order processing method and device based on a large model agent, and electronic equipment, and relates to the technical field of voice interaction. The method comprises the steps of obtaining a to-be-processed order created by a service requester of an order processing system, and determining an order identifier and key content of the to-be-processed order; afterwards, the order identifier and the key content are integrated, first service information is generated, and the first service information is sent to the large model agent for processing. And obtaining a first target instruction generated by the large model agent based on the first service information, executing the first target instruction and generating a first instruction execution result. And sending the first instruction execution result to a service executor of the order processing system, obtaining a voice response initiated by the service executor according to the first instruction execution result, and performing order processing based on the voice response. The order processing efficiency can be improved.

The invention provides an automobile personalized unlocking and locking prompt tone interaction control system, and relates to the technical field of intelligent interaction, and the system is characterized in that the system comprises a control module which is used for receiving an instruction, processing data, and coordinating the work of each module; the storage module is used for storing preset prompt tone resources and user personalized audio files; the sound playing module is used for playing audios; the cloud sound big model generation module is used for generating a customized audio file according to a user demand; and the interaction module is used for realizing instruction input and feedback interaction between the user and the system. The method has the advantages that high personalized setting can be realized, the interestingness and emotion connection of human-vehicle interaction are enhanced, meanwhile, multi-mode internal and external flexible interaction of the vehicle is supported, and the extension and optimization of sound effect styles can be realized in cooperation with a cloud loud sound model.

The invention relates to the technical field of tactile interaction, in particular to a virtual material interaction system with tactile feedback, which comprises a contact state sensing module, a potential gradient calculation module, a friction dynamic regulation and control module, a tactile feedback generation module and an interaction state monitoring module. According to the invention, dynamic mapping of contact pressure, sliding speed and node potential is realized through multi-source signal fusion, so that touch perception keeps continuous response in time sequence, potential difference calculation forms an electric field regulation basis for microscopic change of a material, and space-level adjustment of a surface friction coefficient is realized through charge redistribution and polarization direction switching. The tactile feedback changes adaptively according to material features, the friction spectrum is recombined into a multi-frequency-domain tactile signal after Fourier decomposition, texture, hardness and damping features of different materials are presented in a layered mode, the tactile feedback has more dynamic details and direction consistency, the sense of reality and the tactile recognition degree of virtual materials are improved, and the sense of reality and the sense of touch recognition degree of the virtual materials are improved. And stable and natural interaction touch in the virtual environment is ensured.