30 results about "Interaction field" patented technology

The invention discloses a human-computer interaction method and system based on a vision-language-action model, and belongs to the field of human-computer interaction. According to the method, an anchoring ring strategy is adopted to collect human teaching data to finely adjust the VLA model, and then the trained model is applied to an actual human-computer interaction scene. In the data acquisition stage, a first operator guides a master robot to execute task actions, and a slave robot synchronously moves and interacts with a second operator, and returns to a predefined initial position after each interaction; a teaching sample is formed by recording a robot state, an environment image and an instruction text, and a high-quality data set is generated through data enhancement. In the application stage, the real-time robot state, the environment image and the instruction text serve as input, an action instruction is generated through the VLA model, and the robot is driven to complete a cooperation task. According to the method, the data utilization efficiency and the model generalization ability are remarkably improved, the difference between simulation and the real environment is effectively overcome, and efficient, safe and natural man-machine cooperation is achieved.

The invention discloses a multi-modal emotion calculation method and system, and mainly relates to the technical field of artificial intelligence and human-computer interaction. Comprising the following steps: synchronously collecting voice, visual and tactile multi-modal data of a user, and carrying out feature extraction on each modal data; performing cross-modal fusion on the extracted multi-modal features, including time sequence alignment and semantic association modeling, and generating a global emotion feature vector; performing dynamic emotion reasoning based on the global emotion feature vector, and outputting an emotion category and emotion intensity; generating a tactile feedback signal according to the emotion category and the emotion intensity, and driving an actuator to output; and updating the emotion memory graph based on user interaction data to complete personalized model self-adaption. The method has the beneficial effects that high-precision and low-delay emotion recognition and natural tactile feedback in a cross-culture scene are realized, and the core bottleneck of dynamic drift adaptation failure and emotion-behavior feedback decoupling in the prior art is solved.

The invention discloses a flexible pressure sensor based on ionized hydrogel and a preparation method thereof. The sensor adopts a sandwich layered structure of a flexible composite electrode, an ionized water gel dielectric layer and a flexible composite electrode, ionized water gel is used as a dielectric layer, and an upper flexible electrode and a lower flexible electrode are prepared from a multi-walled carbon nanotube / polydimethylsiloxane (MWCNTs / PDMS) composite material; the surface, making contact with the dielectric layer, of the electrode is copied through an abrasive paper template method to form a micron-sized rough structure. Under the action of external pressure, the effective contact area between the microstructure electrode and the ionized water gel dielectric layer and the equivalent electrode distance change, so that the interface electric double-layer capacitance is regulated and controlled, and high-sensitivity conversion from a pressure signal to a capacitance signal is realized. The flexible pressure sensor is simple in structure and excellent in flexibility, can be further integrated into a pressure sensing array, and is suitable for the fields of wearable electronics, electronic skin, man-machine interaction and the like.

The application discloses a kind of based on directional shuttle-shaped cavity bimodal flexible capacitive sensor and preparation method thereof, belong to flexible electronic sensor technical field, by dispersing magnetic nanoparticles in low boiling point solvent to form magnetic fluid, emulsification dispersion in hydrogel prepolymer liquid, after rheological control, in turn carry out uniform magnetic field pre-stretching and pulse magnetic field strengthening lengthening, make droplet form shuttle-shaped;Again by half freezing lock shape, vacuum freeze drying removes solvent and makes magnetic nanoparticles deposit in cavity inner wall, completely freeze polymerization makes matrix solidification, finally in situ reduction forms conductive layer and is packaged and is prepared sensor, it has bimodal: when pressure is along the long axis direction of shuttle-shaped cavity, it is first electric capacity change rate, when it is along short axis direction, it is second electric capacity change rate, and second electric capacity change rate is greater than first electric capacity change rate, and pressure direction is identified by single electric capacity pair.The application structure is simple, sensitivity is high, stability is good, is suitable for electronic skin, intelligent prosthesis and man-machine interaction field.

The embodiment of the application discloses a kind of display method, device, terminal, storage medium and product of virtual stack, belong to man-machine interaction field.The method includes: display virtual material in virtual environment, virtual material is the material that virtual object falls;Control first virtual object and move virtual material to target position in virtual environment, target position is the virtual material storage position of the camp that first virtual object is in;Display updated first virtual stack, first virtual stack is the virtual stack that the camp that first virtual object is in has, and virtual stack is obtained by virtual material construction.In the embodiment of the application, by providing the mode of constructing virtual stack, to enrich the mode of battle in virtual environment, avoid single battle mode, help to improve man-machine interaction effect.

The invention provides an end-to-end dialogue system data processing method and a related device, and relates to the field of man-machine interaction.The method comprises the steps that a large model and a small model are arranged in an end-to-end interaction system, and when whether the large model can be called in the historical interaction field or not, the large model is called to respond to an obtained corpus; otherwise, the small models are adopted to respond to the obtained corpora, better end-to-end dialogue experience is achieved in the mode that the large models and the small models are fused, the specialty of the small models is reserved, and the expansibility of the large models is well achieved.

Embodiments of the present application provide a kind of action sequence execution method, electronic equipment, storage medium and program product.It relates to human-computer interaction field, the method includes: based on the semantic feature of representing user instruction, generate global action sequence, global action sequence includes multiple node actions with execution order in it;After executing each node action, each node action is identified, and the identification result corresponding to each node action is obtained;In the case where the identification result indicates that the target node action exists exception, generate the target action sequence with the target node action as starting point;Target action sequence is used to update global action sequence;According to the updated global action sequence, the interface element in operation interface is executed to process until the execution target of user instruction is completed.In the technical scheme of the present application, the technical problem that the success rate of automation execution process is not ideal in the related art is solved.

The application discloses a kind of exploration method, device, equipment, medium and program product in virtual world, belong to man-machine interaction field.The method comprises: display is located in the master virtual character in the virtual world, the master virtual character has pet virtual character for exploration;In response to first instruction for the pet virtual character, the pet virtual character is controlled to be attached on the limb of the master virtual character;In response to the master virtual character enters the state of aiming, the enemy virtual character in the preset range of the master virtual character is explored;In response to the enemy virtual character in the preset range of the master virtual character, the position information of the enemy virtual character is displayed.The application provides a new exploration mode, can assist user to explore the position information of enemy virtual character, improves man-machine interaction efficiency.

The invention discloses a user behavior anomaly detection method and system oriented to computing network transactions, and relates to the technical field of user detection oriented to computing network transactions, and the method comprises the following steps: S1, carrying out cross-class recording multi-dimensional fusion: obtaining a user behavior record of a system, the behavior record comprising multi-dimensional data, based on a preset two-dimensional feature window, performing sliding division on the behavior record to obtain a plurality of cross-class sub-records; and dividing the cross-class sub-records on an interaction domain and a numerical domain, projecting the divided sub-records to a multi-domain space formed by the interaction domain and the numerical domain, and generating a cross-class multi-domain space representation to fuse cross-class feature information. According to the method, the cross-class and cross-domain information processing capability is improved, the adaptability of a dynamic scene and heterogeneous distribution is enhanced, and the cooperation efficiency and the detection reliability under the limited bandwidth are improved.

The invention discloses a fabric hybrid electronic integrated system with a stretchable interface. The fabric hybrid electronic integrated system comprises a laser modified fabric substrate, a rigid chip, a printed electrode and a printed interconnection wire. The laser modified fabric is obtained by irradiating a photosensitive polymer composite fabric with laser, can be designed in a customized manner and manufactured in one step by regulating and controlling laser parameters, and simultaneously realizes three different effects: (1) the interface bonding of a printed layer is enhanced; (2) the cross-layer short circuit of the interconnected wires is inhibited; and (3) strain isolation among the rigid chip, the elastic fabric and the interconnected wires. The mechanically enhanced and surface modified fabric realizes heterogeneous integration of a rigid chip and a circuit on the fabric, has interface stretchability, and has potential in the fields of wearable health management and human-computer interaction.

The application provides a kind of smart terminal virtual sliding button tactile reproduction rendering method and device, belong to touch screen technology and man-machine interaction field. Including the position coordinate of finger on touch screen when user carries out interactive operation, displacement and speed, judge touch click or drag, simulate similar tactile feedback of click, increase tactile braking effect through tactile pawl, according to the size of displacement and movement speed, real-time control the friction coefficient when sliding, produce tactile feedback, realize the tactile reproduction rendering of virtual sliding button. The application produces corresponding tactile feedback in the process of tactile perception through different interactive operations of virtual sliding button, improves the interaction efficiency and accuracy, increases the experience of feeling things with fingertip when using touch screen, reduces the cognitive load of vision and hearing, improves the interaction efficiency and immersion.

The invention discloses a non-contact human-object interaction detection method and system based on a potential interaction field, and the method comprises the steps: inputting a target image to a potential interaction field generator, modeling the spatial context information in the target image into a continuous field, quantifying the potential interaction intensity of an object and a person at any position, and determining the potential interaction intensity of the object and the person at any position; obtaining a potential interactive field mask; inputting the target image and the potential interactive field mask into a feature extractor for feature extraction, and respectively obtaining image features and potential interactive field features; inputting the image features and the potential interactive field features into a fusion encoder for feature fusion to obtain fusion features; semantic understanding is enhanced through a context sensing module, and enhanced features are obtained; and inputting the enhanced features into a decoder for decoding to obtain a human-object interaction detection result. According to the method, the detection capability of the model in a non-contact human-object interaction scene can be improved, and the difficulty of the model in long-distance spatial perception and a multi-human-object pair scene is solved.

The application discloses a multi-screen linkage VR immersive interaction method and device and medium, and is applied to the VR interaction field. The method comprises the following steps: acquiring three-dimensional scene data of a healing environment; rendering a first visual angle picture based on the three-dimensional scene data, and performing edge splicing on sub-pictures displayed on each display screen corresponding to a multi-screen PC end by using an edge fusion algorithm; establishing a communication connection with a VR end, and sending a healing environment adjustment instruction, so that the VR end adjusts a second visual angle picture displayed according to the healing environment adjustment instruction; or receiving operation state data fed back by the VR end, and checking the operation state data, wherein the healing environment adjustment instruction and the operation state data both comprise corresponding time stamps. It can be seen that the multi-screen and the edge splicing of the sub-pictures displayed on the multi-screen can greatly improve the participation and immersion experience of the same person, and the time stamp mechanism can further realize the synchronization of the visual content of the two ends.

Embodiments of the present application provide a kind of application program operation prompting method, device, computer equipment, computer readable storage medium, computer program product, belong to man-machine interaction field.The method includes: obtaining the moving element track information of application program interface, moving element state information and the key layout information of target keyboard;According to moving element track information and key layout information, establish the key position mapping relationship between the track of moving element and the physical key of target keyboard;Based on moving element state information and key position mapping relationship, determine the target physical key corresponding to target moving element;When target moving element meets prompting trigger condition, output the light prompt signal for target physical key, to control the light emitting element corresponding to target physical key output light prompt.The technical scheme of the present application embodiment can improve the corresponding accuracy between target moving element in application program interface and physical keyboard prompt, and improve the prompt control accuracy for target physical key.

The invention provides a pseudo-materialized man-machine interaction method and device, electronic equipment and a storage medium, and belongs to the field of man-machine interaction, and the method comprises the steps: obtaining the operation state data of each physical equipment in a target power station control system; based on the operation state data, a display interface of a virtual model is driven and updated, the virtual model is constructed according to the actual layout and equipment composition of the target power station control system, and the display strategy of each virtual equipment in the virtual model is determined based on the equipment type or function role of the corresponding physical equipment; in response to a trigger operation for the display interface, generating and issuing a control instruction corresponding to the trigger operation; the control instruction is used for indicating the target power station control system to execute a corresponding control action. The invention can provide a man-machine interaction scheme which is convenient for operators to understand and operate.

This application discloses a biomimetic eye movement control device, method, and robot, belonging to the field of biomimetic robot technology. The device includes multiple flexible electro-actuators, comprising an electro-actuating material that actively deforms under electric field excitation. One end of each flexible electro-actuator is fixed and connected to a support body, while its free end, having a driving displacement or driving force, is directly or indirectly connected to the functional parts of the eye to drive the eyeball shell to rotate and / or drive the eyelids to open and close. A passive constraint structure is also included, configured to provide anisotropic mechanical constraints on the active deformation of the flexible electro-actuators, thereby guiding and converting the active deformation into a driving displacement or driving force along a first preset direction. This solution achieves compact, compliant, low-noise, and highly biomimetic eye coordination control, applicable to humanoid robots, service robots, and human-computer interaction fields.

The application provides a mobile manipulator human-machine safety path planning method based on a danger index; firstly, an external information sensing system of the mobile manipulator is established, including a two-dimensional laser radar system for detecting the distance of surrounding obstacles and a vision system for identifying the human body contour; then, a global map of the working range of the manipulator and the start and end positions are given, and a global path reachable by the mobile manipulator is planned by an algorithm; during the movement process, if the vision system does not detect human body information, the mobile manipulator will move along the global path to the target position; if the vision system detects human body information, the two-dimensional laser radar system is used to scan and obtain the human body contour coordinates, the mobile manipulator and the human body contour are surrounded by plane minimum enclosing circles respectively, the human-machine safety distance is calculated and obtained, and the human-machine danger evaluation index is evaluated; the path planning algorithm is improved, and the mobile manipulator is guided to move away from the personnel in the scene; the application can guarantee the safety of human-machine integration and lay a foundation for the development of the human-machine interaction field.

The invention discloses an automobile digital cloud exhibition hall interactive experience method based on virtual reality, and relates to the technical field of virtual reality three-dimensional graphic processing, and the method comprises the steps: constructing an interactive automobile digital body, solidifying a movable part motion description record and interactive semantic annotation, and generating an interactive dependence sequence table; obtaining a user experience intention based on the interaction dependency sequence table, converting the user experience intention into a task list, generating a necessary element set for each task, selecting a minimum necessary interaction field from the necessary element set, and generating an interaction script; loading a minimum necessary interaction field according to the interaction script to enter virtual reality, executing actions according to a task list sequence to form candidate vehicle states, calculating a consistency deviation amount, selecting a candidate vehicle state with a smaller consistency deviation amount, and when the script judges that a task is completed, outputting evidence bound with a task type; the reproducible experience record is solidified through the evidence, the interaction script, the action and the vehicle digital body, and script rearrangement is conducted on the task sequence according to the reproducible experience record.

The application discloses a kind of based on virtual reality's car digital cloud exhibition hall interactive experience method, it is related to virtual reality three-dimensional graphics processing technical field, including, constructing interactive vehicle digital body, solidification movable component movement description record and interactive semantic annotation, generate interaction dependent sequence table;Based on interaction dependent sequence table, user experience intention is obtained and is converted into task list, necessary element set is generated for each task, the minimum necessary interaction field is selected from necessary element set, and interaction script is generated;According to interaction script, minimum necessary interaction field is loaded to enter virtual reality, and action is executed according to task list order to form candidate vehicle state, consistency deviation is calculated and candidate vehicle state with smaller consistency deviation is selected, when script determines that task is completed, the evidence bound with task type is output;Through evidence, interaction script, action and vehicle digital body solidification reproducible experience record, and according to reproducible experience record, script is re-arranged to task order.

The embodiment of the invention discloses a virtual map display method and device, electronic equipment and a storage medium, and is applied to the field of man-machine interaction, the method comprises the steps that a target interface is displayed, the target interface displays a first virtual map, and the first virtual map displays a virtual role; and in response to a display trigger operation on a second virtual map, displaying at least a partial region of the first virtual map and at least a partial region of the second virtual map on the target interface, the second virtual map displaying a virtual character, and the second virtual map being an independent region entered through the first virtual map. According to the embodiment of the invention, the immersion of the user is improved, the user can understand the moving rule of the virtual map in a more visual and vivid manner, the understanding cost of the user on the target interface in the process of displaying different virtual maps on the target interface is reduced, and the participation experience of the user is optimized while the interestingness is improved.

The invention relates to the technical field of virtual reality and human-computer interaction, in particular to a micro-current tactile parameter automatic generation method and system based on microscopic geometric feature mapping. The method comprises the following steps: acquiring microscopic geometric image data of the surface of a virtual object currently contacted by a user in real time, carrying out explicit feature extraction on the microscopic geometric image data, and calculating to obtain a first visual feature value representing a texture fluctuation change degree and a second visual feature value representing a texture edge sharpness degree; respectively inputting the first visual characteristic value and the second visual characteristic value into a visual tactile roughness mapping model and a flexibility mapping model to respectively obtain a surface space wavelength parameter and a flexibility coefficient of the virtual object; and transmitting the surface space wavelength parameter and the softness coefficient to a micro-current tactile rendering controller, and driving the finger electrode array to generate corresponding tactile feedback. According to the method, the micro-current stimulation control parameters are automatically generated by analyzing the visual features of the virtual textures, and the problems that in the prior art, dependency on a pre-stored database is high, and adaptability to unknown textures is poor are solved.

The invention discloses a false touch prevention interaction method based on medium-free holography, and particularly relates to the field of false touch prevention interaction of medium-free holography, which comprises the following steps: generating a medium-free holographic image through a medium-free holographic imaging device, the semantic interaction body is composed of a plurality of interaction voxels or interaction planes; acquiring a human face image through a camera arranged on the medium-free holographic imaging equipment, and identifying a human face position, a human face orientation, a human face size and an eye distance parameter based on the human face image so as to determine a spatial range of a human face in the medium-free holographic image; when the face is in the spatial range, determining a first duration when the face is in the spatial range; an operation pre-confirmation mechanism is introduced into a multi-level judgment chain of face recognition, sight tracking, space-time intention judgment and mode comparison, so that the real intention of a user is verified before interaction triggering.

The application discloses a sharing method and device of information flow, equipment and storage medium, belong to man-machine interaction field. Method includes: obtaining the clipping information sent by the first client, the first client includes the reading function of information content from information source, the clipping information is the relevant information provided by the first user account when customizing clipping; at least one information flow element is generated according to the clipping information, and the information flow element includes information content and information source;According to at least one information flow element, the information flow of the custom clipping corresponding to the first user account is generated;In response to receiving the sharing request of the first client, the information flow of the custom clipping is sent to at least one second client. Through the generation of the information flow of the custom clipping, the information of multiple sources can be collected, and the efficiency of information collection is improved. At the same time, the information flow is stored in the server, so that the client can quickly read the target information flow according to the index, and the efficiency of file management is improved.

The invention discloses a dynamic management combination information display method and system, electronic equipment and a storage medium, and relates to the field of vehicle-machine interaction, and the method comprises the steps: constructing a four-level morphological container architecture; an island-on request of the application is received, the island-on request comprises an application identifier and a trigger condition, and the trigger condition is self-defined by the application; performing priority ranking on the island request through a priority analyzer; the current driving state weight is generated according to the real-time vehicle condition, the environment data and the user behavior data; according to a sorting result, selecting a target form container through a form controller: when the number of requests is greater than or equal to 2, selecting a combination of a medium-sized island and a small-sized island, displaying a high-priority application on the medium-sized island, and displaying a secondary-priority application on the small-sized island; when an emergency occurs, the expansion island is selected to cover other forms; triple linkage logic is realized through the state monitor; and in response to a click operation of a user on the island display, executing a corresponding instruction according to the application type and the click area.

This invention provides a lightweight method for pedestrian trajectory integration and risk assessment, comprising: acquiring a continuous video stream and preprocessing the image scale and pixels; obtaining the detection results of the current frame of the continuous video stream using a YOLOv11 detection model, outputting bounding boxes and confidence scores for each detected pedestrian or obstacle, and simultaneously calibrating the scene boundaries, wherein the output boundary and obstacle set is T. env An improved ByteTrack algorithm, employing Gaussian linear interpolation (GSI) and AFlink appearance-independent trajectory association, is used to track pedestrians and obtain a smooth set of pedestrian motion trajectories. Based on T... env This invention obtains the individual potential energy field, interaction field, and environmental obstacle field, thereby calculating the crowd risk field. A global indicator is then used as a risk assessment tool, and the crowd risk field is displayed in the form of a heatmap. This invention improves detection and tracking capabilities in complex scenarios, proposes a specific scheme for crowd risk field analysis, and the overall process is lightweight and suitable for edge devices.

According to the artificial consciousness system implementation method and device, a multi-dimensional semantic state map is constructed based on a DIKWP * DIKWP mesh cognitive model, and semantic jump and parallel consciousness paths are achieved through hierarchical interaction of data, information, knowledge, intelligence and intention. According to the system, an intention chain is triggered through external input, semantic processing and reasoning are completed along a DIKWP path, and a closed-loop cognitive cycle is formed; a consciousness BUG theory is introduced, and abnormalities such as semantic distortion, target dislocation and concept distortion are monitored in real time and dynamically corrected; a self-modeling engine is combined to perceive and record a state, and a self-atlas is constructed to optimize cognition. The device comprises a sensor interface, a semantic bus, a processing module, a consciousness management module, a semantic reasoning module, a BUG monitoring module, a self-modeling module and the like, and software and hardware are cooperatively realized. According to the method, the interpretability, autonomy and reliability of AI are improved, and the method is suitable for semantic interaction fields such as intelligent medical treatment, robots and intelligent assistants and has important application value.

The invention discloses a soft keyboard input method in the field of human-computer interaction of embedded equipment, a soft keyboard adopts a modular structure, and integration with a human-computer interaction interface of an embedded system is realized on the basis of a QT plug-in; the soft keyboard adopts an MVC framework, an interface and a service logic function are separated, the interface part is responsible for realizing keyboard interface display, signal and slot function realization and interaction content passing through a signal and slot mechanism, and the logic part is responsible for defining an interface and realizing a specific interface and a logic function; the soft keyboard is integrally packaged into a plug-in file for system software development; and the soft keyboard simulates a keyboard key value by adopting a post Event method and sends the keyboard key value to the specified control. And the keyboard position and the interaction mode are adaptively adjusted along with the context of the application, and are transplanted to embedded system equipment without matching of an input method, so that the complexity of transplanting the input method is eliminated.

The application provides a kind of based on water-based polyurethane / silsesquioxane / carbon nanotube ternary synergistic conductive elastic aerogel, preparation method and its application in piezoresistive sensor, belongs to flexible electronic material and sensing technology field.The application is covalently bonded by hydroxylated silsesquioxane (HSQ) and water-based polyurethane (WPU), and combined with the physical compounding of multi-walled carbon nanotubes (MWCNTs), a "rigid island-flexible sea" hybrid three-dimensional network is constructed.The preparation method uses water as medium, and the process is green, simple and low in cost.The obtained aerogel has excellent mechanical properties and sensing characteristics;Meanwhile, the material has good thermal stability and biocompatibility.The application provides a kind of high-performance, high-reliability piezoresistive sensing material platform for wearable health monitoring, electronic skin and human-computer interaction fields.

The invention discloses a multi-input interactive screen system based on cloud collaboration, and particularly relates to the field of man-machine interaction, which comprises an interactive screen terminal, a communication module, an input analysis module, an action package generation module and a local collaboration presentation module, the interactive screen terminal comprises a processor, a memory, a display screen, and a touch control assembly, a handwriting pen assembly and an external input access assembly which are electrically connected with the processor, and is used for collecting input events from the touch control assembly, the handwriting pen assembly and the external input access assembly and forming an input event stream. Multi-source input is aligned into an input event stream, an action packet sequence carrying an action target identifier, an action constraint set, change amount data and target state verification information is generated through analysis, and a cloud side executes consistency judgment and conflict judgment based on a session rendering state and then issues a confirmation sequence to drive all terminals to update consistently.

The invention relates to a touch panel integrated musical instrument simulation control area interaction method, device and equipment, belongs to the field of electric digital induction interaction, utilizes a pressure induction layer and a capacitive induction array to cooperatively detect and synchronously obtain position coordinates, pressure values and contact areas touched by a user, and ensures data accuracy through high-frequency sampling and an accurate algorithm. A personalized mapping table is constructed based on historical playing data of a user, a product of pressure and a contact area is mapped into volume, and dynamic correction is performed along with continuous operation duration to adapt to finger fatigue changes. And in combination with the finger sliding track characteristics and the volume, generating an audio signal corresponding to the musical instrument, and meanwhile, analyzing an audio spectrum by means of a pre-trained sound auxiliary model, generating a dynamic oscillogram linked with the volume, and realizing real-time visual feedback. The sound auxiliary model is trained by multiple musical instrument samples and fine-tuned by user data, so that the suitability is improved. Instrument simulation interaction experience which fits user habits, is accurate and natural and is visual in feedback is integrally realized.