Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

266 results about "Haptic sensing" patented technology

Haptic refers to technology that uses touch to control and interact with computers. A user may apply a sense of touch through vibrations, motion or force. Haptic technology is used mainly in creating virtual objects, controlling virtual objects or in the improvement of the remote control of machines and devices.

Intelligent grabbing control method and system based on tactile perception

The invention provides an intelligent grabbing control method and system based on tactile perception, and the method comprises the steps: obtaining a tactile feedback signal through a sensor array of a humanoid robot, carrying out the frequency domain decomposition of the signal through a Fourier transform method, and carrying out the analysis of the pressure and deformation data of each contact point on the surface of a to-be-grabbed object, calculating to obtain frequency characteristic distribution of the tactile feedback signal; if the initial estimation value of the object rigidity gradient exceeds a threshold value, performing finite element analysis on the object rigidity gradient, and combining a time domain processing result of the tactile feedback signal to obtain object rigidity gradient distribution; carrying out probability modeling on the deformation field by adopting a Bayesian inference method according to the gradient distribution of the rigidity of the object, and carrying out iterative optimization on a modeling result to obtain dynamic update parameters mapped by the deformation field; and regenerating an action sequence of the end effector of the humanoid robot based on the optimized strategy according to a trigger condition of grabbing failure detection, and determining a final grabbing control parameter.
Owner:SHENZHEN CHANGYING ROBOT CO LTD +1

Manipulator grabbing control system based on visual identification

The invention discloses a manipulator grabbing control system based on visual identification, and the system comprises a visual identification module which is used for collecting the three-dimensional form data and surface feature information of a target object, and eliminating the noise interference in an original image through preprocessing; the multi-modal fusion processor is used for receiving the three-dimensional form data and the surface feature information output by the visual recognition module, executing point cloud structured conversion on the three-dimensional form data, extracting geometric features of an object through a neural network, and meanwhile, performing weight distribution on the surface feature information by adopting a feature attention mechanism to complete multi-feature fusion processing; according to the multi-axis cooperative manipulator provided with the end executor, the end executor integrates a touch sensing assembly used for touch sensing and an adsorption execution device used for assisting grabbing. By integrating the technologies of visual identification, multi-modal fusion, intelligent optimization, dynamic feedback and the like, the sensing precision, the environmental adaptability and the grabbing reliability of the system to object characteristics are improved.
Owner:HUBEI ZICHEN INFORMATION TECHNOLOGY CO LTD

Dexterous hand multi-object stable grabbing method and system based on vision and touch perception

The invention provides a dexterous hand multi-object stable grabbing method and system based on vision and touch perception. The dexterous hand multi-object stable grabbing method comprises the steps that RGB images and depth maps of target objects are collected through a monocular RGB-D camera, and dense point cloud data are generated; geometric features are extracted by using a three-dimensional point cloud neural network, and composite object distribution features are analyzed in combination with visual information; an initial grasping strategy is generated based on the features, actions are executed, and the joint state and contact force data are synchronously obtained in real time through body sensing and a fingertip force sensor; in the carrying process, multi-dimensional force perception and the joint state are fused to analyze object stress distribution and center-of-gravity shift; vision and force sensing data are used as input. Vision, body sensing and force sensing data are fused, the problems of three-dimensional structure recognition and dynamic stress regulation and control in multi-object composite grabbing are solved, compared with a single sensing scheme, the grabbing planning precision and the self-adaptive capacity in a complex scene are remarkably improved, and the method is particularly suitable for stable carrying of combinations of loose objects such as dinner plates carrying tableware.
Owner:SHANGHAI JIAOTONG UNIV

Tactile perception fingertip device and robot

The invention relates to the technical field of robots. According to the touch sensing fingertip device, protection of a touch sensor in fine operation of a mechanical arm is achieved, and objects of sheet structures can be grabbed more accurately. Specifically, through the bionic fingernail part installed on the back side of the fingertip body, the protection part of the bionic fingernail part extends forwards and exceeds the highest point of the touch sensor, and a cantilever protection structure similar to a human fingernail is formed; the protection parts form a physical barrier (for example, the protection parts are preferentially contacted during grabbing) in a non-contact state by utilizing a reasonable coverage range of the bionic nail part, and meanwhile, when the protection parts are matched with fingers on the opposite side, the two corresponding protection parts can be matched to grab an object of a sheet-shaped structure; according to the design, the durability of the sensor in a complex environment is improved, and the accuracy of grabbing the sheet-shaped objects is improved.
Owner:DAIMON (SHENZHEN) ROBOTICS TECHNOLOGY CO LTD

High-sensitivity tactile perception system based on magnetic cilia array

The invention discloses a high-sensitivity tactile sensing system based on a magnetic cilia array, a sensor comprises the magnetic cilia array and a sensor array, and the magnetic cilia array is attached to the upper surface of the sensor array; the magnetic cilia array comprises a substrate and cilia structures which are orderly arranged and fixed on the substrate; the cilia structure is made of ecological silicone rubber mixed with magnetic powder, and a plurality of groups of sensors are adopted to form a sensor array to construct a sensing system. By optimizing the magnetization process, uniform distribution of the magnetic particles in each cilium is ensured, and the output stability and sensitivity of the sensor are improved; meanwhile, the multi-sensor array layout is adopted, and high-precision sensing of multi-dimensional tactile information such as pressure, direction and vibration is achieved.
Owner:ZHEJIANG UNIV

Multi-modal fusion touch fingertip module

The utility model discloses a multi-mode fusion touch fingertip module which comprises a supporting layer (107). The outer surface of the supporting layer (107) is provided with a proximity sense sensing layer (101) used for sensing the distance, a temperature site (102) used for sensing the temperature, a touch sense / slip sense sensing layer (103) used for sensing the touch sense, a control element (104), an electrode layer (105) used for transmitting signals and a force sensing layer (106) used for sensing the force. According to a three-dimensional force three-dimensional tactile sensing network, multi-mode sensor signals can be obtained, a multi-branch tactile neural network is constructed by using the signals, and a tactile fingertip module is formed, so that the shortages of two-dimensional tactile sensing can be made up, and three-dimensional characteristics of tactile sensing can be obtained; that is to say, richer haptic information such as output magnitude, direction, acting position, spatial distribution of force, dynamic force time sequence characteristics, spatial distribution of temperature and the like can be decoupled, various characteristics of the object are extracted, and the accuracy of object haptic recognition is improved.
Owner:CHONGQING INST OF GREEN & INTELLIGENT TECH CHINESE ACAD OF SCI

Tactile interaction system and method for laparoscopic surgery robot

The invention relates to the technical field of robot tactile perception, in particular to a laparoscopic surgery robot tactile interaction system and method, and the system comprises an F / T sensor which is used for obtaining and detecting sensor information of contact force between a tail end surgical instrument and patient tissue; the data processor is used for detecting the contact force between the tail end surgical instrument and the tissue of the patient according to the information of the sensor, converting the contact force into feedback force which can be sensed by an operation object, converting the feedback force into control parameters of the force feedback device, and smoothly optimizing the control parameters; and the force feedback device is used for controlling and driving a force feedback type main manipulator of the laparoscopic surgery robot according to the control parameters after smooth optimization so as to transmit feedback force to an operation object for sensing. According to the invention, an operator can sense the contact force between the end surgical instrument and the tissue of a patient, the operator can be prevented from sensing abrupt change, the smoothness of tactile sensing is ensured, and a basic guarantee is provided for accurate tactile judgment of the operator.
Owner:XIEHE HOSPITAL ATTACHED TO TONGJI MEDICAL COLLEGE HUAZHONG SCI & TECH UNIV

Underwater static pressure self-balancing visual tactile perception device and method

The invention provides an underwater static pressure self-balancing visual touch perception device and method. The device comprises an elastic body, a hexagonal tray, a light source, a camera, a protective cover, a base, a water inlet pipe, a water outlet pipe and a computer. The elastomer is used for contacting an object, and a plurality of micron-sized through holes for balancing internal and external water pressure are formed in the surface; the elastomer is arranged on the inner side of the hexagonal tray, and the RGB three-color light source is arranged on the outer side to realize uniform distribution of light; the camera collects a light intensity image reflected by the elastomer; the protective cover is fixedly connected to the base and used for isolating external light and fixing the hexagonal tray. A camera is mounted on the base; the computer is used to model the acquired images or videos as different haptic features.
Owner:DALIAN MARITIME UNIVERSITY

Robotic system with haptic perception

The invention discloses a robot system with tactile perception, and belongs to the technical field of tactile robots. The problem that an existing robot is poor in environment pressure sensing capacity is solved. Comprising a head module, an integrated vision-inertial navigation sensing module and a head controller, two side surfaces are provided with a pair of rotatable connecting ends, and the outer surface is provided with a tactile sensor; the head controller transmits data to the upper computer through the communication module; the driving body module comprises a plurality of modularized joints which are connected end to end, touch sensors are arranged on the two side faces of each modularized joint, and the adjacent modularized joints are orthogonally connected; the modularized joint is integrated with a joint controller and a joint steering engine; the tail module integrates a tail controller and a tail steering engine, and tactile sensors are arranged on the two side faces of the tail module. The tail controller carries out data transmission with the head controller through the adjacent previous joint controller in sequence, and the head controller receives a control instruction of the upper computer and carries out data transmission with all other controllers. According to the invention, the environmental pressure can be sensed in all directions.
Owner:HARBIN INST OF TECH

Robot finger touch sensing method and system based on artificial intelligence

The invention discloses a robot finger tactile perception method and system based on artificial intelligence, and the method comprises the following steps: S1, obtaining visual data and tactile perception initial parameters of a to-be-interacted object of a robot finger, carrying out the preprocessing of the visual data, and extracting the appearance features of the object, performing initial configuration on the touch sensing initial parameters; and S2, object recognition is conducted on the preprocessed visual data through a machine learning model, and the material category, morphological characteristics and surface attributes of an object are determined. According to the robot finger tactile perception method and system based on artificial intelligence, by combining a visual system and tactile sensor data and utilizing a convolutional neural network and Transform fusion architecture to extract local textures and global morphological features of an object, high-precision recognition of material categories, morphological features and surface attributes of the object is realized.
Owner:LINGXIN QIAOSHOU (BEIJING) TECH CO LTD

Tactile perception system and method, electronic device, storage medium, and program product

The embodiment of the invention provides a touch sensing system and method, electronic equipment, a storage medium and a program product. The touch sensing system comprises a contact assembly, a projection assembly, a collection assembly and a processing assembly, and is configured to be capable of being in contact with an external object and generating deformation; the projection assembly is configured to project an active light field with a time modulation characteristic to a first surface of the contact assembly, the active light field is projected on the first surface to form a plurality of pattern areas, the light intensity of adjacent pattern areas changes based on different time sequence codes, and the first surface is opposite to a second surface, making contact with an external object, of the contact assembly; the acquisition assembly comprises a plurality of acquisition units arranged in an array, and is configured to acquire a plurality of pattern areas and output a time stamp acquisition data sequence.
Owner:SHENZHEN RUISHIZHIXIN TECH CO LTD

Multi-mode visual tactile sensor and sensing method thereof

The invention discloses a multi-mode visual tactile sensor and a sensing method thereof. The sensor is composed of a sensing cover and an imaging box body, the sensing cover is fixed on the imaging box body, the sensing cover is provided with a flexible sensing layer, an embedded mark point array combining inert ink and thermochromic ink is arranged in the sensing layer, during tactile sensing, a light source is provided through the imaging box body, and multi-mode sensing data is obtained. Therefore, displacement tracking and temperature sensing are realized at the same time. According to the invention, multi-mode sensing of five modes of a two-dimensional texture pattern, a three-dimensional texture image, a three-dimensional displacement field, a three-dimensional force field and a two-dimensional temperature field can be realized under a single optical frame, real-time co-registration measurement can be realized, and a high-integration-level solution is provided for a robot touch system. The problems that an existing visual tactile sensor cannot sense multi-mode information synchronously, force field reconstruction calculation is complex, and temperature sensing capacity is lacked are solved, and the visual tactile sensor is suitable for application scenes such as robot tactile sensing, man-machine interaction, intelligent artificial limbs and industrial detection.
Owner:HANGZHOU INTERNATIONAL INNOVATION INSTITUTE OF BEIHANG UNIVERSITY

Facial robot expression and action accurate control system based on multi-modal perception

The invention discloses a facial robot expression and action precise control system based on multi-mode perception, and the system comprises a multi-mode perception module which is used for integrating the information of various perception modes, such as vision, sound, touch and bio-electricity signals at the same time; the multi-mode sensing module comprises a visual sensing module, a sound sensing module, a touch sensing module and a bio-electricity signal sensing module. According to the method, information of various sensing modes such as vision, sound, touch and bio-electricity signals can be integrated at the same time, comprehensive analysis is carried out through an advanced artificial intelligence algorithm, and therefore accurate and natural control over facial expressions and actions of the facial robot is achieved. The intelligent level and interaction experience of the robot can be greatly improved, and the robot can better adapt to complex and changeable environments and user requirements.
Owner:ZHENGZHOU UNIV

Visual tactile sensor

The utility model relates to the technical field of sensors, in particular to a visual touch sensor. According to the utility model, the colloid on the transparent plate is in contact with an object, the single-sided mirror is arranged opposite to the colloid on the opening, the camera component performs visual detection on the deformation condition of the colloid reflected by the single-sided mirror, and the effect of clamping different objects is achieved through the deformation of the colloid, so that the tactile perception capability of the visual tactile sensor is realized; the robot is simple in structure, low in cost and high in adaptability, and can be widely applied to the fields of object grabbing, flexible operation, touch perception in rehabilitation prostheses and the like; and meanwhile, the number of parts required by the visual tactile sensor is reduced, the working stability of the visual tactile sensor can be effectively improved, the failure rate is low, and the reliability is relatively high.
Owner:SHANGHAI VITAI TECHNOLOGY CO LTD

Flexible multifunctional touch sensing electronic skin and application

The invention relates to the technical field of sensors, in particular to a flexible multifunctional touch sensing electronic skin and application, and the flexible multifunctional touch sensing electronic skin comprises a deformation module, an imaging module and a deep learning algorithm processing module; the deformation module comprises a mark layer provided with a mark pattern; the deformation module is used for capturing deformation information of the marking layer caused by external stimulation in real time; the imaging module comprises an embedded camera; the imaging module is used for acquiring a real-time image of the marking layer of the deformation module and reflecting the characteristics of tactile stimulation through image data; and the deep learning algorithm processing module is used for processing the image data captured by the imaging module in real time through a deep learning algorithm, extracting feature information in the tactile signal and further analyzing the property and the distribution of the external stimulation. According to the method, the deep learning algorithm and the visual tactile perception are combined, so that the tactile perception precision is improved, breakthrough is realized in the aspects of three-dimensional force decoupling and real-time recognition of complex actions, and the method has higher application potential and wide prospects.
Owner:SHENZHEN INST OF ADVANCED TECH

Multi-parameter dynamic coding method for tactile feedback

The invention discloses a multi-parameter dynamic coding method for tactile feedback. The method comprises the following steps: arranging a multi-channel electrode array in a tactile sensing area, and establishing a corresponding relation between each channel of a multi-channel array electrode and a spatial position in the tactile sensing area through spatial coding; calibrating the minimum value and the maximum value of various types of electrode stimulation parameters reflecting the touch perception degree to obtain a dual-threshold calibration result; performing intensity coding according to the double-threshold calibration result; constructing a type code, wherein the type code reflects a corresponding relation between the frequency interval and the touch induction type; and generating a parameter dynamic mapping model based on the intensity code and the type code, wherein the parameter dynamic mapping model reflects a corresponding relation between an interaction characteristic between the touch sensing area and a target and an electrode stimulation parameter combination sensed by the touch sensing area. The method can be widely applied to man-machine interaction scenes needing tactile feedback.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Industrial robot self-adaptive grabbing method and system based on multi-mode perception

The invention provides an industrial robot self-adaptive grabbing method based on multi-modal sensing, which comprises the following steps of: 1, acquiring multi-modal data of an object and an environment through a multi-modal sensing module; the multi-mode sensing module comprises at least two sensing modules of a visual sensing unit, a touch sensing unit, a force sensing unit and an auditory sensing unit; 2, preprocessing and feature extraction are carried out on the multi-modal data, feature information of different modals is fused through a multi-modal fusion algorithm, and comprehensive object description information is generated; 3, generating an optimal grabbing strategy based on the comprehensive object description information; wherein the grabbing strategy comprises the position and posture of a grabbing point, a grabbing path and grabbing force; and fourthly, the industrial robot executes the optimal grabbing strategy, the first step to the third step are repeated, and the grabbing strategy is adjusted in a self-adaptive mode till grabbing is completed. Stable and efficient grabbing can be achieved.
Owner:HUNAN INST OF INFORMATION TECH +2

Inductive self-decoupling miniature six-dimensional force sensor with origami structure

The invention discloses a paper folding structure inductance type self-decoupling miniature six-dimensional force sensor, which belongs to the technical field of force sensors and comprises a base, a folding flexible circuit board, a metal shell, a communication cable, a coil inductance measuring circuit and an elastic body. The folding flexible circuit board comprises a coil array and an inductance measuring circuit, the coil array is folded on the upper surface and the four side faces of the base, the inductance measuring circuit is folded at the bottom of the base, and a communication cable is led out of the inductance measuring circuit. The metal shell is arranged above the base and surrounds the surface, except the bottom surface, of the folding flexible circuit board; an elastic body is arranged between the metal shell and the base. The elastomer converts six-dimensional force borne by the metal shell into six-dimensional displacement. According to the sensor, the characteristic that the eddy current effect is sensitive to normal displacement and insensitive to tangential displacement and rotation is utilized, self-decoupling measurement of six-dimensional displacement of the metal shell is achieved in combination with three-dimensional coil layout, and therefore self-decoupling six-dimensional force measurement is achieved, and the sensor can be integrated to the fingertip of the dexterous hand to provide endogenous tactile perception.
Owner:UNIV OF SCI & TECH OF CHINA

Visual tactile sensor

An embodiment of the utility model discloses a visual tactile sensor, which relates to the technical field of sensors and comprises a base, a flexible plate, an image acquisition device and a plane mirror. The flexible plate is arranged on the base, the image acquisition device is arranged on the base, the image acquisition device is located on one side of the flexible plate, and the plane mirror is obliquely arranged on the upper side of the flexible plate. The layout between the flexible plate and the image acquisition device can be changed through the plane mirror, the size of the visual tactile sensor in the height direction is greatly reduced, and the size of the visual tactile sensor is reduced. According to the scheme, through the innovative structural design of reflection imaging of the plane mirror, on the premise that the tactile perception precision is ensured, the problem that the size of a traditional visual tactile sensor is too large due to vertical imaging layout is solved, meanwhile, multiple technical requirements of environmental adaptability, cost controllability and the like are taken into consideration, and the visual tactile sensor is suitable for popularization and application. And better hardware support is provided for scenes such as refined operation and man-machine interaction of the robot.
Owner:DAIMON (SHENZHEN) ROBOTICS TECHNOLOGY CO LTD

Vision-based high-density three-dimensional force sensing array system and three-dimensional force distribution identification method thereof

The invention discloses a vision-based high-density three-dimensional force sensing array system and a three-dimensional force distribution identification method thereof. The system comprises a first force sensing layer, a second force sensing layer, a support force bearing layer, an LED lighting unit, a light-transmitting reference plate, a camera and a supporting shell box body. The second force sensing layer is a high-density array formed by independently distributed cylinder and hemisphere elastic structure units; and the light-transmitting reference plate, the LED lighting unit and the camera form an optical imaging assembly. When an external object is in contact with the surface of the array, each structural unit deforms independently, a camera captures a deformation image, features are extracted through an image processing algorithm, and three-dimensional force distribution of a contact area is solved according to a pre-calibrated image-mechanics mapping model. The system can reconstruct the three-dimensional contour form of a contact object in real time and perceive the force distribution characteristics of the contact object, and a high-precision and low-cost force touch perception solution is provided for the fields of robot touch recognition, human-computer interaction, safety monitoring and the like.
Owner:ZHEJIANG UNIV OF TECH

Array-type flexible tactile sensor and manufacturing method therefor, and tactile sensing system

An array-type flexible tactile sensor, comprising a plurality of flexible tactile sensor units arranged in an array. Each tactile sensor unit comprises, from top to bottom, a friction layer, a hydrophilic layer, an electrode layer, and a substrate layer. The lower surface of the friction layer is a hydrophilic surface. By adding the hydrophilic layer between the friction layer and the electrode layer, the friction layer and the electrode layer can be well bonded; on this basis, the electrode layer is printed on the hydrophilic layer by adopting a simple screen printing method, so that the electrode layer can be bonded to the friction layer; a screen printing plate is designed into an array-type structure, so that the array-type tactile sensor can be directly obtained, realizing large-area batch production, and improving the manufacturing efficiency. The manufactured array-type flexible tactile sensor can realize dynamic multi-point sensing, the sensitivity, the working stability and the resolution are improved, and self-powering and self-driving can be achieved. Also provided are a manufacturing method for the array-type flexible tactile sensor, and a tactile sensing system.
Owner:THE GBA NAT INST FOR NANOTECHNOLOGY INNOVATION

Three-dimensional array type magnetic tactile sensor

The utility model relates to the technical field of tactile sensing, in particular to a three-dimensional array type magnetic tactile sensor. The three-dimensional array type magnetic tactile sensor comprises a flexible circuit board layer, an elastic layer and a flexible magnet layer which are sequentially stacked and bonded from bottom to top, when the flexible magnet layer deforms due to external pressure, the surrounding magnetic field intensity is changed, and the flexible circuit board layer measures external force by sensing the magnetic field change of the flexible magnet layer. The elastic layer is used for expanding the external force measurement range of the flexible circuit board layer. The flexible magnet layer comprises a top-layer flexible body and a plurality of flexible magnets embedded in the top-layer flexible body, and the flexible magnets are used as contacts. The device simulates hand touch perception, has a wide force measurement range, can accurately detect tiny force change, and improves sensitivity.
Owner:SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI

Finger module, manipulator and robot

The invention provides a finger module, a manipulator and a robot. The finger module comprises a plurality of knuckles and a touch sensing assembly. The tactile sensing assembly is arranged on the ventral side of at least one knuckle, the tactile sensing assembly comprises a plurality of deformation assemblies located on the same plane and sensing assemblies attached to the deformation assemblies, and the sensing assemblies respond to deformation of the deformation assemblies attached to the sensing assemblies to generate corresponding electric signals. In the scheme, the finger module has high-precision tactile perception capability.
Owner:BEIJING XIAOMI ROBOT TECH CO LTD

Array type flexible tactile sensor, preparation method thereof and tactile sensing system

The invention provides an array type flexible tactile sensor, a preparation method thereof and a tactile sensing system. The array type flexible tactile sensor comprises a plurality of arrayed flexible tactile sensor units, each flexible tactile sensor unit sequentially comprises a friction layer, a hydrophilic layer, an electrode layer and a substrate layer from top to bottom, and the lower surface of the friction layer is a hydrophilic surface. The hydrophilic layer is added between the friction layer and the electrode layer, good attachment of the friction layer and the electrode layer can be achieved, on the basis, the electrode layer is printed on the hydrophilic layer through a simple silk-screen printing method so as to be combined with the friction layer, a silk-screen printing plate is designed to be of an array structure, and an array touch sensor can be directly obtained; large-area batch production can be realized, and the preparation efficiency is improved. The prepared array type flexible tactile sensor can realize dynamic multi-point sensing, improve the sensing sensitivity, the working stability and the resolution ratio, and can realize self-energizing and self-driving.
Owner:THE GBA NAT INST FOR NANOTECHNOLOGY INNOVATION

Electrical Stimulation From A Wristband With Augmented Reality Visual Effects For Remote Haptic Sensations In The Hand, And Systems And Methods Of Use Thereof

A method of providing remote haptic feedback is described. The method includes applying, via a set of electrodes of a wearable device, a haptic signal to a first portion of a user. The haptic signal is configured to cause haptic feedback to be perceived at a second portion of the user that is distinct from the first portion of the user. The method further includes causing a visual indication of the haptic feedback at the second portion to be displayed to the user via a display of a head-wearable device.
Owner:META PLATFORMS TECHNOLOGIES LLC

Virtual material interaction system with tactile feedback

The invention relates to the technical field of tactile interaction, in particular to a virtual material interaction system with tactile feedback, which comprises a contact state sensing module, a potential gradient calculation module, a friction dynamic regulation and control module, a tactile feedback generation module and an interaction state monitoring module. According to the invention, dynamic mapping of contact pressure, sliding speed and node potential is realized through multi-source signal fusion, so that touch perception keeps continuous response in time sequence, potential difference calculation forms an electric field regulation basis for microscopic change of a material, and space-level adjustment of a surface friction coefficient is realized through charge redistribution and polarization direction switching. The tactile feedback changes adaptively according to material features, the friction spectrum is recombined into a multi-frequency-domain tactile signal after Fourier decomposition, texture, hardness and damping features of different materials are presented in a layered mode, the tactile feedback has more dynamic details and direction consistency, the sense of reality and the tactile recognition degree of virtual materials are improved, and the sense of reality and the sense of touch recognition degree of the virtual materials are improved. And stable and natural interaction touch in the virtual environment is ensured.
Owner:嘉兴南湖学院

Sea-turtle-imitating amphibious robot terrain classification and self-adaptive gait switching method based on visual tactile perception

The invention discloses a terrain classification and self-adaptive gait switching method for a sea-turtle-imitating amphibious robot based on visual tactile perception. The method comprises the following steps: establishing a robot model carrying a pressure sensor and a waterproof camera; the method comprises the following steps: acquiring tactile time sequence data and visual images in various terrains such as broken stones and sand beaches, and constructing a training data set; establishing a multi-modal convolutional neural network, and fusing features through dual-channel feature extraction and an adaptive attention mechanism; motion energy consumption and speed under each terrain are collected, and the optimal gait is determined; and constructing a gait switching finite-state machine in combination with terrain physical attribute classification and the optimal gait. According to the method, a sensing-decision-driving closed loop is formed, the terrain is sensed through visual touch, the gait is decided through a finite-state machine, the gait driving motion is executed, and through experimental verification, the self-adaptive gait can improve the moving efficiency and speed, and the amphibious environment adaptability of the robot is enhanced.
Owner:TSINGHUA SHENZHEN INTERNATIONAL GRADUATE SCHOOL

Guide wire terminal force feedback simulation system

The invention discloses a guide wire terminal force feedback simulation system which comprises a guide wire operation and force feedback system located at a doctor operation end, a guide wire action execution system located at a patient execution end and a medical image processing system. The guide wire operation and force feedback system comprises a damping force device, a linear displacement sensor and an angular displacement sensor; according to the application, remote operation gets rid of the constraint of a rocker, a doctor can also use an actual guide wire to operate at the operation end, on the basis, a damping force device is added, the guide wire at the operation end is clamped to different degrees according to the stress condition, calculated by a medical image processing system, of the tip end of the guide wire in a human body, and the operation efficiency is improved. Therefore, the hand feeling of stress of the guide wire in actual clinical use is accurately simulated in real time, a doctor can simulate the touch experience in a traditional operation more truly, the immersion feeling and the control feeling of operation are improved, touch perception is provided for a remote interventional operation, and the accuracy and the safety of the operation and the operation experience of the doctor are improved.
Owner:HUAXI JINGCHUANG MEDICAL TECH (CHENGDU) CO LTD

Multi-modal interaction aging-adaptive interface self-adaptive system

The invention discloses a multi-mode interaction adaptive system for an aging-adaptive interface. The multi-modal interaction aging-adaptive interface self-adaption system comprises a multi-modal input module, a tactile feedback module and a dual-redundancy wake-up module. Wherein the multi-modal input module is used for acquiring current joint description data acquired by the multi-modal integrated sensor, and performing identification and dialect adaptation processing on the current joint description data to obtain a dialect identification result corresponding to a target user; the tactile feedback module is used for analyzing the current joint description data when receiving a tactile feedback instruction to obtain a tactile perception result; and the dual-redundancy wake-up module is used for judging whether the triggering of the current joint description data is valid or not through a preset false touch suppression algorithm to obtain a triggering judgment result. The dialect recognition method solves the problems that an intelligent device cannot recognize dialects more accurately, tactile perception is poor and the mistaken touch rate is high, dialect recognition is better achieved, health of old people is guaranteed, and the experience feeling of the old people using the intelligent device is improved.
Owner:AIMI (BEIJING) ROBOT CO LTD

Tactile fingertip with fingerprint microstructure and tactile information sensing method

The application designs a tactile fingertip with fingerprint microstructure and a tactile information sensing method, the overall structure simulates the shape, structure and functional characteristics of the fingertip of human fingers, adopts a hybrid structure of flexible skin layer-tactile sensing layer-rigid phalanx, and four groups of sensitive elements are embedded in the flexible skin, each group contains two sensitive elements for sensing dynamic signals and static signals, and is located at different skin layer depths. The surface of the finger pulp is designed with raised fingerprint microstructure, which can further enhance the tactile sensing ability. According to the different contact areas, the fingertip can realize surface attribute recognition, and the finger pulp can realize clamping and contact state sensing. The structure of the application is simple, the process is simple, and the cost is low, and various functions such as contact state sensing, object surface recognition and shape distinction can be realized, which helps the robot to realize accurate force feedback control. Further, the application can be installed on various mechanical clamps to give them tactile sensing ability.
Owner:SOUTHEAST UNIV