Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1368 results about "Tactile sensor" patented technology

A tactile sensor is a device that measures information arising from physical interaction with its environment. Tactile sensors are generally modeled after the biological sense of cutaneous touch which is capable of detecting stimuli resulting from mechanical stimulation, temperature, and pain (although pain sensing is not common in artificial tactile sensors). Tactile sensors are used in robotics, computer hardware and security systems. A common application of tactile sensors is in touchscreen devices on mobile phones and computing.

Manipulator grabbing planning system and method based on visual identification

The invention discloses a manipulator grabbing planning system and method based on visual identification, and relates to the technical field of robots, the manipulator grabbing planning system comprises a visual perception module, a coordinate conversion module, a motion planning module, a control execution module, a tail end perception module and a system integration and communication module; the visual perception module realizes multi-view target detection, semantic segmentation and three-dimensional pose estimation through a binocular depth camera; the coordinate conversion module is used for converting a target pose under a camera coordinate system into a world coordinate under a mechanical arm base coordinate system; the motion planning module is responsible for generating a mechanical arm grabbing path, optimizing a strategy and supporting generalization migration of a multi-form mechanical arm; the control execution module drives the six-axis cooperative mechanical arm to complete the grabbing action, and vision-force mixed feedback closed-loop control is achieved. The tail end sensing module monitors the grabbing state in real time through a touch sensor and dynamically adjusts a grabbing strategy; and the system integration and communication module is used for realizing real-time data interaction and cooperative work among the modules of the system.
Owner:SHANGHAI AOTEBOG TECH DEV CO LTD

Interactive mechanical arm control method based on tactile feedback analysis

The invention discloses an interactive mechanical arm control method based on tactile feedback analysis, and relates to the technical field of mechanical arm control, and the method comprises the following steps: configuring a high-precision tactile sensor through an end effector of a target mechanical arm, and sensing and obtaining tactile data; obtaining a tactile feedback signal, and judging the attribute of a contact object based on the tactile feedback signal; analyzing and recognizing the touch mode, predicting first operation of the mechanical arm, and generating a mechanical arm control strategy; based on the visual information of the mechanical arm, the tactile feedback signal is fused, and an operation path of the target mechanical arm is generated; and the target mechanical arm is controlled through the mechanical arm control updating strategy. The technical problems that existing mechanical arm control depends on vision and position sensors and cannot respond to external fine contact accurately in real time, so that control is not fine enough, and flexibility and safety are lacked are solved, target objects are sensed accurately, and the control precision is improved. The technical effect of improving the precision, flexibility and safety of operation control of the mechanical arm is achieved.
Owner:SUZHOU CURIOSITY DIGITAL TECH CO LTD

Multi-modal collaborative decision-making method and device for humanoid robot in industrial scene

The invention discloses a multi-modal collaborative decision-making method and device for a humanoid robot in an industrial scene, and relates to the technical field of robot control, and the method comprises the steps: obtaining a multi-frame monitoring image, force touch sensor data and equipment operation sensor data of a visual camera of the humanoid robot in the industrial scene; extracting feature vectors of the multi-frame monitoring image, the force touch sensor data and the equipment operation sensor data as multi-modal feature vectors; taking the multi-modal feature vector as a training sample to train a cross-modal model, so that the cross-modal model learns an association relationship among vision, haptic and equipment data; obtaining dynamic industrial scene data, extracting feature vectors, and inputting the feature vectors into the trained cross-modal model to generate scene description information; and outputting an operation decision instruction according to the scene description information so as to control the humanoid robot. Through cross-modal feature fusion and dynamic knowledge reasoning, the task execution precision and environmental adaptability of the humanoid robot in a complex industrial environment can be improved.
Owner:广州里工实业有限公司

Robot multi-modal fusion autonomous decision-making method and system based on large language model

The invention relates to the technical field of robot decision making, and provides a robot multi-modal fusion autonomous decision making method and system based on a large language model.The method comprises the steps that a robot obtains multi-modal environment information through a visual sensor, a touch sensor, an auditory sensor and a laser radar which are carried by the robot; performing preliminary filtering and noise reduction processing on the original sensor data, and synchronously recording all the sensor data by timestamps; performing space-time semantic alignment on the preprocessed multi-modal data, mapping pixel coordinates of a target in a visual target coordinate quantization original image to a robot coordinate system, performing uncertainty evaluation on a multi-modal signal through a dynamic Bayesian network, and taking entropy or variance as an uncertainty quantitative evaluation index. According to the method, the information quality is improved from a data fusion source, accurate and reliable basic support is provided for subsequent decision making, and decision making errors caused by data deviation are greatly reduced.
Owner:ANHUI UNIV +1

Control method for support robot, support robot, electronic device, computer storage medium, and computer program product

A control method for a support robot, the method comprising: in response to recognizing that a target object has an intent to require support, controlling a support robot to move toward the target object, and when the support robot moves to a target movement position, controlling a robot arm to move to a target joint position, wherein the target movement position and the target joint position are both determined on the basis of the relative position between the target object and a target sensor; and in the process of the robot arm moving to the target joint position or after the robot arm moves to the target joint position, when it is detected by means of a tactile sensor that an external force is applied to the robot arm, performing compliance control on the support robot. Further provided are a support robot, an electronic device, a computer storage medium, and a computer program.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Optical Tactile Sensor

An optical tactile sensing method is provided distinguishing having an optical tactile sensor and performing shape reconstruction and force measurement. The optical tactile sensor has an elastomeric hemisphere. A single camera captures the illumination of the entire reflective inner surface of the elastomeric hemisphere in a single input image. Shape reconstruction for a novel shape is performed while in contact with the hemisphere. Image pixels of a single sensor input image are inputted to a trained neural network, which outputs shape characteristics of the contact of the novel shape. With a continuous pattern on the elastomeric hemisphere, the optical tactile sensing method further distinguishes performing force reconstruction / estimation. Force reconstruction / estimation is performed through tracking deformation of the continuous pattern of the elastomeric hemisphere. Multiple sensor input images collected during the deformation are inputted to a trained neural network, which outputs force vector information of the contact of the novel shape.
Owner:THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIV

Robot hierarchical reinforcement learning variable impedance control method based on vision and touch

The invention discloses a robot hierarchical reinforcement learning variable impedance control method based on vision and touch, and belongs to the field of robot control. According to the method, an upper-layer planning system and a lower-layer variable impedance control system are included, the upper-layer planning system fuses information from a visual sensor and a tactile sensor, feature coding is conducted on a visual image through a variational self-coding model, tactile feedback and mechanical arm state information are combined, and an action strategy adapting to the current environment and corresponding impedance parameters are formulated. And the lower-layer variable impedance control system realizes variable impedance control of the robot based on a depth kinematics and dynamics model, and allows the robot to dynamically adjust the motion and contact force according to the sensed information when interacting with the environment, thereby improving the adaptability to the environment change and the task execution efficiency. According to the method, the success rate and execution efficiency of the robot for executing the complex assembly task in the unstructured environment are remarkably improved, and high robustness is shown.
Owner:UNIV OF SCI & TECH OF CHINA

Multi-dimensional haptic self-adaptive grabbing dexterous hand control system and control method

The invention relates to the technical field of manipulator control, in particular to a multi-dimensional force touch sense self-adaptive grabbing dexterous hand control system and a multi-dimensional force touch sense self-adaptive grabbing dexterous hand control method. The control system comprises an upper computer, a dexterous hand master controller module, a finger controller module, a three-dimensional force tactile sensor module and an actuator module, wherein the finger controller module, the three-dimensional force tactile sensor module and the actuator module are independently configured for each finger of the dexterous hand; wherein the dexterous hand master controller receives an instruction of an upper computer and generates a control instruction corresponding to each finger; the three-dimensional force tactile sensor monitors contact data of a finger and an object; the finger controller calculates target positions of the servo motor at different time points based on the control instruction, the contact data and actuator state feedback, and generates a third control instruction; and after receiving the instruction, the actuator module adjusts the position of a servo motor to ensure that the dexterous hand completes self-adaptive grabbing according to a preset track and force. The grabbing force and speed of the dexterous hand can be adjusted in a self-adaptive mode according to different conditions, and the accuracy and stability of the grabbing action are ensured.
Owner:SUZHOU HANGKAI MICROELECTRONICS TECH CO LTD

Bionic multi-finger underwater manipulator device, control system, grabbing strategy and target identification method

The invention relates to a bionic multi-finger underwater manipulator device, a control system, a grabbing strategy and a target identification method.The manipulator is mainly composed of a flange plate and an under-actuated mechanical finger of a seven-connecting-rod mechanism, and the mechanical finger comprises a base, a triangular piece, a fingertip piece and a sliding block; two corners of the triangular piece are connected with the fingertip piece and the sliding block through connecting rod mechanisms respectively, the third corner of the triangular piece is connected with the base through a trapezoidal connecting piece, the sliding block is driven by a threaded linear long-axis motor, a magnetic touch sensor is arranged in a fingertip, and the magnetic touch sensor receives fingertip touch information through a fingertip receptor unit made of a magnetic powder silica gel mixture. The device is controlled by a control system comprising a microprocessor, naturally adapts to objects with different shapes and sizes by formulating corresponding adaptive force grabbing strategies, and classifies and identifies underwater objects through a deep learning algorithm. Compared with the prior art, the method has the advantages of high sensitivity, interference resistance and the like, and has the capabilities of tactile perception recognition and self-adaptive grabbing.
Owner:TONGJI UNIV

Joint denoising method for robot visual motion prediction

The invention discloses a joint denoising method for robot visual motion prediction, and the method comprises the steps: constructing a unified generative model through fusing an image and a depth map collected by a depth camera, motion data collected by CAN line communication of a Piper mechanical arm, and a tactile image collected by a Gelsight Mini tactile sensor; the method comprises two steps of data acquisition and input coding, and joint denoising and generation: firstly, multi-modal data are coded into low-dimensional potential representation, and then future images, depth maps, tactile data and robot actions are cooperatively predicted through a joint denoising framework based on Transform. A mask self-attention mechanism is innovatively introduced, information interaction between modes is dynamically adjusted, action generation is guided through tactile feedback, and the force control precision is improved. The model adopts a de-noising diffusion probability loss function to jointly optimize multi-modal prediction, so that the output consistency is ensured. According to the method, the robustness and the accuracy of flexible operation of the robot are remarkably improved.
Owner:ROBOTICS RESEARCH CENTER OF YUYAO CITY +1

Control method of supporting robot, supporting robot and electronic equipment

The embodiment of the invention discloses a control method of a supporting robot, the supporting robot and electronic equipment, the supporting robot is controlled to move towards a target object in response to the fact that the target object has the intention of requiring supporting, and when the supporting robot moves to a target moving position, a mechanical arm is controlled to move to a target joint position, the target moving position and the target joint position are changed along with the relative position between the target object and the target sensor, so that the state of the target object can be sensed, and the support task is automatically executed according to the state of the target object; in the process that the mechanical arm moves to the target joint position or after the mechanical arm moves to the target joint position, when external force is applied to the touch sensor, compliance control is conducted on the mechanical arm, so that the mechanical arm can follow the posture of the target object, the supporting comfort is improved, diversified interaction with the target object is achieved, and the user experience is improved. And the intelligent degree is high.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Five-finger bionic dexterous hand with distributed touch perception and control method

The invention discloses a five-finger bionic dexterous hand with distributed touch perception and a control method. The five-finger bionic dexterous hand comprises a palm part; fingers of the thumb unit, the index finger unit, the middle finger unit, the ring finger unit and the little finger unit respectively comprise a three-stage series flexion and extension mechanism which is sequentially composed of a third knuckle, a second knuckle and a first knuckle from a metacarpophalangeal joint, and each three-stage series flexion and extension mechanism has three flexion and extension freedom degrees and one deflection freedom degree; the tendon rope driving units are arranged in the palm part; the palm center camera is integrated on the front face of the palm part and used for collecting visual information of an operation area; the 15 air pressure type touch sensor modules are installed on the third knuckles, the second knuckles and the first knuckles of all the finger units in a distributed mode, and each air pressure type touch sensor module is integrated with a pressure and temperature double sensing unit and used for sensing contact pressure and environment temperature; the control module is integrated on the back face of the palm part and is in signal connection with the palm center camera, the air pressure type touch sensor modules and the tendon rope driving unit.
Owner:NANJING UNIV OF INFORMATION SCI & TECH

Fluidic Tactile Sensor

A fluidic tactile sensor includes a core having an outer surface, channels formed within the core, and an elastic skin disposed over a surface portion of the outer surface. Cells are formed between the surface portion and the elastic skin. Each cell is connected to one of the channels through an opening of the channel on the surface portion. Compressible fluid volumes extend between the elastic skin and the core. Each compressible fluid volume includes a first fluid volume formed inside one of the cells and a second fluid volume formed inside the channel connected to the one of the cells. The first and second fluid volumes contain portions of a continuous compressible fluid medium. A contact force applied to the elastic skin at a location corresponding to a given cell produces a measurable change in a fluid pressure of the continuous compressible fluid medium associated with the given cell.
Owner:SANCTUARY COGNITIVE SYST CORP

Ultrasonic enhanced tactile sensor system, sensor and sensing method

The invention discloses an ultrasonic enhanced tactile sensor system, a sensor and a sensing method. The tactile sensor system comprises a multi-mode sensing unit and a processing unit. The multi-mode sensing unit integrates an ultrasonic module and a visual tactile sensing module, ultrasonic acoustic impedance matching and optical imaging transmission are achieved through an acousto-optic matching structure, and ultrasonic echo signals and tactile deformation images can be synchronously collected. In the processing unit, an event triggering module detects a contact event based on a tactile image and generates a switching signal, and a self-adaptive processing module dynamically controls an ultrasonic mode, distance measurement during non-contact, and switching to object internal imaging or material property identification during contact according to the switching signal. And the three-level fusion processing module outputs a multi-modal sensing result through signal-level synchronous acquisition, feature-level cross-modal fusion and decision-level task switching. According to the system, multi-dimensional perception of proximity sense, surface texture and deep information is realized, and the pre-judgment and accurate operation capability of the robot in a complex scene is improved.
Owner:TSINGHUA SHENZHEN INTERNATIONAL GRADUATE SCHOOL

Grabbing method, robot arm and robot

The invention discloses a grabbing method, a manipulator and a robot. The grabbing method is applied to a controller of the manipulator. The method comprises the steps that in the process that the robot arm grabs a target object, real-time contact information generated when the robot arm grabs the target object is obtained; on the basis of the real-time contact information, current grabbing postures of at least two finger mechanisms of the robot arm are adjusted, and contact information generated by the at least two finger mechanisms after posture adjustment is made to be matched with the predicted contact information; wherein the real-time contact information is collected by at least one of touch sensors arranged on the at least two finger mechanisms and a touch sensor arranged on the palm part of the robot arm. In this way, the robot arm can grab the target object in the appropriate grabbing posture, and therefore the object grabbing accuracy of the robot arm is improved.
Owner:BEIJING GALBOT AI CO LTD

Robot dynamic grabbing control method based on visual sense and tactile sense depth fusion

The invention relates to a robot dynamic grabbing control method based on visual sense and tactile sense depth fusion. The method comprises the following steps that firstly, based on visual information, surface geometric features of a target object are extracted, grabbing adaptability scores are calculated, an optimal grabbing point is selected, and a collision-free approaching track is planned; secondly, in a contact establishment stage, detecting a contact event through a touch sensor, fusing vision and touch data to unify a coordinate system, calculating a vision-touch consistency score, and applying an initial grabbing force; and thirdly, in the stable holding stage, slip detection is conducted through wavelet packet energy entropy and pressure gradient, and the grabbing force and impedance parameters are dynamically adjusted in combination with self-adaptive impedance control. According to the method, intelligent control over the whole process from approaching to contact to stable holding is achieved, and the adaptability, stability and safety of robot grabbing in the dynamic environment are improved.
Owner:INEXBOT

Robot flexible grabbing method and system based on touch sensor

The invention relates to the technical field of pose control, in particular to a robot flexible grabbing method and system based on a touch sensor, and the method comprises the steps: carrying out the image collection of an environment where a to-be-operated object is located based on a camera integrated in a robot, so as to obtain an image of the environment where the to-be-operated object is located; and acquiring a real-time pose of an end effector of the robot based on inertial measurement equipment integrated in the robot, and performing pose estimation on a to-be-operated object in the environment image based on a pre-trained pose estimation model to obtain the pose of the to-be-operated object. By combining the environment image acquired by the camera and the real-time pose information provided by the inertial measurement equipment, the robot can estimate the pose of the object to be operated in real time, and the position and the pose of the object can be accurately speculated by utilizing the pre-trained pose estimation model, so that the accuracy of the operation of the robot is improved. Therefore, the operation of the end effector of the robot can be accurately butted with the object, and errors in the operation process are reduced.
Owner:WUXI DECHUN TECH CO LTD

Fluidic tactile sensor

A fluidic tactile sensor includes a core having an outer core portion, an inner core portion, and a first channel having a first opening at a first surface portion of the outer core portion. An elastic skin is disposed over the first surface portion. A cell is formed between the first surface portion and the elastic skin and fluidly is fluidly connected to the first channel. The cell contains a fluid. A contact force applied to the elastic skin produces a measurable change in fluid pressure inside the cell.
Owner:SANCTUARY COGNITIVE SYST CORP

Large-deflection deformation flexible shaft hole assembling method and device based on tactile perception, storage equipment and program product

The invention discloses a large-deflection deformation flexible shaft hole assembly method and device based on tactile perception, storage equipment and a program product, and belongs to the technical field of robot assembly. The problem that an existing assembling method does not consider the influence of non-linear large-deflection deformation of the flexible shaft on the assembling precision of the shaft hole is solved. Based on pressure distribution data fed back by the tactile sensor, the deformation condition of the shaft can be estimated and adjusted, the flexible shaft workpiece makes effective contact with the rigid plane where the target hole is located, whether the shaft passes through the hole or not is monitored in real time in the blind hole searching process, and after the hole is searched, the mechanical arm is controlled to automatically align the shaft hole, so that the hole searching efficiency is improved. And the shaft insertion action is completed. The device is mainly used for shaft hole assembly of the large-deflection deformation flexible shaft workpiece.
Owner:HARBIN INST OF TECH

Multi-curvature high-resolution bionic miniature visual tactile sensor for fingertips

The invention discloses a multi-curvature high-resolution bionic miniature visual tactile sensor for fingertips, which relates to the technical field of sensors and comprises a fingertip structure, a transparent support structure, a flexible silica gel sensing layer and an image acquisition module. A cavity is formed in the fingertip structure; the transparent supporting structure is clamped in the cavity; the flexible silica gel sensing layer is adhered to the transparent supporting structure, and black circular array mark points are attached to the surface of the flexible silica gel sensing layer; the image acquisition module is arranged on the fingertip structure, the acquisition end of the image acquisition module is arranged above the transparent supporting structure, and the view field area of the acquisition end covers the whole flexible silica gel sensing layer area; compared with other fingertip tactile sensors, the visual tactile sensor is a human fingertip simulated visual tactile sensor with the highest spatial resolution, the smallest overall size and the lowest manufacturing cost.
Owner:江淮前沿技术协同创新中心

Mechanical arm obstacle avoidance method based on EIT touch sensor

The invention discloses a mechanical arm obstacle avoidance method based on an EIT tactile sensor, and belongs to the technical field of robot tactile perception. Firstly, tactile information is obtained through an EIT tactile sensor, and a tactile sensing image is reconstructed; then, the visual module starts to detect the target object and the box, if the visual module does not recognize the target object, the target object is fed back to the control module, and the tail end of the mechanical arm is controlled to move to the next area until the whole workbench is traversed; if the target object and the box are detected, obtaining a target position and a placement position through coordinate transformation; after the tail end of the mechanical arm moves to a target position, a target object is clamped through a clamping jaw, and then the mechanical arm moves to a placement position; in the moving process of the mechanical arm, an obstacle touches the mechanical arm, the EIT tactile sensor detects the change of the conductivity of a sensing area, and the position of a change center point is converted to the position below a mechanical arm base system and transmitted to the control module to re-plan a route; and finally, the mechanical arm touches the obstacle for multiple times during movement, and the control module enables the mechanical arm to bypass the obstacle and reach the target object placement position through multiple route plans. According to the method, the obstacle model can be actively sensed and established, and a safer and more reliable obstacle avoidance route can be planned.
Owner:HEBEI UNIV OF TECH

Augmented reality system including corporal tactile devices

The present invention relates to an advanced augmented reality, AR, apparatus featuring a video see-through AR, VST-AR, device that captures images of a real-world environment and displays augmented versions on a screen. The system includes a corporal entity, such as an empty laboratory vessel, equipped with a unique identification marker. This marker provides real-time spatial data for generating visual augmentations representing virtual matter within the vessel. The apparatus integrates various sensors, including an inertial measurement unit, IMU, capacitive tactile sensors, and a thermal diode, to dynamically adjust visual augmentations based on user interactions. Additional sensory enhancements include an olfactory output fan, an eccentric rotating mass, ERM, motor, and auditory outputs. Wireless connectivity via IEEE 802.11 (Wi-Fi) and IEEE 802.15.1 (Bluetooth) ensures seamless communication between components. This AR system is particularly valuable for educational and laboratory settings, offering realistic, interactive simulations.
Owner:UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION INC

Skin-like multi-mode tactile sensor and preparation method thereof

The invention discloses a skin-like multi-mode tactile sensor and a preparation method thereof, and belongs to the technical field of sensors, the sensor comprises an isolation layer lower substrate, electrodes, a sensing layer and a protection layer upper substrate from bottom to top; the lower substrate adopts a hydrogenated styrene-butadiene block copolymer (SEBS), and in the preparation process of the SEBS substrate, isopropanol can be taken away by overnight volatilization of a toluene solution, so that a porous substrate is formed, and the substrate has air permeability; the electrode uses a mixed solution of PEDOT: PSS PH1000 and DMSO, so that the conductivity of the electrode can be effectively improved; the porous structure of the sensing layer is formed by using cube sugar as a sacrifice template, and the resistance change of the sensing layer is caused by pressing deformation, so that different electric signals are formed, and the change of temperature and tiny pressure can be sensed.
Owner:GUANGDONG LAB OF ARTIFICIAL INTELLIGENCE & DIGITAL ECONOMY (SZ)

Tactile positioning method and device and electronic equipment

The invention discloses a tactile positioning method and device and electronic equipment, and belongs to the technical field of tactile sensors. A positioning block set is arranged on the surface of a target object, and the method comprises the steps that under the condition that a mechanical arm makes contact with the target object, a first image corresponding to the target object is obtained, the first image comprises a plurality of target positioning points, and the target positioning points are determined based on positioning blocks, making contact with the mechanical arm, in the positioning block set; acquiring a second image including a plurality of reference points based on the first image; and based on the offset information of each target positioning point and the closest reference point, determining the contact position information of the manipulator in contact with the target object. According to the technical scheme, decoding operation can be carried out to determine the contact position information based on the offset information of each target positioning point and the closest reference point, comparison and matching with other feature information are not needed, the tactile positioning efficiency can be improved, and quick response of the manipulator is achieved.
Owner:BEIJING INSTITUTE FOR GENERAL ARTIFICIAL INTELLIGENCE

Visual tactile sensor, manipulator and control method thereof

A visual tactile sensor, a manipulator and a control method thereof, the visual tactile sensor comprising: a contact layer, at least a portion of which is transparent; when the contact layer is subjected to external force, at least one part of a plurality of markers in the marker array generates displacement and / or deformation; and the image acquisition unit is used for performing image acquisition on the marker array and performing image acquisition on the outside through the transparent part of the contact layer. The visual tactile sensor provided by the invention not only can capture the external visual information before operation to identify the operation object, but also can provide the tactile information in the operation process, so that the perception capability of an operation system is enhanced, and the operation success rate is improved.
Owner:SHANGHAI XINZHI EMBODIED INTELLIGENT TECHNOLOGY CO LTD

Intelligent navigation method and system

The invention discloses an intelligent navigation method and system, and relates to the field of intelligent robot control. The method comprises the following steps: acquiring multi-modal data acquired by a touch sensor, a visual sensor and a force sensor; if the matching degree of the tactile data and the visual data is lower than a preset threshold value, adjusting the tactile data by adopting a weighting coefficient to obtain a fusion feature vector; a three-dimensional point cloud map is generated according to the fusion feature vector, and if it is detected that the dynamic change rate of the point cloud map is higher than a preset threshold value, an incremental updating algorithm is triggered to correct the environment model; extracting a terrain feature set from the environment model, and generating a candidate path set by adopting a reinforcement learning algorithm; and if the passing cost value of the candidate path is lower than a preset threshold value, smoothing the candidate path to obtain an optimized navigation path. According to the invention, accurate navigation and path planning in a complex environment are realized, and the adaptability and robustness of a navigation system are improved.
Owner:HUNAN AUTOMOTIVE ENG VOCATIONAL COLLEGE

Multi-modal human-computer interaction interface and behavior prediction system

The invention relates to the technical field of artificial intelligence, and discloses a multi-modal man-machine interaction interface and behavior prediction system, which comprises a multi-modal data acquisition module used for acquiring visual, auditory and tactile data of a user in real time; the data synchronization and preprocessing module is used for carrying out time synchronization on the collected multi-modal data and carrying out denoising and error correction on the data; the data fusion module is used for fusing different modal data and extracting core features of the data; the behavior prediction module is used for performing user behavior prediction based on the fused data; and the system optimization module is used for dynamically adjusting the interaction mode and function of the system based on the behavior prediction result so as to realize personalized user experience. By adopting a multi-modal data fusion technology, data from a visual sensor, an auditory sensor and a tactile sensor are efficiently fused, core features are extracted, and a more accurate user behavior prediction effect is achieved.
Owner:北京思普艾斯科技有限公司

Visual tactile sensor and robot

The invention relates to the technical field of sensors, and provides a visual tactile sensor and a robotic.The visual tactile sensor comprises a shell, an elastic body, a light-transmitting plate, a camera, a light source and a light uniformizing plate, the camera, the light source and the light uniformizing plate are arranged in the shell, the elastic body is connected to the surface of the front end of the light-transmitting plate, and the light-transmitting plate is embedded in the front end of the shell; the elastic body protrudes out of the front end surface of the shell, the light-transmitting plate is made of light-transmitting materials, one end of the light uniformizing plate corresponds to the light source, the other end of the light uniformizing plate corresponds to the side portion of the light-transmitting plate, and the light-transmitting plate is used for transmitting light from the side portion of the light-transmitting plate to the front end surface of the light-transmitting plate. Therefore, more uniform light can be obtained to irradiate the surface of the elastic body connected to the surface of the front end of the light-transmitting plate, the light supplementing uniformity of the light source in the visual tactile sensor is effectively improved, the imaging quality of the elastic body of the visual tactile sensor is further improved, and meanwhile, the precision and the stability of the visual tactile sensor are improved.
Owner:BEIJING AGILE ROBOTS TECH CO LTD

Hand-held apparatus for noninvasive measurement of a heart performance metric

Apparatuses, machine-accessible storage media, and methods for noninvasively measuring a heart performance metric, such as left ventricular filling pressure, are described. In an embodiment, the apparatus includes a housing shaped to be grasped by a hand; a tower protruding from a surface of the housing positioned to conform to a finger of the hand when grasping the housing; a tactile sensor disposed on a curved surface of the tower and adapted to measure blood pressure pulsatility in a digital artery of the finger and output pulsatility signals indicative of the blood pressure pulsatility; a graphical user interface for orchestrating a test of the performance metric of the heart and displaying results of the test.
Owner:VERILY HEALTH INC

Large-area split type flexible magnetic tactile sensor with sensing function

The invention provides a large-area split type flexible magnetic tactile sensor with a sensing function, and the sensor employs a plurality of flexible square magnetic sheets which are magnetized in the thickness direction, and the polarities of the flexible square magnetic sheets are alternately arranged in a checkerboard array mode in which the polarities of the magnetic fields of the adjacent flexible square magnetic sheets are opposite, so as to simulate a flexible magnetic film which is magnetized in a folded manner. The magnetic flux density of a contact force acquisition area is enhanced, a U-net algorithm is adopted to carry out field intensity-force relation fitting on the divided acquisition area, and a contact force cloud picture is generated, so that a Hall sensor and a flexible magnetic film can keep a large distance to carry out split type large-area contact force sensing, and lossless split type installation is realized; and compared with simple magnetic field modes such as unidirectional magnetization, the touch sensor has higher sensitivity. According to the size of a required contact force measuring surface, more flexible magnetic touch sensor arrays are arranged, a contact force cloud picture is drawn together through a plurality of units, and the flexible magnetic touch sensor array has application potential in the fields of bionic robots, flexible electronics, medical treatment and the like.
Owner:BEIJING UNIV OF TECH +1