1729 results about "Touch Senses" patented technology

A virtual reality (VR)-based system for improving students' reading comprehension and writing skills. The system includes: a VR headset with an integrated eye-tracking system, high-resolution stereoscopic displays and spatial audio output, where the eye-tracking system detects reading patterns, fixation points and saccadic movements to assess reading engagement; a pair of motion tracking gloves with embedded pressure-sensitive capacitive sensors and haptic feedback actuators, allowing students to work with virtual reading material, perform handwriting exercises, and receive tactile reinforcement of text-based interactions; an adaptive learning module based on artificial intelligence (AI) that is configured to dynamically adjust reading complexity and writing exercises, responding to real-time metrics for interaction with students, with the AI ​​module using deep learning-based natural language processing (NLP) models to analyze reading fluency, written coherence, and syntactic complexity; a speech recognition and synthesis subsystem comprising a neural network-based acoustic model and a phoneme segmentation processor, wherein the subsystem assesses pronunciation accuracy, fluency, and articulation deviations by analyzing phonetic waveforms of spoken responses; a multimodal interactive interface that enables students to interact with virtual reading environments via a combination of hand tracking, voice commands and eye-controlled text selection, with the interface allowing students to highlight, comment on and orally summarize text content; A real-time dashboard for teacher monitoring, which is communicatively connected to the VR system. The dashboard offers educators detailed analyses of student comprehension patterns, writing progress, and AI-generated adaptive learning recommendations; and a cloud-integrated content management system (CMS) configured to store AI-curated reading materials, personalized writing assignments, and NLP-processed insights into student performance, with the CMS enabling adaptive curriculum adjustments based on students' learning trajectories.

The invention relates to a robot system based on multi-mode perception cooperation and an autonomous navigation method, and the robot system comprises a main body frame which is internally integrated with a central processing unit; the multi-mode sensing module comprises a binocular vision camera, a pressure-sensitive touch array, a microphone array and a gas sensor and is used for collecting environmental data; the flexible joint mechanical arm is composed of at least three bionic joints connected in series, and a shape memory alloy driver and an air pressure feedback device are arranged in each joint. The edge computing unit is in communication connection with the central processing unit and used for processing sensing data in real time and generating action instructions, and the core problems that a traditional robot system is insufficient in sensing capacity in a complex environment, mechanical arm rigid-flexible control is unbalanced, and dynamic scene response lags are solved. And a high-adaptability and high-reliability solution is provided for industrial automation, dangerous environment inspection and other scenes.

The invention discloses a dexterous hand teleoperation method based on vision-touch fusion. The method comprises the following steps: 1) vision detection; the method comprises the following steps of (1) carrying out remote control, (2) carrying out redirection, (3) carrying out tactile grabbing, (4) carrying out vision-tactile interaction, (5) carrying out a communication process and (6) carrying out dexterous hand.The method can stably map human hand actions under the complex vision condition, safe and reliable grabbing control is achieved through tactile feedback, meanwhile, multiple dexterous hand configurations and cross-platform deployment are supported, and the precision, robustness and practicability of teleoperation can be improved.

The invention relates to an emotion accompanying robot system based on multi-dimensional perception and an interaction method, and belongs to the technical field of intelligent robots. The system comprises a sensing module which captures micro-expression, voice, body temperature, touch and other multi-source data through a biological radar array, multispectral imaging and a touch sensing fabric; the decision-making module quantifies the emotion intensity by using an emotion state calculation engine, constructs a user personalized emotion file in combination with the dynamic knowledge graph, and generates a dynamic emotion graph; and the execution module realizes anthropomorphic emotion expression through bionic face driving, joint compliance control and thermal feedback. The interaction method comprises the steps of data capture, emotion file construction, dynamic graph generation, interactive execution and feedback adjustment, definition of an emotion intensity quantification formula, a graph edge weight model and the like. According to the method, physiological signals, environment situations and bionic expression are fused, multi-modal precise emotion perception and safe interaction are achieved, man-machine naturalness is improved, the method is suitable for elderly accompanying, psychological counseling and other scenes, and the emotion accompanying effect is enhanced.

A smart busy board is provided utilizing a technology driven timer which can be set to predetermined time intervals for each of a plurality of interactive components disposed on the smart busy board. The timer mechanism and some of the interactive components are connected to electrical elements hidden within the interior housing of the smart busy board. Each of the interactive components engage the infant or toddler with some type of sensory output, such as movement, sound, light, and touch for a predetermined time interval. The busy board is designed to stimulate frontal lobe and cognitive development and improve motor skills.

Disclosed is a robotic system and method designed for the verification and validation of smart connected Human-Machine Interface (HMI) devices. The robotic system integrates a multi-finger modular robotic module, a haptic module, a finger actuator, vision cameras, vision lights, a finger rotary module, a Cartesian robotic arm, an onboard user interface, and an L-shaped door. The method involves replicating human finger interactions, simulating touch sensations on a device under test (DUT), ensuring continuous and reliable operation, utilizing vision cameras for navigation and verification, optimizing vision with controlled lighting, positioning cameras strategically, executing various tasks with a robotic arm, and facilitating user interaction through an onboard interface.

The invention belongs to the field of intelligent rehabilitation medical instruments, and particularly relates to a brain-computer interface-based multi-modal child sensory integration training device, which comprises a brain-computer interface head ring, an intelligent touch floor and AR interactive glasses, the brain-computer interface head ring is connected with a biological signal acquisition module, the intelligent touch floor is connected with a motion trail analysis unit, the AR interactive glasses are connected with a universe scene engine, and the biological signal acquisition module, the motion trail analysis unit and the universe scene engine are connected with a digital twin generator. The digital twin generator is connected with a dynamic mode switching decision tree, and the dynamic mode switching decision tree is connected with a multi-mode feedback actuator; the brain-computer interface head ring is located on the head of the child and collects electroencephalogram, myoelectricity and electrocardiosignals through a biological signal collection module; and the biological signal acquisition module sends a signal to the digital twin generator through wireless transmission. According to the invention, the training efficiency can be improved, the evaluation dimension can be expanded, potential safety hazard early warning can be realized, and the compliance can be enhanced.

An electronic device displays a palette user interface in response to receiving one or more inputs from an electronic stylus that is communicatively coupled to an electronic device. In some embodiments, the electronic device displays the palette user interface at a spatial arrangement that is based on a pose of the stylus at the time that the input to initiate display of the palette user interface is received. In some embodiments, the electronic device generates at the electronic stylus a tactile output having one or more tactile output characteristics based on characteristics of the one or more inputs from the electronic stylus. In some embodiments, the palette user interface includes one or more selectable options that when selected, initiate a process to display one or more additional user interfaces for configuring the output that is generated by the device in response to stylus inputs.

The invention provides a multi-mode virtual-real fusion interaction method and system, and particularly relates to the technical field of man-machine interaction. According to the method, hand three-dimensional coordinate data are collected through a depth perception camera, voice data are collected through a microphone array, the hand data are input into a gesture recognition model to output operation intention parameters, real-time state data of virtual equipment are obtained according to the operation intention parameters, tactile feedback parameters are generated, and the real-time state data of the virtual equipment are obtained after linear mapping association. And generating a vibration waveform and outputting to the touch execution unit. And meanwhile, analyzing the voice data to obtain a voice instruction, and performing space-time alignment on the voice instruction and the operation intention parameter to generate a virtual-real synchronous control instruction. According to the method, the technical problems of how to realize touch feedback of linkage of gesture operation and the equipment state through a low-cost and low-delay natural interaction mode and how to improve the multi-mode instruction cooperation capability so as to reduce the misoperation rate are solved, and accurate touch feedback of linkage of gesture operation and the virtual equipment state is realized; and the multi-mode instruction cooperation capability is improved, and the misoperation rate is remarkably reduced.

The invention relates to a robot-assisted surgery system, in particular to a force feedback monitoring method, medium and system for multi-sensor data fusion based on deep learning, and the method comprises the following steps: obtaining the magnitude and direction of the force applied by a tool, and the acceleration change during vibration and movement; preprocessing the data and performing feature extraction; inputting the extracted spatial features into a deep learning model for time sequence processing; judging a current stage state according to a result obtained by processing the deep learning model, and adjusting a transfer correction coefficient; and carrying out force feedback on the corrected force feedback result. Compared with the prior art, the problem that in the prior art, the touch sense of a doctor cannot be simulated during fine operation, so that surgical operation only depends on experience and visual speculation of the doctor is solved. According to the scheme, in combination with multi-sensor data, micro force changes in an operation are processed and analyzed in real time through a deep learning algorithm, and therefore the accuracy and safety of the system are improved.

In one embodiment, a method receiving, at a processing device of a vocational mask, first data pertaining to instructions for performing a task using a tool; transmitting, via a haptic interface communicatively coupled to the processing device of the vocational mask, the first data to a peripheral haptic device associated with the tool to cause the peripheral haptic device to implement the instructions by at least vibrating in accordance with the instructions to guide a user to perform the task using the tool; responsive to the peripheral haptic device implementing the instructions, receiving feedback data pertaining to gestures, motions, surfaces, temperatures, or some combination thereof, wherein the feedback data is received from the peripheral haptic device, and the feedback data comprises information pertaining to the user's compliance with the instructions for performing the task; and transmitting, to the computing device, the feedback data.

The invention provides a tactile sensor and a device with the tactile sensor, the tactile sensor comprises a shell, a shooting assembly, a touch layer and a reflecting piece, a transparent part is arranged on the shell, and the touch layer is connected with one end, far away from the shell, of the transparent part; the touch layer comprises one or more specific patterns, the reflecting part is arranged in the shell and faces the touch layer, an inclination angle is formed between the plane where the reflecting part is located and the plane where the touch layer is located, and the inclination angle ranges from 15 degrees to 65 degrees; the shooting assembly is arranged in the shell, and the shooting end of the shooting assembly faces the reflecting part. According to the touch screen, the deformation of the specific pattern on the touch layer when the touch layer is in contact with the object is reflected to the shooting assembly through the reflecting piece, so that the shooting assembly analyzes the changed pattern through an advanced image processing algorithm to generate detailed touch information; and by adjusting the relative angle among the reflecting piece, the touch layer and the shooting assembly, the overall thickness of the touch sensor is effectively reduced, the overall size is reduced, and the application range is wider.

The invention relates to the technical field of touch screens, and discloses a touch screen virtual key feedback method, device and equipment, and the method comprises the steps: carrying out the normalization processing of touch data collected by a touch screen, obtaining a standardized position matrix and a standardized pressure matrix, and constructing a touch response matrix; performing singular value decomposition and reconstruction operation on the touch response matrix to obtain a reconstruction matrix; classifying the touch points according to the reconstruction matrix to obtain a touch track, and performing region area calculation and pressure distribution center calculation to obtain a touch feature descriptor; establishing a target touch response equation according to the touch feature descriptors; performing signal linearization processing and interference compensation to obtain a compensated touch signal; according to the method, feedback parameters are calculated, stability constraint calculation is conducted on the feedback parameters, virtual key feedback signals are output, accurate control over the virtual key feedback intensity is achieved, and the sense of reality and operation experience of tactile feedback are improved.

The invention discloses a flexible touch sensor capable of distinguishing a force direction and a preparation method thereof. The sensor comprises a force loading layer, a force amplification block, a test electrode, a piezoresistive layer, a reference electrode and a substrate, the piezoresistive layer is of a micro-pyramid structure; the bottom surface of the force loading layer is fixedly connected with the force amplification block and the substrate respectively; the piezoresistive layer is cross-shaped and is arranged between the reference electrode and the test electrode; the test electrode is of a cross-shaped structure, and the tail part of each channel forms an electrode of the sensor; the piezoresistive layer is tightly attached to the reference electrode and the test electrode respectively; the force amplification blocks are distributed corresponding to the four channels of the test electrode; a wire hole is formed in the substrate, and a wire of the reference electrode penetrates out of the wire hole. According to the invention, high-sensitivity detection of shear forces and normal pressures in different directions is realized, and simultaneous detection of directions and magnitudes of forces is realized.

A piezoelectric sensing module includes a polyvinylidene fluoride (PVDF) piezoelectric film, a first electrode layer that includes multiple receiver electrodes arranged in a first pattern enabling a sensing of a position of an input object on a touch surface using the PVDF piezoelectric film, and a second electrode layer that includes at least one common electrode. The PVDF piezoelectric film is arranged between the first electrode layer and the second electrode layer, with the second electrode layer between the PVDF piezoelectric film and the touch surface.

The invention discloses a multi-task dexterous hand operation method based on self-adaptive two-way distillation, which comprises the following steps of: constructing a plurality of single-task expert strategies based on vision-touch pre-training, and collecting state-action tracks of a high-degree-of-freedom dexterous manipulator on various operation tasks; on-line distillation is utilized to distill multi-task expert data into a unified diffusion strategy sharing perception characterization and task coding, and modeling action multi-modal distribution is generated through diffusion type actions; a self-adaptive routing network is introduced, supervision weights of all experts are dynamically distributed according to the current observation state, and weighted distillation of the mixed experts is achieved; and after the performance of the unified strategy is superior to that of experts, performing reverse distillation on the unified diffusion strategy into expert strategies of all tasks by adopting action-reward combined constraint, and performing two-way iterative distillation circulation. Through forward and reverse knowledge migration between a unified strategy and a task expert, the problems of observation distribution offset and task imbalance in multi-task dexterous operation can be effectively relieved.

The invention provides an interactive interface design parameterization method guided by tactile feedback. The method comprises the following steps: acquiring physiological features, use habits and use scene information of a user, and presetting basic tactile feedback parameters according to a scene-parameter mapping rule; during interaction, touch parameters such as vibration frequency and amplitude are dynamically adjusted based on user operation behaviors, physiological reactions and scenes by using a deep learning model; and meanwhile, a multi-modal parameter fusion model is established, so that tactile, visual and auditory parameters have a synergistic effect, for example, when a button is clicked, the three parameters are mutually associated to enhance a feedback effect. After the operation is completed, the feedback effect is evaluated through objective indexes such as the subjective score of the user and the operation accuracy, and the user personalized model and the parameter adjustment model are optimized. According to the method, the problems that traditional parameters are fixed, and multi-modal fusion is insufficient are solved, accurate and personalized man-machine interaction is achieved, and the user experience is improved.

Examples of the disclosure include at least one non-transitory computer-readable medium storing instructions for operating a system including a furniture apparatus and stimulation devices, the instructions configured to instruct at least one processor to receive a user selection of one of a plurality of stimulation routines; determine, based on the selection, first stimulation parameters for a first stimulation device of a first type including one of haptic, sound, visible-light, and electromagnetic-radiation stimulation; determine, based on the selection, second stimulation parameters for a second stimulation device of a second type different than the first and including one of haptic, sound, visible-light, and electromagnetic-radiation, the second set being synchronized to a target synchronization frequency; and provide first and second control signals to the first and second stimulation device, respectively, the first signals including the first stimulation parameters and the second signals including the second stimulation parameters.

The embodiment of the invention discloses a pressure touchpad and a pressure sensing detection method thereof, and relates to the technical field of touchpads, the pressure touchpad comprises a substrate layer, an FPC, a touch layer, a touch sensing layer and a piezoelectric layer; the touch layer is arranged above the touch control sensing layer; the touch sensing layer is arranged above the substrate layer; the piezoelectric layer is arranged below the substrate layer; the FPC is arranged on one side of the substrate layer, and the FPC is electrically connected with the touch net and the piezoelectric layer; wherein the piezoelectric layer vibrates under the excitation of an electric signal of the FPC; the piezoelectric layer receives external force above the piezoelectric layer to deform and generate an electric signal; and the touch sensing layer is used for sensing capacitance change to generate an electric signal. The pressure touch panel is simple in structure, the thickness is greatly reduced, and the cost is also reduced.

Embodiments are directed to a wearable audio device, such as an earbud. The earbud may be configured to detect input using various sensors and structures. For example, the earbud may be configured to detect gestures, physical manipulations, and so forth performed along or on the earbud. In response to the detected inputs, the earbud may be configured to change various outputs, such as an audio output or a haptic output of the device. The earbud may also include a microphone to register voice commands. In some cases, the microphone may be used to control the earbud using the registered voice command in response to one or more detected gestures or physical manipulations.

The invention provides a touch feedback control method and device for a rotary knob, electronic equipment and a medium, and belongs to the technical field of switch control. The method comprises the following steps: converting a current Ia, a current Ib and a current Ic in a three-phase static coordinate system into a current Ialpha and a current Ibeta of a two-phase static coordinate system; the current I alpha and the current I beta of the two-phase static coordinate system are converted into current Id and current Iq under a two-phase rotating coordinate system with rotor flux linkage as orientation; the convergence speed of the driving motor in the dynamic response process is controlled and optimized by adopting a sliding mode variable structure; performing real-time setting through a zebra optimization algorithm to minimize overshoot and optimize convergence time; and the magnitude of the rotation feedback damping force is controlled by adjusting the current Iq. In this way, active rotating tactile feedback and pressing tactile feedback can be provided, and the intelligent interaction degree is improved.

The invention discloses a dexterous hand general grabbing method and device based on single-visual-angle vision and demonstration optimization, and relates to the field of dexterous hand grabbing and artificial intelligence. The method comprises the following steps: firstly, building a real field scene and teleoperation equipment, and collecting expert data of objects with multiple sizes and shapes; and in combination with the collected expert data, on the basis of an algorithm obtained by improving a DAPG algorithm, a general grabbing strategy of cross-object shape primitives is learned in combination with domain randomization operation in a simulation environment. Geometric features of an unknown object are analyzed in real time through the first visual angle visual information, an initial grabbing track is generated, the grabbing force and posture are adjusted by fusing dynamic feedback of a force touch sensor, and high-generalization and high-reliability grabbing is carried out. The problems that a traditional method depends on a large amount of real expert data, a large amount of object model training is needed, strategy generalization is poor, and simulation migration stability is insufficient are solved.

The embodiment of the utility model discloses an electromagnetic touch sensing device, a screen component, electronic equipment and a touch system, an electromagnetic touch screen is provided with a plurality of electrodes extending along a first direction, and at least two electrodes are coupled through an impedance module, so that a loop is formed between the two coupled electrodes. Then the voltage sampling module is used for collecting the voltage on the impedance module, a voltage signal reflecting the magnitude of the current in a loop of the two electrodes can be obtained, and the direction of the voltage on the impedance module between the two electrodes is determined due to the fact that the directions of the current in the sensing coil are the same; therefore, the position of the electromagnetic pen can be reflected by the position of the maximum voltage value, and a sampling mode in which the directions of currents on multiplexed electrodes between adjacent sensing coils are opposite due to direct current sampling and the position of the electromagnetic pen cannot be determined by the position of the maximum current signal is adopted. According to the embodiment of the invention, the position of the electromagnetic pen can be accurately judged through the voltage sampling signal of the voltage sampling module.

Computing devices and methods for determining a force applied to a user input device are disclosed. In one example, a computing device comprises a user input device comprising a touch surface, a haptic actuator coupled to the touch surface, and an accelerometer coupled to the touch surface. The computing device receives a touch input from the touch surface and drives the haptic actuator with a force detection driving signal to cause an acceleration in the touch surface. The computing device measures the acceleration using a signal from the accelerometer and uses at least the acceleration to determine a force of the touch input on the touch surface.

The invention relates to a foot type robot terrain perception modeling method fusing vision and touch, and belongs to the technical field of walking control of foot type cross-country robots. According to the method, comprehensive perception of a geometric structure, mechanical properties and material characteristics of a terrain is realized by integrating various sensor data, and a local terrain model is established on the basis, so that passable characteristics of an unknown road surface in front are predicted, and finally autonomous selection of a safe area in a complex environment is helped to be realized by the foot-type robot.

Method starts with processor causing virtual reality (VR) interface for communication session to be displayed on first user interface of a first head-wearable apparatus and on second user interface of second head-wearable apparatus. Processor detects first touch input from first VR input device and second touch input from second VR input device. Processor monitors location of the first touch input within the first user interface and location of the second touch input within second user interface. Processor determines distance between location of the first touch input within first user interface and location on first user interface corresponding to location of second touch input within second user interface. Processor causes first and second VR input devices to generate haptic feedback response based on the distance. Haptic feedback response increases in intensity or speed as distance decreases and decreases in intensity or speed as distance increases. Other embodiments are described herein.

The invention discloses a multi-sensory interaction display system based on the Internet, and the system comprises a multi-sensory data collection layer which carries out the synchronous collection of visual, auditory, touch and temperature data, carries out the preprocessing of the collected multi-modal data, and generates a multi-modal data package with a unified timestamp; the multi-modal data coding and transmission layer is used for compressing a multi-modal data packet based on a space-time joint coding algorithm and transmitting the multi-modal data packet through a low-delay transmission protocol; the terminal rendering and interaction layer is used for generating user interaction feedback in real time by adopting a dynamic multi-sensory fusion algorithm; and the edge-cloud cooperative computing layer is used for realizing low-delay feedback control and privacy protection based on a federated learning distributed computing framework. According to the invention, through layered decoupling and cross-layer optimization, strong space-time consistency of multi-modal interaction is realized, and through three innovative technologies of space-time joint coding, dynamic multi-sensory fusion and low-delay tactile control, high-fidelity and low-delay multi-sensory interaction is realized.

There is disclosed a modular sensory platform for generating an experience for a guest on the platform located on an event floor of a venue. At least one deck module may each include a frame with a bottom side for mounting to the event floor, a side edge bordering the frame, and a standing surface opposite the bottom for supporting the guest. Lift actuators may be positioned along the side edge or under the deck for changing a distance between the event floor and the standing surface according to a lift signal. One or more sensory stimuli each receivable of a stimulus signal may be mounted to the frame and include at least one of a vibration buzzer, a low-frequency transducer, smoke effects, a heater, a water spritzer, air and scent lines, an air blaster and scent emission, a haptic device, fiber optic lighting, LED lighting, and a fog unit.

The invention discloses a dexterous hand environment article sensing and modeling algorithm based on body sensing. The algorithm comprises the steps that a mechanical arm drives a dexterous hand to approach an object; tactile-spatial data acquisition: a three-axis force sensor is arranged at the tail end of each finger of the dexterous hand, and the system is in contact with an object through multiple fingers of the dexterous hand to acquire multi-dimensional information of the appearance, surface characteristics and local topology of the object; active exploration sampling, multi-finger movement of the mechanical arm and the dexterous hand, and active penetration of unknown object surface and enhanced sampling of local features through the dexterous hand by the system; the method comprises the following steps: modeling an object attribute, analyzing a mechanical response sequence obtained by tactile-spatial data acquisition and active exploration sampling, modeling a target object in three dimensions of elasticity, hardness and local geometric morphology, and realizing accurate identification and modeling of an unknown object appearance form and an object attribute in an environment. The distribution uniformity of the tactile point cloud and the model integrity are improved, the hardware dependency is reduced, and the environmental adaptability is enhanced.