2687 results about "Touch Senses" patented technology

A novel method provides an AI language virtual agent having self-improvement features and which uses language modeling and tree search techniques. The AI language virtual agent exchanges textual discussion with users and other simulated agents. The method includes receiving a current situational description depicting natural language user input, temperament qualities and textual tendencies of the virtual agent, and indicia regarding subject matter context of a present conversation. The indicia regarding subject matter context include textual logs from recent conversational exchanges. The current situational description includes audio, visual, and tactile inputs collected proximate to the virtual agent. The method preferably utilizes an MCTS tree search in combination with self-moving modules, one or more language models, tree search techniques outputting textual responses to the current situation description, and the virtual agent responding with textual expression to verbal input in combination with the audio, visual, tactile, and other sensory inputs.

The invention discloses an information interaction method for an intelligent robot with a body, and the method comprises the steps: S1, receiving the information which is transmitted by a user and comprises a task instruction, S2, carrying out the analysis of the information based on a context understanding module, so as to recognize the specific meaning and environment conditions of the task instruction, s3, operation corresponding to the specific meaning is executed, and execution parameters are adjusted in a specific environment to ensure that the task instruction is accurately implemented; according to the information interaction method of the intelligent robot with the body, environment perception and adaptive capacity are enhanced, various perception information such as vision, hearing and touch can be integrated, comprehensive perception of the environment is achieved, instruction understanding and execution accuracy is improved, the intelligent robot with the body can analyze complex user instructions more accurately, and user experience is improved. Through real-time multi-modal data fusion and decision optimization, the robot can realize real-time integration of different data sources in a highly dynamic scene, and the task execution efficiency and the user experience are improved.

The present invention generally relates to a virtual reality (VR) navigation system using artificial intelligence (AI), thus enabling providing of individualized and context-aware navigation experience in VR environments. It consists of an AI-inclusive central processing unit (CPU) that receives and processes real-time data from multiple hardware sensors deployed in a wearable VR headset, e.g., inertial measurement units (IMUs), eye-tracking sensors, biometric ones. This is AI-driven CPU that dynamically changes the navigation path and sensory outputs such as visual, audio, haptic based on user input / interaction & environmental context. It consists of a hand-held controller with numerous input interfaces and a wireless communication module, enabling it to be easily linked or integrated into several VR applications.

A user interface for a vehicle includes a base display, a vibrotactile haptic actuator coupled to the base display, and a force sensor coupled to the base display. The user interface also includes an outer layer coupled to the base display. The outer layer is configured to generate surface friction haptic feedback.

A virtual reality (VR)-based system for improving students' reading comprehension and writing skills. The system includes: a VR headset with an integrated eye-tracking system, high-resolution stereoscopic displays and spatial audio output, where the eye-tracking system detects reading patterns, fixation points and saccadic movements to assess reading engagement; a pair of motion tracking gloves with embedded pressure-sensitive capacitive sensors and haptic feedback actuators, allowing students to work with virtual reading material, perform handwriting exercises, and receive tactile reinforcement of text-based interactions; an adaptive learning module based on artificial intelligence (AI) that is configured to dynamically adjust reading complexity and writing exercises, responding to real-time metrics for interaction with students, with the AI ​​module using deep learning-based natural language processing (NLP) models to analyze reading fluency, written coherence, and syntactic complexity; a speech recognition and synthesis subsystem comprising a neural network-based acoustic model and a phoneme segmentation processor, wherein the subsystem assesses pronunciation accuracy, fluency, and articulation deviations by analyzing phonetic waveforms of spoken responses; a multimodal interactive interface that enables students to interact with virtual reading environments via a combination of hand tracking, voice commands and eye-controlled text selection, with the interface allowing students to highlight, comment on and orally summarize text content; A real-time dashboard for teacher monitoring, which is communicatively connected to the VR system. The dashboard offers educators detailed analyses of student comprehension patterns, writing progress, and AI-generated adaptive learning recommendations; and a cloud-integrated content management system (CMS) configured to store AI-curated reading materials, personalized writing assignments, and NLP-processed insights into student performance, with the CMS enabling adaptive curriculum adjustments based on students' learning trajectories.

At least one electrical brain signal is received from a patient and is demultiplexed into an efferent motor intention signal and at least one afferent sensory signal (such as an afferent touch sense signal and / or an afferent proprioception signal). A demultiplexed afferent touch sense signal may be used to control a haptic device.

Disclosed are an affective haptic regulation system and method based on multimodal fusion, including a haptic optimal parameter adjustment module, a haptic generation module, a visual-auditory generation module, a multi-physiological signal acquisition module, a multi-sensory signal acquisition module, and a multimodal fusion emotion recognition module. The system can fuse multi-physiological signal features with audio and haptic modal features by acquiring a plurality of physiological signals of a user, accurately identify a current affective state of the user in real time through advanced data processing and analysis technology, seek for a haptic parameter with the help of an optimization theory, and achieve proactive regulation of affective state of the user; and the system can overcome the limitations of traditional subjective scale methods, effectively reduce the influence of unstable physiological signals on emotion recognition results, and significantly improve the accuracy of affective detection in the affective haptic regulation system.

The invention relates to the technical field of manipulator control, in particular to a multi-dimensional force touch sense self-adaptive grabbing dexterous hand control system and a multi-dimensional force touch sense self-adaptive grabbing dexterous hand control method. The control system comprises an upper computer, a dexterous hand master controller module, a finger controller module, a three-dimensional force tactile sensor module and an actuator module, wherein the finger controller module, the three-dimensional force tactile sensor module and the actuator module are independently configured for each finger of the dexterous hand; wherein the dexterous hand master controller receives an instruction of an upper computer and generates a control instruction corresponding to each finger; the three-dimensional force tactile sensor monitors contact data of a finger and an object; the finger controller calculates target positions of the servo motor at different time points based on the control instruction, the contact data and actuator state feedback, and generates a third control instruction; and after receiving the instruction, the actuator module adjusts the position of a servo motor to ensure that the dexterous hand completes self-adaptive grabbing according to a preset track and force. The grabbing force and speed of the dexterous hand can be adjusted in a self-adaptive mode according to different conditions, and the accuracy and stability of the grabbing action are ensured.

Systems and methods are presented herein for balancing rendering of haptics and graphics of a version of media content from a server at a client device. At a server, a request is received for a media asset for interaction on a haptic enabled device. Based on the request, haptic feedback settings of the haptic enabled device associated with the request are determined. The server transmits to the haptic enabled device a version of the media asset comprising haptic feedback rendering criteria compatible with the haptic enabled device. The version of the media asset is comprised of graphics and haptics rendering criteria transmittable over a current network connection strength between the server and the haptic enabled device and also incorporates user interaction data. The haptic enabled device renders the version of the media asset based on the haptic feedback settings.

Embodiments are directed to in-bed haptic systems including a pneumatic pad configured for placement between a user and a bed. The pneumatic pad can include an array of actuation cells, where each actuation cell in the array of actuation cells is configured to actuate in response to fluid being introduced into the actuation cell. The system can include an input device that includes a touch sensitive display and is configured to display a set of haptic sequences that can be applied to the array of actuation cells in a user interface of the input device and receive an input at the touch sensitive display of a selected haptic sequence. The system can include a control system that receives an indication of the selected haptic sequence and actuates actuation cells of the array of actuation cells using the selected haptic sequence and the pressure measurements.

The invention provides an interactive tactile glove system for astronaut training. The interactive tactile glove system comprises an upper computer virtual environment, a lower computer tactile perception glove and a tactile representation glove. The touch sensing glove is used for collecting temperature, humidity and pressure information of a hand and transmitting the information to the upper computer for processing through Bluetooth. The upper computer virtual environment is built based on a Unity 3D platform, various task scenes can be simulated, and corresponding tactile feedback signals are generated and transmitted. The tactile representation glove receives data transmitted by a virtual environment or the tactile perception glove, and real-time representation of temperature, force feedback and motion postures is achieved through an integrated semiconductor cooler, a vibration element, a bending sensor and other assemblies. According to the system, multi-modal tactile feedback can be provided in single astronaut fine operation training and cooperative operation of multiple astronauts, and the training effect and team adaptability are improved. The system not only has high integration level and stability, but also can provide multi-level and multi-mode tactile simulation according to task requirements, and is suitable for accurate training and remote operation in a complex task environment.

A sensor head transitions between a retracted and extended state. While retracted, sensors are covered. While extended, the sensors are exposed and may be used to acquire sensor data about the physical space. A force applied by a user, or a received command, may initiate transition. For example, a user may press on the sensor head to initiate retraction or extension. A motor provides a force to move the sensor head and generate haptic feedback, while a position encoder determines a displacement of the sensor head due to an external force being applied. Different applications of force by the user to the sensor head may result in different operations by the device. For example, a short push may retract the sensor head and disable the sensors for a specified time interval. In comparison a long push may retract the sensor head and disable the sensors until a specified clock time.

The invention relates to a robot system based on multi-mode perception cooperation and an autonomous navigation method, and the robot system comprises a main body frame which is internally integrated with a central processing unit; the multi-mode sensing module comprises a binocular vision camera, a pressure-sensitive touch array, a microphone array and a gas sensor and is used for collecting environmental data; the flexible joint mechanical arm is composed of at least three bionic joints connected in series, and a shape memory alloy driver and an air pressure feedback device are arranged in each joint. The edge computing unit is in communication connection with the central processing unit and used for processing sensing data in real time and generating action instructions, and the core problems that a traditional robot system is insufficient in sensing capacity in a complex environment, mechanical arm rigid-flexible control is unbalanced, and dynamic scene response lags are solved. And a high-adaptability and high-reliability solution is provided for industrial automation, dangerous environment inspection and other scenes.

Method starts with processor causing virtual reality (VR) interface for communication session to be displayed on first user interface of a first head-wearable apparatus and on second user interface of second head-wearable apparatus. Processor detects first touch input from first VR input device and second touch input from second VR input device. Processor monitors location of the first touch input within the first user interface and location of the second touch input within second user interface. Processor determines distance between location of the first touch input within first user interface and location on first user interface corresponding to location of second touch input within second user interface. Processor causes first and second VR input devices to generate haptic feedback response based on the distance. Haptic feedback response increases in intensity or speed as distance decreases and decreases in intensity or speed as distance increases. Other embodiments are described herein.

The invention discloses a dexterous hand teleoperation method based on vision-touch fusion. The method comprises the following steps: 1) vision detection; the method comprises the following steps of (1) carrying out remote control, (2) carrying out redirection, (3) carrying out tactile grabbing, (4) carrying out vision-tactile interaction, (5) carrying out a communication process and (6) carrying out dexterous hand.The method can stably map human hand actions under the complex vision condition, safe and reliable grabbing control is achieved through tactile feedback, meanwhile, multiple dexterous hand configurations and cross-platform deployment are supported, and the precision, robustness and practicability of teleoperation can be improved.

The invention relates to an emotion accompanying robot system based on multi-dimensional perception and an interaction method, and belongs to the technical field of intelligent robots. The system comprises a sensing module which captures micro-expression, voice, body temperature, touch and other multi-source data through a biological radar array, multispectral imaging and a touch sensing fabric; the decision-making module quantifies the emotion intensity by using an emotion state calculation engine, constructs a user personalized emotion file in combination with the dynamic knowledge graph, and generates a dynamic emotion graph; and the execution module realizes anthropomorphic emotion expression through bionic face driving, joint compliance control and thermal feedback. The interaction method comprises the steps of data capture, emotion file construction, dynamic graph generation, interactive execution and feedback adjustment, definition of an emotion intensity quantification formula, a graph edge weight model and the like. According to the method, physiological signals, environment situations and bionic expression are fused, multi-modal precise emotion perception and safe interaction are achieved, man-machine naturalness is improved, the method is suitable for elderly accompanying, psychological counseling and other scenes, and the emotion accompanying effect is enhanced.

A touch sensing apparatus is disclosed, comprising a light transmissive panel that defines a touch surface, an opposite rear surface, and panel sides extending between the touch surface and rear surface. The panel sides define a perimeter of the light transmissive panel. The touch sensing apparatus comprises a plurality of light emitters and detectors arranged along the perimeter and adjacent the panel sides, a light guide arranged along the perimeter and having a first reflective surface comprising a diffusive light scattering element. The light emitters are arranged to emit a respective beam of light onto the diffusive light scattering element so as to generate propagating light that diffusively propagates above the touch surface, wherein the light detectors are arranged to receive detection light generated as said propagating light impinges on the diffusive light scattering element, and wherein the diffusive light scattering element is arranged at least partly outside the panel sides and extending at least partly above the touch surface.

Universal switch modules, universal switches, and methods of using the same are disclosed, including haptic confirmation of commands generated by the user, methods of preparing an individual to interface with an electronic device or software.

A smart busy board is provided utilizing a technology driven timer which can be set to predetermined time intervals for each of a plurality of interactive components disposed on the smart busy board. The timer mechanism and some of the interactive components are connected to electrical elements hidden within the interior housing of the smart busy board. Each of the interactive components engage the infant or toddler with some type of sensory output, such as movement, sound, light, and touch for a predetermined time interval. The busy board is designed to stimulate frontal lobe and cognitive development and improve motor skills.

In a method for virtual reality (VR) interaction, a plurality of virtual objects in a VR environment is displayed. The plurality of virtual objects includes at least a first virtual object controlled by a first user and a second virtual object controlled by a second user. In response to an interaction initiated by the first virtual object towards the second virtual object, haptic feedback is triggered through a VR device worn by the second user. Apparatus and non-transitory computer-readable storage medium counterpart embodiments are also contemplated.

Method for generating haptic feedback responses starts with processor causing communication interface for communication session to be displayed on first user interface and on a second user interface. Processor detects first touch input on first user interface. Processor causes second user interface to display first indicator element at location on second user interface of second client device corresponding to location of first touch input on first user interface. First indicator element is displayed for a predetermined period of time. Processor detects second touch input on second user interface. In response to determining that location of the second touch input on second user interface corresponds to location of first indicator on second user interface and determining that second touch input on second user interface is detected within predetermined period of time, processor causes first user interface and second user interface to generate haptic feedback response. Other embodiments are described herein.

Disclosed is a robotic system and method designed for the verification and validation of smart connected Human-Machine Interface (HMI) devices. The robotic system integrates a multi-finger modular robotic module, a haptic module, a finger actuator, vision cameras, vision lights, a finger rotary module, a Cartesian robotic arm, an onboard user interface, and an L-shaped door. The method involves replicating human finger interactions, simulating touch sensations on a device under test (DUT), ensuring continuous and reliable operation, utilizing vision cameras for navigation and verification, optimizing vision with controlled lighting, positioning cameras strategically, executing various tasks with a robotic arm, and facilitating user interaction through an onboard interface.

The invention belongs to the field of intelligent rehabilitation medical instruments, and particularly relates to a brain-computer interface-based multi-modal child sensory integration training device, which comprises a brain-computer interface head ring, an intelligent touch floor and AR interactive glasses, the brain-computer interface head ring is connected with a biological signal acquisition module, the intelligent touch floor is connected with a motion trail analysis unit, the AR interactive glasses are connected with a universe scene engine, and the biological signal acquisition module, the motion trail analysis unit and the universe scene engine are connected with a digital twin generator. The digital twin generator is connected with a dynamic mode switching decision tree, and the dynamic mode switching decision tree is connected with a multi-mode feedback actuator; the brain-computer interface head ring is located on the head of the child and collects electroencephalogram, myoelectricity and electrocardiosignals through a biological signal collection module; and the biological signal acquisition module sends a signal to the digital twin generator through wireless transmission. According to the invention, the training efficiency can be improved, the evaluation dimension can be expanded, potential safety hazard early warning can be realized, and the compliance can be enhanced.

An electronic device displays a palette user interface in response to receiving one or more inputs from an electronic stylus that is communicatively coupled to an electronic device. In some embodiments, the electronic device displays the palette user interface at a spatial arrangement that is based on a pose of the stylus at the time that the input to initiate display of the palette user interface is received. In some embodiments, the electronic device generates at the electronic stylus a tactile output having one or more tactile output characteristics based on characteristics of the one or more inputs from the electronic stylus. In some embodiments, the palette user interface includes one or more selectable options that when selected, initiate a process to display one or more additional user interfaces for configuring the output that is generated by the device in response to stylus inputs.

A wearable electronic device may include a display and a housing. The housing may include a chassis defining a first portion of a rear exterior surface of the wearable electronic device, a first portion of a side exterior surface of the wearable electronic device, and an internal wall. The housing may also include a glass shell defining a front wall positioned over the display and defining a front exterior surface of the wearable electronic device and a side wall extending from the front wall and overlapping the internal wall, the side wall defining a second portion of the side exterior surface of the wearable electronic device. The wearable electronic device may also include a touch sensing system within the housing and configured to detect a touch input applied to the front exterior surface of the wearable electronic device.

The invention provides a multi-mode virtual-real fusion interaction method and system, and particularly relates to the technical field of man-machine interaction. According to the method, hand three-dimensional coordinate data are collected through a depth perception camera, voice data are collected through a microphone array, the hand data are input into a gesture recognition model to output operation intention parameters, real-time state data of virtual equipment are obtained according to the operation intention parameters, tactile feedback parameters are generated, and the real-time state data of the virtual equipment are obtained after linear mapping association. And generating a vibration waveform and outputting to the touch execution unit. And meanwhile, analyzing the voice data to obtain a voice instruction, and performing space-time alignment on the voice instruction and the operation intention parameter to generate a virtual-real synchronous control instruction. According to the method, the technical problems of how to realize touch feedback of linkage of gesture operation and the equipment state through a low-cost and low-delay natural interaction mode and how to improve the multi-mode instruction cooperation capability so as to reduce the misoperation rate are solved, and accurate touch feedback of linkage of gesture operation and the virtual equipment state is realized; and the multi-mode instruction cooperation capability is improved, and the misoperation rate is remarkably reduced.

The invention relates to a robot-assisted surgery system, in particular to a force feedback monitoring method, medium and system for multi-sensor data fusion based on deep learning, and the method comprises the following steps: obtaining the magnitude and direction of the force applied by a tool, and the acceleration change during vibration and movement; preprocessing the data and performing feature extraction; inputting the extracted spatial features into a deep learning model for time sequence processing; judging a current stage state according to a result obtained by processing the deep learning model, and adjusting a transfer correction coefficient; and carrying out force feedback on the corrected force feedback result. Compared with the prior art, the problem that in the prior art, the touch sense of a doctor cannot be simulated during fine operation, so that surgical operation only depends on experience and visual speculation of the doctor is solved. According to the scheme, in combination with multi-sensor data, micro force changes in an operation are processed and analyzed in real time through a deep learning algorithm, and therefore the accuracy and safety of the system are improved.

The present disclosure generally relates to user interfaces for managing peer-to-peer transfers. In some examples, a device provides user interfaces for initiating and managing transfers. In some examples, a device provides user interfaces corresponding to completed transfers. In some examples, a device provides user interfaces for providing visually distinguishable message object appearances based on message designation. In some examples, a device provides user interfaces for activating accounts for accepting and sending transfers. In some examples, a device provides user interfaces for exchanging accounts for use in a transfer. In some examples, a device provides user interfaces for splitting transfers between two or more accounts. In some examples, a device provides user interfaces for generating and displaying a transfers history list. In some examples, a device provides user interfaces for voice-activation of transfers. In some examples, a device provides visual or haptic feedback corresponding to a transfer operation.

In some embodiments, a computer mouse comprises a housing, a depressible keyplate disposed within the housing, a carrier platform including a top side and disposed within the housing, a haptic element coupled to a top side of the carrier platform, a biasing system configured to couple the carrier platform to the housing and provide a pre-loading force that pushes the haptic element coupled to the carrier platform against a bottom surface of the depressible keyplate, and a limiter element operable to physically limit a movable range of the keyplate in one direction that prevents a top surface of the keyplate to deflect past an adjacent top surface of the housing due to the pre-loading force, the top surface of the keyplate and the adjacent top surface of the housing forming a continuous contour when the depressible keyplate is in a non-depressed, neutral position.

The invention relates to the technical field of man-machine interaction and tactile rendering, in particular to a virtual friction tactile rendering method and device based on micro-current stimulation, and the method comprises the steps: obtaining friction tactile interaction information of a real object and hand action information of an interactor, and mapping the friction tactile interaction information and the hand action information to a virtual object and a virtual hand; defining friction interaction states of the virtual hand and the surface of the virtual object, and designing a tactile feedback array which provides corresponding stimulation modes for different friction interaction states; when the virtual hand starts to make contact with the surface of the virtual object, the stimulation mode is converted into the contact mode; when the virtual hand starts to slide on the surface of the virtual object, the stimulation mode is converted into a sliding mode; when the virtual hand leaves the surface of the virtual object, the stimulation mode is converted into a separation mode; an interactor perceives real surface information of various objects from three feedback channels of audio-visual touch through friction interaction processes of contact, sliding, separation and the like in a virtual scene, and immersive interaction experience is realized. The reality sense and immersion sense of the virtual friction touch sense are improved.