106 results about "Multi sensory" patented technology

In some implementations a non-transitory storage device on a smartphone having a multi-sensory-recognition engine stored thereon is coupled to a microcontroller, a device-controller for an electrical device that is wirelessly coupled to the microcontroller, and at least one of a plurality of sensors is operably coupled to the microcontroller.

A mobile device includes an air conduction microphone and an alternative sensor that provides an alternative sensor signal indicative of speech. A communication interface permits the mobile device to communicate directly with other mobile devices.

Methods and systems for providing dynamic emoticons during chat sessions across game consoles are disclosed. A dynamic emoticon may include haptic, visual, and / or auditory components. Each component may have an associated intensity level, e.g., based on a pressure with which a user of the game console presses a controller button or actuates a control input. The emoticon's auditory component may include or identify a sound effects filter or a known audio file; the emoticon's visual component may include or identify a visual effects filter or a known video or graphic file; the emoticon's haptic component may cause vibration of or force feedback on the controller. Emoticons may be sent from one voice chat participant's game console to another voice chat participant's game console across a network such as the Internet.

A multisensory interface for a tele-robotic surgical control system. The invention allows the surgeon to use natural gestures and motions to control the actions of end effectors in the robotic surgical apparatus. Multiple feedback mechanisms are provided to allow the physician a more intuitive understanding of what is being controlled, along with a greater situational awareness. Prior art robotic end effectors are inserted into the patient through a small incision—as is already known in the art. The invention presents an improved method of controlling these effectors.

A mobile device includes an air conduction microphone and an alternative sensor that provides an alternative sensor signal indicative of speech. A communication interface permits the mobile device to communicate directly with other mobile devices.

A mobile device is provided that includes a digit input that can be manipulated by a user's fingers or thumb, an air conduction microphone and an alternative sensor that provides an alternative sensor signal indicative of speech. Under some embodiments, the mobile device also includes a proximity sensor that provides a proximity signal indicative of the distance from the mobile device to an object. Under some embodiments, the signal from the air conduction microphone, the alternative sensor signal, and the proximity signal are used to form an estimate of a clean speech value. In further embodiments, a sound is produced through a speaker in the mobile device based on the amount of noise in the clean speech value. In other embodiments, the sound produced through the speaker is based on the proximity sensor signal.

A computer based process for providing a visually impaired subject with multi-modal (local, remote, human-aided, computer-aided), multi-sensory (hearing, touch), information about the subject's physical environment is disclosed, involving identifying at least one guide; identifying at least one subject; establishing a communication connection between the guide and the subject; capturing information about the at least one subject's physical environment; presenting the information about the at least one subject's physical environment to the at least one guide; capturing the guide's response to the at least one subject's physical environment; and communicating the guide's response to the at least one subject. The system may involve a guide computer, a user mounted information collection system for receiving visual signals, audio input signals, and a user mounted information dispensing system for dispensing a haptic signal and an audio output signal. A bi-directional communication system operably linked between the computer, the information collection system, and the information dispensing system enables the computer to receive visual and audio signals from the user and communicates audio output signals from the guide to the user.

Methods and systems for providing dynamic emoticons during chat sessions across game consoles are disclosed. A dynamic emoticon may include haptic, visual, and / or auditory components. Each component may have an associated intensity level, e.g., based on a pressure with which a user of the game console presses a controller button or actuates a control input. The emoticon's auditory component may include or identify a sound effects filter or a known audio file; the emoticon's visual component may include or identify a visual effects filter or a known video or graphic file; the emoticon's haptic component may cause vibration of or force feedback on the controller. Emoticons may be sent from one voice chat participant's game console to another voice chat participant's game console across a network such as the Internet.

An educational software system is disclosed which includes interactive notes which automatically adapt to each student. Each note represents an individual item to learn and has an associated mastery level which is visually represented for the student. Built-in activities are provided which serve the dual purpose of providing practice and measurement in a multi-sensory, rapid response environment with immediate and specific feedback. The mastery level of each note is automatically adjusted by the student's performance. The software automatically selects notes to be practiced along with the activity to be used, thereby optimizing the student's practice time. The algorithm used for this selection takes into account such factors as the current mastery level of each note and the length of time since the note was last practiced.

An absorbent article including features facilitating toilet training of a wearer is disclosed. In particular, the absorbent articles may have one or several of a variety of multi-functional training features. These features include features designed to facility ease of application and removal of the garment such as informational graphics or slow recovery elasticized features. Other features may be designed to provide training feedback to a wearer upon a urination incident or upon remaining dry for a period of time. These features may be employed in combination in a multi-functional article to provide both multi-sensory feedback and ease of application and removal features.

A method and system for a scalable multi-sense user experience are disclosed. A three-dimensional (“3-D”) display is disposed behind a slit plane comprising slits and ultrasonic transducers. Light from the 3-D display passes through the slits in the slit plane to generate a 3-D image. The ultrasonic transducers on the front of the slit plane, i.e., opposite the side where the 3-D display is disposed, generate directed acoustic field and / or a formed tactile field. Because the generating components for all three senses, i.e., visual, audio, and tactile, are coplanar, units may be tiled and thereby scaled to generate larger multi-sense experiences.

The present invention combines a conventional audio microphone with an additional speech sensor that provides a speech sensor signal based on an input. The speech sensor signal is generated based on an action undertaken by a speaker during speech, such as facial movement, bone vibration, throat vibration, throat impedance changes, etc. A speech detector component receives an input from the speech sensor and outputs a speech detection signal indicative of whether a user is speaking. The speech detector generates the speech detection signal based on the microphone signal and the speech sensor signal.

The present invention is a wearable, multi-sensory, personal safety and tracking device which predicts danger by sensing changes in voice, pulse, emotions, impact, motion of the wearer and the device state. In emergency situations, the device triggers SOS, alarm, electro shock, pepper spray and starts capturing images and audio recording for the safety of the wearer. For keeping a track of the wearer, the device connects to the internet using GPRS and sends the images clicked, the sound recorded and the GPS and GSM coordinates to the rescue team for gaining help for the wearer if needed. In the present invention, various technologies are integrated into one single wearable device thereby eliminating the need for purchasing and carrying multiple devices like pulse monitor, motion monitor, phone, camera, GPS module, self-defense tools, etc. thus saving money and providing comfort to the user.

In some implementations a non-transitory storage device having a multi-sensory-recognition engine stored thereon is coupled to a microcontroller, a device-controller for an electrical device that is wirelessly coupled to the microcontroller, and at least one of a plurality of sensors is operably coupled to the microcontroller.

The present disclosure provides a therapeutic method applicable to learning, attention, cognitive and developmental disorders. This method combines auditory, visual and vestibular stimuli into a systematic method which can be customized to address individual learning, attention and processing disorders. This method may be wirelessly implemented in a group setting. A device for providing vestibular and somatosensory stimulation through bone conduction of sound waves to skeletal bones is provided in the form of a pad that is applied to or wrapped around the individual in treatment, which is comfortable in use and may contain particulate filler material capable of providing bone conduction stimulation adjacent to the location of a bone conduction transducer and expand the sound conduction site over a larger area.

An electronic learning / teaching device operates with and without a printed sheet element having an arrangement of selectable content by means of a user responsive sensor array beneath a surface configured to receive the element. The sensor array is formed by cross-points of two sets of crossing conductive lines, one set being driven sequentially with a radio frequency square wave and the other set being sampled sequentially though a high impedance amplifier connection with an asynchronous detection circuit. Where more than one cross-point location is user activated, algorithms are used to identify one cross-point sensor location as the user activated selection.

A method and apparatus determine a channel response for an alternative sensor using an alternative sensor signal and an air conduction microphone signal. The channel response is then used to estimate a clean speech value using at least a portion of the alternative sensor signal.

An interactive computer based system and method for multi-sensory learning to teach students to read, to write, to improve their fluency, and to improve their reading comprehension. The multi-sensory system combines phonics and reading comprehension to teach students how to decode the alphabet and understand what they read. The multi-sensory system can be individually customized and tailored to meet needs of an individual student.

The present invention combines a conventional audio microphone with an additional speech sensor that provides a speech sensor signal based on an input. The speech sensor signal is generated based on an action undertaken by a speaker during speech, such as facial movement, bone vibration, throat vibration, throat impedance changes, etc. A speech detector component receives an input from the speech sensor and outputs a speech detection signal indicative of whether a user is speaking. The speech detector generates the speech detection signal based on the microphone signal and the speech sensor signal.

Various systems and methods for introducing multi-sensory stimuli to a participant and / or evaluating a participant's reaction to a delivered stimuli. As just one example, an embodiment of the present invention includes a trochoidal movement table, a light emitting visual display, an audio device and a controller. The controller includes a processor and a computer readable medium, and the controller is coupled to the trochoidal movement table and the light emitting display. The controller is operable to receive a sensory program from a remote server and to store the sensory program to the computer readable medium. The sensory program includes instructions executable by the processor to cause the trochoidal movement table to move in one of at least two selectable directions, and to cause the light emitting visual display to emit a visual stimulus.

A system for improving a breathing pattern with an interactive multi-sensory approach is provided. The system includes a breathing condition detector and a processor, for guiding a user to learn a suitable breathing pattern. The breathing condition detector attached to the user, is adapted to detect a breathing condition according to a natural expansion or a natural shrinkage of a body of the user. The breathing condition at least includes a breathing mode (breast breathing or belly breathing), breathing rate, and breathing depth. The processor displays a relative breathing condition picture reflecting the detected breathing condition detected by the breathing condition detector on a monitor. As such, the user can understand the practical breathing condition by viewing the breathing condition picture, so as to be instructed to learn to use a breathing pattern suitable for him.

A baby monitor for monitoring sounds wherein the monitor comprises a first base and a second base each having a microphone for detecting sound and a radio component for broadcasting the detected sound as a unique radio signal unique to each base. The baby monitor also has a receiver which contains a speaker for broadcasting a reproduction of the detected sound, a first indicator light to indicate if the unique radio signal is a first unique radio signal, a second indicator light to indicate if the unique radio signal is a second unique radio signal, and a vibrating motor which issues a first vibratory alert when a first unique radio signal is received and a second vibratory alert when a second unique radio signal is received.

A voxel database can store and manage a set of voxel records in a voxel table. Each of the records can have a unique voxel identifier. Each voxel record can include a set of different sensory attributes. The sensory attributes can include visual attributes, spectral signature attributes, olfaction attributes, audition attributes, gustation attributes, somatsensory attributes, and material composition attributes. Uniquely defined voxels of voxel database can be a volume unit on a grid (regular or non-regular) in three dimensional space, which is a voxel space. A correspondence can exist between voxels in the voxel space and volume units of a real world volumetric space from which geospatial data was directly gathered and encoded within the voxel database. Voxel space can be mapped to simulation space. Thus, simulators can consume data of the voxel space to generate three dimensional immersive environments having multisensory output.

The present invention combines a conventional audio microphone with an additional speech sensor that provides a speech sensor signal based on an input. The speech sensor signal is generated based on an action undertaken by a speaker during speech, such as facial movement, bone vibration, throat vibration, throat impedance changes, etc. A speech detector component receives an input from the speech sensor and outputs a speech detection signal indicative of whether a user is speaking. The speech detector generates the speech detection signal based on the microphone signal and the speech sensor signal.

A multi-sensory feedback learning system is provided for helping children learn outside of the classroom. The system includes a depressible game controller mat that is in communication with a monitor or television. Housed within the controller mat are components necessary to store and run a learning video game. Games involving alphabetical characters, numerical characters, and foreign languages are available for children to play via the system. Prompts are displayed on the monitor or audibly through a monitor coupled audio feedback device. Children respond to the prompt by depressing alphanumeric indicia on the controller mat, thereby making answer selections. Feedback on answers is provided in the form of visual, audible, and tactile output from the system. Correct answers are rewarded with points, and a child's total score can be tracked for progress comparison.

A human head portrait robot having facial expression and multi-sensory function belongs to the robot application technical field, for resolving the problems of prior robots such as single expression and no multi-sensory function. The robot body comprises a motion drive mechanism, an expression drive mechanism, a face shell and a face elastic skin. A motion control system comprises a steering gear controller and a plurality of steering gears; the information sensed by a multi-sensory sensing system is output to a master controller to be processed; the master controller outputs corresponding commands to the steering gear controller; the steering gear controller outputs PWM pulse to drive corresponding steering gears to rotate to appointed positions; the steering gears drive the motion drive mechanism to drive the skin at lip, thereby imitating human mouth by the robot, and the steering gears drive the expression drive mechanism to drive the elastic skin on face to realize various face expression by the robot.

An electronic learning device configured to receive in a predetermined orientation a book having an arrangement of selectable mode icons, selectable content and a page identifier. Non-volatile memory in the electronic learning device has instructions associated with each mode icon, and data associated with the selectable content. A controller is in electrical communication with a page identification sensor and a position sensor for detecting the presence of a selector. The controller is configured a) to operate in accordance with instructions associated with each mode icon, b) to determine the position of the selector when the selector is within the active range of the position sensor, c) to recognize the page identifier, and a selection by the selector of one of the selectable mode icons, the selectable indicia or the selectable content and d) to send to the electronic user interface a signal associated with the selection.

The invention provides a multi-sensory human-simulated five-finger dexterous hand and belongs to the technical field of robots. The multi-sensory human-simulated five-finger dexterous hand is composed of a palm, a thumb, an index finger, a middle finger, a ring finger, a little finger and multiple sensors, wherein the index finger and the middle finger are of the same structure, and the ring finger and the little finger are of the same structure. The multi-sensory human-simulated five-finger dexterous hand has 20 degrees of freedom in total, and the 20 degrees of freedom include 13 active degrees of freedom and 7 passive degrees of freedom. Each finger is formed by connecting a basic-end joint, a basic-end knuckle, a near-end joint, a near-end knuckle, a middle-end joint, a middle-end knuckle, a far-end joint, a far-end knuckle and a finger tip in sequence. The basis ends of all the fingers are connected with a driving module located on the outer side of the palm through a plurality of tendons. The driving module transmits power to all the fingers in a rope meridian driving mode. A control system acquires signals of the sensors and conducts closed-loop control over the dexterous hand. The 31 sensors in total include arrayed tactile sensors and angular sensors located at the finger tips, the knuckles and the palm. The multi-sensory human-simulated five-finger dexterous hand has the advantages of being strong in sensory ability, high in human simulation degree and capable of completing grabbing tasks better.