Frequency-multiplexed speech-sound stimuli for hierarchical neural characterization of speech processing

a hierarchical neural and speech processing technology, applied in the field of producing frequency-multiplexed chirpspeech stimuli, can solve the problems of not being adopted by clinicians nor reimbursed, taking too long to implement in the clinic, and lack of the power to analyze the relationship between different levels of processing

Inactive Publication Date: 2020-10-15
RGT UNIV OF CALIFORNIA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

This patent presents a technology for creating synthetic sound-speech stimuli that can be used for analyzing electrical brain activity. These stimuli can provide a wide range of assessments and experimental procedures for medical practitioners and researchers. They can help diagnose and treat speech-related issues and also improve the fitting of hearing aids. The technology also includes a method for minimizing disruptions between speech and synthetic sounds to measure their interactions in the brain. Overall, it offers a more accurate and efficient tool for studying and improving speech processing in the auditory system.

Problems solved by technology

However these methods generally: 1) would take too long to implement in the clinic and therefore would neither be adopted by clinicians nor reimbursed by insurers; 2) would lack the power to analyze relations among different levels of processing; and 3) do not even use actual speech or similar complex sounds, and therefore may not be representative of speech perception in everyday experience.
One of the greatest challenges in the hearing loss industry is assessing how patients will perform in real environments, and to explain the variability among patients.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Frequency-multiplexed speech-sound stimuli for hierarchical neural characterization of speech processing
  • Frequency-multiplexed speech-sound stimuli for hierarchical neural characterization of speech processing
  • Frequency-multiplexed speech-sound stimuli for hierarchical neural characterization of speech processing

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0082]In order to demonstrate the technology, a “Functionally Integrated Speech Hierarchy” (FISH) assessment comprising a new speech stimulus corpus and advanced EEG analysis procedures was performed. For this illustration, 16 subjects with normal hearing and one subject with impaired hearing were recruited. EEG was acquired at 16 kHz with 20 channels distributed across the scalp while subjects listened attentively or watched a silent movie.

[0083]Sound attributes and analyses were jointly designed on mathematical and physiological principles to provide simultaneous but independent characterization of different levels of the ascending auditory system. The FISH assessment included multiple simultaneous measurements of the following:

[0084]1) Auditory brainstem response (ABR) to the first, last, and / or all chirps in each train. The ABR assesses neural responses from the auditory nerve through the inferior colliculus (IC), the most important integrative structure in the ascending auditor...

example 2

[0091]To further demonstrate the technology, neural responses to the same frequency-multiplexed chirp-speech stimuli were performed from a group of 17 subjects. In this example, the chirp train component was an isochronous 41 Hz series of “cochlear chirps”. These chirps compensate for the traveling wave velocity in the basilar membrane, resulting in a more synchronized neural response and larger auditory brainstem response (ABR) as well as a potentially more robust middle latency responses (MLR) and long latency responses (LLR).

[0092]FIG. 5 is a graph showing auditory brainstem response (ABR) of a test subject that was presented the frequency-multiplexed chirp-speech stimulus of Example 1. FIG. 6 is a graph of the auditory steady state response (ASSR). FIG. 7 shows middle-latency response (MLR) and FIG. 8 shows the long-latency response (LLR). FIG. 9 shows alpha power at 12 Hz over the parietal lobe, demonstrating how the stimulus can be used in conjunction with high-level perceptua...

example 3

[0093]Auditory Steady State Response (ASSR) responses for simultaneous chirp-speech stimulus signals were taken to characterize how well speech information is passed from lower to higher levels in the auditory system. FIG. 10 shows ASSRs from an ancillary demonstration where two independent chirp-speech signals were presented dichotically (simultaneously with different signal in each ear). In this case the pitches and therefore chirp rates were different between ears: 38 Hz and 43 Hz. Chirps and speech were frequency-multiplexed in opposing bands between the ears, such that a given band contained chirps for one ear and speech for the other.

[0094]From the discussion above it will be appreciated that the technology described herein can be embodied in various ways, including the following:

[0095]1. A method for generating synthetic sound-speech stimuli for analyzing electrical brain activity, the method comprising: (a) providing at least one speech corpus having a plurality of utterance...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A system and method for generating frequency-multiplexed synthetic sound-speech stimuli and for detecting and analyzing electrical brain activity of a subject in response to the stimuli. Frequency-multiplexing of speech copora and synthetic sounds helps the composite sound to blend into a single auditory object. The synthetic sounds are temporally aligned with the utterances of the speech corpus. Frequency multiplexing may include splitting the frequency axis into alternating bands of speech and synthetic sound to minimize the disruptive interaction between the speech and synthetic sounds along the basilar membrane and in their neural representations. The generated stimuli can be used with both traditional and advanced techniques to analyze electrical brain activity and provides a rapid, synoptic view into the functional health of the early auditory system, including how speech is processed at different levels and how these levels interact.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application is a divisional of U.S. patent application Ser. No. 15 / 406,047, filed on Jan. 13, 2017 and titled Frequency-Multiplexed Speech-Sound Stimuli for Hierarchical Neural Characterization of Speech Processing, which is 35 U.S.C. § 111(a) continuation of PCT International Application No. PCT / US2015 / 040629, filed on Jul. 15, 2015 and titled Frequency-Multiplexed Speech-Sound Stimuli for Hierarchical Neural Characterization of Speech Processing, which claims priority to, and the benefit of, U.S. Provisional Patent Application Ser. No. 62 / 024,646, filed on Jul. 15, 2014 and titled Frequency-Multiplexed Speech: Simultaneous Neural Characterization of Continuous Speech Processing Hierarchy in Ascending Auditory System, each of which is incorporated herein by reference in its entirety. Priority is claimed to each of the foregoing applications.[0002]The above-referenced PCT international application was published as PCT International P...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(United States)
IPC IPC(8): A61B5/00A61B5/0484A61B5/0476
CPCA61B5/0476A61B5/04845A61B5/741A61B5/38A61B5/372
Inventor MILLER, LEEMOORE, IV, BARTLETT
Owner RGT UNIV OF CALIFORNIA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products