Cochlear implant system, method for cochlear implant system and storage medium

By exchanging audio data in a bilateral cochlear implant system and synchronizing the stimulation pulse sequence based on ITD, the problem of not being able to correctly provide ITD prompts in the prior art is solved, and the effect of tone perception and timing prompts is improved.

CN113170262BActive Publication Date: 2024-11-08COCHLEAR LIMITED
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
CN202080006333.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-10-30
Filing Date
2020-10-26
Publication Date
2024-11-08
Estimated Expiration
2040-10-26

AI Technical Summary

Technical Problem

Existing bilateral cochlear implant systems do not properly provide interaurial time difference (ITD) prompts, affecting the effect of hearing prosthesis system on tone perception and timing prompts.

Method used

By exchanging audio data between the first cochlear implant and the second cochlear implant of the bilateral cochlear implant system and performing amplitude modulation based on the fundamental frequency of the received sound signal, generating and delivering a stimulation pulse sequence, Synchronize these pulse sequences with interaurial time difference (ITD) to provide the correct ITD prompt.

Benefits of technology

Improved tone perception and provided appropriate ITD cues, enhanced functionality of the hearing prosthesis system, ensuring that the recipient can benefit from tone and timing cues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113170262B_ABST
    Figure CN113170262B_ABST
Patent Text Reader

Abstract

The present disclosure relates to cochlear implant systems, methods for cochlear implant systems, and storage media. Presented herein is a binaural hearing prosthesis system configured to provide pitch cues to a recipient at both ears while preserving / maintaining binaural timing cues.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention generally relates to hearing prosthesis systems. Background Art

[0002] Medical devices have provided a wide range of therapeutic benefits to recipients over the past several decades. Medical devices may include internal or implantable components / devices, external or wearable components / devices, or combinations thereof (e.g., devices having external components that communicate with implantable components). Medical devices such as traditional hearing aids, partially implantable or fully implantable hearing prostheses (e.g., bone conduction devices, mechanical stimulators, cochlear implants, etc.), pacemakers, defibrillators, functional electrical stimulation devices, and other medical devices have been successful for many years in performing life-saving and / or lifestyle-improving functions and / or recipient monitoring.

[0003] Over the years, the types of medical devices and the range of functions performed thereby have increased. For example, many medical devices, sometimes referred to as "implantable medical devices," now often include one or more instruments, devices, sensors, processors, controllers, or other functional mechanical or electrical components that are permanently or temporarily implanted in a recipient. These functional devices are often used to diagnose, prevent, monitor, treat, or manage disease / injury or its symptoms, or to study, replace, or modify anatomical structures or physiological processes. Many of these functional devices utilize power and / or data received from an external device that is part of or operates with the implantable component. Summary of the invention

[0004] In one aspect presented herein, a method is provided. The method includes: receiving a first set of sound signals at a first cochlear implant of a bilateral cochlear implant system; and receiving a second set of sound signals at a second cochlear implant of the bilateral cochlear implant system, wherein the first set of sound signals and the second set of sound signals are associated with the same one or more sound sources; generating a first stimulation pulse sequence based on the first set of sound signals at the first cochlear implant, wherein the first stimulation pulse sequence has an amplitude modulated using a first modulation; delivering the first stimulation pulse sequence to a first ear of a recipient of the bilateral cochlear implant system; generating a second stimulation pulse sequence based on the second set of sound signals at the second cochlear implant, wherein the second stimulation pulse sequence has an amplitude modulated using the same first modulation as the first stimulation pulse sequence; and delivering the second stimulation pulse sequence to the second ear of the recipient, wherein the second stimulation pulse sequence is delivered to the recipient with a time delay relative to the delivery of the first stimulation pulse sequence, and wherein the time delay is based on an interaural time difference (ITD) associated with the reception of the first set of sound signals at the first cochlear implant and the reception of the second set of sound signals at the second cochlear implant.

[0005] In another aspect, a cochlear implant system is provided. The cochlear implant system includes: a first cochlear implant configured to: receive a first set of sound signals associated with at least one sound source, convert the first set of sound signals into a first stimulation pulse train, wherein the first stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, and deliver the first stimulation pulse train to a first ear of a recipient of the cochlear implant system; a second cochlear implant configured to: receive a second set of sound signals associated with at least one sound source, convert the second set of sound signals into a second stimulation pulse train, wherein the second stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, and deliver the second stimulation pulse train to a second ear of the recipient with a time delay relative to the delivery of the first stimulation pulse train to the first ear of the recipient.

[0006] In another aspect, a method is provided. The method includes: receiving a first set of sound signals at a first cochlear implant of a bilateral cochlear implant system; receiving a second set of sound signals at a second cochlear implant of the bilateral cochlear implant system, wherein the first set of sound signals and the second set of sound signals are associated with the same one or more sound sources; generating a first stimulation pulse sequence based on the first set of sound signals at the first cochlear implant, wherein the first stimulation pulse sequence has an amplitude modulated using a first modulation; delivering the first stimulation pulse sequence to a first ear of a recipient of the bilateral cochlear implant system; generating a second stimulation pulse sequence based on the second set of sound signals at the second cochlear implant, wherein the second stimulation pulse sequence has an amplitude modulated using the same first modulation as the first stimulation pulse sequence; and delivering the second stimulation pulse sequence to a second ear of the recipient, wherein the second stimulation pulse sequence is delivered to the recipient with a time delay relative to the delivery of the first stimulation pulse sequence, and wherein the time delay is based on an interaural time difference (ITD) associated with the reception of the first set of sound signals at the first cochlear implant and the reception of the second set of sound signals at the second cochlear implant.

[0007] In another aspect, a cochlear implant system is provided. The cochlear implant system includes: a first cochlear implant configured to: receive a first set of sound signals generated by at least one sound source, convert the first set of sound signals into a first stimulation pulse train, wherein the first stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, and deliver the first stimulation pulse train to a first ear of a recipient of the cochlear implant system; a second cochlear implant configured to: receive a second set of sound signals generated by at least one sound source, convert the second set of sound signals into a second stimulation pulse train, wherein the second stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, determine a time delay for delivery of the second stimulation pulse train to a second ear of the recipient relative to delivery of the first stimulation pulse train to the first ear of the recipient, and deliver the second stimulation pulse train to the second ear of the recipient at a time corresponding to the time delay.

[0008] In another aspect, a non-transitory computer-readable storage medium is provided that is encoded with instructions that, when executed by one or more processors, cause the one or more processors to: generate a first stimulation pulse sequence at a first cochlear implant of a cochlear implant system, the first stimulation pulse sequence representing first audio data received at the first cochlear implant; modulate the first stimulation pulse sequence based on one or more characteristics of the first audio data and second audio data; generate a second stimulation pulse sequence at a second cochlear implant of the cochlear implant system, the second stimulation pulse sequence representing second audio data received at the second cochlear implant; and modulate the second stimulation pulse sequence based on one or more characteristics of the first audio data and the second audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Embodiments of the present invention are described herein with reference to the accompanying drawings, in which:

[0010] Figure 1A is a schematic diagram of a cochlear implant system in which embodiments presented herein may be implemented;

[0011] Figure 1B Yes Wear Figure 1A Side view of a recipient of a cochlear implant system;

[0012] Figure 1C yes Figure 1A A schematic diagram of components of a cochlear implant system;

[0013] Figure 1D and Figure 1E is formed Figure 1A A block diagram of a sound processing unit that is part of a cochlear implant system;

[0014] Figure 2is a functional block diagram of a cochlear implant system according to certain embodiments presented herein;

[0015] Figure 3 is a schematic diagram illustrating stimulation pulse timing of a cochlear implant system according to certain embodiments presented herein;

[0016] Figure 4 is a functional block diagram of another cochlear implant system according to certain embodiments presented herein;

[0017] Figure 5 is a functional block diagram of another cochlear implant system according to certain embodiments presented herein;

[0018] Fig. 6A is a functional block diagram of an audio synchronizer for a cochlear implant system according to certain embodiments presented herein;

[0019] Figure 6B is a functional block diagram of another audio synchronizer for a cochlear implant system according to certain embodiments presented herein;

[0020] Figure 6C is a functional block diagram of another audio synchronizer for a cochlear implant system according to certain embodiments presented herein;

[0021] Figure 7 is a flowchart of a method according to certain embodiments presented herein, and

[0022] Figure 8 is a flow chart of another method according to certain embodiments presented herein. DETAILED DESCRIPTION

[0023] In recent decades, medical devices and medical device systems (e.g., including multiple implantable medical devices) have provided a wide range of therapeutic benefits to recipients. For example, a hearing prosthesis system is an implantable medical device system that includes one or more hearing prostheses that operate to convert sound signals into one or more acoustic, mechanical, and / or electrical stimulation signals for delivery to a recipient. One or more hearing prostheses that may form part of a hearing prosthesis system include, for example, hearing aids, cochlear implants, middle ear stimulators, bone conduction devices, brainstem implants, electroacoustic cochlear implants or electroacoustic devices, and other devices that provide acoustic, mechanical, and / or electrical stimulation to a recipient.

[0024] A specific type of hearing prosthesis system, referred to herein as a "binaural hearing prosthesis system" or more simply a "binaural system," includes two hearing prostheses, wherein one of the two hearing prostheses is located at each ear of the recipient. More specifically, in a binaural system, each of the two prostheses provides stimulation to one of the two ears of the recipient (i.e., the right ear or the left ear of the recipient).

[0025] Proposed herein is a binaural hearing prosthesis system, such as a binaural or bilateral cochlear implant system, which is configured to provide pitch cues to a recipient at both ears while retaining / maintaining binaural timing cues. More specifically, the binaural or bilateral cochlear implant system includes first and second cochlear implants located at the first and second ears of the recipient, respectively. The first cochlear implant is configured to capture / receive a first group of sound signals and convert the first group of sound signals into a first stimulation pulse sequence to deliver to the first ear of the recipient. Similarly, the second cochlear implant is configured to receive a second group of sound signals and convert the second group of sound signals into a second stimulation pulse sequence to deliver to the second ear of the recipient. Based on the fundamental frequency (F0) of the first and second groups of sound signals associated with the same one or more sound sources, each of the first and second stimulation pulse sequences is amplitude modulated to provide pitch cues to the recipient.

[0026] Additionally, the first and second sets of sound signals are received at the first and second cochlear implants at relative timings corresponding to the relative positions of the one or more sound sources. The first and second cochlear implants are configured to synchronize delivery of the first stimulation pulse sequence to the first ear of the recipient with delivery of the second stimulation pulse sequence to the second ear of the recipient based on the relative timing, thereby providing binaural timing cues to the recipient.

[0027] It should be understood that the technology presented herein can be implemented with any of a variety of medical devices and systems, including in conjunction with cochlear implants or other hearing prostheses, balance prostheses (e.g., vestibular implants), retinal or other visual prostheses, cardiac devices (e.g., implantable pacemakers, defibrillators, etc.), epilepsy devices, sleep apnea devices, electroporation devices, spinal cord stimulators, deep brain stimulators, motor cortex stimulators, sacral nerve stimulators, pudendal nerve stimulators, sympathetic / vagus nerve stimulators, trigeminal nerve stimulators, diaphragm (septal) pacemakers, analgesic stimulators, other nerves, neuromuscular or functional stimulators, etc. However, for ease of description only, various aspects of the technology will generally be described with reference to a specific medical device system (i.e., a bilateral cochlear implant system). As used herein, a "bilateral" cochlear implant system is a system that includes a first and a second cochlear implant located at a first and a second ear of a recipient, respectively. In such a system, each of the two cochlear implant systems delivers stimulation (current) pulses to one of the two ears of the recipient (i.e., the right ear or the left ear of the recipient). In a bilateral cochlear implant system, one or more of the two cochlear implants may also deliver acoustic stimulation to the recipient's ear (e.g., an electroacoustic cochlear implant) and / or the two cochlear implants need not be identical in terms of, for example, the number of electrodes used to electrically stimulate the cochlea, the type of stimulation delivered, etc.

[0028] Figure 1A-1E is a diagram illustrating an example bilateral cochlear implant system 100 configured to implement the techniques presented herein. More specifically, Figure 1A-1E An example bilateral system 100 is illustrated that includes left and right cochlear implants referred to as cochlear implant 102L and cochlear implant 102R. Figure 1A and Figure 1B is a schematic diagram of a recipient wearing a left cochlear implant 102L at a left ear 141L and a right cochlear implant 102R at a right ear 141R, and Figure 1C is a schematic diagram of each of the left and right cochlear implants. Figure 1D and Figure 1E 102L and 102R are block diagrams illustrating further details of left and right cochlear implants, respectively.

[0029] See specifically Figure 1C , cochlear implant 102L includes an external component 104L configured to be attached directly or indirectly to the body of a recipient and an implantable component 112L configured to be implanted in the recipient. External component 104L includes a sound processing unit 106L, while implantable component 112L includes an internal coil 114L, a stimulator unit 142L, and an elongated stimulation accessory (electrode array) 116L ( Figure 1C not shown).

[0030] Cochlear implant 102R is substantially similar to cochlear implant 102L. In particular, cochlear implant 102R includes an external assembly 104R that includes a sound processing unit 106R, and an implantable assembly 112R that includes an internal coil 114R, a stimulator unit 142R, and an elongated stimulation accessory 116R.

[0031] Figure 1D is a block diagram illustrating further details of cochlear implant 102L, and Figure 1E 1 is a block diagram illustrating further details of cochlear implant 102R. As noted, cochlear implant 102R is substantially similar to cochlear implant 102L and includes the same elements as described below with reference to cochlear implant 102L. For ease of description, further details of cochlear implant 102R are omitted from the description.

[0032] As noted, external components 104L of cochlear implant 102L include a sound processing unit 106L. Sound processing unit 106L includes one or more input devices 113L configured to receive input signals (e.g., sound or data signals). Figure 1D In the example of , the one or more input devices 113L include one or more sound input devices 118L (e.g., microphone, audio input port, phone coil, etc.), one or more auxiliary input devices 119L (e.g., audio port such as direct audio input (DAI), data port such as universal serial bus (USB) port, cable port, etc.), and wireless transmitter / receiver (transceiver) 120L. However, it should be understood that the one or more input devices 113L may include more types of input devices and / or fewer input devices (e.g., the wireless transceiver 120L and / or one or more auxiliary input devices 119L may be omitted).

[0033] The sound processing unit 106L also includes a tightly coupled transmitter / receiver (transceiver) 122L (referred to as a radio frequency (RF) transceiver 122L), a power supply 123L, and a processing module 124L. The processing module 124L includes one or more processors 125L and a memory 126L, which includes binaural sound processing logic 128L. Figure 1A-1EIn the example of , the sound processing unit 106L and the sound processing unit 106R are outside-the-ear (OTE) sound processing units (i.e., components having a generally cylindrical shape and configured to be magnetically coupled to the recipient's head), etc. However, it should be appreciated that embodiments of the present invention may be implemented with sound processing units having other arrangements, such as with behind-the-ear (BTE) sound processing units configured to be attached to and worn adjacent to the recipient's ears, including mini or micro BTE units, in-the-canal units configured to be located in the recipient's ear canals, body-worn sound processing units, and the like.

[0034] The implantable assembly 112L includes an implant body (main module) 134L, a lead region 136L, and an intracochlear stimulation accessory 116L, all of which are configured to be implanted beneath the skin / tissue (tissue) 115 of a recipient. The implant body 134L typically includes an airtight housing 138L in which the RF interface circuit 140L and the stimulator unit 142L are disposed. The implant body 134L also includes an internal / implantable coil 114L, which is typically external to the housing 138L but is accessible via an airtight feedthrough (at Figure 1D ) and connected to transceiver 140L.

[0035] As noted, stimulation accessory 116L is configured to be at least partially implanted in the cochlea of ​​a recipient. Stimulation accessory 116L includes a plurality of longitudinally spaced intracochlear electrical stimulation contacts (electrodes) 144L that together form a contact or electrode array 146L for delivering electrical stimulation (electrical current) to the cochlea of ​​the recipient.

[0036] Stimulation accessory 116L extends through an opening in the recipient's cochlea (e.g., cochleotomy, round window, etc.) and has a proximal end ( 142L) connected to stimulator unit 142L via lead region 136L and an airtight feedthrough. Figure 1D 144L to the stimulator unit 142L.

[0037] As noted, cochlear implant 102L includes an external coil 108L and an implantable coil 114L. Coils 108L and 114L are typically wire antenna coils, each of which includes multiple turns of electrically insulated single or multiple strands of platinum or gold wire. Typically, a magnet is fixed relative to each of external coil 108L and implantable coil 114L. The magnets fixed relative to external coil 108L and implantable coil 114L facilitate operational alignment of external coil 108L with implantable coil 114L. This operational alignment of the coils enables external component 104L to transmit data, and possibly power, to implantable component 112L via a tightly coupled wireless link formed between external coil 108L and implantable coil 114L. In some examples, the tightly coupled wireless link is a radio frequency (RF) link. However, various other types of energy transfer, such as infrared (IR), electromagnetic, capacitive, and inductive transmission, may be used to transfer power and / or data from an external component to an implantable component, and thus, Figure 1D Only one example arrangement is illustrated.

[0038] As noted above, the sound processing unit 206L includes a processing module 124L. The processing module 124L is configured to convert received input signals (received at one or more input devices 113L) into output signals 145L for stimulating the first ear of the recipient (i.e., the processing module 124L is configured to perform sound processing on the input signals received at the sound processing unit 106L). In other words, in the sound processing mode, the one or more processors 125L are configured to execute the binaural sound processing logic 128L in the memory 126L to convert the received input signals into output signals 145L representing electrical stimulation for delivery to the recipient.

[0039] exist Figure 1D In an embodiment of the present invention, the output signal 145L is provided to the RF transceiver 114, which transmits the output signal 145L (e.g., in an encoded manner) transcutaneously to the implantable component 112L via the external coil 108L and the implantable coil 114L. That is, the output signal 145L is received at the RF interface circuit 140L via the implantable coil 114L and provided to the stimulator unit 142L. The stimulator unit 142L is configured to utilize the output signal 145L to generate an electrical stimulation signal (e.g., a current signal) for delivery to the cochlea of ​​the recipient via one or more stimulation contacts 144L. In this manner, the cochlear implant 102L electrically stimulates the auditory nerve cells of the recipient in a manner that causes the recipient to perceive one or more components of the received sound signal, thereby bypassing the non-existent or defective hair cells that normally convert acoustic vibrations into neural activity.

[0040] As noted, cochlear implant 102R is substantially similar to cochlear implant 102L and includes an external component 104R and an implantable component 112R. External component 104R includes a sound processing unit 106R, which includes an external coil 108R, an input device 113R (i.e., one or more sound input devices 118R, one or more auxiliary input devices 119R, and a wireless transceiver 120R), a tightly coupled transceiver (RF transceiver) 122R, a power supply 123R, and a processing module 124R. Processing module 124R includes one or more processors 125R and memory 126R, including binaural sound processing logic 128R. Implantable component 112R includes an implant body (main module) 134R, a lead region 136R, and an intra-cochlear stimulation accessory 116R, all of which are configured to be implanted beneath the skin / tissue (tissue) 115 of a recipient. The implant body 134R generally includes an airtight housing 138R in which the RF interface circuit 140L and the stimulator unit 142R are disposed. The implant body 134R also includes an internal / implantable coil 114R that is generally external to the housing 138R but is accessible via an airtight feedthrough (in the Figure 1E The stimulation accessory 116R includes a plurality of longitudinally spaced intracochlear electrical stimulation contacts (electrodes) 144R that together form a contact or electrode array 146R for delivering electrical stimulation (electrical current) to the recipient's cochlea. Figure 1E Each element of the cochlear implant 102R shown in FIG. 1 is similar to Figure 1D Like numbered elements of cochlear implant 102L shown in .

[0041] In normal hearing, the main binaural cues for left / right sound localization are the interaural (ear-to-ear) level difference (ILD) and the interaural (ear-to-ear) time difference (ITD). The main benefit of a bilateral cochlear implant system is that such a system can provide the recipient with an ILD (interaural level difference) cue. However, existing bilateral cochlear implant systems cannot provide the recipient with correct ITD cues.

[0042] The technology proposed herein enables a bilateral cochlear implant system to provide pitch cues (stimulation pulse train amplitude modulation) to the recipient in a manner that does not interfere with the ITD cues (i.e., enables the recipient to benefit from both pitch cues and binaural timing cues). More specifically, in Figure 1A-1EIn an example of , cochlear implant 102L is configured to receive a first set of sound signals and convert the first set of sound signals into a first stimulation pulse train for delivery to a first ear of a recipient. Similarly, cochlear implant 102R is configured to receive a second set of sound signals and convert the second set of sound signals into a second stimulation pulse train for delivery to a second ear of the recipient. Based on the fundamental frequency (F0) of the first and second sets of sound signals (which are associated with the same one or more sound sources), the first and second stimulation pulse trains generated by cochlear implants 102L and 102R, respectively, are amplitude modulated. That is, the modulation of the stimulation pulse amplitudes in the first and second pulse trains is synchronized on both the left and right sides and is based on the fundamental frequency of the received sound signals.

[0043] In addition, the first and second sets of sound signals are received at cochlear implants 102L and 102R with relative timing corresponding to the relative positions of one or more sound sources. That is, cochlear implants 102L and 102R are configured to synchronize the delivery of the first stimulation pulse sequence to the first ear of the recipient with the delivery of the second stimulation pulse sequence to the second ear of the recipient based on the relative positions of the sound sources that generate the first and second sets of sound signals. As a result, bilateral cochlear implant system 100 is configured to both improve pitch perception and provide appropriate ITD cues.

[0044] Figure 2 2 is a functional block diagram of a bilateral cochlear implant system 200 according to an embodiment presented herein. As shown, the bilateral cochlear implant system 200 includes a left (first) cochlear implant 202L and a right (second) cochlear implant 202R. Referring first to the cochlear implant 202L, the cochlear implant includes a microphone array 250L (e.g., a two-microphone system), a filter bank 252L, a smoother 254L, a mixer 256L, a pulse generator 258L, and a modulation controller 260L.

[0045] In some examples, the operations described below with reference to filter bank 252L, smoother 254L, mixer 256L, and modulation controller 260L may be performed in a system such as Figure 1D In addition, in some examples, some operations described below with reference to pulse generator 258L may be performed at a processing module (e.g., processing module 124L), while other operations may be performed at a processing module such as processing module 124L. Figure 1D The process is performed at a stimulator unit such as stimulator unit 142L.

[0046] Cochlear implant 202R, which is substantially similar to cochlear implant 202L, includes microphone array 250R, filter bank 252R, smoother 254R, mixer 256R, pulse generator 258R, and modulation controller 260R. In some examples, the operations described below with reference to filter bank 252R, smoother 254R, mixer 256R, and modulation controller 260R may be implemented in a device such as Figure 1E In addition, in some examples, some operations described below with reference to pulse generator 258R may be performed at a processing module (e.g., processing module 124R), while other operations may be performed at a processing module such as processing module 124R. Figure 1E The process is performed at a stimulator unit such as stimulator unit 142R.

[0047] Although the description will be made with reference to the use of microphone arrays 250L and 250R Figure 2 , but it should be understood that cochlear implants 202L and 202R may also or alternatively include different types of sound input devices and combinations thereof. It should also be understood that for each of cochlear implants 202L and 202 Figure 2 The functional blocks shown in FIG. 1 may be distributed on one, two, or more different physical devices. Figure 2 Some of the functional blocks shown in the figure may be part of an external component (e.g., external component 104L), while other functional blocks for cochlear implant 202L may be part of an implantable component (e.g., implantable component 112L). Alternatively, all functional blocks for cochlear implant 202L may be part of the implantable component, the functional blocks for cochlear implant 202L may be split between two external components and an implantable component, and so on.

[0048] return Figure 2 In the example of FIG. 1 , a first set of acoustic sound signals (sounds) 248L are received at a microphone array 250L and used to generate audio data (aL) 251L. More specifically, the audio data 251L is derived from the microphone signals and processed by an analog-to-digital converter (ADC), a beamformer, and an automatic gain control (AGC), all of which are described from FIG. Figure 2 In a similar manner, the microphone array 250R converts the second group of acoustic sound signals (sound) 248R into audio data (aR) 251R.

[0049] Due to the tonotopic mapping of the recipient's cochlea, different parts of the received sound signals 248L and 248R are delivered to different target locations / locations in the cochlea via different "stimulation channels". As used herein, a stimulation channel is a combination / group of implanted electrodes that are used simultaneously / commonly to deliver current signals to the cochlea, thereby inducing stimulation at a specific target location / location of the cochlea. Due in part to the use of different stimulation channels to deliver stimulation to the recipient, audio data 251L and 251R are applied to filter banks 252L and 252R, respectively. Filter banks 252L and 252R each include a bandpass filter and an envelope detector for each of a plurality of stimulation channels. In this way, filter bank 252L generates a group (e.g., a plurality of) filter bank envelopes 253L (v1L), and filter bank 252R generates a group of filter bank envelopes 253R (v1R), wherein each filter bank envelope is associated with a stimulation channel.

[0050] exist Figure 2 , lines / arrows labeled with " / N", such as arrows 253L and 253R, indicate multiple sets of related signals, one for each of multiple stimulation channels in a cochlear implant system. A typical cochlear implant system may have 12 to 22 stimulation channels, although other numbers of channels may be used in different embodiments.

[0051] The filter bank envelopes 253L and 253R are applied to smoothers 254L and 254R, respectively, which smooth each filter bank envelope to remove amplitude fluctuations at frequencies within a desired range of and above the base frequency (e.g., 70 Hertz (Hz) and higher). Smoothers 254L and 254R produce a set of smoothed envelope signals 255L (v3L) and 255R (v3R), respectively.

[0052] In addition, smoothers 254L and 254R delay a set of filter bank envelopes 253L and 253R, respectively, to produce a set of delayed filter bank envelopes 257L (v2L) and 257R (v2R), respectively, each of which has a delay matching the inherent delay, which is introduced by the smoothing operation of smoothers 254L and 254R, respectively. In other words, envelopes 255L and 257L are aligned in time, and envelopes 255R and 257R are aligned in time.

[0053] As noted elsewhere herein, the first group of acoustic sound signals 248L and the second group of acoustic sound signals 248R are generated by the same one or more sound sources 221. Thus, the group of acoustic sound signals 248L and the second group of acoustic sound signals 248R are received by the cochlear implants 202L and 202R "simultaneously" (i.e., at approximately the same time). However, the first group of acoustic sound signals 248L and the second group of acoustic sound signals 248R are received at the respective cochlear implants 202L and 202R at a relative timing corresponding to the position of the one or more sound sources 221. In other words, relative to the reception of one of the first or second groups of acoustic sound signals, the other of the first or second groups of acoustic sound signals may be received with a delay. The delay corresponds to an interaural time difference (ITD) between the left and right ears of the recipient relative to the position of the one or more sound sources. The ITD may change (increase or decrease) as the position of the one or more sound sources 211 changes.

[0054] exist Figure 2 In the example of , cochlear implants 202L and 202R are configured to operate a bidirectional audio link / channel 262 that enables, for example, the transmission of audio data 251L and 251R between the cochlear implants. That is, bidirectional audio channel 262 enables cochlear implant 202R to send audio data 251R to cochlear implant 202L (i.e., send data representing second set of sound signals 248R), and similarly, enables cochlear implant 202L to send audio data 251L to cochlear implant 202R (e.g., send data representing first set of sound signals 248L). Thus, cochlear implants 202L and 202R each have access to both audio data 251L and 251R, and therefore both sets of sound signals 248L and 248R. Bidirectional audio channel 262 may be a wired electrical channel or a wireless channel (e.g., a standardized wireless channel such as Low Energy (BLE) or other channel interfaces utilizing any number of standard wireless streaming protocols); proprietary protocols for wireless streaming of audio data; and more. yes (registered trademark owned by SIG).

[0055] exist Figure 2In the example of , audio data 251L and audio data 251R (received directly or via a bidirectional audio channel 262) are applied to modulation controllers 260L and 260R. Typically, modulation controllers 260L and 260R are configured to generate modulator signals 259L (mL) and 259R (mR), respectively, each having a period corresponding to the fundamental frequency (F0) of the most dominant harmonic component in the audio data 251L and 251R. That is, modulation controllers 260L and 260R are each configured to identify the fundamental frequency (F0) associated with the received sound signals 248L and 248R. Then, modulation controllers 260L and 260R generate modulation signals 259L and 259R based on the identified fundamental frequency (F0).

[0056] exist Figure 2 In the example of FIG. 1 , the modulation controllers 260L and 260R operate on both the same-side (same side) audio data 251L and the opposite-side (other side) audio data 251R. In some embodiments, the modulation controller 260L is configured to generate a so-called “F0 iL ” and uses the contralateral audio 251R to generate a signal called “F0 cL " is the second estimate of the fundamental frequency. If the two estimates F0 iL and F0 cL If the two estimated F0 are approximately equal, it is assumed that there is a dominant sound source in the environment and the binaural processing function according to the proposed embodiment is enabled. iL and F0 cL If the two frequencies are significantly different, it is assumed that there is no single dominant sound source and the binaural processing functionality according to the embodiments presented herein may be disabled. The modulation controller 260R may operate in a similar manner to generate and compare two estimates of the fundamental frequency, referred to as "F" (formed using the ipsilateral audio data 251R). iR " and F0 (formed using the contralateral audio 251L) cR ”.

[0057] For example, when there is one speaker near the left ear and another speaker near the right ear, the binaural processing function according to the embodiments presented herein can be disabled. In another example, when the recipient holds the phone to one ear and the other ear is exposed to ambient sound, the binaural processing function according to the embodiments presented herein can be disabled. In this case, the binaural processing function is disabled so that cochlear implants 202L and 202R operate independently.

[0058] When not disabled, several binaural processing functions according to the embodiments presented herein may be applied by cochlear implant 202L and cochlear implant 202R. Referring first to cochlear implant 202L, the first binaural processing function according to the embodiments presented herein is to convert two F0 estimates to F0 iL and F0 cL are combined into a single joint estimate, called “F0 jL Then, the joint estimate F0 jL is used to generate the modulation signal 259L. At 264L, the modulation signal 259L is used to modulate the smoothed envelope signal 255L, thereby generating a modulated envelope signal 261L (v4L).

[0059] Cochlear implant 202R operates in a similar manner to convert the two F0 estimates F0 iR and F0 cR are combined into a single joint estimate, called “F0 jR ”, which is then used to generate the modulation signal 259R. The modulation signal 259R is used to modulate the smoothed envelope signal 255R, thereby generating a modulated envelope signal 261R (v4R).

[0060] In addition to generating modulator signals 259L and 259R, modulation controllers 260L and 260R are each configured to generate, for each of a plurality of bandpass filter channels, an estimate of the probability that a signal component in the corresponding bandpass filter channel is harmonically related to a dominant harmonic component in the audio data 251L and 251R. Thus, modulation controller 260L generates a set of harmonic probability signals (hL) 263L, and modulation controller 260R generates a set of harmonic probability signals (hR) 263R. Each signal in each set 263L and 263R corresponds to a bandpass filter channel and provides an estimate of the probability that a signal in the corresponding bandpass filter channel is harmonically related to a dominant harmonic component in the audio data 251L and 251R.

[0061] Each group of harmonic probability signals 263L and 263R are applied to mixers 256L and 256R, respectively. Mixer 256L is configured to add the delayed filter bank envelope 257L (v2L) and the modulated envelope signal 261L (v4L), wherein the relative proportion of each is controlled by the harmonic probability signal in group 261L. Mixer 256L produces a group of modulated output envelopes (v5L) 265L. The group of modulated output envelopes 265L is then applied to pulse generator 258L. Mixer 256R operates in a similar manner to add the delayed filter bank envelope 257R (v2R) and the modulated envelope signal 261R (v4R), wherein the relative proportion of each is controlled by the harmonic probability signal in group 261R. Mixer 256R produces a group of modulated output envelopes (v5R) 265R. The set of modulated output envelopes 265R is then applied to the pulse generator 258R.

[0062] A second binaural processing function at cochlear implants 202L and 202E is implemented by interaural time difference (ITD) estimators 266L and 266R of modulation controllers 260L and 260R, respectively, which determine the ITD of the most dominant harmonic component in audio data 251L and 251R. The ITD estimate generated by ITD estimator 266L controls delay signal 267L (tL), while the ITD estimate generated by ITD estimator 266R controls delay signal 267R (tR). More specifically, if the most dominant harmonic sound source is on the left side of the recipient's head (i.e., close to cochlear implant 202L), delay signal 267L will be zero, and delay signal 267R will represent the time delay required for the sound to reach the right ear from the most dominant harmonic sound source. However, if the dominant harmonic sound source is on the right side of the recipient's head (i.e., near cochlear implant 202R), delay signal 267R will be zero, and delay signal 267L will represent the time delay required for the sound to reach the left ear from the most dominant harmonic sound source. If the dominant harmonic sound source is directly in front of the recipient, both delay signals 267L and 267R will be zero because there is no ITD between the left and right ears for a sound source directly in front of the recipient. If the binaural processing function is disabled, no ITD estimation is performed, and delay signals 267L and 267R will also be zero.

[0063] The delayed signals 267L and 267R are applied to pulse generators 258L and 258R, respectively. As noted above, the set of output envelopes (v5L) 265L is also applied to pulse generator 258L, and the set of output envelopes (v5R) 265R is also applied to pulse generator 258R. Pulse generator 258L is configured to sample the set of output envelopes (v5L) 265L to produce a stimulation pulse train 268L (i.e., a stimulation pulse train (pL)). Similarly, pulse generator 258R is configured to sample the set of output envelopes (v5R) 265R to produce a stimulation pulse train 268R (pL). Figure 2 In the example of , a pulse having one of the stimulation pulse trains 268L or 268R is delayed by a time interval controlled by the delay signal 267L or 267R (ie, the pulse is generated with a time delay based on the ITD estimate formed by the modulation controllers 260L and 260R).

[0064] Figure 3 2 is a diagram illustrating an example stimulation pulse sequence 268L and an example stimulation pulse sequence 268R generated by cochlear implants 202L and 202R, respectively, according to embodiments presented herein. For ease of illustration and clarity, only four channels are shown. However, as noted above, a typical cochlear implant system may have anywhere from 12 to 22 channels, although other numbers of channels are possible. Figure 3 , the channel stimulation rate is 1000 pulses per second (pps), and there is a single dominant sound source with an F0 of 200 Hz. Thus, the modulation signals 259L (mL) and 259R (mR) each have a period of 5 milliseconds (ms). In addition, the dominant sound source is on the left side of the recipient's head (i.e., near the cochlear implant 202L), and the ITD at the right cochlear implant 202R is 250 microseconds (μs). Thus, relative to the pulses in the stimulation pulse train 268L delivered to the recipient's left cochlea via the cochlear implant 202L, the pulses delivered to the recipient's right cochlea via the cochlear implant 202R are delayed by 250 μs. Figure 3 In the example, the delay is labeled “tR”.

[0065] In summary, Figure 2 and Figure 3 An embodiment is illustrated in which cochlear implants 202L and 202R generate stimulation pulse trains 268L and 268R, respectively, with the same amplitude modulation based on the fundamental frequency (F0) of one or more sound sources 221 (i.e., cochlear implants 202L and 202R synchronize the modulation of the stimulation pulse amplitudes in first and second pulse trains 268L and 268R). Figure 2, the same modulation applied at both cochlear implants 202L and 202R is based on the complete ipsilateral and complete contralateral audio data (ie, based on the first set of sound signals 248L and the second set of sound signals 248R), which are exchanged between the cochlear implants.

[0066] In addition, Figure 2 and Figure 3 In an embodiment of the present invention, cochlear implants 202L and 202R are configured to synchronize the delivery of stimulation pulse sequences 268L and 268R to a recipient in a timely manner based on the relative positions of one or more sound sources 221. Similarly, the relative timing of delivering stimulation pulse sequences 268L and 268R to a recipient is determined based on the complete ipsilateral and complete contralateral audio data (i.e., based on the first set of sound signals 248L and the second set of sound signals 248R), which are exchanged between the cochlear implants. The relative timing between stimulation pulse sequences 268L and 268R corresponds to the ITD of the first set of sound signals 248L and the second set of sound signals 248R (i.e., the delay between the receipt of the first set of sound signals 248L and the second set of sound signals 248R at the cochlear implants 202L and 202R and vice versa). As a result, bilateral cochlear implant system 200 is configured to both improve pitch perception (via synchronized (identical) F0 amplitude modulation) and provide appropriate ITD cues (via synchronized timing of delivery of stimulation pulse trains 268L and 268R to the recipient).

[0067] exist Figure 2 In some embodiments, the delay between the delivery of stimulation pulse sequences 268L and 268R can correspond directly to the determined ITD. However, in some embodiments, the ITD cue (the relative delay between the delivery of pulse sequences 268L and 268R) can be exaggerated to compensate for the reduced sensitivity of cochlear recipients to ITD cues. For example, the relative delay between the delivery of pulse sequences 268L and 268R can be greater than the estimated ITD, such as a multiple of the actual ITD (e.g., the pulse delay can be twice the estimated ITD).

[0068] Additionally or alternatively, the ILD cues may be exaggerated by the mixer 256L or 256R by applying additional gain or attenuation to the modulated envelope 261L or 261R (v4L or v4R) on the appropriate side. That is, in such an embodiment, the delay signals 267L and 267R are also applied to the mixers 256L and 256R, respectively. As a result, the mixer 256L or 256R may adjust the gain or attenuation applied to the modulated envelope 261L or 261R based on the ITD (as indicated by the delay signals 267L and 267R).

[0069] As pointed out, Figure 2An embodiment is illustrated in which cochlear implants 202L and 202R exchange audio data 251L and 251R. Figure 4 An alternative embodiment according to the embodiments presented herein is illustrated, wherein signals with a lower bandwidth than the audio data 251L and 251R are exchanged between two cochlear implants.

[0070] More specifically, in Figure 4 4 is a cochlear implant system 400 including a left (first) cochlear implant 402L and a right (second) cochlear implant 402R. Cochlear implant 402L is similar to cochlear implant 202L and includes a microphone array 250L (e.g., a two-microphone system), a filter bank 252L, a smoother 254L, a mixer 256L, a pulse generator 258L, and a modulation controller 260L. However, cochlear implant 402L also includes a low pass filter 470L.

[0071] Cochlear implant 402R is similar to cochlear implant 202R and includes microphone array 250R (eg, a two-microphone system), filter bank 252R, smoother 254R, mixer 256R, pulse generator 258R, and modulation controller 260R. However, cochlear implant 402R also includes low pass filter 470R.

[0072] Unless otherwise stated below, Figure 2 Components / blocks in the same Figure 4 The components / blocks in the Figure 2 The same like numbered components / blocks have substantially the same functions. However, as described in detail below, Figure 4 The components / blocks in Figure 2 The components / blocks in the Figure 2 The same similarly numbered components / blocks operate on similar but slightly different inputs.

[0073] In addition, unless otherwise indicated below, Figure 2 Signals and / or signal groups in the same manner may be substantially similar to Figure 2 However, as described in detail below, Figure 4 The signals and / or groups of signals may be based on Figure 2 The same similarly numbered signals and / or groups of signals are generated based on similar but slightly different inputs.

[0074] As noted above, acoustic sound signal (sound) 248L is received at microphone array 250L, while acoustic sound signal (sound) 248R is received at microphone array 250L. Acoustic sound signals 248L and 248R are used to generate audio data (aL) 251L and 251R, respectively.

[0075] As mentioned above Figure 2 As described, audio data 251L and 251R are applied to filter banks 252L and 252R, respectively, and filter banks 252L and 252R generate filter bank envelopes 253L (v1L) and filter bank envelopes 253R (v1R), respectively. Similarly, audio data 251L and 251R are applied to modulation controllers 260L and 260R, respectively.

[0076] exist Figure 4 In the specific example of , the audio data 251L and 251R are also applied to low pass filters 470L and 470R, respectively. The acoustic sound signal 251L is applied to the low pass filter 470L to generate low frequency audio data 471L. That is, the low frequency audio data 471L only represents the low frequency part of the audio data 251L. Similarly, the audio data 251R is applied to the low pass filter 470R to generate the low frequency audio data 471R. That is, the low frequency audio data 471R only represents the low frequency part of the audio data 251R.

[0077] Figure 4 An example arrangement is illustrated in which low pass filters 470L and 470R are separated from filter banks 252L and 252R, respectively. However, in alternative embodiments, low pass filters 470L and 470R may be implemented by collecting the outputs of a small number (e.g., 2, 3, or 4) of the lowest frequency bandpass filters in filter banks 252L and 252R, respectively. That is, the outputs from a small number of filter banks 252L may be added together to generate low frequency audio data 471L, while a small number of filter banks 252R may be added together to generate low frequency audio data 471R.

[0078] exist Figure 4 In the example of FIG. 4 , cochlear implants 402L and 402R are configured to operate a bidirectional audio link / channel 462 that enables low-frequency audio data 471L and 471R to be transmitted between the cochlear implants. That is, bidirectional audio channel 462 enables cochlear implant 402R to send low-frequency audio data 471R to cochlear implant 402L, and similarly, enables cochlear implant 402L to send low-frequency audio data 471L to cochlear implant 402R. Bidirectional audio channel 462 may be a digital wired electrical channel or a digital wireless channel (e.g., a standardized wireless channel such as Low Energy (BLE) or other channel interfaces utilizing any number of standard wireless streaming protocols); proprietary protocols for wireless streaming of audio data; and so on. yes (registered trademark owned by SIG).

[0079] As noted above, in Figure 2 In the example of , cochlear implants 202L and 202R exchange complete audio data 251L and 251R with each other. Figure 4 In the example of FIG. 4 , cochlear implants 402L and 402R exchange only frequency-restricted portions of audio data 251L and 251R (i.e., low-frequency audio data 471L and 471R) with each other. In this way, low-frequency audio data 471L and 471R may be transmitted digitally (e.g., wirelessly) using a lower data rate than original audio data 251L and 251R, which has the benefit of reducing power consumption.

[0080] exist Figure 4 In the embodiment of the present invention, the audio data 251L and the low-frequency audio data 471R (directedly received or received via the bidirectional audio channel 462) are applied to each of the modulation controllers 260L and 260R. Generally, as described above, the modulation controllers 260L and 260R operate to generate modulator signals 259L (mL) and 259R (mR), respectively, each modulator signal having a period corresponding to the fundamental frequency (F0) of the most dominant harmonic component in the audio data 251L and 251R. That is, the modulation controllers 260L and 260R are each configured to identify the fundamental frequency (F0) associated with the received sound signals 248L and 248R. Then, the modulation controllers 260L and 260R generate the modulation signals 259L and 259R, respectively, based on the identified fundamental frequency (F0).

[0081] exist Figure 4 In the example of FIG. 1 , the modulation controllers 260L and 260R operate on both the same-side (same side) audio data 251L and the opposite-side (other side) low-frequency audio data 471R or 472R (lower bandwidth signal). In some embodiments, the modulation controller 260L is configured to use the same-side audio data 251L to generate a signal referred to as “F0 iL ” and uses the contralateral low frequency audio data 471R to generate a signal referred to as “F0 cL " is the second estimate of the fundamental frequency. If the two estimates F0 iL and F0 cL If the two estimated F0L and F0L are approximately equal, it is assumed that there is a dominant sound source in the environment and the binaural processing function according to the proposed embodiment is enabled. cLIf the two frequencies are significantly different, it is assumed that there is no single dominant sound source and the binaural processing functionality according to the embodiments presented herein is disabled. The modulation controller 260R may operate in a similar manner to generate and compare two estimates of the fundamental frequency, referred to as "F" (formed using the ipsilateral audio data 251R). iR " and F0 (formed using the contralateral low-frequency audio data 471L) cR ”.

[0082] The modulation controllers 260L and 260R will each come to the same conclusion as to whether to enable the disabled binaural processing function according to the proposed embodiment. That is, the lower bandwidth signals 471L and 471R still allow the modulation controllers 260L and 260R to estimate a common F0 and ITD.

[0083] When not disabled, cochlear implants 402L and 402R will each function as described above with reference to Figure 2 The stimulation pulse trains 268L and 268R are operated as described above to generate stimulation pulse trains 268L and 268R, respectively. As described above, the stimulation pulse trains 268L and 268R are generated using the same amplitude modulation (using the same modulation function corresponding to the F0 of the one or more sound sources 221). However, depending on the location of the most dominant harmonic sound source, the stimulation pulses in the stimulation pulse trains 268R or 268L may be time delayed relative to the other, wherein the time delay is based on an estimate of the ITD for the most dominant harmonic sound source.

[0084] In summary, Figure 4 The example is basically similar to Figure 2 However, in Figure 2 , cochlear implants 202L and 202R exchange complete audio data 251L and 251R, while cochlear implants 402L and 402R exchange only the low-frequency portion of audio data 251L and 251R. Thereafter, cochlear implants 402L and 402R are connected as in reference Figure 2 The apparatus operates as described to generate pulse trains 268L and 268R that are delivered to the left and right ears of the recipient, respectively.

[0085] As mentioned above, Figure 2 and Figure 4 Embodiments of the invention generally rely on bidirectional exchange of audio data between bilateral cochlear implants. Figure 5 Another embodiment of bidirectional exchange that does not rely on audio data is illustrated. As further described below, Figure 5 The cochlear implants are each configured to derive a synchronization signal from only the ipsilateral audio data and use the synchronization signal to control pulse timing to preserve the ITD information.

[0086] More specifically, Figure 55 is a functional block diagram of a bilateral cochlear implant system 500 according to an embodiment presented herein. As shown, the bilateral cochlear implant system 500 includes a left (first) cochlear implant 502L and a right (second) cochlear implant 502R. Referring first to the cochlear implant 502L, the cochlear implant includes a microphone array 550L (e.g., a two-microphone system), a filter bank 552L, a smoother 554L, a mixer 556L, a pulse generator 558L, and a modulation controller 560L.

[0087] In some examples, the operations described below with reference to filter bank 552L, smoother 554L, mixer 556L, and modulation controller 560L may be performed in a system such as Figure 1D In addition, in some examples, some operations described below with reference to pulse generator 558L may be performed at a processing module (e.g., processing module 124L), while other operations may be performed at a processing module such as processing module 124L. Figure 1D The process is performed at a stimulator unit such as stimulator unit 142L.

[0088] Cochlear implant 502R, which is substantially similar to cochlear implant 502L, includes microphone array 550R, filter bank 552R, smoother 554R, mixer 556R, pulse generator 558R, and modulation controller 560R. In some examples, the operations described below with reference to filter bank 552R, smoother 554R, mixer 556R, and modulation controller 560R may be implemented in a device such as Figure 1E In addition, in some examples, some operations described below with reference to pulse generator 558R may be performed at a processing module (e.g., processing module 124R), while other operations may be performed at a processing module such as processing module 124R. Figure 1E The process is performed at a stimulator unit such as stimulator unit 142R.

[0089] Although the description will be made with reference to the use of microphone arrays 550L and 550R Figure 5 , but it should be understood that cochlear implants 502L and 502R may also or alternatively include different types and combinations of sound input devices. It should also be understood that for each of cochlear implants 502L and 502 Figure 5 The functional blocks shown in FIG. 5 can be distributed on one, two, or more different physical devices. Figure 5Some of the functional blocks shown in can be part of an external component (e.g., external component 104L), while other functional blocks for cochlear implant 502L can be part of an implantable component (e.g., implantable component 112L). Alternatively, all functional blocks for cochlear implant 502L can be part of the implantable component, the functional blocks for cochlear implant 502L can be split between two external components and an implantable component, and so on.

[0090] return Figure 5 , a first set of acoustic sound signals (sounds) 548L are received at microphone array 550L and used to generate audio data (aL) 551L. More specifically, audio data 551L is derived from the microphone signals and processed by an analog-to-digital converter (ADC), a beamformer, and an automatic gain control (AGC), all of which are described from the example of FIG. Figure 5 Omitted in. Partly due to the use of different stimulation channels to deliver stimulation to the recipient, audio data 551L is applied to filter bank 552L, which includes a bandpass filter and an envelope detector for each of the multiple stimulation channels. In this way, filter bank 552L produces a group (e.g., multiple) of filter bank envelopes 553L (v1L), wherein each filter bank envelope is associated with a stimulation channel. In a similar manner, microphone array 550R converts a second group of acoustic sound signals (sound) 548R into audio data (aR) 551R.

[0091] Similar to the above embodiment, Figure 5 Lines / arrows marked with " / N" in the figure, such as arrows 553L and 553R, indicate a set of related signals, one for each of a plurality of stimulation channels in a cochlear implant system. A typical cochlear implant system may have 12 to 22 stimulation channels, although other numbers of channels may be used in different embodiments.

[0092] The filter bank envelopes 553L and 553R are applied to smoothers 554L and 554R, respectively, which smooth each filter bank envelope to remove amplitude fluctuations at frequencies within and above the expected range of the base frequency. Smoothers 554L and 554R produce a set of smoothed envelope signals 555L (v3L) and 55R (v3R), respectively.

[0093] In addition, smoothers 554L and 554R delay a set of filter bank envelopes 553L and 553R, respectively, to generate a set of delayed filter bank envelopes 557L (v2L) and 557R (v2R), respectively, having a delay matching the inherent delay, which is introduced by the smoothing operation of smoothers 554L and 554R, respectively. In other words, envelopes 555L and 557L are aligned in time, and envelopes 555R and 557R are aligned in time.

[0094] As noted elsewhere herein, the first group of acoustic sound signals 548L and the second group of acoustic sound signals 548R are generated by the same one or more sound sources 521. Thus, the group of acoustic sound signals 548L and the second group of acoustic sound signals 548R are received by the cochlear implants 502L and 502R "simultaneously" (i.e., at approximately the same time). However, the first group of acoustic sound signals 548L and the second group of acoustic sound signals 548R are received at the respective cochlear implants 502L and 502R at a relative timing corresponding to the position of the one or more sound sources 521. In other words, relative to the reception of one of the first or second groups of acoustic sound signals, the other of the first or second groups of acoustic sound signals may be received with a delay. The delay corresponds to the interaural time difference (ITD) between the left and right ears of the recipient relative to the position of the one or more sound sources. The ITD may change (increase or decrease) as the position of the one or more sound sources 511 changes.

[0095] exist Figure 5 In the example of , audio data 551L is also applied to modulation controller 560L, and audio data 551R is applied to modulation controller 560R. Typically, modulation controllers 560L and 560R are each configured to generate modulator signals 559L (mL) and 559R (mR), each having a period corresponding to the fundamental frequency (F0) of the most dominant harmonic component in audio data 551L and 551R. That is, modulation controller 560L is configured to identify the fundamental frequency (F0) associated with received sound signal 548L, and modulation controller 560R is configured to identify the fundamental frequency (F0) associated with received sound signal 548R. Then, modulation controllers 560L and 560R generate modulation signals 559L and 559R, respectively, based on the identified fundamental frequency (F0).

[0096] In addition to generating modulator signals 559L and 559R, modulation controllers 560L and 560R are each configured to generate, for each of a plurality of bandpass filter channels, an estimate of the probability that a signal component in the corresponding bandpass filter channel is harmonically related to a dominant harmonic component in the audio data 551L and 551R. Thus, modulation controller 560L generates a set of harmonic probability signals (hL) 563L, and modulation controller 560R generates a set of harmonic probability signals (hR) 563R. Each signal in each set 563L and 563R corresponds to a bandpass filter channel and provides an estimate of the probability that a signal in the corresponding bandpass filter channel is harmonically related to a dominant harmonic component in the audio data 551L and 551R.

[0097] Each group of harmonic probability signals 563L and 563R are applied to mixers 556L and 556R, respectively. Mixer 556L is configured to add the delayed filter bank envelope 557L (v2L) and the modulated envelope signal 561L (v4L), wherein the relative proportion of each is controlled by the harmonic probability signal in group 561L. Mixer 556L produces a group of output envelopes (v5L) 565L. Then the group of output envelopes 565L is applied to pulse generator 558L. Mixer 556R operates in a similar manner to add the delayed filter bank envelope 557R (v2R) and the modulated envelope signal 561R (v4R), wherein the relative proportion of each is controlled by the harmonic probability signal in group 561R. Mixer 556R produces a group of modulated output envelopes (v5R) 565R. The set of modulated output envelopes 565R is then applied to the pulse generator 558R.

[0098] As noted above, Figure 2 and Figure 4 The embodiments of each utilize an ITD estimator in a corresponding modulation controller to estimate the ITD of the most dominant harmonic components in the ipsilateral and contralateral audio data. Figure 5 In an embodiment of the present invention, cochlear implants 502L and 502L operate using only ipsilateral audio data (e.g., audio data received at corresponding microphone arrays 550L and 550R, respectively). Thus, since cochlear implants 502L and 502L do not have contralateral audio data, cochlear implants 502L and 502L do not estimate ITD directly from the audio data. Instead, in Figure 5 In an embodiment of the present invention, cochlear implants 502L and 502L are each configured to derive a synchronization signal from only the ipsilateral audio data and use the synchronization signal to control pulse timing to preserve ITD information.

[0099] Referring specifically to cochlear implant 502L, modulation controller 560L includes an audio synchronizer 570L that generates a synchronization signal 571L (sL) from audio data 551L. According to the embodiments presented herein, synchronization signal 571L becomes active at the beginning of each fundamental cycle of modulation signal 559L (i.e., once every T0 seconds, where T0=1 / F0). As described above, synchronization signal 571L is applied to pulse generator 558L such that each activation of synchronization signal 571L triggers pulse generator 558L to generate a pulse sequence having modulation F0 and a duration of T0. That is, synchronization signal 571L initiates the start of a F0 modulation pulse sequence, where the sequence has a duration of T0.

[0100] The audio synchronizer 570L may generate the synchronization signal 571L using any of a number of different methods. Figure 6A-6C is a block diagram illustrating an example method that may be performed by cochlear implant 502L (eg, audio synchronizer 570L) to generate synchronization signal 571L.

[0101] See first Fig. 6A , a first embodiment of an audio synchronizer 570L is shown, referred to as audio synchronizer 670A, in which a bandpass filter 672A spanning a low frequency range (e.g., approximately 70 Hz to approximately 500 Hz) is applied to the audio data 551L ( Figure 5 ). Applying the bandpass filter 672A to the audio data 551L generates an auxiliary signal 673A that includes multiple harmonics of the dominant harmonic sound source. As a result, the envelope of the auxiliary signal 673A will be modulated at F0. Fig. 6A As shown in FIG. 6 , envelope detector 674A applies envelope detection to auxiliary signal 673A to generate auxiliary envelope signal 675A. Synchronization signal generator 676A then derives synchronization signal 571L ( Figure 5 ). For example, in one embodiment, the synchronization signal generator 676A derives the synchronization signal 571L from the positive peaks of the auxiliary envelope signal 675A. The peak detection process can utilize the estimated F0, and therefore the estimated period T0, to avoid false / erroneous peaks. In an alternative example, the synchronization signal generator 676A derives the synchronization signal 571L from the negative peaks (i.e., troughs) of the auxiliary envelope signal 675A.

[0102] In another embodiment, the synchronization signal generator 676A includes a high pass filter with a low corner frequency (e.g., about 50 Hz). In this embodiment, the high pass filter is applied to the auxiliary envelope signal 675A to remove the low frequency components of the envelope. The synchronization signal generator 676A can then detect and utilize the positive zero crossing and / or the negative zero crossing to generate the synchronization signal 571L.

[0103] Figure 6B Another embodiment of the audio synchronizer 570L is illustrated, referred to as audio synchronizer 670B, in which the audio synchronizer from the filter bank 552L ( Figure 5 The outputs (filter bank envelopes) of a selected number (e.g. 2, 3 or 4) of the lowest frequency bandpass filters in ) are obtained. Figure 6B , the filter bank envelopes of a selected number of lowest frequency bandpass filters from filter bank 552L are represented by arrows 653(1)-665(N).

[0104] The filter bank envelopes 653(1)-665(N) are summed at summing module (summer) 678B to generate an auxiliary signal 673B that includes multiple harmonics of the dominant harmonic sound source. As a result, the envelope of the auxiliary signal 673B will be modulated at F0. Figure 6B As shown in FIG. 6 , the envelope detector 674B applies envelope detection to the auxiliary signal 673B to produce the auxiliary envelope signal 675B. The synchronization signal generator 676B then derives the synchronization signal 571L ( Figure 5 ). Generally, the synchronization signal generator 676B can be similar to the above reference Fig. 6A The described synchronization signal generator 676A operates to generate the synchronization signal 571L from one or more attributes of the auxiliary envelope signal 675B (e.g., from positive peaks, negative peaks, positive zero crossings, negative zero crossings, etc.).

[0105] Figure 6C Another embodiment of the audio synchronizer 570L is illustrated, referred to as audio synchronizer 670C, in which a variable bandpass filter 677C is applied to the audio data 551L ( Figure 5 ). The center frequency of the variable bandpass filter 677C is set to pass the estimated F0, and the high cutoff frequency is set to block frequencies twice F0.

[0106] Applying the variable bandpass filter 677C to the audio data 551L generates an auxiliary signal 673C that includes a large amount of energy from the fundamental component and very little energy from the higher harmonics. Figure 6CAs shown in FIG. 6 , envelope detector 674C applies envelope detection to auxiliary signal 673C to produce auxiliary envelope signal 675C. Then, synchronization signal generator 676C derives synchronization signal 571L ( Figure 5 ). Generally, the synchronization signal generator 676C can be similar to the above reference Fig. 6A The described synchronization signal generator 676A operates to generate the synchronization signal 571L from one or more attributes of the auxiliary envelope signal 675C (e.g., from positive peaks, negative peaks, positive zero crossings, negative zero crossings, etc.).

[0107] return Figure 5 In a specific example, cochlear implant 502R also includes a modulation controller 560R having an audio synchronizer 570R. The audio synchronizer 570R may be, for example, as described above with reference to Figure 6A-6C The synchronization signal 571R (sR) is operated as described above to generate a synchronization signal 571R (sR) from the audio data 551R. According to the embodiments presented herein, the synchronization signal 571R becomes active at the beginning of each basic cycle of the modulation signal 559R (i.e., once every T0 seconds, where T0=1 / F0). As described above, the synchronization signal 571R is applied to the pulse generator 558R so that each activation of the synchronization signal 571R triggers the pulse generator 558R to generate a pulse sequence having F0 modulation and a duration of T0. In other words, the synchronization signal 571R initiates the start of a F0 modulation pulse sequence, wherein the sequence has a duration of T0.

[0108] exist Figure 5 In the embodiment of the invention, in response to a harmonic audio source in the audio environment, the bilateral cochlear implant system 500 will obtain audio data 551L at the left ear and audio data 551R at the right ear, so that the corresponding harmonic components of the audio data 551L and 551R will have an ITD that depends on the location of the audio source. As detailed above, since the timing of each synchronization signal 571L and 571R is directly related to the temporal characteristics of the dominant harmonic components in the corresponding audio data 551L and 551R, the same ITD will be presented between the synchronization signals 571L and 571R, and therefore between the pulse sequence 568L delivered via the left cochlear implant 502L and the pulse sequence 568R delivered via the right cochlear implant 502R.

[0109] That is, as noted above, synchronization signals 571L and 571R are activated (generated) based on the same parameters of audio data 551L and 551R. These parameters will appear in 551L and 551R with a relative time difference corresponding to ITD. For example, if the dominant sound source is on the left, these features will appear in 551L before appearing in 551R. The time period between the appearance of the features in 551L and the appearance of the features in 551R corresponds to ITD. Therefore, since synchronization signals 571L and 571R are activated based on these features (which appear in 551R after 551L with a time delay corresponding to ITD), synchronization signal 571R will also be activated a time period after synchronization signal 571L, wherein the delay between signals 571L and 571R corresponds to ITD. Likewise, since synchronization signals 571L and 571R control when the pulses in pulse trains 568L and 568R will be generated, each set of pulses generated at 558R will be delayed relative to each set of pulses generated at 558L by at least the ITD of the input audio change. Again, the result is that Figure 3 Pulse sequences such as those shown in .

[0110] In summary, Figure 5 and Figure 6A-6C Embodiments are illustrated in which cochlear implants 502L and 502R generate stimulation pulse trains 568L and 568R, respectively, based on amplitude modulation of the fundamental frequency (F0) of one or more sound sources 521 (i.e., cochlear implants 502L and 502R synchronize the modulation of the stimulation pulse amplitudes in first and second pulse trains 568L and 568R). Figure 5 , the modulation applied at both cochlear implants 502L and 502R is based only on ipsilateral audio data (ie, only on first set of sound signals 548L at cochlear implant 502L and only on second set of sound signals 548R at cochlear implant 502R).

[0111] In addition, Figure 5 and Figure 6A-6CIn an embodiment of the present invention, cochlear implants 502L and 502R are configured to synchronize the delivery of stimulation pulse trains 568L and 568R to a recipient in time based on the relative positions of one or more sound sources 521. Likewise, the relative timing of stimulation pulse trains 568L and 568R (i.e., the time delay between the delivery of the pulse trains) is determined solely from the ipsilateral audio data (i.e., based solely on first set of sound signals 548L at cochlear implant 502L and solely on second set of sound signals 548R at cochlear implant 502R). In particular, each cochlear implant 502L and 502R synchronizes the timing of delivery of stimulation pulse sequences 568L and 568R to a recipient based on one or more attributes present in both the first group of sound signals 548L and the second group of sound signals 548R, wherein the one or more attributes present in the first and second groups of sound signals 548L and 548R with a relative timing corresponding to the ITD (i.e., the one or more attributes may be delayed in the other of the first or second groups of sound signals 548L relative to one of the first or second groups of sound signals 548L and 548R). As a result, the relative timing between delivery of stimulation pulse sequences 568L and 568R corresponds to the ITD between the first group of sound signals 548L and the second group of sound signals 548R (i.e., the delay between the first group of sound signals 548L and the second group of sound signals 548R being received at the cochlear implant 502L and 502R, and vice versa). As a result, bilateral cochlear implant system 500 is configured to both improve pitch perception (via synchronized (identical) F0 amplitude modulation) and provide appropriate ITD cues (via synchronized timing of delivery of stimulation pulse trains 568L and 568R to the recipient).

[0112] Figure 7780 is a flow chart of a method 780 according to some embodiments presented herein. The method 780 begins at 781, where a first cochlear implant of a bilateral cochlear implant system receives a first set of sound signals. At 782, a second cochlear implant of the bilateral cochlear implant system receives a second set of sound signals, wherein the first set of sound signals and the second set of sound signals are associated with the same one or more sound sources. At 783, the first cochlear implant generates a first stimulation pulse sequence based on the first set of sound signals, wherein the first stimulation pulse sequence has an amplitude modulated using a first modulation. At 784, the first cochlear implant delivers the first stimulation pulse sequence to a first ear of a recipient of the bilateral cochlear implant system. At 785, the second cochlear implant generates a second stimulation pulse sequence based on the second set of sound signals, wherein the second stimulation pulse sequence has an amplitude modulated using the same first modulation as the first stimulation pulse sequence. At 786, the second cochlear implant delivers the second stimulation pulse sequence to a second ear of the recipient. A second stimulation pulse train is delivered to the recipient with a time delay relative to delivery of the first stimulation pulse train, and wherein the time delay is based on an interaural time difference (ITD) associated with receipt of a first set of sound signals at the first cochlear implant and receipt of a second set of sound signals at the second cochlear implant.

[0113] Figure 8 890 is a flow chart of a method 890 according to some embodiments presented herein. The method 890 begins at 891, where a first cochlear implant of a bilateral cochlear implant system receives first audio data (e.g., a first set of sound signals). At 892, a second cochlear implant receives second audio data (e.g., a second set of sound signals) at a second cochlear implant of the bilateral cochlear implant system, wherein the first and second audio data are associated with the same fundamental frequency. At 893, the first cochlear implant generates a first stimulation pulse sequence representing the first audio data, and at 894, the first cochlear implant amplitude modulates the first stimulation pulse sequence based on the fundamental frequencies of the first audio data and the second audio data. At 895, the second cochlear implant generates a second stimulation pulse sequence representing the second audio data, and at 896, the second cochlear implant amplitude modulates the second stimulation pulse sequence based on the fundamental frequencies of the first audio data and the second audio data. At 897, the timing of delivery of a first stimulation pulse sequence to a first ear of a recipient of a bilateral cochlear implant system is synchronized with the timing of delivery of a second stimulation pulse sequence to a second ear of the recipient of the bilateral cochlear implant system.

[0114] For ease of description only, the technology proposed herein has been described herein primarily with reference to an illustrative medical device system, which is a bilateral cochlear implant system that delivers electrical stimulation to both ears of a recipient. However, it should be understood that the technology proposed herein can also be used with a variety of other medical devices that can benefit from the proposed technology while providing a wide range of therapeutic benefits to recipients, patients, or other users. For example, a bilateral cochlear implant system according to an embodiment proposed herein can also deliver acoustic stimulation to one or both ears of a recipient (e.g., one or more cochlear implants are electroacoustic cochlear implants). It should also be understood that the two cochlear implants of a bilateral cochlear implant system according to an embodiment proposed do not need to be identical in terms of, for example, the number of electrodes used to electrically stimulate the cochlea, the type of stimulation delivered, and the like. In addition, it should be understood that the technology proposed herein can be used with other binaural hearing prosthesis systems, such as systems including acoustic hearing aids, bone conduction devices, middle ear hearing prostheses, direct acoustic stimulators, other electrically simulated hearing prostheses (e.g., auditory brain stimulators, etc.). The technology presented in this article can also be used with vestibular devices (e.g., vestibular implants), visual devices (i.e., bionic eyes), sensors, pacemakers, drug delivery systems, defibrillators, functional electrical stimulation devices, catheters, epilepsy devices (e.g., devices for monitoring and / or treating epileptic events), sleep apnea devices, electroporation, and the like.

[0115] It should be appreciated that the above embodiments are not mutually exclusive and may be combined with each other in various arrangements.

[0116] The scope of the invention described and claimed herein is not limited by the specific preferred embodiments disclosed herein, because these embodiments are intended to be illustrative of several aspects of the present invention, rather than limiting. Any equivalent embodiments are intended to be within the scope of the present invention. In fact, in addition to those shown and described herein, various modifications of the present invention will become apparent to those skilled in the art based on the foregoing description. Such modifications are also intended to fall within the scope of the appended claims.

Claims

1. A method for a cochlear implant system, include: receiving first audio data at a first cochlear implant of a bilateral cochlear implant system; receiving second audio data at a second cochlear implant of the bilateral cochlear implant system, wherein the first audio data and the second audio data are associated with a same fundamental frequency; generating, at the first cochlear implant, a first stimulation pulse train representing the first audio data; amplitude modulating the first stimulation pulse train based on the fundamental frequencies of the first audio data and the second audio data; generating, at the second cochlear implant, a second stimulation pulse train representing the second audio data; amplitude modulating the second stimulation pulse train based on the fundamental frequencies of the first audio data and the second audio data; as well as synchronizing the timing of delivery of the first stimulation pulse sequence to a first ear of a recipient of the bilateral cochlear implant system with the timing of delivery of the second stimulation pulse sequence to a second ear of the recipient of the bilateral cochlear implant system, wherein the time delay of delivery of the second stimulation pulse sequence relative to the delivery of the first stimulation pulse sequence is equal to an interaural time difference ITD associated with reception of the first audio data at the first cochlear implant and reception of the second audio data at the second cochlear implant, and The base frequency is determined by: generating, by the first cochlear implant and the second cochlear implant, a first estimate and a second estimate of a fundamental frequency using both the first audio data and the second audio data, respectively, and The fundamental frequency is determined in response to the first estimate and the second estimate being equal.

2. The method of claim 1, wherein the fundamental frequency is associated with one or more sound sources in the recipient's audio environment, and wherein the delivery timing of the first stimulation pulse train is synchronized with the delivery timing of the second stimulation pulse train. include: The delivery timing of the first stimulation pulse sequence to the first ear of the recipient is synchronized with the delivery timing of the second stimulation pulse sequence to the second ear of the recipient based on the relative positions of the one or more sound sources in the audio environment.

3. The method of claim 1 , wherein the delivery timing of the first stimulation pulse sequence is synchronized with the delivery timing of the second stimulation pulse sequence include: The delivery timing of the first train of stimulation pulses and the delivery timing of the second train of stimulation pulses are synchronized based on one or more signal properties present in both the first audio data and the second audio data. 4 . The method of claim 3 , wherein the one or more signal properties occur in the first audio data and the second audio data with a relative timing corresponding to the interaural time difference (ITD).

5. The method according to claim 3, further comprising: include: detecting, at the first cochlear implant, one or more signal properties of the first audio data; detecting, at the second cochlear implant, one or more signal properties of the second audio data, wherein the one or more signal properties of the second audio data are the same as the one or more signal properties of the first audio data; setting a delivery timing of the first stimulation pulse train to the first ear of the recipient based on the timing of the one or more signal attributes in the first audio data; as well as Based on the timing of the one or more signal attributes in the second audio data, the timing of delivery of the second stimulation pulse train to the second ear of the recipient is set.

6. The method of claim 1, 2 or 3, wherein the delivery timing of the first stimulation pulse sequence to the first ear of the recipient is synchronized with the delivery timing of the second stimulation pulse sequence to the second ear of the recipient. include: The second stimulation pulse train is delivered to the second ear of the recipient with a time delay relative to delivery of the first stimulation pulse train to the first ear of the recipient.

7. The method according to claim 1, further comprising: include: The delivery timing of the second stimulation pulse train is determined based solely on the second audio data.

8. The method according to claim 7, further comprising: include: detecting one or more signal properties of the second audio data that are also present in the first audio data; as well as timing the delivery of the second stimulation pulse train to the second ear of the recipient based on the timing of the one or more signal attributes in the second audio data, Wherein the first cochlear implant is configured to time delivery of the first stimulation pulse train based on the timing of the one or more signal attributes in the first audio data.

9. A cochlear implant system, include: A first cochlear implant, the first cochlear implant being configured to: receiving a first set of sound signals associated with at least one sound source, converting the first set of sound signals into a first stimulation pulse train, wherein the first stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, and delivering the first stimulation pulse train to a first ear of a recipient of the cochlear implant system; as well as A second cochlear implant, the second cochlear implant being configured to: receiving a second set of sound signals associated with the at least one sound source, converting the second set of sound signals into a second stimulation pulse train, wherein the second stimulation pulse train is artificially amplitude modulated based on the fundamental frequency associated with the at least one sound source, delivering the second stimulation pulse train to a second ear of the recipient with a time delay relative to delivery of the first stimulation pulse train to a first ear of the recipient, wherein the time delay for delivery of the second stimulation pulse train relative to the delivery of the first stimulation pulse train is equal to an interaural time difference ITD associated with reception of the first set of sound signals at the first cochlear implant and reception of the second set of sound signals at the second cochlear implant, and The base frequency is determined by: generating, by the first cochlear implant and the second cochlear implant, a first estimate and a second estimate of fundamental frequency using both the data representing the first set of sound signals and the data representing the second set of sound signals, respectively, and The fundamental frequency is determined in response to the first estimate and the second estimate being equal.

10. The cochlear implant system of claim 9, wherein the time delay is based on a relative position of the at least one sound source.

11. The cochlear implant system of claim 9 or 10, wherein the second cochlear implant is configured to determine the timing of the delivery of the second stimulation pulse train based solely on the second set of sound signals.

12. The cochlear implant system of claim 11, wherein the second cochlear implant is configured to: detecting one or more signal properties of the second set of sound signals that are also present in the first set of sound signals; and timing the delivery of the second stimulation pulse train to the second ear of the recipient based on the timing of the one or more signal attributes in the second set of sound signals, Wherein the first cochlear implant is configured to time delivery of the first stimulation pulse train based on the timing of the one or more signal attributes in the second set of sound signal data.

13. A method for a cochlear implant system, include: receiving a first set of sound signals at a first cochlear implant of a bilateral cochlear implant system; receiving a second set of sound signals at a second cochlear implant of the bilateral cochlear implant system, wherein the first set of sound signals and the second set of sound signals are associated with the same one or more sound sources; generating, at the first cochlear implant, a first stimulation pulse train based on the first set of sound signals, wherein the first stimulation pulse train has an amplitude modulated with a first modulation; delivering the first stimulation pulse train to a first ear of a recipient of the bilateral cochlear implant system; generating, at the second cochlear implant, a second stimulation pulse train based on the second set of sound signals, wherein the second stimulation pulse train has an amplitude modulated using the same first modulation as the first stimulation pulse train; as well as delivering the second stimulation pulse train to a second ear of the recipient, wherein the second stimulation pulse train is delivered to the recipient with a time delay relative to delivery of the first stimulation pulse train, and wherein the time delay is based on an interaural time difference ITD associated with reception of the first set of sound signals at the first cochlear implant and reception of the second set of sound signals at the second cochlear implant, wherein the first modulation is based on the fundamental frequencies of the first group of sound signals and the second group of sound signals, and The base frequency is determined by: generating, by the first cochlear implant and the second cochlear implant, a first estimate and a second estimate of fundamental frequency using both the data representing the first set of sound signals and the data representing the second set of sound signals, respectively, and The fundamental frequency is determined in response to the first estimate and the second estimate being equal.

14. The method according to claim 13, further comprising: include: transmitting first audio data from the first cochlear implant to the second cochlear implant, wherein the first audio data is generated from the first set of sound signals; as well as Second audio data is transmitted from the second cochlear implant to the first cochlear implant, wherein the second audio data is generated from the second set of sound signals.

15. The method according to claim 14, further comprising: include: determining, at the first cochlear implant, the first modulation from the first set of sound signals and the second audio data; as well as At the second cochlear implant, the first modulation is determined from the second set of sound signals and the first audio data.

16. The method of claim 14, wherein the first audio data is transmitted from the first cochlear implant to the second cochlear implant include: converting the first group of sound signals into the first audio data, and transmitting the first audio data to the second cochlear implant; and Wherein sending the second audio data from the second cochlear implant to the first cochlear implant comprises: converting the second group of sound signals into second audio data, and The second audio data is transmitted to the first cochlear implant.

17. The method of claim 14, wherein the first audio data is transmitted from the first cochlear implant to the second cochlear implant include: converting the first group of sound signals into first audio data, filtering the first audio data to generate frequency-limited first audio data, and transmitting only the frequency-limited first audio data to the second cochlear implant; and Wherein sending the second audio data from the second cochlear implant to the first cochlear implant comprises: converting the second group of sound signals into second audio data, filtering the second audio data to generate frequency limited second audio data, and Only the frequency limited second audio data is sent to the first cochlear implant.

18. The method according to claim 17: The first audio data is filtered to generate frequency-limited first audio data. include: low-pass filtering the first audio data to generate low-frequency first audio data representing only a low-frequency portion of the first audio data; and The filtering of the second audio data to generate frequency-limited second audio data comprises: The second audio data is low-pass filtered to generate low-frequency second audio data representing only a low-frequency portion of the second audio data.

19. The method according to claim 17: The first audio data is filtered to generate frequency-limited first audio data. include: applying the first audio data to a first filter bank configured to generate a plurality of first filtered output signals, and summing only a subset of the filtered first output signals to generate the frequency limited first audio data, The filtering of the second audio data to generate frequency-limited second audio data comprises: applying the second audio data to a second filter bank configured to generate a plurality of second filtered output signals, and Only a subset of the filtered second output signals is summed to generate the frequency limited second audio data.

20. The method according to claim 14, further comprising: include: At the second cochlear implant, the time delay for delivery of the second sequence of stimulation pulses relative to the delivery of the first sequence of stimulation pulses is determined based on the second set of sound signals and the first audio data.

21. The method of claim 20, wherein the time delay for delivery of the second stimulation pulse sequence relative to the delivery of the first stimulation pulse sequence is determined based on the second set of sound signals and the first audio data. include: At the second cochlear implant, an ITD of a most dominant harmonic component in each of the second set of sound signals and the first audio data is determined.

22. The method of claim 13 or 14, wherein the time delay for delivery of the second stimulation pulse sequence relative to the delivery of the first stimulation pulse sequence is equal to the ITD.

23. The method of claim 13 or 14, wherein the time delay for delivery of the second stimulation pulse sequence relative to the delivery of the first stimulation pulse sequence is greater than the ITD.

24. The method of claim 13 or 14, wherein generating a first stimulation pulse train based on the first set of sound signals at the first cochlear implant, wherein the first stimulation pulse train has an amplitude modulated using a first modulation comprises: applying the first set of sound signals to a first filter bank, the first filter bank comprising, for each stimulation channel of a plurality of stimulation channels, a bandpass filter and an envelope detector to produce a plurality of filter bank envelopes, wherein each filter bank envelope is associated with a stimulation channel; determining a fundamental frequency of the first group of sound signals; generating a set of modulated output envelopes from the plurality of filter bank envelopes based on the fundamental frequencies of the first set of sound signals; selecting a plurality of modulated output envelopes from the set of modulated output envelopes; as well as The first stimulation pulse train is generated based on the plurality of modulated output envelopes.

25. The method according to claim 24, further comprising: include: determining harmonics of each filter bank envelope of the plurality of filter bank envelopes; as well as The set of modulated output envelopes is generated from the plurality of filter bank envelopes based on the fundamental frequency of the first set of sound signals, based on the fundamental frequency of the first set of sound signals and the harmonics of each of the plurality of filter bank envelopes.

26. The method according to claim 25, further comprising: include: Prior to generating the set of modulated output envelopes from the plurality of filter bank envelopes, the plurality of filter bank envelopes are smoothed.

27. A cochlear implant system, include: A first cochlear implant, the first cochlear implant being configured to: receiving a first set of sound signals generated by at least one sound source, converting the first set of sound signals into a first stimulation pulse train, wherein the first stimulation pulse train is artificially amplitude modulated based on a fundamental frequency associated with the at least one sound source, and delivering the first stimulation pulse train to a first ear of a recipient of the cochlear implant system; as well as A second cochlear implant, the second cochlear implant being configured to: receiving a second set of sound signals generated by the at least one sound source, converting the second set of sound signals into a second stimulation pulse train, wherein the second stimulation pulse train is artificially amplitude modulated based on the fundamental frequency associated with the at least one sound source, determining a time delay for delivery of the second stimulation pulse train to a second ear of the recipient relative to delivery of the first stimulation pulse train to the first ear of the recipient, and delivering the second stimulation pulse train to the second ear of the recipient at a time corresponding to the time delay, wherein the time delay for delivery of the second stimulation pulse train relative to the delivery of the first stimulation pulse train is equal to an interaural time difference ITD associated with reception of the first set of sound signals at the first cochlear implant and reception of the second set of sound signals at the second cochlear implant, and The base frequency is determined by: generating, by the first cochlear implant and the second cochlear implant, a first estimate and a second estimate of fundamental frequency using both the data representing the first set of sound signals and the data representing the second set of sound signals, respectively, and The fundamental frequency is determined in response to the first estimate and the second estimate being equal.

28. The cochlear implant system of claim 27, wherein to determine the time delay for delivery of the second stimulation pulse train to the second ear of the recipient, the second cochlear implant is configured to determine the time delay from the interaural time difference ITD.

29. The cochlear implant system of claim 28, wherein the time delay for delivery of the second stimulation pulse train relative to the delivery of the first stimulation pulse train is equal to the ITD.

30. The cochlear implant system of claim 28, wherein the time delay for delivery of the second stimulation pulse train relative to the delivery of the first stimulation pulse train is greater than the ITD.

31. The cochlear implant system of claim 27, 28, 29 or 30: wherein the first cochlear implant is configured to transmit first audio data to the second cochlear implant, wherein the first audio data is generated from the first set of sound signals; and Wherein the second cochlear implant is configured to transmit second audio data to the first cochlear implant, wherein the second audio data is generated from the second set of sound signals.

32. The cochlear implant system of claim 31 , wherein the second cochlear implant is configured to determine the time delay for delivery of the second stimulation pulse train relative to the delivery of the first stimulation pulse train based on the second set of sound signals and the first audio data.

33. A non-transitory computer-readable storage medium encoded with instructions that, when executed by one or more processors, cause the one or more processors to: generating a first stimulation pulse sequence at a first cochlear implant of a cochlear implant system, the first stimulation pulse sequence representing first audio data received at the first cochlear implant; generating a second stimulation pulse sequence at a second cochlear implant of the cochlear implant system, the second stimulation pulse sequence representing second audio data received at the second cochlear implant; modulating an amplitude of the first stimulation pulse train based on one or more characteristics of the first audio data and the second audio data; as well as modulating the amplitude of the second stimulation pulse train based on the one or more characteristics of the first audio data and the second audio data, wherein the one or more characteristics include fundamental frequencies of the first audio data and the second audio data, wherein the time delay of delivery of the second stimulation pulse sequence relative to the delivery of the first stimulation pulse sequence is equal to an interaural time difference ITD associated with reception of the first audio data at the first cochlear implant and reception of the second audio data at the second cochlear implant, and The base frequency is determined by: generating, by the first cochlear implant and the second cochlear implant, a first estimate and a second estimate of a fundamental frequency using both the first audio data and the second audio data, respectively, and The fundamental frequency is determined in response to the first estimate and the second estimate being equal.

34. The non-transitory computer-readable storage medium of claim 33, further comprising instructions that, when executed by the one or more processors, cause the one or more processors to: The timing of delivery of the first sequence of stimulation pulses to a first ear of a recipient of the cochlear implant system is synchronized with the timing of delivery of the second sequence of stimulation pulses to a second ear of the recipient of the cochlear implant system.

35. The non-transitory computer-readable storage medium of claim 34, wherein the fundamental frequency is associated with one or more sound sources in the recipient's audio environment, and wherein the instructions for synchronizing the delivery timing of the first stimulation pulse train with the delivery timing of the second stimulation pulse train include instructions that, when executed by the one or more processors, cause the one or more processors to: The delivery timing of the first stimulation pulse sequence to the first ear of the recipient is synchronized with the delivery timing of the second stimulation pulse sequence to the second ear of the recipient based on the relative positions of the one or more sound sources in the audio environment.

36. The non-transitory computer-readable storage medium of claim 34, wherein the instructions for synchronizing the delivery timing of the first stimulation pulse sequence with the delivery timing of the second stimulation pulse sequence include instructions that, when executed by the one or more processors, cause the one or more processors to: The delivery timing of the first train of stimulation pulses and the delivery timing of the second train of stimulation pulses are synchronized based on one or more signal properties present in both the first audio data and the second audio data.

37. The non-transitory computer-readable storage medium of claim 36, wherein the one or more signal attributes occur in the first audio data and the second audio data with a relative timing corresponding to the interaural time difference (ITD).

38. The non-transitory computer-readable storage medium of claim 34, further comprising instructions that, when executed by the one or more processors, cause the one or more processors to: detecting, at the first cochlear implant, one or more signal properties of the first audio data; detecting, at the second cochlear implant, one or more signal properties of the second audio data, wherein the one or more signal properties of the second audio data are the same as the one or more signal properties of the first audio data; setting a delivery timing of the first stimulation pulse train to the first ear of the recipient based on the timing of the one or more signal attributes in the first audio data; as well as Based on the timing of the one or more signal attributes in the second audio data, the timing of delivery of the second stimulation pulse train to the second ear of the recipient is set.

39. The non-transitory computer-readable storage medium of claim 34, further comprising instructions that, when executed by the one or more processors, cause the one or more processors to: The second stimulation pulse train is delivered to the second ear of the recipient with a time delay relative to delivery of the first stimulation pulse train to the first ear of the recipient.

Citation Information

Patent Citations

  • Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced / unvoiced distinctions

    CN102596309A

  • Fitting bilateral hearing prostheses

    CN104685907A

  • Interaural coherence based cochlear stimulation using adapted envelope processing

    CN109963615A

  • Cochlear implant sound processing method and system

    US20050107843A1

  • Binaural Stimulation in Neural Auditory Prostheses or Hearing Aids

    US20080319509A1