Enhancing safety-related saliency

Abstract

A medical device is configured to operate to convert acoustic signals to electrical stimulation signals for delivery to a recipient. In response to detecting a safety-related acoustic feature, the medical device is configured to adjust the conversion of acoustic signals to electrical stimulation signals to enhance a saliency of the safety-related acoustic feature.

Description

Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1ENHANCING SAFETY-RELATED SALIENCYBACKGROUNDTechnical Field[ooot] The present disclosure relates generally to operating a medical device to enhance saliency of a safety-related feature.Related Art

[0002] Medical devices have provided a wide range of therapeutic benefits to recipients over recent decades. Medical devices can include internal or implantable components / devices, external or wearable components / devices, or combinations thereof (e.g., a device having an external component communicating with an implantable component). Medical devices, such as traditional hearing aids, partially or fully-implantable hearing prostheses (e.g., bone conduction devices, mechanical stimulators, cochlear implants, etc.), pacemakers, defibrillators, functional electrical stimulation devices, and other medical devices have been successful in performing lifesaving and / or lifestyle enhancement functions and / or recipient monitoring for a number of years.

[0003] The types of medical devices and the ranges of functions performed thereby have increased over the years. For example, many medical devices, sometimes referred to as “implantable medical devices,” now often include one or more instruments, apparatus, sensors, processors, controllers or other functional mechanical or electrical components that are permanently or temporarily implanted in a recipient. These functional devices are typically used to diagnose, prevent, monitor, treat, or manage a disease / injury or symptom thereof, or to investigate, replace or modify the anatomy or a physiological process. Many of these functional devices utilize power and / or data received from external devices that are part of, or operate in conjunction with, implantable components.SUMMARY

[0004] In one aspect, a method is provided. The method comprises: converting acoustic signals to electrical stimulation signals for delivery to a recipient of the medical device; detecting a safety-related acoustic feature; and adjusting the conversion of acoustic signals to electrical stimulation signals in response to detecting the safety-related acoustic feature.

[0005] In another aspect, a method is provided. The method comprises: operating a hearing device in a first mode; converting incoming acoustic inputs to electrical stimulation signals inAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 accordance with a first electrical stimulation paradigm during operation of the hearing device in the first mode; detecting a safety-related acoustic input during operation of the hearing device in the first mode; transitioning operation of the hearing device from the first mode to a second mode in response to detecting the safety-related acoustic input; and converting incoming acoustic inputs to electrical stimulation signals in accordance with a second electrical stimulation paradigm during operation of the hearing device in the second mode. The second electrical stimulation paradigm is different from the first electrical stimulation paradigm.

[0006] In yet another aspect, a medical device is provided. The medical device comprises: one or more input devices configured to receive input signals associated with an ambient environment of a recipient of the medical device; one or more electrodes; and a processing unit configured to convert the input signals into electrical stimulation signals for delivery to the recipient via the one or more electrodes. In response to detecting a safety-related feature in the input signals, the processing unit is configured to adjust one or more spectro-temporal aspects of the electrical stimulation signals.BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Embodiments of the present disclosure are described herein in conjunction with the accompanying drawings, in which:

[0008] FIG. 1A is a schematic diagram illustrating a cochlear implant system with which aspects of the techniques presented herein can be implemented;

[0009] FIG. IB is a side view of a recipient wearing a sound processing unit of the cochlear implant system of FIG. 1A;[ooto] FIG. 1C is a schematic view of components of the cochlear implant system of FIG. 1 A;[ooit] FIG. ID is a block diagram of the cochlear implant system of FIG. 1A;

[0012] FIG. 2 is a block diagram of a signal processing path of an implantable system with which aspects of the techniques presented herein can be implemented;

[0013] FIG. 3 is a block diagram of signal intake path of an implantable system with which aspects of the techniques presented herein can be implemented;

[0014] FIG. 4 is a schematic diagram illustrating different frequency-to-electrode mappings using aspects of techniques presented herein;Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1

[0015] FIGs. 5, 6. 7, and 8 are each a flowchart of a method for operating an implantable medical device using aspects of techniques presented herein;

[0016] FIG. 9 is a schematic diagram illustrating a vestibular stimulator system with which aspects of the techniques presented herein can be implemented;

[0017] FIG. 10 is a schematic diagram illustrating a retinal prosthesis system with which aspects of the techniques presented herein can be implemented;

[0018] FIG. 11 is a perspective view of a tinnitus therapy device with which aspects of the techniques presented herein can be implemented;

[0019] FIG. 12 is a perspective view of an upper airway stimulation device with which aspects of the techniques presented herein can be implemented; and

[0020] FIG. 13 is a schematic diagram illustrating a computing device with which aspects of the techniques presented herein can be implemented.DETAILED DESCRIPTION

[0021] Presented herein are techniques for enhancing saliency of a safety-related feature, such as safety-related acoustic feature, for a recipient of a medical device that operates to convert input signals to electrical stimulation signals for delivery to the recipient to enable the recipient to perceive the input signals. More specifically, in accordance with certain embodiments presented herein, the medical device (or an associated device) detects a “safety-related acoustic feature” (e.g., such as siren, alarm, etc.) In response to detection of the safety-related acoustic feature, the medical device is configured to adjust the conversion of acoustic signals to electrical stimulation signals to enhance “saliency” of the safety-related acoustic feature. As used herein, enhancing the “saliency” of the safety-related acoustic feature refers to a process that enables the recipient to perceive the safety-related acoustic feature more clearly and / or focuses the attention of the recipient on the safety-related acoustic feature.

[0022] For example, in one arrangement, prior to detection of the safety-related acoustic feature, the medical device converts acoustic signals to electrical stimulation signals to enable the recipient to perceive various sounds (e.g., speech) from an ambient sound environment. In response to the detection of the safety-related acoustic feature, the medical device operation is adjusted so as to convert acoustic signals to electrical stimulation signals in a manner that enable the recipient to perceive the safety-related acoustic feature more clearly, even though such converted electrical stimulation signals can reduce the recipient’s perception of otherAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 sounds, such as speech, from the ambient sound environment. That is, the recipient can more readily perceive the safety-related acoustic feature and, accordingly, promptly react to the safety-related acoustic feature. In orders, adjusting operation of the implantable medical device to convert acoustic signals to electrical stimulation signals in response to detection of a safety- related acoustic feature can help the recipient respond more desirably to the safety-related acoustic feature.

[0023] There are a number of different types of medical devices in / with which embodiments of the present disclosure can be implemented. Merely for ease of description, the techniques presented herein are primarily described with reference to a specific medical device in the form of a cochlear implant system. However, it is to be appreciated that the techniques presented herein can also be partially or fully implemented by any of a number of different types of devices, including consumer electronic device (e.g., mobile phones), wearable devices (e.g., smartwatches), hearing devices, implantable medical devices, consumer electronic devices, etc. As used herein, the term “hearing device” is to be broadly construed as any device that acts on an acoustical perception of an individual, including to improve perception of sound signals, to reduce perception of sound signals, etc. In particular, a hearing device can deliver sound signals to a user in any form, including in the form of acoustical stimulation, mechanical stimulation, electrical stimulation, etc., and / or can operate to suppress all or some sound signals. As such, a hearing device can be a device for use by a hearing-impaired person (e.g., hearing aids, middle ear auditory prostheses, bone conduction devices, direct acoustic stimulators, electro-acoustic hearing prostheses, auditory brainstem stimulators, bimodal hearing prostheses, bilateral hearing prostheses, dedicated tinnitus therapy devices, tinnitus therapy device systems, combinations or variations thereof, etc.), a device for use by a person with normal hearing (e.g., consumer devices that provide audio streaming, consumer headphones, earphones, and other listening devices), a hearing protection device, etc. In other examples, the techniques presented herein can be implemented by, or used in conjunction with, various implantable medical devices, such as visual devices (i.e., bionic eyes), sensors, pacemakers, drug delivery systems, defibrillators, functional electrical stimulation devices, catheters, seizure devices (e.g., devices for monitoring and / or treating epileptic events), sleep apnea devices, electroporation devices, etc.

[0024] FIGs. 1A-1D illustrate an example cochlear implant system 102 with which aspects of the techniques presented herein can be implemented. The cochlear implant system 102 comprises an external component 104 that is configured to be directly or indirectly attached toAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 the body of the user, and an intemal / implantable component 112 that is configured to be implanted in or worn on the head of the user. In the examples of FIGs. 1A-1D, the implantable component 112 is sometimes referred to as a “cochlear implant.” FIG. 1A illustrates the cochlear implant 112 implanted in the head 154 of a user, while FIG. IB is a schematic drawing of the external component 104 worn on the head 154 of the user. FIG. 1C is another schematic view of the cochlear implant system 102, while FIG. ID illustrates further details of the cochlear implant system 102. For ease of description, FIGs. 1A-1D will generally be described together.

[0025] In the examples of FIGs. 1A-1D, the external component 104 comprises a sound processing unit 106, an external coil 108, and generally, a magnet fixed relative to the external coil 108. The cochlear implant 112 includes an implantable coil 114, an implant body 134, and an elongate stimulating assembly 116 configured to be implanted in the user’s cochlea. In one example, the sound processing unit 106 is an off-the-ear (OTE) sound processing unit, sometimes referred to herein as an OTE component, which is configured to send data and power to the implantable component 112. In general, an OTE sound processing unit is a component having a generally cylindrically shaped housing 111 and which is configured to be magnetically coupled to the user’s head 154 (e.g., includes an integrated external magnet 150 configured to be magnetically coupled to an intemal / implantable magnet 152 in the implantable component 112). The OTE sound processing unit 106 also includes an integrated external (headpiece) coil 108 (the external coil 108) that is configured to be inductively coupled to the implantable coil 114.

[0026] It is to be appreciated that the OTE sound processing unit 106 is merely illustrative of the external devices that could operate with implantable component 112. For example, in alternative examples, the external component 104 can comprise a behind-the-ear (BTE) sound processing unit configured to be attached to, and worn adjacent to, the recipient’s ear. A BTE sound processing unit comprises a housing that is shaped to be worn on the outer ear of the user. In certain examples, the BTE is connected to a separate external coil assembly via a cable, where the external coil assembly is configured to be magnetically and inductively coupled to the implantable coil 114, while in other embodiments the BTE includes a coil disposed in or on the housing worn on the outer ear of the user. It is also to be appreciated that alternative external components could be located in the user’s ear canal, worn on the body, etc.

[0027] Although the cochlear implant system 102 includes the sound processing unit 106 and the cochlear implant 112, as described below, the cochlear implant 112 can operateAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 independently from the sound processing unit 106, for at least a period, to stimulate the user. For example, the cochlear implant 112 can operate in a first general mode, sometimes referred to as an “external hearing mode,” in which the sound processing unit 106 captures sound / acoustic signals that are then used as the basis for delivering stimulation signals to the user. The cochlear implant 112 can also operate in a second general mode, sometimes referred as an “invisible hearing” mode, in which the sound processing unit 106 is unable to provide sound signals to the cochlear implant 112 (e.g., the sound processing unit 106 is not present, the sound processing unit 106 is powered-off, the sound processing unit 106 is malfunctioning, etc.). As such, in the invisible hearing mode, the cochlear implant 112 captures sound signals itself via implantable sound sensors and then uses those sound signals as the basis for delivering stimulation signals to the user. Further details regarding operation of the cochlear implant 112 in the external hearing mode are provided below, followed by details regarding operation of the cochlear implant 112 in the invisible hearing mode. It is to be appreciated that reference to the external hearing mode and the invisible hearing mode is merely illustrative and that the cochlear implant 112 could also operate in alternative modes.

[0028] In FIGs. 1A and 1C, the cochlear implant system 102 is shown with an external device 110, configured to implement aspects of the techniques presented. The external device 110 is a computing device, such as a personal computer (e.g., laptop, desktop, tablet), a mobile phone (e.g., smartphone), a remote control unit, etc. The external device 110 and the cochlear implant system 102 (e.g., sound processing unit 106 or the cochlear implant 112) wirelessly communicate via a bi-directional communication link 126. The bi-directional communication link 126 can comprise, for example, a short-range communication, such as Bluetooth link, Bluetooth Low Energy (BLE) link, a proprietary link, etc.

[0029] The sound processing unit 106 of the external component 104 also comprises one or more input devices configured to capture and / or receive input signals (e.g., sound or data signals) at the sound processing unit 106. The one or more input devices include, for example, one or more sound input devices 118 (e.g., one or more external microphones, audio input ports, telecoils, etc.), one or more auxiliary input devices 128 (e.g., audio ports, such as a Direct Audio Input (DAI), data ports, such as a Universal Serial Bus (USB) port, cable port, etc.), and a short-range wireless transmitter / receiver (wireless transceiver) 120 (e.g., for communication with the external device 110), each located in, on or near the sound processing unit 106. However, it is to be appreciated that one or more input devices can include additional types ofAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 input devices and / or less input devices (e.g., the short-range wireless transceiver 120 and / or one or more auxiliary input devices 128 could be omitted).

[0030] The sound processing unit 106 also comprises the external coil 108, a charging coil 130, a closely-coupled radio frequency transmitter / receiver (RF transceiver) 122, at least one rechargeable battery 132, and an external sound processing module 124. The external sound processing module 124 can be configured to perform a number of operations. Although such operations are described with respect to the external sound processing module 124, it should be noted that these operations could also or alternatively be implemented / performed as part of the implantable sound processing module 158, as part of the external device 110, etc.

[0031] The implantable component 112 comprises an implant body (main module) 134, a lead region 136, and the stimulating assembly 116, all configured to be implanted under the skin (tissue) 115 of the user. The implant body 134 generally comprises a hermetically-sealed housing 138 that includes, in certain examples, at least one power source 125 (e.g., one or more batteries, one or more capacitors, etc.), in which the RF interface circuitry 140 and a stimulator unit 142 are disposed. The implant body 134 also includes the intemal / implantable coil 114 that is generally external to the housing 138, but which is connected to the RF interface circuitry 140 via a hermetic feedthrough (not shown in FIG. ID).

[0032] As noted, the stimulating assembly 116 is configured to be at least partially implanted in the user’s cochlea. The stimulating assembly 116 includes a plurality of longitudinally spaced intra-cochlear electrical stimulating contacts (electrodes) 144 that collectively form a contact array (electrode array) 146 for delivery of electrical stimulation (current) to the recipient’s cochlea. The stimulating assembly 116 extends through an opening in the recipient’s cochlea (e.g., cochleostomy, the round window, etc.) and has a proximal end connected to stimulator unit 142 via the lead region 136 and a hermetic feedthrough (not shown in FIG. ID). The lead region 136 includes a plurality of conductors (wires) that electrically couples the electrodes 144 to the stimulator unit 142. The implantable component 112 also includes an electrode outside of the cochlea, sometimes referred to as the extra-cochlear electrode (ECE) 139.

[0033] As noted, the cochlear implant system 102 includes the external coil 108 and the implantable coil 114. The external magnet 150 is fixed relative to the external coil 108 and the intemal / implantable magnet 152 is fixed relative to the implantable coil 114. The external magnet 150 and the intemal / implantable magnet 152 fixed relative to the external coil 108 andAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 the intemal / implantable coil 114, respectively, facilitate the operational alignment of the external coil 108 with the implantable coil 114. This operational alignment of the coils enables the external component 104 to transmit data and power to the implantable component 112 via a closely-coupled wireless link 148 formed between the external coil 108 with the implantable coil 114. In certain examples, the closely-coupled wireless link 148 is an RF link. However, various other types of energy transfer, such as infrared (IR), electromagnetic, capacitive, and inductive transfer, can be used to transfer the power and / or data from an external component to an implantable component and, as such, FIG. ID illustrates only one example arrangement.

[0034] As noted above, the sound processing unit 106 includes the external sound processing module 124. The external sound processing module 124 is configured to process the received input sound signals (received at one or more of the input devices, such as sound input devices 118 and / or auxiliary input devices 128) and convert the received input sound signals into output control signals for use in stimulating a first ear of a recipient or user (i.e., the external sound processing module 124 is configured to perform sound processing on input signals received at the sound processing unit 106). Stated differently, the one or more processors (e.g., processing element(s) implementing firmware, software, etc.) in the external sound processing module 124 are configured to execute sound processing logic in memory to convert the received input sound signals into output control signals (stimulation signals) that represent electrical stimulation for delivery to the recipient.

[0035] As noted, FIG. ID illustrates an embodiment in which the external sound processing module 124 in the sound processing unit 106 generates the output control signals. In an alternative embodiment, the sound processing unit 106 can send less processed information (e.g., audio data) to the implantable component 112, and the sound processing operations (e.g., conversion of input sounds to output control signals 156) can be performed by a processor within the implantable component 112.

[0036] In FIG. ID, according to an example embodiment, output control signals (stimulation signals) are provided to the RF transceiver 122, which transcutaneously transfers the output control signals (e.g., in an encoded manner) to the implantable component 112 via the external coil 108 and the implantable coil 114. That is, the output control signals (stimulation signals) are received at the RF interface circuitry 140 via the implantable coil 114 and provided to the stimulator unit 142. The stimulator unit 142 is configured to utilize the output control signals to generate electrical stimulation signals (e.g., current signals) for delivery to the user’s cochlea via one or more of the stimulating contacts 144. In this way, the cochlear implant system 102Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 electrically stimulates the user’s auditory nerve cells, bypassing absent or defective hair cells that normally transduce acoustic vibrations into neural activity, in a manner that causes the recipient to perceive one or more components of the input sound signals (the received sound signals).

[0037] As detailed above, in the external hearing mode, the cochlear implant 112 receives processed sound signals from the sound processing unit 106. However, in the invisible hearing mode, the cochlear implant 112 is configured to capture and process sound signals for use in electrically stimulating the user’s auditory nerve cells. In particular, as shown in FIG. ID, an example embodiment of the cochlear implant 112 can include a plurality of implantable sound sensors 165(1), 165(2) that collectively form a sensor array 160, and an implantable sound processing module 158. Similar to the external sound processing module 124, the implantable sound processing module 158 can comprise, for example, one or more processors and a memory device (memory) that includes sound processing logic. The memory device can comprise any one or more of: Non-Volatile Memory (NVM), Ferroelectric Random Access Memory (FRAM), read only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical / tangible memory storage devices. The one or more processors are, for example, microprocessors or microcontrollers that execute instructions for the sound processing logic stored in memory device.

[0038] In the invisible hearing mode, the implantable sound sensors 165(1), 165(2) of the sensor array 160 are configured to detect / capture input sound signals 166 (e.g., acoustic sound signals, vibrations, etc.), which are provided to the implantable sound processing module 158. The implantable sound processing module 158 is configured to convert received input sound signals 166 (received at one or more of the implantable sound sensors 165(1), 165(2)) into output control signals 156 for use in stimulating the first ear of a recipient or user (i.e., the implantable sound processing module 158 is configured to perform sound processing operations). Stated differently, the one or more processors (e.g., processing element(s) implementing firmware, software, etc.) in the implantable sound processing module 158 are configured to execute sound processing logic in memory to convert the received input sound signals 166 into output control signals 156 that are provided to the stimulator unit 142. The stimulator unit 142 is configured to utilize the output control signals 156 to generate electrical stimulation signals (e.g., current signals) for delivery to the user’s cochlea, thereby bypassingAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 the absent or defective hair cells that normally transduce acoustic vibrations into neural activity.

[0039] It is to be appreciated that the above description of the so-called external hearing mode and the so-called invisible hearing mode are merely illustrative and that the cochlear implant system 102 could operate differently in different embodiments. For example, in one alternative implementation of the external hearing mode, the cochlear implant 112 could use signals captured by the sound input devices 118 and the implantable sound sensors 165(1), 165(2) of the sensor array 160 in generating stimulation signals for delivery to the user.

[0040] In some circumstances, the cochlear implant system 102 (e.g., the sound processing unit 106, the cochlear implant 112, or external device 110) is configured to detect / receive a “safety-related acoustic feature” 168. As used herein, a “safety-related acoustic feature” comprises one or more sounds attributes / sound parts / sound signals that represent a potentially dangerous, urgent, or critical circumstance / situation for the recipient or other person. For instance, the safety-related acoustic feature is intended to trigger a hyperarousal response (e.g., fight or flight) from the automatic nervous system to prompt immediate attention from the recipient. The safety-related acoustic features 168 can have any of a variety of different safety forms and can include, for example, a siren (e.g., from an emergency vehicle, from a civil defense system), an alarm (e.g., from a smoke detector, from a carbon monoxide detector, mobile device), audible human cues (e.g., shouting from a crowd, crying from a baby, screaming from a person), an explosion, a collision, and so forth.

[0041] In general, safety-related acoustic features 168 have a prominent acoustic profile and, in certain cases, have a standard / defined acoustic profile. In cases in which the safety-related acoustic features have a defined acoustic profile, the safety-related acoustic feature is sometimes referred to as a “safety-related acoustic object.” For instance, an alarm system defined by International Organization for Standardization (ISO) 7731:2003 have similar frequency ranges, spectro-temporal modulations, and amplitude profiles. Verbal danger alerts defined by ISO 9921:2003 also have pre-defined acoustic features. Human non-verbal calls, such as shouts, crying, screaming also occupy specific frequency range, with different spectro- temporal modulation profiles, etc. As described further below, more specific and individualizable safety-related auditory objects, such as baby crying, explosion, sirens, collision etc., can be identified using a classifier (with 0% to 100% probability).Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1

[0042] In general, the safety-related acoustic features 168 are generated by a source 170 in the recipient’s ambient environment. However, it is be appreciated that the potentially dangerous circumstance / situation for the recipient or other person may or may not be present in the recipient’s ambient environment. For example, in certain arrangements, the source 170 could be an ambulance or smoke detector indicating a dangerous situation is present in the recipient’s ambient / immediate environment. In other arrangements, the source 170 could be an electronic device (e.g., mobile phone) generating an alert (e.g., government or emergency bulletin, such as a Child Abduction Emergencies (CAE) alert) indicating a dangerous situation exists, but where the dangerous situation is not necessarily in the recipient’s ambient / immediate environment.

[0043] Upon generation of a safety-related acoustic feature 168 by the source 170, the recipient can have limited time to perform a suitable action, such as to identify a location of the source 170 and take a responsive action (e.g., for moving toward or away from the source 170 in response, etc.). Therefore, it is desirable for the recipient to be able to identify the presence of the safety-related acoustic feature 168 as quickly as possible to enable the recipient to perform a corresponding action.

[0044] Embodiments of the present disclosure are directed to enhancing (e.g., increasing, improving) saliency of a safety-related acoustic feature to help a recipient perceive the safety- related acoustic feature more clearly / quickly. By way of example, operation of the cochlear implant system 102 to convert received input signals (e.g., the safety-related acoustic feature 168, the received input sound signals 166) to output control signals 156 adjusts in response to detecting the safety-related acoustic feature in the safety-related acoustic feature 168 to enhance saliency. In other words, the manner in which input signals are captured and / or the manner in which the output control signals 156 are generated based on captured input signals is implemented / adjusted based on whether a safety-related acoustic feature is identified. For instance, in one illustrative arrangement, a recipient could have a spectro-temporal modulation threshold indicative of how well the recipient can perceive an acoustic feature. The operation of the cochlear implant system 102 could be adjusted to increase a spectro-temporal modulation of a safety-related acoustic feature above the spectro-temporal modulation threshold, thereby enhancing spectro-temporal cues of the safety-related acoustic feature to cause the recipient to perceive the safety-related acoustic feature more readily.

[0045] By adjusting how input signals are converted to the output control signals 156, the cochlear implant system 102 can indicate the recipient of the presence of the safety-relatedAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 acoustic feature more effectively and potentially still enable the recipient to perceive sounds from an ambient sound environment. As an example, in comparison to merely providing an additional alert (e.g., by superimposing audio feedback on audio output currently being provided, by providing another type of feedback, such as tactile feedback, in addition to audio output), adjusting conversion of input signals to the output control signals 156 can capture / focus the attention of the recipient more readily on the safety-related acoustic feature.

[0046] FIG. 2 is a block diagram of a signal processing path 250 that can be utilized by an implantable system, such as the cochlear implant system 102, to convert an input signal to an output signal. As a preliminary matter, is noted that FIG. 2 refers to the signal processing path 250 as including different devices / blocks / modules. The arrangement of FIG. 2, and reference to including different devices / blocks / modules, is merely for illustration and does not require or imply any specific arrangement of components. Indeed, various aspects shown in FIG. 2 would be implemented as software processes implemented / executed by one or more processors.

[0047] Returning to the FIG. 2, the signal processing path 250 includes a sound input device system 252 with two sound input devices 218 (e.g., microphones) and an auxiliary input 211 (e.g., an audio input port, a cable port, a telecoil, a wireless transceiver). The sound input devices 218 are configured to receive input acoustic signals and, if the input acoustic signals are not already in an electrical form, convert the input acoustic signals into electrical signals 253 representing the received acoustic signals. The sound input devices 218 then provide the electrical signals 253 to a pre-filterbank processing module 254 of the signal processing path 250.

[0048] The pre-filterbank processing module 254 is configured to combine the electrical signals 253 received from the sound input devices 218 and prepare the combined signals for subsequent processing. Specifically, the pre-filterbank processing module 254 generates a prefiltered output signal 255 that represents the collective acoustic signals received at the sound input devices 218. The pre-filterbank processing module 254 provides the pre-filtered output signal 255 to a filterbank module 256 of the signal processing path 250.

[0049] The filterbank module 256 generates a suitable set of bandwidth limited channels, or frequency bins, that each includes a spectral component of the received acoustic signals. That is, the filterbank module 256 includes a plurality of band-pass filters (e.g., sound processing channels) that separates the pre-filtered output signal 255 into multiple components / channels, each one carrying a single frequency sub-band of the original sound (i.e., frequencyAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 components of the received acoustic signal). The signal components (e.g., band-pass fdtered signals, channelized signals) within each of the band-pass filters are further processed within the signal processing path 250. Thus, the signal components are referred to differently at different stages of the signal processing path 250. That is, reference to a signal component can refer to the spectral component of the received acoustic signal at any point within the signal processing path 250.

[0050] The filterbank module 256 is configured to output the signal components as pre- processed signals 257 to a post-filterbank processing module 258. A quantity of channels and pre-processed signals 257 can depend on various factors, including implant design, quantity of active electrodes, coding strategy, and / or recipient preference. In certain arrangements, twenty-two channelized pre-processed signals 257 are created, and the signal processing path 250 correspondingly includes twenty-two channels. The post-filterbank processing module258 is configured to perform various sound processing operations, such as channelized gain adjustments for hearing loss compensation (e.g., gain adjustments to one or more discrete frequency ranges of acoustic signals), noise reduction operations, speech enhancement operations, etc., to process the pre-processed signals 257 in one or more channels. After performing the sound processing operations, the post-filterbank processing module 258 outputs processed signals 259 to a channel selection module 260 of the signal processing path 250.

[0051] The channel selection module 260 is configured to perform a channel selection process to select which of the channels should be used in hearing compensation. The processed signals259 selected at the channel selection module 260 are output as selected signals 261 to a mapping and encoding module 262. For example, the channel selection module 260 is configured to select a subset of the processed signals 259 for use in generation of electrical stimulation for delivery to a recipient (i.e., the sound processing channels are reduced from the post-filterbank processing module 258 to the mapping and encoding module 262). In one specific example, a subset quantity ‘n’ of channels is selected from an available quantity ‘m’ of channels, with quantities ‘m’ and ‘n’ being programmable during initial fitting and / or operation of the implantable system. In some embodiments, the signal processing path 250 does not include the channel selection module 260. For example, certain arrangements can use a continuous interleaved sampling (CIS), CIS-based, or other non-channel selection sound coding strategy.

[0052] The mapping and encoding module 262 is configured to map amplitudes of the selected signals 261 (or of the processed signals 259 in embodiments that do not include the channelAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 selection module 260) into a set of output signals 263 (e.g., stimulation commands) that represent the attributes of the electrical stimulation signals that are to be delivered to the recipient so as to evoke perception of at least a portion of the received acoustic signals. The channel mapping can include, for example, threshold and comfort level mapping, dynamic range adjustments (e.g., compression), volume adjustments, etc., and can encompass selection of various sequential and / or simultaneous stimulation strategies. Thus, the mapping and encoding module 262 converts the selected signals 261 into the output signals 263.

[0053] The output signals 263 are used to stimulate an ear of a recipient and help the recipient perceive sound. As an example, the output signals 263 are transcutaneously transmitted (e.g., via an RF link) from the mapping and encoding module 262 to an implant, which then delivers the set of output signals 263 (e.g., to a stimulator unit) to stimulate the ear. As another example, the set of output signals 263 are directly delivered from the mapping and encoding module 262 (e.g., to a stimulator unit) to stimulate the ear.

[0054] The signal processing path 250 also includes a safety-related acoustic feature identification module 266, a sound classification module 264, and a saliency enhancement module 268, each of which are described in greater detail below. The sound classification module 264 configured to evaluate / analyze the pre-filtered output signal 255 and determine a sound class of the pre-filtered output signal 255. That is, the sound classification module 264 is configured to use received acoustic signals to classify an ambient sound environment of a recipient into one or more sound categories (i.e., determine an input signal type). The sound classes / categories can include “speech,” “noise,” speech+noise,” “music,” and “quiet.” The sound classification module 264 can also estimate a signal-to-noise ratio (SNR) of the prefiltered output signal 255. Although a single sound classification module 264 is shown in FIG. 2, the signal processing path 250 can utilize multiple sound classification modules 264 that are each configured to determine information of the pre-filtered output signal 255. The sound classification module 264 generates sound classification information / data 265 that can be used to control aspects of the signal processing path 250, such as operations of the post-filterbank processing module 258, channel selection module 260, etc. For ease of illustration, the control of these operations by the sound classification module 264 (e.g., arrows from the sound classification module 264 to the various other modules) is not shown in FIG. 2.

[0055] As noted, the signal processing path 250 also includes the safety-related acoustic feature identification module 266 and the saliency enhancement module 268. The safety-related acoustic feature identification module 266 receives the pre-filtered output signal 255 and / or theAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 electrical signals 253 from the sound input devices 218, to determine the occurrence of a safety- related acoustic feature . That is, as noted, safety-related acoustic features 168 have a prominent acoustic profde and the safety-related acoustic feature identification module 266 is configured to detect when the pre-filtered output signal 255 and / or the electrical signals 253 from the sound input devices 218 include an acoustic profile indicative of the presence of a safety-related acoustic feature. In certain examples, the safety-related acoustic feature identification module 266 is a classifier, implemented as a neural network, provided as a probabilistic model, etc.

[0056] In certain examples of the safety-related acoustic feature identification module 266, the specific acoustic feature or group of features (e.g., calculated from high-dimension collapsing methods such as Principal component analysis (PCA)) can be compared with certain threshold of value(s). For instance, if a detected spectro-temporal modulation rate exceeds a value defined in ISO 7731:2003, then this suggests that a fire alarm might be present in the ambient auditory environment, especially considering this rate is uncommon in other scenarios.

[0057] In certain examples, the safety-related acoustic feature identification module 266 operates using a classification confidence value of safety-related auditory objects, meaning the confidence / probably needs to reach a certain probability threshold (e.g., 75% confidence), for the module to determine that a safety-related acoustic feature is present. The classification / identification algorithm can identify standard / pre-existing safety-related acoustic objects (e.g., for common dangerous objects) and / or be pre-trained to meet specific needs of users. That is, operation of the safety-related acoustic feature identification module 266 can be customized for a particular recipient. For instance, hearing-impaired parents of newborns might want to be alerted when there is a sudden burst of infants crying.

[0058] It is noted that operation of the safety-related acoustic feature identification module 266, such as the thresholds, could be combined and individualized in several manners. For instance, a joint threshold can be defined with feature(s) and object detection so that a decision is made by considering both information. Also, one recipient might be more conservative than others and prefer more false positives than insufficient true positives, then the thresholds can be lowered to allow for more frequent alerts.

[0059] In operation, once the safety-related acoustic feature identification module 266 determines the occurrence of a safety-related acoustic feature (e.g., once certain threshold(s) is reached during constant monitoring of the acoustic environment), the saliency enhancement module (saliency enhancement operations) 268 are activated. That is, operation of the deviceAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 is adjusted one or more manners to enhance the saliency of the detected / identified safety- related acoustic feature.

[0060] In FIG. 2, the saliency enhancement module 268 is used to illustrate how the operations of the various operations of the signal processing path 250 could be adjusted based on / in response to detection of safety-related acoustic feature in order to enhance the saliency of the safety-related acoustic feature. In particular, as shown, the saliency enhancement module 268 is configured to adjust one or more operations performed in the signal processing path 250 to achieve a target saliency for the safety-related acoustic feature. The saliency enhancement module 268 can adjust operations of the filterbank module 256, the post-filterbank processing module 258, the channel selection module 260, and / or the mapping and encoding module 262 to generate the set of output signals 263 having the target of saliency for the safety-related acoustic feature.

[0061] Indeed, electrical stimulation has a number of characteristics / attributes that can affect the saliency. These attributes include for example, spatial attributes of electrical stimulation, temporal attributes of electrical stimulation, frequency attributes of electrical stimulation, instantaneous spectral bandwidth attributes of the electrical stimulation, any other spectro- temporal attributes of the electrical stimulation, etc. The spatial attributes of electrical stimulation control an area of activated nerve cells in response to delivered stimulation. The temporal attributes control a temporal coding of the electrical stimulation, such as the pulse / stimulation rate / duration, polarity, cathodic / anodic, and so forth. The frequency attributes control a frequency analysis of acoustic input by a filterbank (e.g., the pre-filterbank processing module 254), such as the number and sharpness of the fdters in the filterbank. The instantaneous spectral bandwidth attributes control a proportion of the analyzed spectrum that is delivered via electrical stimulation, such as a quantity of channels stimulated out of the total number of channels (e.g., as selected by the channel selection module 260) in each stimulation frame. Any one or more of these attributes could be adjusted to enhance the saliency of a safety-related acoustic feature. In some embodiments, the attributes are temporarily adjusted from a baseline for a period of time (e.g., corresponding to a duration or expected duration of occurrence of the safety-related acoustic feature) to enhance the saliency of the safety-related acoustic feature. After the period of time has elapsed, the attributes can be reverted back to the baseline to help a recipient perceive other sounds (e.g., to avoid trying to enhance saliency of a safety-related acoustic when there is no safety-related acoustic feature present).Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1

[0062] One example adjustment that can be provided by the saliency enhancement module 268 includes changing how input acoustic signals are provided prior to conversion. For instance, respective input acoustic signals received by the sound input devices 218 are initially weighted in a beamforming operation, and such weighing of the input acoustic signals can be changed. Additionally or alternatively, noise reduction with respect to the input acoustic signals is adjusted, such as suspended, to change the amount of noise that can be perceived by the recipient via the output signals 263. Another example adjustment includes changing a frequency-to-electrode mapping used to convert the input acoustic signals to the output signals 263. That is, instead of converting the input acoustic signals to the output signals 263 with a frequency-to-electrode mapping to provide stimulation that causes the input acoustic signals to be perceived (e.g., to mimic natural hearing), the frequency-to-electrode mapping is changed to provide stimulation that indicates the presence of a safety-related acoustic feature (e.g., even if the changed frequency-to-electrode mapping no longer effectively mimics natural hearing). Other example adjustments include changing (e.g., exaggerating) a rate and / or depth of amplitude modulation, modulating frequency bandwidth, changing the acoustic to electric level mapping (e.g., changing the transduction function between acoustic amplitude and electric charge) so that a different acoustic dynamic range can be transmitted in the electric space, changing a stimulation rate (e.g., to a resonance frequency of a safety-related acoustic feature), changing a pulse duration / amplitude (e.g., increasing to change timbre), changing stimulation polarity or resolution (e.g., changing from a monopolar mode that has relatively low stimulus resolution to a focused mode that has relatively high stimulus resolution), changing stimulation sequence (e.g., changing a sequence in which stimulation is output by electrodes), changing timing (e.g., latency between capturing an input acoustic signal and delivering an output signal converted from the input acoustic signal), any other suitable adjustment, or any combination thereof. FIG. 3 specifically provides further details regarding adjusting the beamforming operation, and FIG. 4 specifically provides further details regarding changing the frequency- to-electrode mapping.

[0063] In any case, the adjustments to sound processing operations in response to identification of the safety-related acoustic feature increase saliency of the safety-related acoustic feature to enable the recipient to perceive a presence of the safety-related acoustic feature more readily. Thus, the conversion of the electrical signals 253 to the output signals 263 adjusts upon identification of the safety-related acoustic feature. As an example, the adjusted conversion of the electrical signals 253 to the output signals can change aspects of sound eventually perceivedAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 by the recipient, such as to change a regularity, a brightness, a pitch, harmonicity, a bandwidth, a rate, a flatness, and / or a scale of sound.

[0064] In some embodiments, the adjustments to the sound processing operations effectuated by the saliency enhancement module 268 enable the recipient to perceive the safety-related acoustic feature more clearly. That is, the output signals 263 delivered to the recipient helps the recipient discern the safety-related acoustic feature from other possible sound of the ambient sound environment. In additional or alternative embodiments, the adjustment to the sound processing operations effectuated by the saliency enhancement module 268 is intended to capture the attention of the recipient to alert the recipient of the presence of the safety-related acoustic feature without the recipient necessarily perceiving the safety-related acoustic feature itself. For instance, by causing the recipient to perceive a sudden and substantial change in sound, such as a sound (e.g., a dissonant tone) that is not typically perceived and / or a sudden change in timing of provided sound, the output signals 263 can readily divert the attention of the recipient without the recipient having to recognize and identify the safety-related acoustic feature in particular. In some implementations, the adjustment to the sound processing operations can reduce the saliency of certain other sounds, such as speech, such that the saliency of the safety-related acoustic feature appears to be relatively enhanced.

[0065] FIG. 2 has generally been described with reference to an embodiment in which the various operations are performed by a medical device (e.g., hearing device) itself. However, it is to be appreciated that this example embodiment is illustrative and that, in certain arrangements, one or more operations can be performed by another device. For example, an external device (e.g., mobile phone) in wireless connection with the medical device could receive / capture the sound signals, identify the safety-related acoustic feature, and / or determine saliency enhancements (e.g., perform the operations of the sound input device system 252, perform the operations of the pre-filterbank processing module 254, perform the operations of the safety-related acoustic feature identification module 266, and / or perform operations of the saliency enhancement module 268). It is also to be appreciated that the various operations shown in FIG. 2 could be performed by an externally-worn medical device, an implantable medical device, and / or a combination thereof.

[0066] FIG. 3 is a block diagram of a signal intake path 300, which can be a part of the signal processing path 250 (e.g., at the sound input device system 252). The signal intake path 300 includes two microphones 302A, 302B, such as omnidirectional microphones, configured to capture acoustic signals for conversion to an output control signal 363 via a sound processorAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1304 (e.g., the external sound processing module 124, the implantable sound processing module 158, the post-filterbank processing module 258). The microphones 302 output captured acoustic signals 306 to a beamformer 308 of the signal intake path 300. The beamformer 308 processes the respective acoustic signals 306 by applying a weighting factor to each acoustic signal 306 to create a virtual beam that produces a desired combined signal 310. As an example, the beamformer 308 determines characteristics of the acoustic signals 306, such as directional components of each acoustic signal 306, to apply the weighting factor. In some embodiments, operation of the beamformer 308 removes noise from the acoustic signals 306 to provide the combined signal 310. The beamformer 308 then outputs the combined signal 310 to the sound processor 304 for further processing, such as gain adjustments, noise reduction operations, speech enhancement operations, and the like.

[0067] In certain embodiments, operation associated with the signal intake path 300 is adjusted in response to detecting a safety-related acoustic feature (e.g., from the acoustic signals 306). By way of example, operation of the beamformer 308 is adjusted (e.g., by changing and / or removing the weighting factor applied to the acoustic signals 306), thereby changing how the combined signal 310 is generated and subsequently converted to the output control signal 363 (e.g., by increasing a volume of noise perceived by the recipient). In additional or alternative embodiments, operation of the microphones 302 are adjusted. For instance, operation of one of the microphones 302 is suspended to change the acoustic signals 306 provided to the beamformer 308 for generating the combined signal 310 that is converted to the output control signal 363. In either case, the output control signal 363 provided by the sound processor 304 in view of the adjusted operation of the signal intake path 300 can capture the attention of a recipient more readily or otherwise notify the recipient of the presence of a safety-related acoustic feature.

[0068] FIG. 4 is a schematic diagram illustrating an adjustment to a frequency-to-electrode mapping for delivering electrical stimulation signals to a recipient, in accordance with certain embodiments presented herein. More specifically, FIG. 4 schematically illustrates the present of multiple electrodes 444 spaced along a cochlea of a recipient (e.g., along a basilar membrane). The cochlea is tonotopically mapped in that each region of the cochlea is acoustically responsive to acoustic signals in a respective, particular frequency range. In general, the basal region of the cochlea is responsive to higher frequency sounds, while the more apical regions of the cochlea are responsive to lower frequencies. Thus, it can be considered that the cochlea provides a frequency axis 400 (e.g., along a basilar membrane ofAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 the cochlea) representative of the relative locations of the regions of the cochlea and the different frequency ranges responsive at each region.

[0069] The tonopotic nature of the cochlea is leveraged in cochlear implants with frequency- to-electrode mapping in which each particular electrode 444 is associated with a specific acoustic frequency and is positioned to a corresponding tonotopic region responsive to (e.g., would naturally be stimulated in acoustic hearing by) the specific acoustic frequency. That is, specific frequency bands are mapped to a set of one or more electrodes 444 used to stimulate a selected (target) population of cochlea nerve cells. Collectively, the frequency bands and associated electrodes 444 form a stimulation channel that delivers stimulation signals at a wide range of frequencies to the recipient.

[0070] Different electrode configurations can be used for a given stimulation channel to activate different nerve cell regions. Thus, control of the electrodes 444 for delivery of stimulation current to a recipient can be adjusted to cause the recipient to evoke different hearing percepts. Each stimulation current can be delivered to a recipient using charge- balanced waveforms, such as biphasic current pulses, and a magnitude of the stimulation current represents relative “weights” that are applied to both phases of the charge-balanced waveform at the corresponding electrode 444. Monopolar stimulation, for instance, is an electrode configuration where for a given stimulation channel, current is “sourced” via one of the electrodes 444, and current is “sunk” by an electrode (e.g., the ECE 139) outside of the cochlea. Other types of electrode configurations, such as bipolar, tripolar, focused multi-polar (FMP), a.k.a. “phased-array” stimulation, etc., typically reduce the size of an excited neural population by “sourcing” the current via one or more of the electrodes 444, while also “sinking” the current via one or more other proximate electrodes 444. Further types of electrode configurations, such as double electrode mode, virtual channels, wide channels, defocused multi-polar, etc., typically increase the size of an excited neural population by “sourcing” the current via multiple adjacent or neighboring intra-cochlear electrodes.

[0071] In a first configuration / mode 470, a magnitude 480A of stimulation current is provided to electrodes 444(12), 444(13), 444(14) for delivery to a recipient in response to an input acoustic signal. That is, in accordance with a first frequency-to-electrode mapping (e.g., for a first electrical stimulation paradigm), the input acoustic signal is converted to output control signals that cause the electrodes 444(12), 444(13), 444(14) to output stimulation current at the magnitude 480A. However, in response to detection of a safety-related acoustic feature, a second frequency-to-electrode mapping (e.g., for a second electrical stimulation paradigm) isAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 used instead of the first frequency-to-electrode mapping for a second configuration / mode 472. In particular, in the second configuration 472, the magnitude 480B of stimulation current is provided to electrodes 444(1), 444(2), 444(3), rather than to the electrodes 444(12), 444(13), 444(14) with respect to the first configuration 470, for delivery to the recipient in response to the same input acoustic signal. In this manner, in accordance with the second frequency-to- electrode mapping, the input acoustic signal is converted to output control signals that cause the electrodes 444(1), 444(2), 444(3), to output stimulation current at the magnitude 480B. Therefore, adjusting the frequency-to-electrode mapping can adjust the distribution of current flow across the electrodes 444.

[0072] Because the electrodes 444(1), 444(2), 444(3) are arranged at different positions along the frequency axis 400 as compared to the positions of the electrodes 444(12), 444(13), 444(14), the stimulation current output by the electrodes 444(1), 444(2), 444(3), can cause the recipient to perceive a different sound, such as different sound frequencies, than that provided via stimulation current output by the electrodes 444(12), 444(13), 444(14). That is, the different stimulation currents (i.e., different channel weightings) effectuated by different frequency-to-electrode mapping result in different voltage and neural excitation along the frequency axis 400 of the cochlea.

[0073] As an example, a frequency-to-electrode mapping is adjusted to activate electrodes that are not typically activated by a similar input acoustic signal (e.g., activating electrodes positioned more basilar in the cochlea in response to a low frequency acoustic input that typically activates electrodes positioned more apical in the cochlea). A recipient can readily detect the change in frequency-to-electrode mapping, such as based on perceiving a different, unexpected sound caused by electrodes stimulating nerve cell regions that are not typically stimulated by a particular input acoustic signal. Thus, changing the frequency-to-electrode mapping can capture the attention of the recipient for indicating the presence of a safety-related acoustic feature.

[0074] The illustrated embodiment shows the change in frequency-to-electrode mapping is accompanied by a shift in the magnitude from 480A to 480B. For instance, the magnitude can be increased in response to detection of a safety-related acoustic feature. In other embodiments, the magnitude can be the same in both modes.

[0075] Moreover, although electrical stimulation is provided to a different group of three electrodes 444 in each of the frequency-to-electrode mappings, changing the frequency-to-Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 electrode mapping can change the quantity of electrodes 444 receiving stimulation current (e.g., to change between monopolar, bipolar, tripolar, and / or FMP stimulation). For example, while stimulation current is delivered to three electrodes 444(12), 444(13), 444(14) in the first configuration 470, stimulation current is delivered to five electrodes 444 (e.g., including the electrodes 444(1), 444(1), 444(3)) in the second configuration 472. Indeed, any suitable change in delivering stimulation current to the electrodes 444 can be established as a result of changing the frequency-to-electrode mapping in response to detection of a safety-related acoustic feature for alerting a recipient.

[0076] FIGs. 5, 6, 7, and 8 illustrate various methods for operating an implantable medical device in accordance with examples presented herein. It should be noted that operation of any of the methods can be performed differently than depicted. For example, an additional operation can be performed for any of the methods, and / or operations of any of the methods can be performed differently than depicted, performed in a different order, and / or not performed. Moreover, respective operations of the methods can be performed in any suitable manner relative to one another, such as sequentially and / or in parallel.

[0077] FIG. 5 is a flowchart of a method 550 for adjusting operation of an implantable medical device in response to detecting a safety-related acoustic feature. At block 552, acoustic signals (e.g., acoustic inputs) are continually captured, such as from a microphone or other sound input device. In some embodiments, the acoustic signals are captured from different directions. At block 554, the captured acoustic signals are converted to electrical stimulation signals for delivery to a recipient to evoke a hearing percept.

[0078] At block 556, a safety-related acoustic feature is detected in a captured acoustic signal. In some embodiments, the safety-related acoustic feature is detected by comparing properties of an acoustic signal (e.g., calculated from a high-dimension collapsing method, such as principal component analysis) to a threshold level. As an example, the safety-related acoustic feature is detected in response to determining a spectro-temporal modulation rate of an acoustic signal exceeds a threshold level, an amplitude of an acoustic signal exceeds a threshold level, a frequency / duration of an acoustic signal exceeds a threshold level, and / or a brightness of an acoustic signal exceeds a threshold level. In additional or alternative embodiments, the safety- related acoustic feature is detected by comparing the acoustic signal to a reference signal indicative of a presence of a safety-related acoustic feature, and the safety-related acoustic feature is detected in response to determining a difference between the acoustic signal and the reference signal is below a threshold level. In certain implementations, a confidence levelAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 associated with the detection of the safety-related acoustic feature is determined based on analysis of the acoustic signal, and detection of the safety-related acoustic feature is verified in response to the confidence level exceeding a threshold. Moreover, in some embodiments, detection of the safety-related acoustic feature can be customized (e.g., by a user) based on a desired regularity in which a safety-related acoustic feature is detected to potentially be present. For instance, the threshold levels can be adjusted (e.g., lowered) accordingly to increase detection of safety-related acoustic features (e.g., for a relatively more cautious recipient who prefers more false positives than insufficient true positives).

[0079] At block 558, after the safety-related acoustic feature is detected, a determination is made regarding whether streaming content operation is active. That is, a determination is made regarding whether audio is currently being provided to the recipient independent of (i.e., not converted based on) captured acoustic signals. Such streaming content can include music, a podcast, a video, a voice message, and so forth. At block 660, in response to determining streaming content operation is not active, the saliency of the safety-related acoustic feature is enhanced. In particular, operation of the implantable medical device to convert captured acoustic signals to stimulation signals is adjusted. For example, a spectro-temporal modulation of the safety-related acoustic feature is increased above a spectro-temporal modulation threshold of the recipient, such as by providing increased clarity of the safety-related acoustic feature to directly cause the recipient to perceive the safety-related acoustic feature and / or by providing an unexpected or atypical sound that is readily perceived by the recipient to cause the recipient to perceive the safety-related acoustic feature indirectly. However, at block 662, in response to determining streaming content operation is active, the streaming content operation is suspended before enhancing saliency of the safety-related acoustic feature. In particular, the audio being streamed can affect a recipient’s perception of sound, such as the safety-related acoustic feature, provided via stimulation generated based on the acoustic signals. Thus, suspending the streaming content operation can further enable the recipient to perceive the safety-related acoustic feature more readily. As an example, for a streaming operation that is in connection with the implantable medical device (e.g., via a streaming application), a command is output to suspend the streaming operation. As another example, a mixing ratio between streaming input and acoustic input for evoking a hearing percept of the recipient is adjusted (e.g., by reducing the streaming input relative to acoustic input).

[0080] The saliency of the safety-related acoustic feature can be enhanced using a variety of different techniques. As an example, enhancing saliency of the safety-related acoustic featureAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 includes adjusting spectro-temporal aspects of stimulation. That is, a spatial, spectral, and / or temporal cue associated with the safety-related acoustic feature is enhanced to help the recipient perceive the safety-related acoustic feature. To this end, magnitudes of stimulation current provided to electrodes and / or the particular electrodes that receive stimulation current (e.g., a frequency-to-electrode mapping) is adjusted to change the electrical stimulation signals provided to a recipient. Adjusting the spectro-temporal aspects of electrical stimulation signals can effectively capture the attention of the recipient and enable the recipient to recognize the presence of the safety-related acoustic feature. In contrast, although a recipient may recognize a change in volume, which is not a spectro-temporal aspect, the recipient may not recognize the presence of a safety-related acoustic feature in response to the change in volume. For instance, the recipient may not immediately react to associate the change in volume with a safety-related acoustic feature (e.g., the recipient may initially associate the change in volume as being a natural change in environment sounds, such as caused by movement of the recipient toward a sound source). Additionally or alternatively, in comparison to adjusting a volume of sound perceived by the recipient, adjusting the spectro-temporal aspects can capture the attention of the recipient without adversely affecting a behavior of the recipient. By way of example, a sudden increase of volume of sound can frighten the recipient or otherwise change a behavior of the recipient in a manner that can negatively affect an ability of the recipient to respond to a detected safety-related acoustic feature (e.g., by causing the recipient to recoil or freeze instead of taking immediate action). Meanwhile, changing the spectro-temporal aspects can capture the attention of the recipient while enabling the recipient to respond desirably. However, it should be noted that in some embodiments, the spectro-temporal aspects of electrical stimulation are adjusted along with volume changes of perceived sound, such as by adjusting a depth of amplitude modulation (e.g., to change timbre).

[0081] FIG. 6 is a flowchart of a method 600 for adjusting operation of an implantable medical device in response to detecting a safety-related acoustic feature. At block 602, incoming acoustic inputs (e.g., acoustic signals, filtered acoustic signals, partially processed acoustic signals) are converted to electrical stimulation signals in accordance with a first electrical stimulation paradigm for delivery to a recipient to evoke a hearing percept. For example, the first electrical stimulation paradigm is used while no safety-related acoustic feature is detected. At block 604, a safety-related acoustic feature is detected, such as from a captured acoustic signal. At block 606, in response to detection of a safety-related acoustic feature, incoming acoustic inputs are converted to electrical stimulations signals in accordance with a secondAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 electrical stimulation paradigm, different from the first electrical stimulation paradigm, for delivery to the recipient to evoke a hearing percept.

[0082] In this way, the manner in which the implantable medical device converts input signals to output signals is adjusted. For instance, the implantable medical device initially operates in a first mode (e.g., an ambient hearing mode, a speech mode) to convert acoustic input signals to electrical stimulation signals in accordance with the first electrical stimulation paradigm, and the implantable medical device transitions operation from the first mode to a second mode (e.g., an alert mode) to convert acoustic input signals to electrical stimulation signals in accordance with the second electrical stimulation paradigm. By way of example, the first electrical stimulation paradigm is more suitable to help the recipient perceive certain acoustic inputs (e.g., speech), whereas the second electrical stimulation paradigm is more suitable to help the recipient perceive, directly or indirectly, the safety-related acoustic feature in particular (e.g., rather than for perceiving speech). In some embodiments, spectro-temporal aspects of electrical stimulation signals generated based on the incoming acoustic inputs are adjusted between the electrical stimulation paradigms. In additional or alternative embodiments, noise signals associated with the incoming acoustic inputs are adjusted. As an example, noise reduction operation is suspended such that an overall amount of acoustic input being converted to electrical stimulation signals is increased, such as to increase noise perceived by the recipient. As another example, operations (e.g., beamforming, directional sensitivity) related to a microphone is adjusted, such as to increase the amount of acoustic input captured and correspondingly converted to electrical stimulation signals. In any case, converting the incoming acoustic inputs to electrical stimulation signals enhances saliency of the safety-related acoustic feature.

[0083] In certain embodiments, operation of the implantable medical device can be adjusted (e.g., from converting incoming acoustic inputs to electrical stimulation signals in accordance with the first electrical stimulation paradigm or in accordance with the second electrical stimulation paradigm) to convert incoming acoustic inputs to electrical stimulation signals in accordance with athird electrical stimulation paradigm (e.g., to operate in athird mode), which can be different from both the first electrical stimulation paradigm and / or the second electrical stimulation paradigm. As an example, the third electrical stimulation paradigm can be utilized in response to detection of a different safety-related acoustic feature, and the third electrical stimulation paradigm can be more suitable (e.g., as compared to the second electrical stimulation paradigm) for enhancing saliency of that particular safety-related acoustic feature.Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1Therefore, an electrical stimulation paradigm can be selected from a list of available electrical stimulation paradigms based on the particular safety-related acoustic feature that is detected. Thus, operation of the implantable medical device can be more suitably adjusted to enhance the saliency of a detected safety-related acoustic feature.

[0084] In additional or alternative embodiments, operation of the implantable medical device can be reverted back to converting incoming acoustic inputs to electrical stimulation signals in accordance with the first electrical stimulation paradigm. By way of example, the first electrical stimulation paradigm can be utilized in response to a determination that no safety- related acoustic feature has been detected (e.g., within a threshold duration of time). Thus, while no safety-related acoustic feature is being detected, the implantable medical device operates to enable a recipient to perceive sound more suitably via the first electrical stimulation paradigm, rather than any electrical stimulation paradigm used for enhancing saliency of a safety-related acoustic feature.

[0085] FIG. 7 is a flowchart of a method 700 for adjusting operation of an implantable medical device in response to detecting a safety-related acoustic feature. At block 702, a spectro- temporal modulation threshold of a recipient is determined to ascertain a characteristic of hearing perception of the recipient. As an example, the spectro-temporal modulation threshold of the recipient is determined during fitting of the implantable medical device to determine the ability of the recipient to perceive various acoustic signals having different properties.

[0086] At block 704, a safety-related acoustic feature is detected. At block 706, operation of the implantable medical device to convert acoustic inputs to electrical stimulation signals is adjusted to generate an electrical stimulation signal representing the safety-related acoustic feature and having a spectro-temporal modulation above the spectro-temporal modulation threshold. Thus, the electrical stimulation signal can cause the recipient to perceive sound indicative of the presence of the safety-related acoustic feature more readily. The adjustment made to the conversion of acoustic inputs to electrical stimulation signals can be performed via any of the techniques discussed herein, such as by adjusting spectro-temporal aspects of the electrical stimulation signals (e.g., by adjusting frequency-to-electrode mapping). By adjusting the conversion of acoustic inputs to electrical stimulation signals in a manner that increases the spectro-temporal modulation above the spectro-temporal modulation threshold specific the recipient, operation of the implantable medical device can be adjusted more suitably to enable the recipient to perceive the safety-related acoustic feature. For instance, the conversion of acoustic inputs to electrical stimulation signals is adjusted in a first manner (e.g., by changingAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 frequency-to-electrode mapping) in response to the spectro-temporal modulation of a safety- related acoustic feature being below a first safety-related acoustic feature threshold of a first recipient, whereas the conversion of acoustic inputs to electrical stimulation signals is adjusted in a second, different manner (e.g., by changing stimulation rate) in response to the spectro- temporal modulation of the safety-related acoustic feature being below a second safety-related acoustic feature threshold of a second recipient. Adjusting the conversion of acoustic inputs to electrical stimulation signals in different manners for different recipients can enable each recipient to perceive a safety-related acoustic feature as desired.

[0087] In some embodiments, operation of the implantable medical device to convert acoustic inputs to electrical stimulation signals is adjusted based on a particular safety-related acoustic feature that is detected. In other words, the conversion of acoustic inputs to electrical stimulation signals can also be adjusted in different manners for different detected safety- related acoustic features. To this end, respective spectro-temporal modulations of various safety-related acoustic features are determined. In response to detecting one of the safety- related acoustic features, operation of the implantable medical device is then adjusted to increase the particular spectro-temporal modulation corresponding to the safety-related acoustic feature above the spectro-temporal modulation threshold of the recipient, even though such an adjusted operation of the implantable medical device may not change the spectro- temporal modulation corresponding to a different one of the safety-related acoustic feature above the spectro-temporal modulation threshold.

[0088] As an example, the spectro-temporal modulation threshold of the recipient can be compared to the spectro-temporal modulations of various safety-related acoustic features to determine whether the recipient can perceive each safety-related acoustic feature and how a property of a safety-related acoustic feature can be adjusted to increase the spectro-temporal modulation of the safety-related acoustic feature . By way of example, for a particular recipient, the frequency of a first safety-related acoustic feature is too high for the recipient to perceive the first safety-related acoustic feature effectively. Therefore, to increase the spectro-temporal modulation of the first safety-related acoustic feature above the spectro-temporal modulation threshold of the recipient, conversion of acoustic inputs to electrical stimulation signals is adjusted to generate an electrical stimulation signal that reduces the frequency of the first safety-related acoustic feature. In contrast, the frequency of a second safety-related acoustic feature is too low for the recipient to perceive the second safety-related acoustic feature effectively. Thus, to increase the spectro-temporal modulation of the second safety-relatedAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 acoustic feature above the spectro-temporal modulation threshold, conversion of acoustic inputs to electrical stimulation signals is adjusted to generate an electrical stimulation signal that increases the frequency of the second safety-related acoustic feature. In this manner, instead of adjusting operation of the implantable medical device in the same manner (e.g., by increasing the frequency) for each detected safety-related acoustic feature, operation of the implantable medical device is more suitably adjusted to enable a safety-related acoustic feature to be perceived by the recipient.

[0089] FIG. 8 is a flowchart of a method 850 for selectively adjusting operation of an implantable medical device in response to a detected safety-related acoustic feature. At block 852, a user selection is received to indicate a first safety-related acoustic feature that is of interest and a second safety-related acoustic feature that is not of interest. That is, the user selection indicates that a recipient desires to be notified when the first safety-related acoustic feature is detected but not when the second safety-related acoustic feature is detected.

[0090] At block 854, operation of the implantable medical device to convert acoustic inputs to electrical stimulation signals is adjusted in response to detecting the first safety-related acoustic feature. In particular, operation of the implantable medical device is adjusted to enhance the saliency of the first safety-related acoustic feature, such as to increase a spectro-temporal modulation of the first safety-related acoustic feature (e.g., above a spectro-temporal modulation threshold). Thus, a recipient can more readily perceive the first safety-related acoustic feature that is of interest.

[0091] At block 856, operation of the implantable medical device to convert acoustic inputs to electrical stimulation signals is maintained in response to detecting the second safety-related acoustic feature. That is, because the second safety-related acoustic feature is not of interest, increased saliency of the second safety-related acoustic feature is not desirable, so a current operation of the implantable medical device is maintained to avoid intentionally or dedicatedly increasing saliency of the second safety-related acoustic feature. In this manner, the implantable medical device can operate more suitably to convert acoustic inputs to electrical stimulation signals, such as to granularly control whether the saliency of different safety-related acoustic features is enhanced.

[0092] By selectively adjusting operation of the implantable medical device in response to different safety-related acoustic features, a recipient can be more suitably and effectively be alerted of safety-related acoustic features. By way of example, a safety-related acoustic featureAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 that includes a fire alarm is of interest to a first recipient, but a safety-related acoustic feature that includes a baby crying is not of interest to the first recipient. However, because a baby crying can be a relatively more ubiquitous noise, adjusting the conversion of acoustic inputs to electrical stimulation signal each time a safety-related acoustic feature that includes a baby crying is detected can repeatedly or regularly cause the first recipient to perceive a presence of a detected safety-related acoustic feature, even though such a detected safety-related acoustic feature is not of interest. Consequently, the first recipient can become desensitized to such an alert. Thus, in response to an adjusted conversion of acoustic inputs to electrical stimulation signals in response to detection of a safety-related acoustic feature that includes a fire alarm, the first recipient may ignore an indication that a safety-related acoustic feature is detected, even though such a safety-related acoustic feature is of interest to the first recipient. Thus, adjusting the conversion of acoustic inputs to electrical stimulation signals in response to detecting a baby crying can negatively affect the behavior of the first recipient. Meanwhile, a safety-related acoustic feature that includes a baby crying is of interest to a second recipient, who has child. Therefore, it would be more suitable for the implantable medical device to adjust how acoustic inputs are converted to electrical stimulation signals in response to a detection of a safety-related acoustic feature that includes a baby crying to inform the second recipient of the presence of such a safety-related acoustic feature. In such an example, changing how the implantable medical device operates in response to detecting a safety-related acoustic feature that includes a baby crying, namely whether converting acoustic inputs to electrical stimulation signals is adjusted, between the first recipient and the second recipient can more suitably prompt a responsive action.

[0093] In the above embodiments, the “saliency-enhancements” can, in certain examples, be considered “acoustic saliency-enhancements” or “hearing-saliency enhancements.” That is, the enhancements are performed to increase the recipient’s perception of the safety-related acoustic feature via the acoustic / hearing pathway. However, as previously described, the technology disclosed herein can be applied in any of a variety of circumstances and / or with a variety of different devices and, accordingly, the “saliency-enhancements” can take different forms, and the types of safety-related features can take different forms. That is, the safety- related features could include other types of input signals, including types of spatial inputs (e.g., light signals). Example devices, other than a cochlear implant, which can benefit from technology disclosed herein are described in more detail in FIGS. 9-12. However, as noted, the techniques of the present disclosure can be applied to any suitable device, such as aAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 neurostimulator, a cardiac pacemaker, a cardiac defibrillator, a sleep apnea management stimulator, a seizure therapy stimulator, a tinnitus management stimulator, a vestibular stimulation device, as well as other medical devices that deliver stimulation to tissue. Further, technology described herein can also be applied to consumer devices. Indeed, techniques discussed herein can be implemented in any suitable implantable auditory prosthesis, such as a cochlear implant as discussed herein, or in any other suitable device configured to convert an input signal to an output signal for stimulating a recipient. These different systems and devices can benefit from the technology described herein.

[0094] FIG. 9 illustrates an example vestibular stimulator system 902 (e.g., a vestibular implant, a vestibular stimulation device), with which embodiments presented herein can be implemented. As shown, the vestibular stimulator system 902 comprises an implantable component (vestibular stimulator) 912 and an external device / component 904 (e.g., external processing device, battery charger, remote control, etc.). The external device 904 comprises a transceiver unit 960. As such, the external device 904 is configured to transfer data (and potentially power) to the vestibular stimulator 912.

[0095] The vestibular stimulator 912 comprises an implant body (main module) 934, a lead region 936, and a stimulating assembly 916, all configured to be implanted under the skin / tissue 915 of the recipient. The implant body 934 generally comprises a hermetically-sealed housing 938 in which RF interface circuitry, one or more rechargeable batteries, one or more processors, one or more memories, and a stimulator unit are disposed. The implant body 134 also includes an intemal / implantable coil 914 that is generally external to the housing 938, but which is connected to the transceiver via a hermetic feedthrough (not shown).

[0096] The stimulating assembly 916 comprises a plurality of electrodes 944(l)-(3) disposed in a carrier member (e.g., a flexible silicone body). In this specific example, the stimulating assembly 916 comprises three (3) stimulation electrodes, referred to as stimulation electrodes 944(1), 944(2), and 944(3). The stimulation electrodes 944(1), 944(2), and 944(3) function as an electrical interface for delivery of electrical stimulation signals to the recipient’s vestibular system.

[0097] The stimulating assembly 916 is configured such that a surgeon can implant the stimulating assembly adjacent the recipient’s otolith organs via, for example, the recipient’s oval window. It is to be appreciated that this specific embodiment with three stimulation electrodes 944 is merely illustrative and that the techniques presented herein can be used withAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 stimulating assemblies having different numbers of stimulation electrodes, stimulating assemblies having different lengths, etc.

[0098] In operation, the vestibular stimulator 912, the external device 904, and / or another external device can be configured to implement the techniques presented herein. That is, the vestibular stimulator 912, possibly in combination with the external device 904 and / or another external device, can include an evoked biological response analysis system, as described elsewhere herein. For example, the vestibular stimulator 912 is configured to convert input signals (e.g., motion inputs) to electrical stimulation signals provided by the electrodes 944, such as to stimulate the recipient’s vestibular system to maintain a sense of balance and spatial orientation of the recipient. The vestibular stimulator 912 is also configured to detect a safety- related acoustic feature and adjust the conversion of input signals to electrical stimulation signals to enhance a saliency of the safety-related acoustic feature.

[0099] For instance, the vestibular stimulator 912 is configured to perform certain operations described with reference to FIG. 2, such as the operations of the safety-related acoustic feature identification module 266 and / or the operations of the saliency enhancement module 268, to enable the vestibular stimulator 912 to selectively perform “saliency-enhancemenf ’ operations. In one example, the vestibular stimulator 912 could adjust spectro-temporal aspects of the electrical stimulation signals to help the recipient perceive the presence of the safety-related acoustic feature. In the context of FIG. 9, the “saliency-enhancement” is not necessarily an “acoustic saliency-enhancement,” but instead can be considered a “motion saliency- enhancement” or “balance saliency-enhancement” (e.g., a change in the balance control signals to focus the recipient’s attention on the safety-related acoustic feature.[ootoo] FIG. 10 illustrates a retinal prosthesis system 1001 that comprises an external device 1010 configured to communicate with an implantable retinal prosthesis 1000 via signals 1051. The implantable retinal prosthesis 1000 comprises an implanted processing module 1025, and a retinal prosthesis sensor-stimulator 1090 is positioned proximate the retina of a recipient. The external device 1010 and the processing module 1025 can communicate via coils 1008, 1014.[ooiot] In an example, sensory inputs (e.g., photons entering the eye) are absorbed by a microelectronic array of the sensor-stimulator 1090 that is hybridized to a glass piece 1092 including, for example, an embedded array of microwires. The glass can have a curved surface that conforms to the inner radius of the retina. The sensor-stimulator 1090 can include aAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 microelectronic imaging device that can be made of thin silicon containing integrated circuitry that converts the incident photons to an electronic charge.

[0102] The processing module 1025 includes an image processor 1023 that is in signal communication with the sensor-stimulator 1090 via, for example, a lead 1088 that extends through a surgical incision 1089 formed in the eye wall. In other examples, the processing module 1025 is in wireless communication with the sensor-stimulator 1090. The image processor 1023 processes the input into the sensor-stimulator 1090 and converts the input to control signals that are provided back to the sensor-stimulator 1090 so the sensor-stimulator 1090 can provide an output to the optic nerve. That said, in an alternate example, the processing is executed by a component proximate to, or integrated with, the sensor-stimulator 1090. The electric charge resulting from the conversion of the incident photons is converted to a proportional amount of electronic current which is input to a nearby retinal cell layer. The cells fire and a signal is sent to the optic nerve, thus inducing a sight perception.

[0103] The processing module 1025 can be implanted in the recipient and function by communicating with the external device 1010, such as a BTE unit, a pair of eyeglasses, etc. The external device 1010 can include an external light / image capture device (e.g., located in / on a behind-the-ear device or a pair of glasses, etc.), while, as noted above, in some examples, the sensor-stimulator 1090 captures light / images, in which the sensor-stimulator 1090 is implanted in the recipient.

[0104] In accordance with various techniques discussed herein, the processing module 1025 can adjust the conversion of input to control signals used to stimulate the retina to enable the recipient to better perceive a safety-related feature, such as a flashing light. More specifically, the processing module 1025 is configured to perform certain operations similar to those described with reference to FIG. 2, such as the operations of the safety-related acoustic feature identification module 266 (but modified to detect a visual safety-related feature) and / or the operations of the saliency enhancement module 268, to enable the retinal prosthesis system 1001 to selectively perform “saliency-enhancement” operations. That is, the processing module 1025 is configured to detect a safety-related visual feature and adjust operations in response to generate control signals that cause a recipient to perceive the presence of the safety- related visual feature. In some embodiments, the processing module 1025 is configured to adjust spectro-temporal aspects of the control signals. By way of example, the processing module 1025 converts input to control signals with adjusted frequency / timing that causes the recipient to perceive a flashing light.Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1

[0105] FIG. 11 illustrates a tinnitus therapy device 1100 (e.g., a tinnitus implant, a tinnitus management stimulator) including a sound input unit 1102 (e.g., a microphone) configured to receive acoustic inputs. In some embodiments, the sound input unit 1102 is implanted adjacent to an outer ear 1103 to position a diaphragm 1116 of the sound input unit 1102 such that the diaphragm 1116 is configured to be displaced (vibrate) in response to the acoustic inputs. The tinnitus therapy device 1100 further includes an implant body 1104 in which circuitry, such as a processor and / or a memory, is disposed. The implant body 1104 is also coupled to a coil 1108 to enable transfer of power / data between the tinnitus therapy device 1100 and an external device. The implant body 1104 is electrically coupled to the sound input unit 1102 to receive the acoustic input. The tinnitus therapy device 1100 is then configured to convert the acoustic input to tinnitus therapy control signals (e.g., based on a classification of the acoustic input).

[0106] The tinnitus therapy control signals are provided to an actuator 1106 electrically coupled to the implant body 1104 for delivery to the recipient. By way of example, a coupling member 1140 couples the actuator 1106 to an ossicular chain 1136 (i.e., the malleus, the incus, and the stapes bones) positioned in a middle ear cavity between a tympanic membrane 1113 and a cochlea 1138 of the recipient, and the actuator 1106 is configured to deliver the tinnitus therapy control signals. The actuator 1106 is attached to a temporal bone 1115 of the recipient via a fixation system 1142 and is configured to impart motion to (e.g., vibrate) the ossicular chain 1136, which is typically configured to amplify sound waves received via an ear canal 1111. In operation, the actuator 1106 is configured to impart motion based on the tinnitus therapy control signals, and such vibration creates waves of fluid motion of perilymph within the cochlea 1138 to activate hair cells within the cochlea 1138. Activation of the hair cells causes nerve impulses to be generated and transferred through spiral ganglion cells, an auditory nerve, and a brain, where the vibration is perceived as sounds to provide relief of tinnitus symptoms experienced by the recipient.

[0107] The tinnitus therapy device 1100 is also configured to perform various techniques discussed herein. That is, the tinnitus therapy device 1100 is configured to perform certain operations described with reference to FIG. 2, such as the operations of the safety-related acoustic feature identification module 266 and / or the operations of the saliency enhancement module 268, to enable the tinnitus therapy device 1100 to adjust the conversion of acoustic input to tinnitus therapy control signals in response to detecting a safety-related acoustic feature and enhance saliency of the safety-related acoustic feature. Such operational adjustments canAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 include changing a spectro-temporal aspects of the tinnitus therapy control signals to help the recipient perceive the presence of the safety-related acoustic feature.

[0108] FIG. 12 illustrates an upper airway stimulation device 1200 (e.g., an upper airway implant, a sleep apnea management stimulator) that includes an implant body 1202, a sensor 1204, and a stimulator 1206. The upper airway stimulation device 1200 is implantable in a recipient 1208 to position the sensor 1204 adjacent to lungs 1210 of the recipient 1208. Thus, the sensor 1204 is able to receive input that indicates breathing performed by the recipient 1208. The implant body 1202 includes a housing in which circuitry, such as a processor and / or a memory, is disposed. The sensor 1204 transmits electrical signals in response to receipt of the input, and the upper airway stimulation device 1200 is configured to convert the electrical signals to stimulation signals, which are provided to the stimulator 1206. The stimulator 1206 is positioned adjacent to a hypoglossal nerve 1212 of the recipient 1208 and is configured to deliver the stimulation signals to the hypoglossal nerve 1212, which fires nerve cells of a tongue of the recipient 1208, thereby causing the tongue to contract and move (e.g., in an anterior direction) and increase a size of an opening of an airway of the recipient 1208. Consequently, the upper airway stimulation device 1200 generates stimulation signals based on the input to help the recipient 1208 breathe more easily (e.g., while the recipient 1208 is asleep to mitigate sleep apnea).

[0109] In some embodiments, the upper airway stimulation device 1200 is configured to adjust the conversion of electrical signals to stimulation signals in response to detection of a safety- related acoustic feature. That is, the upper airway stimulation device 1200 is configured to perform certain operations described with reference to FIG. 2, such as the operations of the safety-related acoustic feature identification module 266 and / or the operations of the saliency enhancement module 268. By way of example, the upper airway stimulation device 1200 is configured to adjust spectro-temporal aspects of the stimulation signals to change how the hypoglossal nerve 1212 is being stimulated to help the recipient 1208 perceive the safety- related acoustic feature. For instance, the upper airway stimulation device 1200 operates to convert the electrical signals to stimulation signals with irregular frequency / timing that awakens the recipient 1208 from a sleep cycle to enable the recipient 1208 to perceive the safety-related acoustic feature.[ooito] FIG. 13 is a block diagram illustrating one example arrangement for a computing device 1300 configured to perform one or more operations in accordance with certain embodiments presented herein. For example, the computing device 1300 is a part of the external componentAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1104 (e.g., the external sound processing module 124), the cochlear implant 112 (e.g., the implantable sound processing module 158), the external device 110, the external device 904, the external device 1010, the vestibular stimulator 912, the implantable retinal prosthesis 1000, the tinnitus therapy device 1100, and / or the upper airway stimulation device 1200.

[0111] As shown in FIG. 13, in its most basic configuration, the computing device 1300 includes at least one processing unit 1383 and a memory 1384. The processing unit 1383 includes one or more hardware or software processors (e.g., Central Processing Units, Digital Signal Processors (DSPs), uC cores), including software and firmware, which can obtain and execute instructions to perform operations described herein. To this end, the at least one processing unit 1383 can be implemented as firmware elements, partially or fully implemented with digital logic gates in one or more application-specific integrated circuits (ASICs), partially or fully in software, etc. The processing unit 1383 can communicate with and control the performance of other components of the computing device 1300. The memory 1384 is one or more software or hardware-based computer-readable storage media operable to store information accessible by the processing unit 1383. The memory 1384 can store, among other things, instructions executable by the processing unit 1383 to implement applications or cause performance of operations described herein, as well as other data. The memory 1384 can be volatile memory (e.g., RAM), non-volatile memory (e.g., ROM), or combinations thereof. The memory 1384 can include transitory memory or non-transitory memory. The memory 1384 can also include one or more removable or non-removable storage devices. In examples, the memory 1384 can include RAM, ROM) EEPROM (Electronically-Erasable Programmable Read-Only Memory), flash memory, optical disc storage, magnetic storage, solid state storage, or any other memory media usable to store information for later access. By way of example, and not limitation, the memory 1384 can include wired media, such as a wired network or direct-wired connection, and wireless media, such as acoustic, RF, infrared, other wireless media, or combinations thereof. In certain embodiments, the memory 1384 comprises logic 1395 that, when executed, enables the processing unit 1383 to perform aspects of the techniques presented.

[0112] In the illustrated example of FIG. 13, the computing device 1300 further includes a network adapter 1386, one or more input devices 1387, and one or more output devices 1388. The computing device 1300 can include other components, such as a system bus, component interfaces, a graphics system, a power source (e.g., a battery), among other components. The network adapter 1386 is a component of the computing device 1300 that provides networkAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 access (e.g., access to at least one network 1389). The network adapter 1386 can provide wired or wireless network access and can support one or more of a variety of communication technologies and protocols, such as Ethernet, cellular, Bluetooth, near-field communication, and RF, among others. The network adapter 1386 can include one or more antennas and associated components configured for wireless communication according to one or more wireless communication technologies and protocols. The one or more input devices 1387 are devices over which the computing device 1300 receives input from a user. The one or more input devices 1387 can include physically-actuatable user-interface elements (e.g., buttons, switches, or dials), a keypad, keyboard, mouse, touchscreen, and voice input devices, among other input devices that can accept user input. The one or more output devices 1388 are devices by which the computing device 1300 is able to provide output to a user. The output devices 1388 can include a display 1390 (e.g., a liquid crystal display (LCD)) and one or more speakers 1391, among other output devices for presentation of visual or audible information to the recipient, a clinician, an audiologist, or other user.

[0113] It is to be appreciated that the arrangement for the computing device 1300 shown in FIG. 13 is merely illustrative and that aspects of the techniques presented herein can be implemented at a number of different types of systems / devices including any combination of hardware, software, and / or firmware configured to perform the functions described herein. For example, the computing device 1300 can be a personal computer (e.g., a desktop or laptop computer), a hand-held device (e.g., a tablet computer), a mobile device (e.g., a smartphone), a surgical system, and / or any other electronic device having the capabilities to perform the associated operations described elsewhere herein.

[0114] As should be appreciated, while particular uses of the technology have been illustrated and discussed above, the disclosed technology can be used with a variety of devices in accordance with many examples of the technology. The above discussion is not meant to suggest that the disclosed technology is only suitable for implementation within systems akin to that illustrated in the figures. In general, additional configurations can be used to practice the processes and systems herein and / or some aspects described can be excluded without departing from the processes and systems disclosed herein.

[0115] This disclosure described some aspects of the present technology with reference to the accompanying drawings, in which only some of the possible aspects were shown. Other aspects can, however, be embodied in many different forms and should not be construed as limited to the aspects set forth herein. Rather, these aspects were provided so that thisAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 disclosure was thorough and complete and fully conveyed the scope of the possible aspects to those skilled in the art.

[0116] As should be appreciated, the various aspects (e.g., portions, components, etc.) described with respect to the figures herein are not intended to limit the systems and processes to the particular aspects described. Accordingly, additional configurations can be used to practice the methods and systems herein and / or some aspects described can be excluded without departing from the methods and systems disclosed herein.

[0117] According to certain aspects, systems and non-transitory computer readable storage media are provided. The systems are configured with hardware configured to execute operations analogous to the methods of the present disclosure. The one or more non-transitory computer readable storage media comprise instructions that, when executed by one or more processors, cause the one or more processors to execute operations analogous to the methods of the present disclosure.

[0118] Similarly, where steps of a process are disclosed, those steps are described for purposes of illustrating the present methods and systems and are not intended to limit the disclosure to a particular sequence of steps. For example, the steps can be performed in differing order, two or more steps can be performed concurrently, additional steps can be performed, and disclosed steps can be excluded without departing from the present disclosure. Further, the disclosed processes can be repeated.

[0119] Although specific aspects were described herein, the scope of the technology is not limited to those specific aspects. One skilled in the art will recognize other aspects or improvements that are within the scope of the present technology. Therefore, the specific structure, acts, or media are disclosed only as illustrative aspects. The scope of the technology is defined by the following claims and any equivalents therein.

[0120] It is also to be appreciated that the embodiments presented herein are not mutually exclusive and that the various embodiments can be combined with another in any of a number of different manners.

Claims

Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1CLAIMSWhat is claimed is:

1. A method, comprising: converting acoustic signals to electrical stimulation signals for delivery to a recipient of a medical device; detecting a safety-related acoustic feature; and adjusting the conversion of acoustic signals to electrical stimulation signals in response to detecting the safety-related acoustic feature.

2. The method of claim 1, wherein adjusting the conversion of acoustic signals to electrical stimulation signals in response to detecting the safety-related acoustic feature enhances a saliency of the safety-related acoustic feature.

3. The method of claim 2, wherein adjusting the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprises: changing a frequency-to-electrode mapping associated with delivery of electrical stimulation signals to the recipient.

4. The method of claim 2, wherein adjusting the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprises: adjusting noise reduction applied to acoustic signals.

5. The method of claim 4, wherein adjusting noise reduction applied to acoustic signals comprises: suspending noise reduction applied to acoustic signals.

6. The method of claim 2, wherein adjusting the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprises: adjusting beamforming operations associated with a plurality of microphones configured to capture acoustic signals.Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC17. The method of claim 2, wherein adjusting the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprises: adjusting a stimulation rate associated with electrical stimulation signals.

8. The method of claim 2, wherein adjusting the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprises: adjusting a spectro-temporal modulation associated with electrical stimulation signals.

9. The method of claim 1, 2, 3, 4, 5, 6, 7, or 8, further comprising: delivering electrical stimulation signals to the recipient via one or more implantable electrodes.

10. The method of claim 1, 2, 3, 4, 5, 6, 7, or 8, wherein the medical device comprises an implantable auditory prosthesis.

11. The method of claim 10, wherein the implantable auditory prosthesis comprises a cochlear implant.

12. The method of claim 10, wherein the implantable auditory prosthesis comprises a tinnitus implant.

13. A method, comprising: operating a hearing device in a first mode; converting incoming acoustic inputs to electrical stimulation signals in accordance with a first electrical stimulation paradigm during operation of the hearing device in the first mode; detecting a safety-related acoustic input during operation of the hearing device in the first mode; transitioning operation of the hearing device from the first mode to a second mode in response to detecting the safety-related acoustic input; andAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 converting incoming acoustic inputs to electrical stimulation signals in accordance with a second electrical stimulation paradigm during operation of the hearing device in the second mode, wherein the second electrical stimulation paradigm is different from the first electrical stimulation paradigm.

14. The method of claim 13, wherein the second electrical stimulation paradigm is configured to increase a saliency of the safety-related acoustic input.

15. The method of claim 14, comprising: determining a spectro-temporal modulation threshold of a recipient of the hearing device, wherein the second electrical stimulation paradigm is configured to increase the saliency of the safety-related acoustic input by increasing a spectro-temporal modulation of the safety-related acoustic input above the spectro-temporal modulation threshold.

16. The method of claim 13, 14, or 15, comprising: detecting an additional safety-related acoustic input during operation of the hearing device in the first mode or in the second mode; transitioning operation of the hearing device to a third mode in response to detecting the additional safety-related acoustic input; and converting incoming acoustic inputs to electrical stimulation signals in accordance with a third electrical stimulation paradigm during operation of the hearing device in the third mode, wherein the third electrical stimulation paradigm is different from the first electrical stimulation paradigm and the second electrical stimulation paradigm.

17. The method of claim 13, 14, or 15, wherein the first mode comprises a content streaming operation, and wherein transitioning operation of the hearing device from the first mode to the second mode comprises suspending the content streaming operation.

18. The method of claim 13, 14, or 15, comprising: receiving a user input indicating a selection of the safety-related acoustic input being of interest; andAtty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 transitioning operation of the hearing device from the first mode to the second mode in response to detecting the safety-related acoustic input and based on the user input indicating the selection of the safety-related acoustic input being of interest.

19. The method of claim 13, 14, or 15, comprising: receiving a user input indicating a selection of an additional safety-related acoustic input not being of interest; detecting the additional safety-related acoustic input during operation of the hearing device in the first mode; and maintaining operation of the hearing device in the first mode in response to detecting the additional safety-related acoustic input and based on the user input indicating the selection of the additional safety-related acoustic input not being of interest.

20. The method of claim 13, 14, or 15, wherein the second electrical stimulation paradigm adjusts a spatial attribute, a temporal attribute, a frequency attribute, a spectral attribute, or any combination thereof of electrical stimulation signals.

21. The method of claim 13, 14, or 15, wherein the first electrical stimulation paradigm comprises applying noise reduction to incoming acoustic inputs, and the second electrical stimulation paradigm comprises adjusting noise reduction applied to incoming acoustic inputs.

22. A medical device, comprising: one or more input devices configured to receive input signals associated with an ambient environment of a recipient of the medical device; one or more electrodes; and a processing unit configured to convert the input signals into electrical stimulation signals for delivery to the recipient via the one or more electrodes, wherein in response to detecting a safety-related feature in the input signals, the processing unit is configured to adjust one or more spectro-temporal aspects of the electrical stimulation signals.

23. The medical device of claim 22, the processing unit is configured to adjust the one or more spectro-temporal aspects of the electrical stimulation signals to enhance one or more spectro-temporal cues associated with perception of the safety-related feature.Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC124. The medical device of claim 22, wherein the processing unit is configured to adjust the one or more spectro-temporal aspects of the electrical stimulation signals by adjusting a frequency-to-electrode mapping associated with delivery of the electrical stimulation signals.

25. The medical device of claim 22, wherein the processing unit is configured to adjust the one or more spectro-temporal aspects of the electrical stimulation signals by temporarily changing a stimulation attribute for a period of time.

26. The medical device of claim 22, wherein the processing unit is configured to adjust the one or more spectro-temporal aspects of the electrical stimulation signals by changing a stimulation mode to adjust current flow distributed across the one or more electrodes.

27. The medical device of claim 22, 23, 24, 25, or 26, wherein the one or more electrodes are configured to deliver the electrical stimulation signals to an inner ear of the recipient.

28. The medical device of claim 27, wherein the one or more electrodes are configured to deliver the electrical stimulation signals to a vestibular system of the inner ear.

29. The medical device of claim 22, 23, 24, 25, or 26, wherein the processing unit is configured to adjust the one or more spectro-temporal aspects of the electrical stimulation signals to adjust the conversion of the input signals into the electrical stimulation signals.

30. The medical device of claim 22, 23, 24, 25, or 26, wherein the processing unit is configured to: convert the input signals into the electrical stimulation signals in accordance with a first stimulation paradigm; and convert the input signals into the electrical stimulation signals in accordance with a second stimulation paradigm in response to detecting the safety-related feature in the input signals to adjust the one or more spectro-temporal aspects of the electrical stimulation signals.

31. The medical device of claim 22, 23, 24, 25, or 26, wherein the safety-related feature is a safety-related acoustic feature.Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC132. One or more non-transitory computer readable storage media comprising instructions that, when executed by one or more processors, are configured to: convert acoustic signals to electrical stimulation signals for delivery to a recipient of a medical device; detect a safety-related acoustic feature; and adjust the conversion of acoustic signals to electrical stimulation signals in response to detecting the safety-related acoustic feature enhances a saliency of the safety-related acoustic feature.

33. The one or more non-transitory computer readable storage media of claim 32, wherein the instructions to adjust the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprise instructions that, when executed by the one or more processors, are configured to: change a frequency-to-electrode mapping associated with delivery of electrical stimulation signals to the recipient.

34. The one or more non-transitory computer readable storage media of claim 32, wherein the instructions to adjust the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprise instructions that, when executed by the one or more processors, are configured to: adjust noise reduction applied to acoustic signals.

35. The one or more non-transitory computer readable storage media of claim 32, wherein the instructions to adjust the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprise instructions that, when executed by the one or more processors, are configured to: adjust beamforming operations associated with a plurality of microphones configured to capture acoustic signals.

36. The one or more non-transitory computer readable storage media of claim 32, wherein the instructions to adjust the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprise instructions that, when executed by the one or more processors, are configured to:Atty. Docket No. 3065.0866i Client Ref. No. CID04072WOPC1 adjust a stimulation rate associated with electrical stimulation signals.

37. The one or more non-transitory computer readable storage media of claim 32, wherein the instructions to adjust the conversion of acoustic signals to electrical stimulation signals to enhance the saliency of the safety-related acoustic feature comprise instructions that, when executed by the one or more processors, are configured to: adjust a spectro-temporal modulation associated with electrical stimulation signals.

Images