Artificial cochlea in-vitro machine and artificial cochlea system

Abstract

The invention provides an artificial cochlea in-vitro machine and an artificial cochlea system. The artificial cochlea in-vitro machine comprises a first in-vitro machine and a second in-vitro machine, the first extracorporeal machine is configured to perform LE Audio broadcast to wait for connection of a playing device; after the first external machine is connected with the playing device, the second external machine sends the broadcast information to the second external machine after receiving a command for transmitting the broadcast information from the playing device; and the first extracorporeal machine and the second extracorporeal machine synchronize to periodic broadcasts sent by the playing device based on the broadcast information, obtain corresponding broadcast isochronous streams, and synchronously play the broadcasts. According to the configuration, power consumption and delay are reduced based on LE Audio transmission. Furthermore, the first extracorporeal machine and the second extracorporeal machine can synchronously acquire the broadcast isochronous stream and synchronously play the broadcast, so that the left and right ear sides can receive the audio played by the playing device at the same time.

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and particularly to a cochlear implant external device and a cochlear implant system. Background Art

[0002] The cochlear implant external device can establish communication with a playback device (including a fixed or mobile device) using Bluetooth. The sound played by the playback device can be directly transmitted to the cochlear implant external device via Bluetooth and then to the implant body, thereby reducing sound attenuation and noise interference.

[0003] However, existing classic Bluetooth has high power consumption and high latency during audio transmission. Moreover, classic Bluetooth uses a one-to-one mode for audio transmission. When bilateral cochlear implants are used, the two external devices cannot receive audio from the playback device simultaneously. Summary of the Invention

[0004] The purpose of the present invention is to provide a cochlear implant external device and a cochlear implant system to solve the problems existing in the audio transmission of existing cochlear implant external devices using classic Bluetooth.

[0005] To solve the above technical problems, the present invention provides a cochlear implant external device, which includes a first external device and a second external device;

[0006] The first external device is configured to: perform LE Audio broadcasting to wait for connection by the playback device; after connecting to the playback device, upon receiving a command from the playback device to transmit broadcast information, send the broadcast information to the second external device;

[0007] Based on the broadcast information, the first external device and the second external device synchronize to the periodic broadcast emitted by the playback device, obtain the corresponding broadcast isochronous stream, and play the broadcast synchronously.

[0008] Optionally, when the first external device and / or the second external device fails to obtain the broadcast isochronous stream and waits until a predetermined time, it switches to the idle mode and stops playing the broadcast.

[0009] Optionally, when the first external device and the second external device receive a broadcast source off signal in the broadcast isochronous group emitted by the playback device, they switch to the idle mode and stop playing the broadcast.

[0010] Optionally, when the first external device and / or the second external device leaves the installation position, it switches to the idle mode and stops playing the broadcast.

[0011] Optionally, when the first external device leaves the installation position and the second external device is in the installation position, the second external device continues to obtain the corresponding broadcast isochronous stream based on the periodic broadcast synchronized to the playback device, and continues to play the broadcast.

[0012] Optionally, the first external device and / or the second external device determine whether they are in the installation position according to the communication connection with the corresponding implant.

[0013] Optionally, the first external device and the second external device support true wireless mirroring switching.

[0014] Optionally, the first external device and the second external device each include a microphone, and the first external device and the second external device transmit the audio signals picked up by their respective microphones through Bluetooth; any one of the first external device and the second external device combines the audio signals picked up by its own microphone with the audio signals transmitted by the other through Bluetooth to achieve sound source localization and / or wind noise suppression.

[0015] Optionally, the first external device is configured to be paired with the playback device through LE Audio and classic Bluetooth; the first external device is connected to the playback device through LE Audio and / or classic Bluetooth.

[0016] To solve the above technical problems, the present invention also provides a cochlear implant system, which includes the cochlear implant external device as described above and also includes a playback device.

[0017] In summary, in the cochlear implant external device and the cochlear implant system provided by the present invention, the cochlear implant external device includes a first external device and a second external device; the first external device is configured to: perform LE Audio broadcast to wait for the playback device to connect; after connecting to the playback device, after receiving a command to transmit broadcast information from the playback device, send the broadcast information to the second external device; the first external device and the second external device are synchronized to the periodic broadcast sent by the playback device based on the broadcast information, obtain the corresponding broadcast isochronous stream, and play the broadcast synchronously.

[0018] With such a configuration, based on LE Audio transmission, power consumption and latency are reduced. Further, the first external device and the second external device can synchronously obtain the broadcast isochronous stream and synchronously play the broadcast, so that both the left and right ears can receive the audio played by the playback device simultaneously. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Those of ordinary skill in the art will understand that the provided drawings are used to better understand the present invention and do not constitute any limitation to the scope of the present invention. Among them:

[0020] Figure 1 is the connection topology diagram of the cochlear implant external device and the playback device according to an embodiment of the present invention;

[0021] Figure 2 is the topology diagram of the cochlear implant external device receiving Auracast broadcast according to an embodiment of the present invention;

[0022] Figure 3 is a schematic diagram of two external devices transmitting audio signals to each other according to an embodiment of the present invention. Detailed Embodiments

[0023] To make the objectives, advantages and features of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the accompanying drawings are all in very simplified forms and not drawn to scale, and are only used to facilitate and clearly assist in explaining the objectives of the embodiments of the present invention. In addition, the structures shown in the accompanying drawings are often part of the actual structures. In particular, the accompanying drawings need to show different emphases, and sometimes different scales are used.

[0024] As used in the present invention, the singular forms "a", "an", "one" and "the" include plural objects, the term "or" is generally used in the sense of including "and / or", the term "several" is generally used in the sense of including "at least one", the term "at least two" is generally used in the sense of including "two or more", in addition, the terms "first", "second", "third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first", "second", "third" may explicitly or implicitly include one or at least two of such features. "One end" and "the other end" and "proximal end" and "distal end" generally refer to corresponding two parts, which not only include the endpoints. In addition, as used in the present invention, "mounted", "connected", "coupled", an element "disposed" on another element should be understood in a broad sense, and generally only means that there is a connection, coupling, cooperation or transmission relationship between the two elements, and the two elements can be directly or indirectly connected, coupled, cooperated or transmitted through an intermediate element, and cannot be understood as indicating or implying the spatial position relationship between the two elements, that is, an element can be inside, outside, above, below or on one side of another element, etc. in any orientation, unless the content clearly indicates otherwise. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances. In addition, directional terms such as above, below, up, down, upward, downward, left, right, etc. are used relative to the exemplary embodiments as shown in the figures, and the upward or upper direction faces the top of the corresponding figure, and the downward or lower direction faces the bottom of the corresponding figure.

[0025] The object of the present invention is to provide a cochlear implant external device and a cochlear implant system to solve the problems existing in the audio transmission of the existing cochlear implant external device through classic Bluetooth.

[0026] A cochlear implant usually includes an implant body implanted in the body and an external device placed outside the body. The external device can be fixed near the ear by magnetic attraction or mounted on the ear. At this time, the external device is said to be in the installation position. The external device and the implant body each have a coil. When the external device is in the installation position, the coils of the external device and the implant body match each other, so that wireless signal transmission can be realized. Further, the external device has a microphone, which can collect and pick up sound signals in the environment, encode the sound signals into digital information, and wirelessly transmit the digital information to the implant body through the coil. The mode in which the external device picks up sound through the microphone is called the microphone pickup mode. The implant body decodes the digital information sent by the external device, converts it into an electrical pulse stimulation signal, and sends it to the nerve fibers in the cochlea through the electrodes implanted in the cochlea. When the auditory nerve receives the electrical pulse stimulation signal, the brain can recognize it as sound.

[0027] The external device usually also includes a Bluetooth chip, which can be connected to and communicate with a playback device (such as a mobile phone, etc.). In this way, the audio played by the playback device can be directly transmitted to the external device without passing through the microphone pickup mode, and then after being processed by the voice processing chip, it is transmitted to the implant body. It is not affected by external sounds and can reduce sound distortion. The mode in which the external device plays audio through Bluetooth is called the Bluetooth playback mode. It should be noted that the Bluetooth playback mode of the external device can work simultaneously with the microphone pickup mode, that is, while the external device plays audio through the playback device, its microphone can ensure the pickup of external sounds, and it can take into account the external situation while playing Bluetooth to avoid safety hazards.

[0028] Please refer to Figure 1 and Figure 2 To solve the problems existing in the audio transmission through classic Bluetooth in the prior art, an embodiment of the present invention provides a cochlear implant external device, which includes a first external device 10 and a second external device 20; the first external device 10 is configured to: perform LE Audio broadcasting to wait for a playback device 30 to connect; after connecting to the playback device 30, after receiving a command to transmit broadcast information from the playback device 30, send the broadcast information to the second external device 20; the first external device 10 and the second external device 20 are synchronized to the periodic broadcast issued by the playback device 30 based on the broadcast information, obtain the corresponding broadcast isochronous stream, and play the broadcast synchronously.

[0029] Such as Figure 1As shown, the first external device 10 and the second external device 20 are respectively fixed on the left and right ear sides, for example, and are respectively adapted to the left and right implants implanted bilaterally. Here, the first external device 10 and the second external device 20 are not completely the same in function. The first external device 10 is essentially the main external device, while the second external device 20 is equivalent to a secondary external device. Before the first connection, the first external device 10 is configured to pair with the playback device 30 via LE Audio (LE-ACL) and classic Bluetooth (BR / EDR-ACL). The second external device 20 pairs with the first external device 10 via classic Bluetooth (BR / EDR-ACL).

[0030] When the pairing is completed and the connection and use are carried out, the first external device 10 and the second external device 20 behave as a single device with LE Audio. The first external device 10 first performs LE Audio broadcasting. Since only the first external device 10 performs LE Audio broadcasting, the playback device 30 can only discover one external device (i.e., the first external device 10) that has both BR / EDR and LE Audio functions, and will not see the second external device 20. After the playback device 30 discovers the first external device 10, it can connect via LE Audio and / or classic Bluetooth. Optionally, after the playback device 30 connects to the first external device 10 via LE Audio, it can also use Cross Transport Key Derivation (CTKD) to discover other transports and establish connections.

[0031] Optionally, after the playback device 30 is connected to the first external device 10, the connection can be configured and optimized. For example, including but not limited to:

[0032] The playback device 30 and the first external device 10 configure the uuid profile included in the LE Audio broadcast.

[0033] The playback device 30 is further pre-configured (which means that some software configurations are done in advance, such as the external device name, and security configurations, etc.) to reduce message passing.

[0034] The playback device 30 and the first external device 10 accelerate the connection process via GATT EATT.

[0035] The playback device 30 and the first external device 10 save power consumption by increasing the connection scan interval time (in multiples of 1.25 ms, such as optionally 7.5 ms to about 4 s).

[0036] Such as Figure 2As shown, after the first external device 10 is connected to the playback device 30, the first external device 10 provides the Broadcast Audio Scan Service (BASS) profile to the playback device 30, facilitating the selection of a broadcast source through the UI interface on the playback device 30 side. Subsequently, the playback device 30 sends a command to the first external device 10 to transmit broadcast information. After receiving the command to transmit broadcast information sent by the playback device 30, the first external device 10 sends the broadcast information to the second external device 20.

[0037] Optionally, the playback device 30 sends out Auracast broadcast audio. It can be understood that the broadcast sent by the playback device 30 at this time includes Periodic Advertisements (PA) and Broadcast Isochronous Stream (BIS), etc. Since the first external device 10 is already connected to the playback device 30, it can naturally obtain the broadcast information and synchronize it to the periodic broadcast, and obtain the corresponding broadcast isochronous stream (BIS1) therefrom. Based on the broadcast information transmitted by the first external device 10, the second external device 20 can also synchronize to the periodic broadcast and obtain the corresponding broadcast isochronous stream (BIS2) therefrom. Thus, the first external device 10 and the second external device 20 can play the broadcast synchronously. More specifically, the first external device 10 and the second external device 20 playing the broadcast means transmitting the audio signal played by the playback device 30 to their respective corresponding implants. In some embodiments, if only implanted unilaterally, then the cochlear implant external device may only include the first external device 10. At this time, after the first external device 10 is connected to the playback device 30, it synchronizes to the periodic broadcast and obtains the corresponding broadcast isochronous stream therefrom, that is, starts to play the broadcast.

[0038] It can be understood that Auracast broadcast audio is a low-power Bluetooth transmission based on LE Audio, which reduces power consumption and latency. Further, the first external device 10 and the second external device 20 can synchronously obtain the broadcast isochronous stream and synchronously play the broadcast, enabling both the left and right ears to receive the audio played by the playback device 30 simultaneously.

[0039] To further reduce power consumption, optionally, when the first external device 10 and / or the second external device 20 do not obtain the broadcast isochronous stream and wait until a predetermined time arrives, they switch to the idle mode and stop playing the broadcast. When any external device does not receive the broadcast isochronous stream after exceeding the predetermined time, it can stop receiving the broadcast through the BASS service, switch to the idle mode, and stop playing the broadcast. This scenario is, for example, when the distance between the playback device 30 and the external device is too far or there is interference, etc., such that the external device cannot receive the broadcast.

[0040] Optionally, when the first external device 10 and the second external device 20 receive a broadcast source off signal in a Broadcast Isochronous Group (BIG) sent by the playback device 30, they switch to the idle mode and stop playing the broadcast. When the playback device 30 actively turns off the broadcast, the playback device 30 can send a broadcast source off signal through the broadcast isochronous group. When the first external device 10 and the second external device 20 receive the broadcast source off signal, they immediately switch to the idle mode and stop playing the broadcast.

[0041] Optionally, when the first external device 10 and / or the second external device 20 leave the installation position, they switch to the idle mode and stop playing the broadcast. It can be understood that when any external device leaves the installation position (such as being taken off the ear), the wireless communication connection between the external device and the corresponding implant is interrupted. At this time, the external device immediately switches to the idle mode and stops playing the broadcast to reduce power consumption.

[0042] When the first external device 10 leaves the installation position and the second external device 20 is in the installation position, the second external device 20 continues to obtain the corresponding broadcast isochronous stream based on the periodic broadcast synchronized to the playback device 30 and continues to play the broadcast. It can be understood that the first external device 10 is the main external device and is directly connected to the playback device 30 via Bluetooth. Whether the second external device 20 leaves the installation position does not affect the state of the first external device 10. When the first external device 10 leaves the installation position, the first external device 10 itself switches to the idle mode and stops playing the broadcast. However, if the second external device 20 is still in the installation position at this time, based on the previously synchronized periodic broadcast, it can continue to obtain the corresponding broadcast isochronous stream and continue to play the broadcast.

[0043] Optionally, the first external device 10 and / or the second external device 20 determine whether they are in the installation position according to the communication connection with the corresponding implant. For the judgment of whether the first external device 10 and the second external device 20 are in the installation position, there is no need to additionally set sensors or additional trigger inputs. When any external device is in the installation position, it should be able to communicate with the corresponding implant (that is, the two can achieve wireless communication connection through the matching of their respective coils). Once any external device leaves the installation position, the communication connection between it and the corresponding implant is interrupted, and thus it can be determined that the external device has left the installation position.

[0044] Preferably, the first external device 10 and the second external device 20 support True Wireless Mirroring (TWM). In some embodiments, the first external device 10 and the second external device 20 may be configured to be the same in structure, and the two can be switched based on True Wireless Mirroring. For example, if the first external device 10 is used as the main external device and the built-in battery runs out, the second external device 20, which was originally the secondary external device, can take over the first external device 10 and be configured as the main external device. Optionally, since the first external device 10 and the second external device 20 are configured to be the same in structure, the two external devices with the same configuration can be respectively identified as the first external device 10 (main external device) and the second external device 20 (secondary external device) based on the difference in their Bluetooth addresses (such as even or odd).

[0045] Please refer to Figure 3 , optionally, the first external device 10 and the second external device 20 respectively include microphones, and the first external device 10 and the second external device 20 transmit the audio signals picked up by their respective microphones through Bluetooth; any one of the first external device 10 and the second external device 20 combines the audio signal transmitted by the other through Bluetooth with the audio signal picked up by its own microphone to achieve sound source localization and / or wind noise suppression.

[0046] Limited by the volume, generally only 2 microphones can be set in each external device, and the effect of sound source localization and wind noise suppression is slightly poor. For the cochlear implant external device provided in this embodiment, the first external device 10 and the second external device 20 can perform two-way transmission through Bluetooth. In this way, any external device can not only obtain the audio signal picked up by its own microphone, but also obtain the audio signal picked up by the microphone of the other external device transmitted through Bluetooth. In this way, 3 or even 4 channels of audio signals picked up by microphones can be formed. Based on this, the sound source localization and / or wind noise suppression achieved can effectively improve the accuracy of sound source localization and the effect of wind noise suppression.

[0047] Based on the cochlear implant external device described above, an embodiment of the present invention further provides a cochlear implant system, which includes the above cochlear implant external device and further includes a playback device 30. It further includes an implant. For the structures and principles of other components of the cochlear implant system, those skilled in the art can understand them based on the prior art, and the present invention will not be further elaborated.

[0048] In summary, in the cochlear implant external device and the cochlear implant system provided by the present invention, the cochlear implant external device includes a first external device and a second external device; the first external device is configured to: perform LE Audio broadcasting to wait for a playback device to connect; after connecting to the playback device, upon receiving a command to transmit broadcast information from the playback device, send the broadcast information to the second external device; the first external device and the second external device are synchronized to the periodic broadcast emitted by the playback device based on the broadcast information, obtain corresponding broadcast isochronous streams, and play the broadcast synchronously. With such a configuration, based on LE Audio transmission, power consumption and latency are reduced. Further, the first external device and the second external device can synchronously obtain broadcast isochronous streams and play the broadcast synchronously, so that both the left and right ears can receive the audio played by the playback device simultaneously.

[0049] It should be noted that the above-mentioned several embodiments can be combined with each other. The above description is only a description of the preferred embodiments of the present invention and does not limit the scope of the present invention in any way. Any changes and modifications made by those of ordinary skill in the field of the present invention based on the above disclosure belong to the protection scope of the present invention.

Claims

1. An external cochlear implant device, characterized in that, It includes a first external device and a second external device; The first external device is configured to: conduct LE Audio broadcasting to wait for a playback device to connect; after connecting to the playback device, upon receiving a command to transmit broadcast information from the playback device, send the broadcast information to the second external device; Based on the broadcast information, the first external device and the second external device synchronize to the periodic broadcast emitted by the playback device, obtain corresponding broadcast isochronous streams, and play the broadcast synchronously.

2. The cochlear implant external device according to claim 1, wherein, When the first external device and / or the second external device fails to obtain the broadcast isochronous stream and waits until a predetermined time is reached, it switches to the idle mode and stops playing the broadcast.

3. The cochlear implant external device according to claim 1, wherein, When the first external device and the second external device receive a broadcast source off signal in the broadcast isochronous group emitted by the playback device, they switch to the idle mode and stop playing the broadcast.

4. The cochlear implant external device according to claim 1, wherein When the first external device and / or the second external device leaves the installation position, it switches to the idle mode and stops playing the broadcast.

5. The cochlear implant external device according to claim 4, characterized in that When the first external device leaves the installation position and the second external device is in the installation position, the second external device continues to obtain the corresponding broadcast isochronous stream based on the periodic broadcast synchronized to the playback device and continues to play the broadcast.

6. The cochlear implant external device according to claim 4, wherein The first external device and / or the second external device determines whether it is in the installation position according to the communication connection with the corresponding implant.

7. The cochlear implant external device according to claim 1, characterized in that, The first external device and the second external device support true wireless mirroring switching.

8. The cochlear implant external device according to claim 1, characterized in that, The first external device and the second external device respectively include microphones, and the first external device and the second external device transmit the audio signals picked up by their respective microphones via Bluetooth; either of the first external device and the second external device realizes sound source localization and / or wind noise suppression based on the audio signal transmitted by the other via Bluetooth and combined with the audio signal picked up by its own microphone.

9. The cochlear implant external device according to claim 1, characterized in that, The first external device is configured to pair with the playback device via LE Audio and classic Bluetooth; the first external device is connected to the playback device via LE Audio and / or classic Bluetooth.

10. A cochlear implant system, characterized in that, It includes a cochlear implant external device according to any one of claims 1 to 9, and also includes a playback device.

Images