Hearing system and hearing device with head tracking and related methods

Abstract

A method of head tracking of a subject in a hearing system comprising a first hearing device and a second hearing device is disclosed. The method comprises obtaining first accelerometer data from a first accelerometer of the first hearing device. The method comprises obtaining second accelerometer data from a second accelerometer of the second hearing device. The method comprises determining, based on the first accelerometer data and the second accelerometer data, a head parameter indicative of a position and / or movement of a head of the subject. The method comprises providing an output indicative of the head parameter.

Description

Technical Field

[0001] This disclosure relates to a hearing system including a first hearing device, a second hearing device, and (optionally) accessory devices, as well as related methods including a method of operating the hearing system. Background Technology

[0002] Data obtained from hearing devices through head tracking provides users with valuable insights into improving the performance of their hearing systems. The components used for head tracking are expensive and power-intensive. This high power consumption may require users to charge their hearing devices or replace batteries more frequently. Summary of the Invention

[0003] Therefore, there is a need for hearing devices and methods that can provide head tracking with reduced component costs and / or reduced power consumption.

[0004] A method for head tracking of an object in a hearing system is disclosed. The hearing system includes a first hearing device and a second hearing device. The method includes: obtaining first accelerometer data from a first accelerometer of the first hearing device. The method includes: obtaining second accelerometer data from a second accelerometer of the second hearing device. The method includes: determining head parameters indicating the position and / or movement of the object's head based on the first and second accelerometer data. The method includes: providing an output indicating the head parameters.

[0005] A hearing device is also disclosed. The hearing device includes: a triaxial accelerometer for providing a first accelerometer signal; a set of microphones, including a first microphone, for providing a first microphone input signal; a radio transceiver; a processor for processing the input signal and providing an electrical output signal based on the input signal; and a receiver for converting the electrical output signal into an audio output signal. The hearing device is configured to transmit first accelerometer data based on the first accelerometer signal via the radio transceiver.

[0006] A hearing system is also disclosed. The hearing system includes a first hearing device and a second hearing device. The hearing system is configured to: acquire first accelerometer data from a first accelerometer of the first hearing device. The hearing system is configured to: acquire second accelerometer data from a second accelerometer of the second hearing device. The hearing system is configured to: determine the position and / or head parameters of a specified object's head based on the first and second accelerometer data. The hearing system is configured to: provide an output indicating the head parameters.

[0007] A key advantage of the hearing aid is that head tracking is based on two triaxial accelerometers. These accelerometers have significantly lower power consumption compared to traditional components, providing longer operating times. Furthermore, triaxial accelerometers have a lower component cost than traditional components.

[0008] This disclosure allows for improved (e.g., power-efficient) head tracking based on hearing devices. Obtaining improved head tracking data can allow for a better user experience and better user customization. Head tracking can be used, for example, to control accessory devices in a hearing system, control the hearing device in the hearing system, and / or obtain data about user activity.

[0009] In addition, head tracking can be used to detect movement (e.g., shaking and / or trembling). Shaking and / or trembling may indicate a condition or discomfort associated with involuntary movement (e.g., epilepsy, Parkinson's disease, and Huntington's disease). The advantage is that this disclosure can assist in the early detection of signs of or diagnosis of such conditions or discomfort.

[0010] This disclosure provides a power-efficient and cost-effective hearing system with wireless communication that enables the use of stored posture control accessory devices from head tracking. Attached Figure Description

[0011] The above and other features and advantages of this disclosure will become apparent to those skilled in the art from the following detailed description of exemplary embodiments of this disclosure with reference to the accompanying drawings, wherein:

[0012] Figure 1 An example hearing system according to this disclosure is illustrated schematically.

[0013] Figure 2 A flowchart illustrating an example method according to this disclosure is shown.

[0014] Figure 3 The three axes of a triaxial accelerometer are schematically shown, and

[0015] Figure 4 Examples of head movements such as yaw, pitch, and roll are shown. Detailed Implementation

[0016] Various exemplary embodiments and details are described below with reference to the accompanying drawings when relevant. It should be noted that the drawings may be drawn to scale or not, and elements with similar structure or function are indicated by the same reference numerals throughout the drawings. It should also be noted that the drawings are intended only to facilitate the description of embodiments. They are not intended to be an exhaustive description of this disclosure or a limitation on the scope of this disclosure. Furthermore, the illustrated embodiments need not have all the aspects or advantages shown. Aspects or advantages described in conjunction with a particular embodiment are not necessarily limited to that embodiment and may be practiced in any other embodiment even if not shown or explicitly described therein.

[0017] The disclosed hearing system includes, for example, a first hearing device and a second hearing device. The hearing device (e.g., the first hearing device and / or the second hearing device) can be configured to be worn on a user's ear and can be a audible device (e.g., earplugs, headphones, etc.) or a hearing aid, wherein a processor is configured to compensate for the user's hearing loss. In one or more examples or embodiments, the hearing device (e.g., the first hearing device and / or the second hearing device) can be considered a hearing aid.

[0018] Hearing devices can be of the behind-the-ear (BTE) type, in-the-ear (ITE) type, in-the-canal (ITC) type, in-the-canal (RIC) type, or in-the-ear (RITE) type. Hearing devices can be binaural hearing devices. Hearing systems can include a first earpiece and a second earpiece, wherein the first earpiece and / or the second earpiece is an earpiece such as the hearing device disclosed herein.

[0019] Hearing devices (e.g., a first hearing device and / or a second hearing device) can be configured for wireless communication with one or more devices (e.g., with another hearing device, for example, as part of a binaural hearing system) and / or with one or more accessory devices (e.g., smartphones and / or smartwatches). The hearing device may optionally include an antenna for converting one or more wireless input signals (e.g., a first wireless input signal and / or a second wireless input signal) into an antenna output signal. The wireless input signals may originate from an external source (e.g., a spouse microphone device, a wireless TV audio transmitter, and / or a distributed microphone array associated with a wireless transmitter). The wireless input signals may originate from another hearing device (e.g., as part of a binaural hearing system) and / or one or more accessory devices.

[0020] The hearing device (e.g., a first hearing device and / or a second hearing device) optionally includes a radio transceiver coupled to an antenna for converting an antenna output signal into a transceiver input signal. Radio signals from different external sources may be multiplexed in the radio transceiver as a transceiver input signal, or provided as separate transceiver input signals at separate transceiver output terminals of the radio transceiver. The hearing device may include multiple antennas, and / or the antennas may be configured to operate in one or more antenna modes. The transceiver input signal optionally includes a first transceiver input signal representing a first radio signal from a first external source.

[0021] A hearing device (e.g., a first hearing device and / or a second hearing device) includes a set of microphones. This set of microphones may include one or more microphones. The set of microphones includes: a first microphone for providing a first microphone input signal; and / or a second microphone for providing a second microphone input signal. The set of microphones may include N microphones to provide N microphone signals, where N is an integer from 1 to 10. In one or more exemplary hearing devices, the number of microphones N is two, three, four, five, or more. The set of microphones may include a third microphone for providing a third microphone input signal.

[0022] The hearing device (e.g., a first hearing device and / or a second hearing device) optionally includes a preprocessing unit. The preprocessing unit may be connected to a radio transceiver for preprocessing the transceiver input signal. The preprocessing unit may be connected to a first microphone for preprocessing the first microphone input signal. The preprocessing unit may be connected to a second microphone (if present) for preprocessing the second microphone input signal. The preprocessing unit may include one or more analog-to-digital converters for converting the analog microphone input signal into a digitally preprocessed microphone input signal.

[0023] Hearing systems, hearing devices, health data server devices, healthcare platforms, and / or accessory devices can be configured for wireless communication via wireless communication systems (e.g., short-range wireless communication systems such as Wi-Fi, Bluetooth (e.g., Auracast), Zigbee, IEEE 802.11, IEEE 802.15, infrared, etc.)). Hearing systems, hearing devices, health data server devices, healthcare platforms, and / or accessory devices can also be configured for communication via networks (e.g., global networks (e.g., the Internet) and / or local networks).

[0024] Hearing systems, hearing devices, and / or electronic devices (e.g., accessory devices) can be configured for wireless communication via wireless communication systems (e.g., 3GPP systems that support one or more of the following 3GPP systems: New Radio (NR), Narrowband IoT (NB-IoT), and Long Term Evolution-Enhanced Machine Type Communications (LTE-M), millimeter wave communications (e.g., millimeter wave communications in licensed bands (e.g., device-to-device millimeter wave communications in licensed bands)))).

[0025] The hearing device (e.g., a first hearing device and / or a second hearing device) includes a processor for processing input signals (e.g., preprocessed transceiver input signals and / or preprocessed microphone input signals). The processor provides an electrical output signal based on the input signals to it. Input terminals of the processor may optionally be connected to corresponding output terminals of a preprocessing unit. For example, a transceiver input terminal of the processor may be connected to a transceiver output terminal of the preprocessing unit. One or more microphone input terminals of the processor may be connected to one or more corresponding microphone output terminals of the preprocessing unit.

[0026] The hearing device (e.g., a first hearing device and / or a second hearing device) includes a processor for processing input signals (e.g., preprocessed transceiver input signals and / or preprocessed microphone input signals). The processor is optionally configured to compensate for hearing loss in a user of the hearing device. The processor provides an electrical output signal based on the input signals to it. Input terminals of the processor are optionally connected to corresponding output terminals of a preprocessing unit. For example, a transceiver input terminal of the processor may be connected to a transceiver output terminal of the preprocessing unit. One or more microphone input terminals of the processor may be connected to one or more corresponding microphone output terminals of the preprocessing unit.

[0027] A method for head tracking of an object in a hearing system is disclosed. Head tracking can be associated with detecting head movement. Head tracking can provide data about user intent that enables customization of the hearing device to deliver an improved user experience. For example, head tracking can provide information about head orientation and / or movement, detect abnormal head movements indicating different diseases or discomforts, and / or provide information about the user's level of concentration during a task.

[0028] A hearing system includes a first hearing device and a second hearing device. The method includes: obtaining first accelerometer data from a first accelerometer of the first hearing device. The method includes: obtaining second accelerometer data from a second accelerometer of the second hearing device. Accelerometer data (e.g., first accelerometer data and / or second accelerometer data) can be considered as data associated with an accelerometer (e.g., a triaxial accelerometer). For example, accelerometer data can include one or more of the following: linear acceleration and / or rotational acceleration (e.g., yaw, pitch, and roll) along three axes x, y, and z. Accelerometer data can be considered as data providing information about the condition of an accelerometer (e.g., an accelerometer in a hearing device). Accelerometer data obtained from a user's hearing system can, for example, indicate head movement or body movement.

[0029] The method includes, for example, determining head parameters indicating the position and / or movement of an indicated object's head based on first and / or second accelerometer data. Head parameters can be associated with the state or change in state of the head. In other words, head parameters can indicate, for example, head movement or head position. Head parameters can indicate one or more of the following: rocking movements, twitching movements, uncontrolled tremors, abnormal head movements. Some head parameters can indicate illness or discomfort. Hearing systems can enable the diagnosis of illness or discomfort through head parameters. The method includes providing an output indicating head parameters.

[0030] In one or more example methods, head parameters include one or more of head yaw, pitch, and roll (e.g., the degree of one or more of head yaw, pitch, and roll). Yaw, pitch, and roll can be associated with movement in an internal coordinate system. Yaw can be considered as a rotation about a first axis, pitch can be considered as a rotation about a second axis perpendicular to the first axis, and roll can be considered as a rotation about a third axis perpendicular to both the first and second axes. In the hearing system according to this disclosure, yaw can, for example, be associated with head swaying between left and right. In the hearing system according to this disclosure, pitch can, for example, be associated with head nodding back and forth. In the hearing system according to this disclosure, roll can, for example, be associated with head tilting between left and right.

[0031] In one or more example methods, the head parameters include one or more of a first position parameter, a second position parameter, and a third position parameter. Position parameters (e.g., the first, second, and third position parameters) can be associated with placement. Position parameters can indicate relative placement. For example, having a first, second, and third position parameter can provide information about the head's position relative to the body or the head's default position. Position parameters can indicate movement.

[0032] In one or more examples, the first accelerometer is a triaxial accelerometer. In one or more example hearing systems, the second accelerometer is a triaxial accelerometer. An accelerometer is a sensor used to measure acceleration. A triaxial accelerometer is a sensor used to measure acceleration along three orthogonal axes. Thus, the triaxial accelerometer provides an accelerometer signal as a three-coordinate sensor signal. In other words, two triaxial accelerometers with relative distance allow for the measurement of, for example, the position, yaw, pitch, and roll of a system (e.g., the hearing system of this disclosure).

[0033] In one or more example methods, the method includes: aligning first accelerometer data and second accelerometer data, and determining header parameters based on the aligned accelerometer data. Aligning the first accelerometer data and the second accelerometer data may include: determining a time difference between the first accelerometer data and the second accelerometer data, and, based on the time difference, performing a time offset on one or both of the first accelerometer data and the second accelerometer data to align the first accelerometer data and the second accelerometer data.

[0034] In one or more examples, the hearing system includes accessory devices. The accessory devices may be associated with electronic devices. The accessory devices include interfaces, processors, and memory. The accessory devices may be, for example, mobile phones (e.g., smartphones), smartwatches, dedicated devices (e.g., laptops or PCs, or tablets). The accessory devices form an accessory device for the hearing device. The accessory devices may be paired with the hearing system and / or wirelessly connected to the hearing system. The accessory devices may be able to communicate with the hearing device via wireless connection through signals and / or data.

[0035] In one or more example methods, the method includes, for example, controlling the function of a hearing system based on an output in an accessory device or a first hearing device. Controlling the function of the hearing system can be considered as changing the state of the hearing device. For example, a specific output can be associated with, for example, a change in the volume of the hearing device or answering a telephone call. In other words, specific head movements can be used to control the function of the hearing device and / or accessory device of the hearing system (e.g., the hearing system proposed in this disclosure).

[0036] In one or more examples, providing output indicating head parameters includes feeding head parameters and / or posture, for example, from a hearing application stored in the memory of an accessory device, to a second application stored in the memory of the accessory device of the hearing system. The hearing application may be associated with an application on an electronic device (e.g., an accessory device in the hearing system), for example, to control the functions of the hearing system. The hearing application stored in the memory of the accessory device may be configured to allow data and / or signals (e.g., head parameters) to be transmitted to the second application stored in the memory of the hearing device. In other words, the head parameters provided to the hearing application may be further provided to the second application for, for example, further processing, data sampling, and / or storage. For example, the second application may be configured to map posture to control, derive control signals from the posture / control based on the head parameters, and apply the control signals to the second application / accessory device.

[0037] In one or more examples, App B is one or more of a location app, home automation app, gaming app, fitness app, communication app, and health app. The location app may be associated with an accessory device's App B used to determine location (e.g., GPS location). The location app may receive data from a Global Positioning Network (GPS) to determine the location of the accessory device. The location app may be used to determine, for example, routes and / or distances between two different locations. The location app may be used to track and store movement from one location to another.

[0038] Home automation applications can be associated with accessory devices that control functions such as home appliances or electronic devices via wireless connectivity. For example, a home automation application can be used to change one or more of the following functions: home lighting systems, kitchen appliances (e.g., refrigerators or stoves), audio systems, and displays. In other words, a home automation application can wirelessly connect to electronic appliances in the home and control their functions wirelessly.

[0039] The gaming application can be associated with an accessory device application used to access and execute video games on the accessory device.

[0040] A fitness app can be associated with other apps related to accessories or equipment used in physical activities. The fitness app can record measurements of performance related to the physical activity (e.g., speed, route, heart rate, body temperature). The fitness app can connect to other electronic devices (e.g., a watch) to obtain measurements of physiological performance. In other words, the fitness app can be associated with apps used to measure physiological performance and / or route and weather conditions. The fitness app can record and store measurements of physiological performance and / or route and weather conditions.

[0041] A communication application can be considered as an accessory device associated with communication with one or more electronic devices. A communication device enables wireless communication between one or more electronic devices. A communication application can be configured to transmit and / or receive one or more of the following: text, audio, and data.

[0042] A health app can be viewed as an accessory device associated with monitoring a user's health. In other words, a health app acquires, stores, and processes the user's physiological parameters. A health app may wirelessly communicate with, for example, a second accessory device (e.g., a watch and / or hearing aid) to obtain measurements such as movement, heart rate, and / or tremor.

[0043] In one or more example methods, providing an output indicating head parameters includes storing the head parameters in the memory of the hearing system. The memory of the hearing system may be configured to store one or more of the following: accessory device data disclosed herein, hearing device data, hearing system data, and measurements of physiological parameters.

[0044] In one or more example methods, providing output indicating head parameters includes: determining a pose based on the head parameters and mapping the pose to control. The pose can be associated with, for example, one or more movements in a given order. For example, a pose can be viewed as one or more movements in 3D (e.g., nodding, followed by, for example, tilting the head). A pose made by, for example, the head (e.g., the head wearing a hearing device according to this disclosure) can be decomposed into vectors in three-dimensional space and can be determined by, for example, two triaxial accelerometers. Acceleration measurements provided by the two triaxial accelerometers make it possible to determine the pose by obtaining one or more of the following: position, yaw, pitch, and roll.

[0045] In one or more example methods, the method includes, for example, providing a control signal indicating control to one or both of a first hearing device and a second hearing device, based on posture. The control signal may be a signal indicating a control function (e.g., a function of the hearing device).

[0046] In one or more example methods, providing an output indicating the head parameters includes feeding the head parameters to a pose classifier. The pose classifier may indicate the application used to store the head parameters. The pose classifier may, for example, store historical head parameter data in memory. The pose of the current head parameters provided to the pose classifier can be compared with historical head parameters to identify the pose. The pose classifier may produce an output indicating the pose.

[0047] In one or more example methods, providing the output indicating the head parameters includes sending the head parameters to a server device. The server device may be configured to, for example, obtain the output indicating the head parameters from the accessory device based on data from two triaxial accelerometers of this disclosure via an interface of the server device and / or an interface of the accessory device. Obtaining the head parameters from the accessory device may include, for example, obtaining, receiving, and / or retrieving the head parameters from the accessory device via an interface of the accessory device and / or one or more interfaces of the server device. In other words, the server device may be associated with or include a database to store, receive, and / or transmit data (e.g., data indicating head parameters, such as posture). The server device may be implemented as a central computer system remote from the accessory device and controlled by the manufacturer of the hearing device and / or the hearing application.

[0048] A hearing device is disclosed. The hearing device includes: a triaxial accelerometer for providing a first accelerometer signal; a set of microphones, including a first microphone for providing a first microphone input signal; a radio transceiver; a processor for processing the input signal and providing an electrical output signal based on the input signal; and a receiver for converting the electrical output signal into an audio output signal. The hearing device is configured to transmit first accelerometer data based on the first accelerometer signal via the radio transceiver.

[0049] A hearing system is disclosed. The hearing system includes a first hearing device and a second hearing device. The hearing system is configured to: acquire first accelerometer data from a first accelerometer of the first hearing device; acquire second accelerometer data from a second accelerometer of the second hearing device; determine the position and / or head parameters of an indicated object's head based on the first and second accelerometer data; and provide an output indicating the head parameters.

[0050] In one or more example methods, the hearing system includes: processor circuitry configured to provide output indicating head parameters. In one or more example methods, providing the output includes: determining or deriving a posture based on the head parameters; mapping the posture to control; and, based on the posture, providing a control signal indicating control to one or both of a first hearing device and / or a second hearing device.

[0051] It should be noted that the description and characteristics of the hearing device / system functions (e.g., the hearing device / system configured to be) also apply to the method, and vice versa. For example, the description of a hearing device configured to perform determination also applies to a method, such as operating the hearing device, wherein the method includes: performing determination, and vice versa.

[0052] Figure 1 An example hearing system 1 according to this disclosure is schematically shown. The hearing system 1 includes a first hearing device 2A, a second hearing device 2B, and an accessory device 4. The first hearing device 2A may be, for example, a left-side hearing device. The second hearing device 2B may be, for example, a right-side hearing device.

[0053] Both the first hearing device 2A and the second hearing device 2B include a transceiver module 6 for (wireless) communication with accessory device 4 and / or other hearing devices in the hearing system. The transceiver module 6 includes an antenna 8 and a transceiver 10, and is configured for wireless reception and / or transmission of signals to / from accessory device 4 via wireless connection 11. Both the first hearing device 2A and the second hearing device 2B include corresponding microphones 12A, 12B for providing corresponding first microphone input signals 14A and 14B to processors 16A, 16B of the corresponding hearing devices 2A, 2B. Processors 16A, 16B are configured to: process (e.g., perform) hearing loss compensation on the input signals (e.g., first microphone input signal 14A and second microphone input signal 14B) according to one or more hearing device parameters; and provide corresponding first electrical output signals 18A and 18B based on the input signals. The first hearing device 2A and / or the second hearing device 2B may include: a user interface 20 connected to processors 16A and 16B; and a receiver 22 for providing audio output signals based on electrical output signals 18A and 18B.

[0054] The first hearing device 2A includes a first accelerometer 26A. The first accelerometer may be a triaxial accelerometer that senses or measures acceleration along three mutually orthogonal axes to provide a first accelerometer signal 28A. The first accelerometer 26A is connected to a first processor 16A, which receives the first accelerometer signal 28A. The first processor 16A is configured to transmit first accelerometer data 29A, based on the first accelerometer signal 28A, to the accessory device 4 via a first wireless connection 11A through a radio transceiver 10.

[0055] The second hearing device 2B includes a second accelerometer 26B. The second accelerometer may be a triaxial accelerometer that senses or measures acceleration along three mutually orthogonal axes to provide a second accelerometer signal 28B. The second accelerometer 26B is connected to a second processor 16B, which receives the second accelerometer signal 28B. The second processor 16B is configured to transmit second accelerometer data 29B, based on the second accelerometer signal 28B, to the accessory device 4 via a second wireless connection 11B through a radio transceiver 10.

[0056] Accessory device 4 may be a mobile phone (e.g., the smartphone shown), however, accessory device may be one or more of the following: accessories for smartphones (e.g., smartwatches), computers, laptops, dedicated devices, or tablet computers. Accessory device may include a user interface (not shown), a processor 40, a memory 42, and / or a transceiver module (not shown). Memory 42 may contain a hearing application 44 stored therein. Accessory device 4 is configured to receive first accelerometer data 29A from a first hearing device 2A and second accelerometer data 29B from a second hearing device 2B. Accessory device 4 may be configured to perform functions based on data 29A and 29B.

[0057] Processor 40 is configured to determine head parameters indicating the position and / or movement of the head of the indicated object based on first accelerometer data 29A and second accelerometer data 29B. The head parameters indicate head movement and / or head position. The head parameters may indicate one or more of the following: rocking movement, twitching movement, uncontrolled trembling, abnormal head movement. Some head parameters may indicate illness or discomfort. The hearing system may enable the diagnosis of illness or discomfort through head parameters. Processor 40 (e.g., a hearing application 44 stored in memory 42 and running on processor 40) is configured to provide output indicating the head parameters. The output may be used, for example, to control one or more applications (including a first application 46 stored in memory 42 and running on processor 40 and / or a second application 48) and / or to control one or both hearing devices 2A, 2B.

[0058] Application 46 can be one or more of location applications, home automation applications, gaming applications, fitness applications, communication applications, and health applications, and application 48 can be different from application 46 and can be one or more of location applications, home automation applications, gaming applications, fitness applications, communication applications, and health applications.

[0059] The processor 40 can be configured to store head parameters in the memory 42 of the hearing system and / or send the head parameters to the server device via the wireless connection 11C.

[0060] Processor 40 may include a pose classifier 49, configured to determine a pose based on head parameters, for example, as part of an output providing indications of head parameters, and to map the pose to control. In other words, providing the output indicating head parameters may include feeding the head parameters to the pose classifier. The pose classifier may, for example, store historical head parameter data mapped to poses in memory (e.g., as a lookup table). The pose classifier may generate an output indicating the pose.

[0061] The processor 40 can be configured to, for example, as part of providing an output indicating head parameters, such as based on posture, provide (e.g., send) control signals 41A, 41B indicating control to one or both of the first hearing device 2A and the second hearing device 2B. The control signals 41A, 41B control the functions of the respective hearing devices 2A, 2B (e.g., volume increase or decrease and / or program selection).

[0062] Accessory device 4 may optionally be configured to, for example, send header parameters to server device via wireless communication 11C as part of providing an output indicating header parameters.

[0063] The functions of the hearing system (e.g., the first hearing device 2A and / or the second hearing device 2B) may include one or more of the following: changing programs, adjusting volume, answering and / or hanging up calls, updating location, and logging health indicators (e.g., indicators of epilepsy, Parkinson's disease, and / or Huntington's disease) in memory.

[0064] Figure 2 A flowchart is shown of an exemplary method 100 performed by one or more of a hearing device, hearing system, and accessory device for head tracking of an object, according to the present disclosure. Method 100 includes: obtaining (S102A) first accelerometer data from a first accelerometer (e.g., a triaxial accelerometer) of a first hearing device; and obtaining (S102B) second accelerometer data from a second accelerometer (e.g., a triaxial accelerometer) of a second hearing device.

[0065] Method 100 includes: determining (S104) the position and / or head parameters of the indicated object’s head based on first accelerometer data or second accelerometer data.

[0066] Method 100 includes: providing (S106) an output indicating header parameters.

[0067] The output indicating the head parameters (S106) may include: feeding the head parameters from the hearing application stored in the memory of the accessory device (S106A) to the B application stored in the memory of the hearing system accessory device.

[0068] Providing (S106) an output indicating head parameters may include storing (S106B) the head parameters in the memory of the hearing system.

[0069] Providing (S106) an output indicating head parameters may include: determining (S106C) a posture based on the head parameters; and optionally, mapping (S106G) the posture to a control. Providing (S106) an output indicating head parameters may include: providing (S106H) the posture to one or more applications, such as one or both of a first hearing device or a second hearing device and / or an accessory device.

[0070] The output providing (S106) indicating head parameters may include: providing control signals indicating control, for example, according to posture (S106D), to one or both of the first hearing device or the second hearing device, and / or to one or more applications of the accessory device.

[0071] Providing (S106) an output indicating the head parameters may include feeding (S106E) the head parameters to the pose classifier.

[0072] Providing (S106) an output indicating head parameters may include: sending (S106F) head parameters and / or posture to a server device. In one or more example methods, method 100 includes: in an accessory device, based on output control (S108) of a hearing system function, for example, as described above.

[0073] Figure 3 The three axes of a triaxial accelerometer are schematically shown. The three axes of the triaxial accelerometer, x, y, and z, are orthogonal to each other. Rotation about each axis is referred to as yaw, pitch, and roll, respectively. For example, if two triaxial accelerometers (e.g., a first accelerometer and a second accelerometer) are calibrated, rotation about one or more axes can be determined from the relative acceleration of the first and second accelerometers.

[0074] Figure 4 Examples of head yaw, pitch, and roll movements are shown. Yaw, pitch, and roll can be associated with movement in an internal coordinate system. Example yaw motion 50 can be viewed as rotation about a first axis (e.g., a user shaking their head back and forth from left to right). Example pitch motion 52 can be viewed as rotation about a second axis perpendicular to the first axis (e.g., a user nodding their head back and forth). Example roll motion 54 can be viewed as rotation about a third axis perpendicular to both the first and second axes (e.g., a user tilting their head between the left and right sides).

[0075] It should be noted that the description and characteristics of the hearing device's functions (e.g., the hearing device configured to be) also apply to the method, and vice versa. For example, the description of a hearing device configured to make a determination also applies to a method, such as operating the hearing device, wherein the method includes making a determination, and vice versa.

[0076] Also disclosed are methods, hearing devices, and hearing systems based on any of the following items.

[0077] Item 1. A method for head tracking of an object in a hearing system including a first hearing device and a second hearing device, the method comprising:

[0078] First accelerometer data is obtained from the first accelerometer of the first hearing device;

[0079] Obtain second accelerometer data from the second accelerometer of the second hearing device;

[0080] Based on the first accelerometer data and the second accelerometer data, determine head parameters indicating the position and / or movement of the object's head; and

[0081] Provides output indicating the header parameters.

[0082] Item 2. The method as described in Item 1, wherein the head parameters include one or more of the head's yaw, pitch, and roll.

[0083] Item 3. The method as described in any one of Items 1-2, wherein the header parameter includes one or more of a first position parameter, a second position parameter, and a third position parameter.

[0084] Item 4. The method of any one of items 1-3, wherein the first accelerometer is a triaxial accelerometer, and the second accelerometer is a triaxial accelerometer.

[0085] Item 5. The method of any one of items 1-4, wherein the hearing system includes accessory devices, the method comprising:

[0086] In the accessory device, the function of controlling the hearing system is based on the output.

[0087] Item 6. The method as described in Item 5, wherein providing an output indicating the head parameters comprises: feeding the head parameters from a hearing application stored in the memory of the accessory device to a second application stored in the memory of the accessory device of the hearing system.

[0088] Item 7. The method as described in Item 6, wherein the B application is one or more of a location application, a home automation application, a gaming application, a fitness application, a communication application, and a health application.

[0089] Item 8. The method of any one of items 1-7, wherein providing an output indicating the head parameters comprises: storing the head parameters in the memory of the hearing system.

[0090] Item 9. The method of any one of items 1-8, wherein providing an output indicative of the head parameters comprises: determining a posture based on the head parameters; mapping the posture to control; and providing a control signal indicative of the control to one or both of the first hearing device and the second hearing device according to the posture.

[0091] Item 10. The method of any one of items 1-9, wherein providing an output indicating the head parameters comprises: feeding the head parameters to a pose classifier.

[0092] Item 11. The method of any one of items 1-10, wherein providing the output indicating the header parameters comprises: sending the header parameters to a server device.

[0093] Item 12. A hearing device, comprising:

[0094] A triaxial accelerometer is used to provide the first accelerometer signal;

[0095] A set of microphones, including a first microphone, for providing a first microphone input signal;

[0096] Radio transceiver;

[0097] A processor for processing input signals and providing electrical output signals based on said input signals; and

[0098] A receiver is used to convert the electrical output signal into an audio output signal.

[0099] The hearing device is configured to transmit first accelerometer data based on the first accelerometer signal via the radio transceiver.

[0100] Item 13. A hearing system comprising a first hearing device and a second hearing device, wherein the hearing system is configured to:

[0101] First accelerometer data is obtained from the first accelerometer of the first hearing device;

[0102] Obtain second accelerometer data from the second accelerometer of the second hearing device;

[0103] Based on the first accelerometer data and the second accelerometer data, determine head parameters indicating the position and / or movement of the object's head; and

[0104] Provides output indicating the header parameters.

[0105] Item 14. The hearing system as described in Item 13, wherein the hearing system includes processor circuitry configured to provide an output indicating head parameters, wherein providing the output includes: determining a posture based on the head parameters; mapping the posture to control; and providing a control signal indicating the control to one or both of the first hearing device and the second hearing device according to the posture.

[0106] The use of the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., does not imply any particular order, but is included to identify individual elements. Furthermore, the use of the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., does not indicate any order or importance; rather, the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., are used to distinguish one element from another. Note that the terms "first," "second," "third," and "fourth," "A," "B," and "C," etc., here and elsewhere, are used solely for labelling purposes and are not intended to indicate any particular spatial or temporal order.

[0107] Furthermore, the marking of the first element does not imply the existence of the second element, and vice versa.

[0108] It should be understood that the accompanying drawings include some modules or operations shown in solid lines and some modules or operations shown in dashed lines. The modules or operations included in the solid lines are those included in the most widely exemplary embodiments. The modules or operations included in the dashed lines are exemplary embodiments that may be included in, form part of, or be part of further modules or operations that may be obtained in addition to the modules or operations of the exemplary embodiments shown in the solid lines. It should be understood that these operations need not be performed in the presented order. Furthermore, it should be understood that not all operations need to be performed. The exemplary operations can be performed in any order and in any combination.

[0109] It should be noted that the word "comprising" does not necessarily exclude the existence of other elements or steps besides those listed.

[0110] It should be noted that the words “a” or “an” preceding an element do not preclude the existence of multiple such elements.

[0111] It should also be noted that any reference numerals do not limit the scope of the claims, exemplary embodiments may be implemented at least in part by both hardware and software, and several “means,” “units,” or “devices” may be represented by the same item of hardware.

[0112] The various exemplary methods, apparatuses, and systems described herein are described within the general context of method steps implemented in one aspect by a computer program product including computer-executable instructions (e.g., program code) that execute in a networked environment by a computer. Computer-readable media may include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), etc. Typically, program modules may include routines, programs, objects, components, data structures, etc., that perform specified tasks or implement specific abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for performing steps of the methods disclosed herein. Specific sequences of such executable instructions or associated data structures represent examples of corresponding behaviors for implementing the functionality described in such steps or processes.

[0113] Although features have been shown and described, it should be understood that they are not intended to limit the claimed invention, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the claimed invention. The specification and drawings should therefore be regarded in an illustrative rather than limiting sense. The claimed invention is intended to cover all alternatives, modifications, and equivalents.

[0114] List of reference numerals

[0115] 1 Hearing system

[0116] 2 Hearing devices

[0117] 2A First Hearing Device

[0118] 2B Second Hearing Device

[0119] 4 accessories and equipment

[0120] 6 transceiver modules

[0121] 8 antennas

[0122] 10 transceivers

[0123] 11 Wireless Connection

[0124] 11A First Wireless Connection

[0125] 11B Second Wireless Connection

[0126] 11C Wireless Connection

[0127] 12A First Microphone

[0128] 12B Second Microphone

[0129] 14A First Microphone Input Signal

[0130] 14B Second Microphone Input Signal

[0131] 11 Wireless Connection

[0132] 16A First Processor

[0133] 16B Second Processor

[0134] 18A First Electrical Output Signal

[0135] 18B Second Electrical Output Signal

[0136] 20 User Interfaces

[0137] 22 receiver

[0138] 24 User Interfaces for Accessories

[0139] 26A First Accelerometer

[0140] 26B Second Accelerometer

[0141] 28A First Accelerometer Signal

[0142] 28B Second Accelerometer Signal

[0143] 29A First Accelerometer Data

[0144] 29B Second Accelerometer Data

[0145] 28B Second Accelerometer Signal

[0146] 30 server devices

[0147] 40 accessory devices processor

[0148] 41A is used for the first control signal of the first hearing device.

[0149] 41B is a second control signal for a second hearing device.

[0150] 42 memory

[0151] 44 Listening Applications

[0152] 46B First Application

[0153] 48B Second Application

[0154] 50 yaw motion

[0155] 52 Pitch motion

[0156] 54 Tumbling Movement

[0157] 100 methods for object head tracking

[0158] S102 obtains accelerometer data

[0159] S102A obtains data from the first accelerometer of the first hearing device.

[0160] S102B obtains data from the second accelerometer of the second hearing device.

[0161] S104 determines the position and / or movement parameters of the head of the indicated object.

[0162] S106 provides an output indicating header parameters.

[0163] S106A feeds head parameters stored in the accessory device's memory for hearing applications to application B.

[0164] S106B includes: storing head parameters in the memory of the hearing system.

[0165] The S106C determines posture based on head parameters.

[0166] S106D provides control signals for instruction and control to one or both of the first and second hearing devices based on posture.

[0167] The S106E feeds head parameters into the pose classifier.

[0168] The S106F sends header parameters and / or posture to the server device.

[0169] The S106G maps gestures to controls.

[0170] S106H provides posture

Claims

1. A method for head tracking of an object in a hearing system including a first hearing device and a second hearing device, the method comprising: First accelerometer data is obtained from the first accelerometer of the first hearing device; Obtain second accelerometer data from the second accelerometer of the second hearing device; Based on the first accelerometer data and the second accelerometer data, determine head parameters that indicate the position and / or movement of the object's head; as well as Provides output indicating the header parameters.

2. The method as described in claim 1, wherein, The head parameters include one or more of the head's yaw, pitch, and roll.

3. The method according to any one of claims 1-2, wherein, The head parameters include one or more of a first position parameter, a second position parameter, and a third position parameter.

4. The method according to any one of claims 1-3, wherein, The first accelerometer is a triaxial accelerometer, and the second accelerometer is a triaxial accelerometer.

5. The method according to any one of claims 1-4, wherein, The hearing system includes accessory devices, and the method includes: In the accessory device, the function of controlling the hearing system is based on the output.

6. The method of claim 5, wherein, The output providing indications of the header parameters includes: The head parameters are fed from the hearing application stored in the memory of the accessory device to the B application stored in the memory of the accessory device of the hearing system.

7. The method of claim 6, wherein, The application B is one or more of the following: location application, home automation application, gaming application, fitness application, communication application, and health application.

8. The method according to any one of claims 1-7, wherein, The output providing indications of the header parameters includes: The head parameters are stored in the memory of the hearing system.

9. The method according to any one of claims 1-8, wherein, The output providing indications of the header parameters includes: Based on the head parameters, the posture is determined; Map the gesture to control; and Based on the posture, a control signal instructing the control is provided to one or both of the first hearing device and the second hearing device.

10. The method according to any one of claims 1-9, wherein, The output providing indications of the header parameters includes: The head parameters are fed into the pose classifier.

11. The method according to any one of claims 1-10, wherein, The output providing indications of the header parameters includes: Send the header parameters to the server device.

12. A hearing device, comprising: A triaxial accelerometer is used to provide the first accelerometer signal; A set of microphones, including a first microphone, for providing a first microphone input signal; Radio transceiver; A processor for processing input signals and, based on the input signals, providing an electrical output signal; and A receiver is used to convert the electrical output signal into an audio output signal. The hearing device is configured as follows: First accelerometer data based on the first accelerometer signal is transmitted via the radio transceiver.

13. A hearing system, comprising a first hearing device and a second hearing device, wherein, The hearing system is configured as follows: First accelerometer data is obtained from the first accelerometer of the first hearing device; Obtain second accelerometer data from the second accelerometer of the second hearing device; Based on the first accelerometer data and the second accelerometer data, determine the position of the head of the indicated object and / or the parameters of the moving head; as well as Provides output indicating the header parameters.

14. The hearing system of claim 13, wherein, The hearing system includes a processor circuit configured to provide an output indicating head parameters. The output provided includes: Based on the head parameters, the posture is determined; Map the gesture to control; and Based on the posture, a control signal instructing the control is provided to one or both of the first hearing device and the second hearing device.

Images