Hearing protectors, communication devices, and related methods having context audio generation

Abstract

A communication device, an associated method, and a server device are disclosed. The communication device includes a processing unit, a memory, and an interface connected to the processing unit. The processing unit is configured to receive a first input via the interface, determine a presence of an event based on the first input, and, in response to determining that the event exists, determine a first audio output signal based on first event data indicative of the event, and output the first audio output signal via the interface.

Description

Technical Field

[0001] The present disclosure relates to an auditory protector including a communication device for an auditory protector and the device, and related methods including a method of operating the auditory protector.

Background Art

[0002] In combat situations or other stressful environments with high noise levels, it is desirable to enable the user to communicate with team members via a radio or other communication system while effectively protecting the user's hearing. In combat situations or other stressful environments, the user may have to wear an auditory protection device to attenuate, for example, gunshots, noise from machinery, or other types of continuous or intermittent noise.

[0003] The disadvantage of using wireless communication is that the directional cue can be lost, which makes it difficult for the user to identify the location of the source of the input signal, which can be particularly dangerous in combat situations where the risk of misfiring at friendly forces is significantly increased when the directional cue is lost.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Therefore, there is a need for a communication device and method for an auditory protector that improves the user's situational awareness in combat situations or other stressful environments.

Means for Solving the Problems

[0005] A communication device for an auditory protector is disclosed. The communication device includes a processing unit, a memory, and an interface connected to the processing unit. The processing unit is configured to obtain a first input via the interface. The processing unit is configured to determine the presence of an event based on the first input. In accordance with the determination that the event is present, the processing unit is configured to determine a first audio output signal based on first event data indicating the event. The processing unit is configured to output the first audio output signal via the interface.

[0006] Furthermore, a method for operating a communication device for an auditory protector is provided. The communication device includes a processing unit, a memory, and an interface connected to the processing unit. The method includes obtaining a first input via the interface. The method includes determining the presence of an event based on the first input. The method includes determining a first audio output signal based on first event data indicating the event in accordance with the determination that the event is present. The method includes outputting the first audio output signal via the interface.

[0007] Also disclosed is a server device for event monitoring in a communication system. The communication system includes the server device and a first communication device for an auditory protector. The first communication device may be a communication device as disclosed herein. The server device includes one or more processing units, a memory, and an interface. The server device is configured to obtain first event data. The server device is configured to determine the presence of an event based on the first event data. In accordance with the determination that the event is present, the server device is configured to determine a first input based on the first event data indicating the event. The server device is configured to output the first input via the interface.

[0008] An advantage of the present disclosure is that the situation awareness of the user of the communication device is enhanced in real time, thereby shortening the decision-making time.

[0009] Therefore, for example, in a combat situation, the user of the communication device can better recognize the situation and better identify the location of an event, such as the location of a sound source event such as gunfire, explosion, vehicle, friendly / teammate, or the location of other types of events such as approaching a dangerous area such as an enemy position or minefield and / or approaching the enemy's position. This is very beneficial for mission-performing users / soldiers within the enemy position / combat situation.

[0010] Furthermore, the user, such as a mission-performing user / soldier, is provided with more accurate and precise location identification / directional cues, so that the mission-performing user / soldier can accurately identify events and teammates in the surrounding area while being protected by and remaining connected to the hearing protection device.

[0011] Furthermore, the directivity of input signals from different sources can be improved, for example, in a multi-source hearing protection device, more effective spatial separation of the sources can be provided.

Brief Description of the Drawings

[0012] The above and other features and advantages of the present application will be readily apparent to those skilled in the art from the following detailed description of exemplary communication devices, methods, and / or server devices with reference to the accompanying drawings.

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Best Mode for Carrying Out the Invention

[0014] Various exemplary communication devices, methods, and / or server devices, and details thereof, will be described below with appropriate reference to the drawings. Note that the drawings may or may not be drawn to scale, and elements of similar structure or function are represented by like reference numerals throughout the drawings. It should also be noted that the drawings are only intended to facilitate the description of the communication devices, methods, and / or server devices. The drawings are not intended as an exhaustive description of the present application or as a limitation on the scope of the present application. Furthermore, the illustrated embodiments need not have all of the aspects or advantages shown. Aspects or advantages described in connection with a particular embodiment are not necessarily limited to that embodiment and may be implemented in any other communication device, method, and / or server device even if not so illustrated or explicitly described as such.

[0015] A communication device for an ear protector is disclosed. The communication device includes a processing unit, a memory, and an interface connected to the processing unit.

[0016] The processing unit is configured to obtain a first input via an interface. The first input may be one or more of sound, for example, sound from a vehicle, a weapon, or a teammate, direction, for example, the direction of the sound and / or the direction of an area of interest (e.g., the enemy's position), the distance to the sound or area of interest, and / or a relative direction, for example, an angle indicating a range or area where the sound is made or where the area of interest is located. The first input may be received from one or more microphones of the hearing protector. In other words, the first input may comprise a first microphone input signal from a first microphone and / or a second microphone input signal from a second microphone. The first input may be received from a server device via a wireless unit connected to the interface. In other words, the first input may comprise a server device input.

[0017] The processing unit is configured to determine the presence of an event based on a first input. For example, the processing unit may determine the presence of an event indicating enemy firing from the front left of the user based on the firing sound of a weapon (e.g., received by a microphone of a hearing protector), the position where the sound is emitted (e.g., determined based on a first input with voice input from the microphone), and / or position data indicating the position of the enemy (e.g., received from a server device via a wireless unit connected to the interface). The position data may include the first position and / or the first orientation / direction of the hearing protector / hearing protection device, i.e., the first orientation / direction of the head of the user wearing the hearing protection device. Thus, the position data may indicate the direction of the user's head at the time when the first input and / or the second input is acquired. Therefore, the position data may be used as a reference direction regarding the direction of the event. The first input and / or the second input may be associated with or correspond to the first orientation / direction, such that when the first input and the position data are acquired and / or transmitted (e.g., streamed to a server device), the server device can acquire and / or determine the direction of the event relative to the first orientation / direction of the user's head. For example, the first direction of the user's head may be associated with the first input and the second input. For example, a set of the first voice input signal and the second voice input signal is acquired at times t1 and t2, and the first position data is received at time t3. Here, t1 may be the same as t2, or t1 < t3 < t2 or t2 < t3 < t1. If the user does not change the direction of the head, one or more first inputs and / or second inputs may be associated with or correspond to the same first direction of the user's head. The first input and / or the position data may be transmitted such that the server device can distinguish or use the first input, the second input, and / or the position data from multiple users.

[0018] In accordance with the determination that an event exists, the processing unit is configured to determine a first audio output signal based on first event data indicating the event. The first audio output signal may be an informative audio output or a contextual audio output that gives a suggestion, for example, a suggestion of the type of the event for which the existence has been determined. For example, the first audio output signal may be an audio alert indicating that the enemy has taken a shot. The first audio output signal may be a contextual audio output that gives contextual information indicating the type of the event that has occurred and / or in which direction the event has occurred with respect to the user.

[0019] Determining the first audio output signal may comprise generating a first audio output in a communication device and / or a server device. Determining the first audio output signal may comprise combining the first audio output signal generated in the communication device and the first audio output signal generated in the server device. The first audio output signal may be determined based on one or more of a sound sample, sound piece, or sound file stored in the memory of the communication device, a sound sample, sound piece, or sound file stored in the memory of the server device, and / or a sound sample, sound piece, or sound file generated based on a first input in the communication device (e.g., a gunfire sound to be played and output). The first audio output signal may comprise a predetermined sound sample indicating a given event and / or first audio output identifiers, e.g., first event data based on a given sound of a track, a minefield, and / or an enemy. The first audio output signal may further comprise a combination of sound samples, e.g., a combination of a predetermined sound sample (e.g., a sound sample indicating a track) and a sound sample determined based on the position of an event (indicating the direction of the event). For example, such a first audio output signal may comprise an alert such as "a vehicle is coming from the right" and may be output, e.g., through the right receiver of the user's hearing protection device, depending on the direction the user is looking, i.e., the orientation of the hearing protection device. For example, if the event is to the right of the user at the time of its occurrence and then the user turns their head to the right, the first audio output signal may be output such that the user receives the suggestion that the event is straight ahead. Thus, the audio output signal can "follow" the direction of the user's head when the head direction changes.

[0020] The processing unit is configured to output the first audio output signal via an interface to one or more receivers of the hearing protection device, for example.

[0021] The first input may comprise the direction of the event, e.g., the direction in which the event occurred with respect to the direction of the user's head, the distance to the event or the point of interest, and / or the relative direction, e.g., the angle indicating the range or area where the event occurs or where the point of interest is located with respect to the hearing protector / hearing protection device. The first input may be determined (e.g., estimated or calculated) using, for example, the first audio input from the first microphone and the second audio input from the second microphone, and / or the first position data, e.g., level difference, frequency difference, phase shift, and / or time delay, using head-related transfer function (HRTF) derivation. By combining the HRTF derivation with the first position data, the location identification accuracy of the event can be improved, and the front-back error (the error in determining whether the event occurred in front of or behind the user) can be reduced or avoided. Accordingly, the processing unit may be configured to determine the direction of the event based on the first audio input and the second audio input.

[0022] Outputting the first audio output signal may comprise determining a first filter function based on the first direction and applying the first filter function to the first audio output signal before outputting the first audio output signal. The first filter function may be a first head filter function, e.g., a first left head filter function. By applying a filter function before outputting the first audio output and / or the second audio output, it is possible to give a hint of directivity (e.g., simulate that the audio output comes from the direction of the event). In other words, the processor of the communication device may comprise a first filter module for filtering the first audio output signal according to the first filter function to provide the first left output signal and the first right output signal.

[0023] In one or more exemplary communication devices, the processing unit is configured to determine one or more of event data, such as the type of event, the time of the event, the duration of the event, the direction of the event, and the distance to the event, based on a first input and / or a second input, and optionally, to include the event data in a first audio output signal.

[0024] In one or more exemplary communication devices, methods, and / or server devices, the interface comprises an auditory protection device interface, such as one or more auditory protection device interfaces. The auditory protection device interface may enable connection of the communication device to one or more auditory protection devices of a mission-performing user's hearing protection gear, whereby, for example, a first input or at least a part of the first input is obtained from one or more auditory protection devices.

[0025] In one or more exemplary communication devices, methods, and / or server devices, the interface comprises a radio unit interface, such as one or more radio unit interfaces. The one or more radio unit interfaces may enable connection of the communication device to one or more radio units of a user's hearing protection system, whereby, for example, a first input or at least a part of the first input is obtained from one or more radio units.

[0026] In one or more exemplary communication devices, methods, and / or server devices, the interface comprises an auditory protection device interface and a wireless unit interface, e.g., one or more auditory protection device interfaces and one or more wireless unit interfaces. The auditory protection device interface may enable connection of the communication device to one or more auditory protection devices of the user's hearing protection gear, and the one or more wireless unit interfaces may enable connection of the communication device to one or more wireless units of the user's hearing protection system, whereby, for example, a first input or at least a part of the first input is obtained from the auditory protection device and the wireless unit.

[0027] The auditory protection device interface and the wireless unit interface may comprise a wireless interface or a wired interface.

[0028] In one or more exemplary communication devices, methods, and / or server devices, the first input comprises first event data from a server device via a wireless unit interface. The first event data may be determined and / or stored in the server device, and thus, obtaining the first input via the interface comprises obtaining the first event data from the server device via the wireless unit interface. The first event data may indicate an event whose existence is determined based on the first input.

[0029] The first input may indicate an event, and the event may comprise, for example, a sound source event or an area of interest event. The sound source event may be, for example, a user's sound of interest, e.g., gunfire, shelling, or communication from a mission-performing user of a team member to the user. The area of interest event may be that the user is approaching or moving towards a known area of interest, e.g., a minefield, an enemy position, a military base, or a predetermined arrival destination.

[0030] The first event data may indicate a sound source event or an area of interest event. The first event data may be event-related data, such as parameters or information related to the event. The first event data may include, for example, the location of the event, the distance to the location of the event (e.g., the estimated distance from the location where gunfire occurred or the distance to a minefield), the type of the event (e.g., sound or location), or the direction of the event (e.g., the direction to the event relative to the user, or the absolute direction with respect to a coordinate system such as north, south, east, or west).

[0031] In one or more exemplary communication devices, methods, and / or server devices, the first input comprises a first audio input from a first microphone via an auditory protection device interface. The first microphone may be a microphone of an auditory protector, such as a microphone of an auditory protection device. The first audio input may comprise first audio event data indicating a first sound source event. The first audio input may comprise a first audio signal indicating a first sound source event, such as a gunfire sound, a cannon fire sound, a vehicle running sound, or a speech sound of a user performing a team task. The first audio input may be generated based on the first sound source event at the first microphone of the auditory protector, such as at the first microphone of the auditory protection device. Determining the first audio output signal may comprise determining the first audio output signal based on the first audio input.

[0032] In one or more exemplary communication devices, methods, and / or server devices, the processing unit is configured to obtain a first audio output signal from the memory based on a first audio output identifier of the first event data.

[0033] In one or more exemplary communication devices, methods, and / or server devices, the processing unit is configured to output the first audio output signal via an interface.

[0034] The first audio output signal may be indicative of, or correspond to, for example, a given event (e.g., gunfire, a vehicle, or a minefield), and / or given first event data (e.g., the direction of the event, the location of the event, the distance of the event, or the type of the event), or a combination thereof (e.g., gunfire from the right / east, a vehicle within a 1 km radius area, a minefield within 500 m in the south-west direction), based on the first audio output identifier.

[0035] Outputting the first audio output signal via the interface may comprise outputting a given first audio output signal (e.g., a given sound) from the memory that is indicative of, or corresponds to, a given event and / or given first event data based on the first audio output identifier. The first audio output signal may comprise, for example, a sound alert (e.g., when the user approaches a minefield or a gunfire location near the user), or a guidance sound (e.g., guiding the user towards or away from a given event). The first audio output signal may vary in amplitude, pitch, etc. depending on, for example, the distance from the event or the type of the event. For example, when the user is near a gunshot, the first audio output signal may have a higher amplitude, thereby making the user aware that there may be danger nearby while being aurally protected from the gunfire sound. The first audio output signal may, by having the first audio output identifier, be indicative of, or correspond to, a given event and / or given first event data, and may inform the user of the type of the event by having a pre-stored voice command, alert, or message that can be output to the user. For example, by outputting the first audio output signal via the interface to the first receiver of the hearing protection device and / or the second receiver of the hearing protection device, the first audio output signal may give, for example to the user, a directional cue or information as to where the event and / or the first event data is coming from.

[0036] Outputting the first audio output signal via the interface may include outputting the first audio output signal to an auditory protection device, for example, outputting the first audio output signal to a first receiver of the auditory protection device and / or a second receiver of the auditory protection device. The first receiver may be a left receiver, and the second receiver may be a right receiver. Depending on the direction of the event and / or the first event data, for example, with different amplitudes, level differences, frequency differences, phase shifts, and / or time delays, the first audio output signal may be output to the right receiver and / or the left receiver.

[0037] In one or more exemplary communication devices, methods, and / or server devices, determining the presence of an event includes determining first event data based on a first input. The first event data may be received directly from a server or determined locally in the communication device.

[0038] Determining first event data based on the first input may include determining one or more of the position of the event, the direction of the event, and the type of the event based on the first input. In other words, the first event data may include one or more of the position of the event, the direction of the event, and the type of the event.

[0039] Determining first event data based on the first input may include determining first event data based on the first input in the communication device without communicating with the server device.

[0040] Determining first event data based on the first input may include determining first event data based on the first input in the server device, in which case the first input is obtained from the communication device.

[0041] In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to obtain a second input via an interface.

[0042] In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to determine the presence of an event based on the second input.

[0043] In one or more exemplary communication devices, methods, and / or server devices, the second input comprises second event data from a server device via a radio unit interface.

[0044] The second event data may be determined and / or stored in the server device, and thus, obtaining the second input via the interface comprises obtaining the second event data from the server device via the radio unit interface. The second event data may indicate an event whose presence is determined based on the second input.

[0045] The event may comprise, for example, a sound source event or an area of interest event.

[0046] The sound source event may be, for example, a user's sound of interest, such as gunfire, shelling, or communication from a mission-performing user of a team member to the user. The area of interest event may be that the user is approaching or moving towards a known area of interest, such as a minefield, an enemy position, a military base, or a predetermined arrival destination.

[0047] The second event data may indicate a sound source event or an area of interest event. The second event data may be event-related data, for example, parameters or information related to the event. The second event data may include, for example, the distance to the location of the event (e.g., the estimated distance from the location where the gunfire occurred or the distance to the minefield), the type of the event (e.g., sound or location), or the direction of the event (e.g., the direction to the event relative to the user, or the absolute direction with respect to a coordinate system such as north, south, east, or west).

[0048] In one or more exemplary communication devices, methods, and / or server devices, the second input comprises a second audio input from a second microphone via an auditory protection device interface. The second microphone may be a microphone of an auditory protector, for example, a microphone of an auditory protection device. The second audio input may comprise second audio event data indicating a second sound source event. The second audio input may comprise a second audio signal indicating a second sound source event, for example, the sound of gunfire, the sound of shelling, the sound of a vehicle traveling, or the voice of a user performing a team task. The second audio input may be generated based on a second sound source event at a second microphone of the auditory protector, for example, at a second microphone of the auditory protection device. Determining the second audio output signal may comprise determining the second audio output signal based on the second audio input.

[0049] In one or more exemplary communication devices, methods, and / or server devices, determining the presence of an event comprises determining second event data based on the second input.

[0050] In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to determine a second audio output signal based on second event data indicating an event. In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to output a first audio output signal and / or a second audio output signal via an interface.

[0051] The second audio output signal may be indicative of, or correspond to, for example, a given event (e.g., gunfire, vehicle, or minefield), and / or given second event data (e.g., direction of the event, location of the event, or type of the event), or a combination thereof (e.g., gunfire from the right / east, vehicle within a 1 km radius area, minefield within 500 m in the south-west direction), based on a second audio output identifier.

[0052] Outputting the second audio output signal may comprise determining a second filter function based on a second direction and applying the second filter function to the second audio output signal before outputting the second audio output signal. The second filter function may be a second head filter function, e.g., a first right head filter function. In other words, the processor of the communication device may comprise a filter module for filtering the second audio output signal according to the second filter function to provide a second left output signal and a second right output signal.

[0053] Outputting a second audio output signal via an interface may comprise outputting a given second audio output signal (e.g., a given sound) from memory that indicates or corresponds to a given event and / or given second event data based on a second audio output identifier. The second audio output signal may comprise, for example, a sound alert (e.g., when the user approaches a minefield or a firing position that occurred near the user), or a guidance sound (e.g., guiding the user in the direction of a given event or away from a given event). The second audio output signal may vary in amplitude, pitch, etc., for example, according to the distance from the event or the type of event. For example, when the user is near a gunshot, the second audio output signal may have a higher amplitude, thereby allowing the user to be auditorily protected from the firing sound while also being made aware that danger may be nearby. The second audio output signal may indicate or correspond to a given event and / or given second event data and may inform the user of the type of event by having a pre-stored voice command, alert, or message that can be output to the user. For example, by outputting the second audio output signal via an interface to a second receiver of the hearing protection device and / or the second receiver of the hearing protection device, the second audio output signal may give the user, for example, a directional cue or information as to where the event and / or second event data is coming from.

[0054] Outputting a second audio output signal via an interface may comprise outputting the second audio output signal to a hearing protection device, for example, outputting the second audio output signal to a second receiver of the hearing protection device. Note that the first audio output signal and the second audio output signal are electrical output signals. The first audio output signal and the second audio output signal may be wireless signals.

[0055] The second receiver may be the right receiver, and the first receiver may be the left receiver, and depending on the direction of the event and / or the second event data, for example, with different amplitudes, the second audio output signal may be output to the right receiver and / or the left receiver.

[0056] In one or more exemplary communication devices, methods, and / or server devices, the second input may be different from the first input. For example, the first input may comprise a first audio input, and the second input may comprise first event data. In one or more exemplary communication devices, methods, and / or server devices, the second input may be similar to or the same as the first input.

[0057] For example, the first input may comprise a first audio input, the second input may comprise a second audio input, and / or the first input may comprise a first primary audio input, and the second input may comprise a first secondary audio input.

[0058] In one or more exemplary communication devices, methods, and / or server devices, the second event data and / or the second audio input may be based on events and / or audio inputs that occur after the events and / or audio inputs based on the first event data and / or the first audio input.

[0059] In one or more exemplary communication devices, methods, and / or server devices, the processing unit is configured to obtain position data via an interface.

[0060] In one or more exemplary communication devices, methods, and / or server devices, the processing unit is configured to obtain position data from a position module of the communication device.

[0061] In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to obtain position data from a position module of the communication device via an interface.

[0062] The advantage of obtaining position data from the position module of the communication device is that the user's position data can be determined locally at the communication device. Thereby, the position data is obtained more quickly, substantially instantaneously. By obtaining position data from the position module of the communication device, the user's position can be obtained faster than obtaining position data from a server device. The first direction of an event may be based on the position data and the determination of the presence of the event. By obtaining position data from the position module of the communication device, the user's position data can be continuously obtained (substantially without time delay) with respect to the position of the event, thereby determining the first direction of the event with respect to the user faster and in response to the user's movement (e.g., the user looking in a certain direction, the user changing orientation with respect to the event).

[0063] A further advantage of obtaining position data from the position module of the communication device is that the transfer of additional position data through the radio unit is avoided.

[0064] In one or more exemplary communication devices, methods, and / or server devices, obtaining position data comprises receiving a first position signal from a position module via an interface and / or via a radio unit connected to the communication device. In one or more exemplary communication devices, methods, and / or server devices, the position module and / or the radio unit may comprise a GPS sensor.

[0065] In one or more exemplary communication devices, methods, and / or server devices, a processing unit is configured to determine the presence of an event based on location data. The location data may indicate a first location of a location module and may comprise global positioning system (GPS) coordinates of the location module.

[0066] In one or more exemplary communication devices, methods, and / or server devices, obtaining location data comprises receiving user location data via an interface and / or from a location module of the communication device. The user location data may indicate the location of the user (e.g., a location as determined by a wireless unit, location module, and / or server device), and may comprise global positioning system (GPS) coordinates of the wireless unit, location module, and / or communication device. Thus, the communication device may comprise a location module for determining the location of the communication device, e.g., a GPS location.

[0067] In one or more exemplary communication devices, methods, and / or server devices, the location data comprises first direction data indicating a first direction of the event. Determining a first audio output signal may comprise determining the first audio output signal based on the location data. Determining a first audio output signal may comprise determining the first audio output signal based on first direction data indicating a first direction of the event.

[0068] In one or more exemplary communication devices, methods, and / or server devices, the location data may comprise second direction data indicating the head direction of a user of the communication device. Determining a first audio output signal may comprise determining the first audio output signal based on second direction data indicating the head direction of a user of the communication device.

[0069] In one or more exemplary communication devices, methods, and / or server devices, the location data may comprise data from a location module on the hearing protection device, e.g., above the user's head. Determining the first audio output signal may comprise determining the first audio output signal based on data from a location module on the hearing protection device, e.g., above the user's head.

[0070] In one or more exemplary communication devices, methods, and / or server devices, determining the presence of an event comprises determining an angle between the user's head direction and a first direction of the event.

[0071] The processing unit is configured to obtain a user location signal indicative of the user's location via, e.g., an interface and / or a location module of the communication device.

[0072] The processing unit is configured to obtain a direction signal indicative of the user's head direction via, e.g., an interface and / or a location module. The location module may comprise a first accelerometer and a second accelerometer. Optionally, the location module may comprise a plurality of location modules, e.g., a first location module for providing the user's location and a second location module for providing a direction tracking (e.g., a head tracker) indicative of the direction the user is looking or facing.

[0073] The processing unit is configured to determine a first angle between the head direction and the first direction from the user to the event.

[0074] The communication device may operate independently of the server device. In other words, the communication device may operate autonomously from the server device. For example, for instance, a plurality of communication devices of a plurality of users (a group of mission-performing users, e.g., military units, police forces, special forces, and / or fire departments) may be configured to operate independently of the server device. In other words, the plurality of communication devices may be configured to operate and communicate with each other without communicating via the server device.

[0075] A method for operating a hearing protector including a processing unit, a memory, and an interface connected to the processing unit is disclosed. The method includes obtaining a first input via the interface. The method includes determining the presence of an event based on the first input. The method includes determining a first audio output signal based on first event data indicating the event in accordance with the determination that the event is present. The method includes outputting the first audio output signal via the interface.

[0076] A server device for event monitoring in a communication system is disclosed. The communication system includes the server device and a first communication device for a hearing protector. The server device includes one or more processing units, a memory, and an interface. The server device is configured to obtain first event data. The server device is configured to determine the presence of an event based on the first event data. The server device is configured to determine a first input based on the first event data indicating the event in accordance with the determination that the event is present. The server device is configured to output the first input via the interface.

[0077] Obtaining the first event data may include obtaining the first event data from one or more communication devices. For example, in a multi-user system where multiple user-performing users have multiple communication devices that communicate with a server device, the server device may be configured to obtain the first event data from the multiple communication devices. Accordingly, determining the first input may include determining multiple first inputs for multiple users. The server device may be configured to output the first input via an interface.

[0078] The server device is optionally configured to determine the presence of a first event based on the first event data and determine the presence of a second event based on the second event data. Outputting the first input may include transmitting a first input indicating the first event to the first communication device and / or the second communication device. Outputting the first input may include transmitting a second input indicating the second event to the first communication device and / or the second communication device.

[0079] It should be understood that the description of features regarding the communication device is also applicable to the corresponding method and server device, and vice versa.

[0080] FIG. 1 shows an exemplary task-performing user 1 wearing an exemplary hearing protection system including a communication device 4, a hearing protection device 2, and a wireless unit 6 according to the present disclosure. In one or more exemplary communication devices, the hearing protection system may include a position module 38 that can be worn by the user on a helmet as shown, for example. The communication device 4 is here arranged on the user's body. Alternatively, the communication device may be worn on other parts of the user's body, such as the back, arms, legs, and / or head (e.g., helmet).

[0081] Figure 2 shows an exemplary hearing protection system 3 including a communication device 4, a hearing protection device 2, and a wireless unit 6 according to the present disclosure. The communication device 4 includes a processing unit 14, a memory 22, and an interface 20 connected to the processing unit 14. The processing unit 14 is configured to obtain a first input 23 via the interface 20. In one or more exemplary communication devices, the communication device 4 and the wireless unit may be provided in a communication system 5. In one or more exemplary communication devices, the hearing protection device 2 includes a hearing protection device interface 40.

[0082] The processing unit 14 is configured to determine the presence of an event based on the first input 23. In accordance with the determination that the event is present, the processing unit 14 is configured to determine a first audio output signal 44 based on first event data indicating the event. The processing unit 14 is configured to output the first audio output signal 44 via the interface 20.

[0083] In one or more exemplary communication devices, the interface 20 includes a hearing protection device interface 40. The hearing protection device interface 40 enables connection between the communication device 4 and the hearing protection device 2 of the hearing protector 13 of the mission-performing user 1, whereby, for example, the first input 23 is obtained from the hearing protection device 2 through (partially through) the first input signal 24.

[0084] In one or more exemplary communication devices, the interface 20 includes a wireless unit interface 16. The wireless unit interface 16 enables connection between the communication device 4 and the wireless unit 6 of the user's hearing protection system 3 or communication system 5, whereby, for example, the first input 23 is obtained from the wireless unit 6 through (partially through) the first input signal 24.

[0085] In one or more exemplary communication devices, interface 20 includes an auditory protection device interface 40 and a wireless unit interface 16. The auditory protection device interface 40 enables connection between communication device 4 and the auditory protection device 2 of the user 1's hearing protector 13, and the wireless unit interface 16 enables connection between communication device 4 and the wireless unit 6 of the user's auditory protection system 3. Thus, for example, a first input 23 is obtained from the auditory protection device 2 and the wireless unit 6 through the auditory protection device interface 40 and the wireless unit interface 16 via (partially via) a first input signal 24.

[0086] In one or more exemplary communication devices, the first input 23 includes first event data from a server device via the wireless unit interface 16. The first event data may be determined and / or stored in the server device. Thus, obtaining the first input 23 via interface 20 includes obtaining the first event data from the server device from the wireless unit 6 via the wireless unit interface 16.

[0087] In one or more exemplary communication devices, the first input 23 includes a first voice input 29 from a first microphone 28 via the auditory protection device interface 40. The first microphone may be a microphone of the hearing protector 13, for example, a microphone of the auditory protection device 2. The first voice input 29 may be generated based on a first sound source event at the first microphone 28 of the hearing protector 13, for example, at the first microphone 28 of the auditory protection device 2. Determining the first voice output signal 44 may also include determining the first voice output signal 44 based on the first voice input 28.

[0088] In one or more exemplary communication devices, the processing unit 14 is configured to obtain the first voice output signal 44 from the memory 22 based on a first voice output identifier of the first event data.

[0089] In one or more exemplary communication devices, the processing unit 14 is configured to output a first audio output signal 44 via the interface 20.

[0090] Outputting the first audio output signal 44 via the interface 20 may include outputting the first audio output signal 44 to the hearing protection device 2, for example to the first receiver 7 of the hearing protection device 2. The first receiver 7 may be provided in the first ear protector 9 of the hearing protection device 2, for example in the first earpiece or the first earmuff, and the first earpiece 9 may include a first connection 10, for example a left connection.

[0091] The first receiver 7 may be a left receiver, and the first audio output signal 44 may be output to the left receiver, for example with different amplitudes, depending on the direction of the event and / or the first event data. The first audio output signal 44 may be output as the first audio output 44A by the first receiver 7.

[0092] In one or more exemplary communication devices, the processing unit 14 is configured to obtain a second input 25 via the interface 20. In one or more exemplary communication devices, the processing unit 14 is configured to determine the presence of an event based on the second input 25.

[0093] In one or more exemplary communication devices, the second input 25 includes second event data from a server device via the wireless unit interface 16.

[0094] In one or more exemplary communication devices, the second input 25 includes a second audio input 31 from a second microphone 30 via the hearing protection device interface 40. The second microphone 30 may be the microphone of the hearing protector 13, for example the microphone of the hearing protection device 2. The second input signal 31 may include second audio event data indicating a second sound source event.

[0095] In one or more exemplary communication devices, determining the presence of an event comprises determining second event data based on a second input 25. In one or more exemplary communication devices, the processing unit 14 is configured to determine a second audio output signal 46 based on second event data indicative of an event.

[0096] In one or more exemplary communication devices, the processing unit 14 is configured to output a first audio output signal 44 and / or a second audio output signal 46 via the interface 20.

[0097] The second audio input 31 may be generated based on a second sound source event at a second microphone 30 of the hearing protector 13, for example at the second microphone 30 of the hearing protection device 2. Determining the second audio output signal 46 may comprise determining the second audio output signal 46 based on the second audio input 31.

[0098] Outputting the second audio output signal 46 via the interface 20 may comprise outputting the second audio output signal 46 to the hearing protection device 2, for example to a second receiver 8 of the hearing protection device 2. The second receiver 8 may be provided in a second ear protector 11 of the hearing protection device 2, for example a second earpiece or a second earmuff, and the second earpiece 11 may comprise a second connection 12, for example a right connection. The connections 10 and 12 may be wired connections or wireless connections, for example Bluetooth® connections.

[0099] The second receiver 8 may be a right receiver, and the second audio output signal 46 may be output to the right receiver, for example with different amplitudes, depending on the direction of the event and / or the first event data. The second audio output signal 46 may be output as a second audio output 46A by the second receiver 8.

[0100] In one or more exemplary communication devices, the processing unit 14 is configured to obtain location data 36 from the communication device location module 38A.

[0101] In one or more exemplary communication devices, the processing unit 14 is configured to obtain location data 36 from the hearing protection device location module 38B via the hearing protection device interface 40.

[0102] In one or more exemplary communication devices, the processing unit 14 is configured to obtain location data 36 from the server device via the wireless unit 6 and via the wireless unit interface 16.

[0103] In one or more exemplary communication devices, the processing unit 14 is configured to determine the presence of an event based on the location data 36.

[0104] In one or more exemplary communication devices, the location data 36 may comprise data from location modules 38, 38B, for example, on the head of user 1. The location module may alternatively be located on other parts of the user's body, for example, together with the wireless unit or other parts of the communication system (e.g., outside the communication device and / or the hearing protection device or remotely located from the communication device and / or the hearing protection device).

[0105] FIG. 3 is a flow diagram of an exemplary method of operating a hearing protector comprising a processing unit, a memory, and an interface.

[0106] Method 100 comprises obtaining 102 a first input via an interface.

[0107] In one or more exemplary methods, obtaining 102 the first input comprises obtaining 102A first event data from a server device from the wireless unit via the wireless unit interface.

[0108] In one or more exemplary ways, method 100 comprises obtaining 102B a first audio output signal from a memory based on a first audio output identifier of first event data.

[0109] In one or more exemplary ways, method 100 comprises obtaining 102C a second input via an interface.

[0110] In one or more exemplary ways, method 100 comprises obtaining 102D location data via an interface.

[0111] Method 100 comprises determining 106 the presence of an event based on a first input.

[0112] In one or more exemplary ways, determining 106 the presence of an event comprises determining 106B first event data based on a first input.

[0113] In one or more exemplary ways, method 100 comprises determining 106C the presence of an event based on a second input.

[0114] In one or more exemplary ways, determining 106 the presence of an event comprises determining 106CC second event data based on a second input.

[0115] Method 100 comprises determining 106A a first audio output signal based on first event data indicating the event in accordance with the determination 106 that the event is present.

[0116] In one or more exemplary ways, determining 106A the first audio output signal comprises determining 106AA the first audio output signal based on a first audio input.

[0117] In one or more exemplary methods, the method comprises determining the presence of an event 106D based on location data.

[0118] The method comprises outputting a first audio output signal 110 via an interface. In one or more exemplary methods, the method comprises outputting a second audio output signal 46 110 via an interface.

[0119] FIG. 4 shows an exemplary server device 50 for event monitoring in a communication system 5 comprising a server device 50 and a first communication device 4 for an auditory protector. The server device 50 comprises one or more processing units 52, 52A, 52B, a memory 54, and an interface 56. The server device 50 is configured to acquire first event data. The server device 50 is configured to determine the presence of an event based on the first event data. The server device 50 is configured to determine a first input 23 based on the first event data indicating the event in accordance with the determination that the event is present. The server device 50 is configured to output the first input 23 via the interface 56.

[0120] In one or more exemplary server devices, the server device 50 is configured to output the first input 23 to a wireless unit 6 via the interface 56 through a connection 58. The connection 58 may be a wireless connection, such as a radio wave connection, or a wired connection. In one or more exemplary server devices, the server device 50 is configured to output the first input 23 via the interface 56 through a first input signal 24.

[0121] In one or more exemplary server devices, the server device 50 is configured to obtain second event data. The server device 50 is configured to determine the presence of an event based on the second event data. The server device 50 is configured to determine a second input 25 based on the second event data indicating the event in accordance with the determination that the event is present. The server device 50 is configured to output the second input 25 via the interface 56. The server device 50 is configured to output the second input 25 to the wireless unit 6 via the interface 56 through the connection 58. The server device 50 is configured to output the second input 25 via the interface 56 through the second input signal 26. In one or more exemplary server devices, the server device 50 is configured to obtain location data 56 via the interface 56. The server device 50 is configured to determine the presence of an event based on the location data 56.

[0122] In one or more exemplary server devices, the server device 50 is configured to output a first input 23 via the interface 56 to a second wireless unit 6A configured to communicate with a second communication device 4A and a third wireless unit 6B configured to communicate with a third communication device 4B. In one or more exemplary server devices, the server device 50 is configured to output the first input 23 via the interface 56 through the first input signal 24.

[0123] For example, in a multi-user system in which each of a plurality of task-performing users has a communication device that communicates with a server device, the server device may be configured to obtain first event data from one or more of the plurality of communication devices. Accordingly, determining the first input may include determining the first input for each or several of the plurality of users. The server device may be configured to output the first input via an interface.

[0124] The use of terms such as "first", "second", "third", "fourth", "primary", "secondary", "tertiary", etc. does not imply any particular order and is included for the purpose of identifying individual elements. Further, the use of terms such as "first", "second", "third", "fourth", "primary", "secondary", "tertiary", etc. does not indicate any order or importance. Rather, terms such as "first", "second", "third", "fourth", "primary", "secondary", "tertiary", etc. are used to distinguish one element from another. It should be noted that the terms "first", "second", "third", "fourth", "primary", "secondary", "tertiary", etc. are used herein and elsewhere solely for labeling purposes and are not intended to indicate any particular spatial or temporal order.

[0125] Furthermore, the labeling of a first element does not imply the presence of a second element, and vice versa. It will be understood that FIGS. 1 through 4 comprise several modules or operations shown by solid lines and several modules or operations shown by dashed lines. The solid-line modules or operations are those provided in the broadest exemplary embodiments. The dashed-line modules or operations are exemplary communication devices, methods, and / or server devices that are provided in or are a part of the modules or operations of the exemplary communication device, method, and / or server device shown by the solid lines, or additional modules or operations that may be employed in addition to the modules or operations of the exemplary communication device, method, and / or server device shown by the solid lines. It should be understood that these operations need not be performed in the order presented. Further, it should be understood that not all of the operations need to be performed. The exemplary operations may be performed in any order and in any combination.

[0126] It should be noted that the term "comprising" does not necessarily exclude the presence of other elements or steps besides those enumerated.

[0127] Note that the words "a" or "an" preceding an element do not preclude the presence of more than one such element.

[0128] Furthermore, no symbol limits the scope of the claims, and it should be noted that exemplary communication devices, methods, and / or server devices may be implemented at least in part by both hardware and software, and some "means", "units", or "devices" may be represented by the same item of hardware.

[0129] The various exemplary methods, devices, and systems described herein are described in the general context of a method step process and, in one aspect, may be implemented by a computer program product embodied on a computer-readable medium, including computer-executable instructions, such as program code, executed by a computer in a networked environment. The computer-readable medium may include, but is not limited to, removable and non-removable storage devices including read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), etc. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing the steps of the methods disclosed herein. A particular sequence of such executable instructions or associated data structures represents an example of corresponding acts for implementing the functions described in such steps or processes.

[0130] Features have been shown and described, but they are not intended to limit the invention described in the claims, and it will be understood by those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention described in the claims. Therefore, this specification and the drawings should be regarded as illustrative rather than in a limiting sense. The invention described in the claims is intended to embrace all alternatives, modifications, and equivalents. The following items were described in the claims of the patent application at the initial filing. (Item 1) A communication device for an auditory protector, the communication device comprising: a processing unit; a memory; an interface connected to the processing unit, wherein the processing unit: acquires a first input via the interface; determines the presence of an event based on the first input; determines a first audio output signal based on first event data indicating the event in accordance with the determination that the event is present; and is configured to output the first audio output signal via the interface. A communication device. (Item 2) The communication device according to Item 1, wherein the interface comprises an auditory protector interface and / or a wireless unit interface. (Item 3) The communication device according to Item 2, wherein the first input comprises first event data from a server device via the wireless unit interface. (Item 4) The communication device according to Item 2 or 3, wherein the first input comprises a first audio input from a first microphone via the auditory protector interface. (Item 5) The communication device according to any one of Items 1 to 4, wherein determining the presence of an event comprises determining the first event data based on the first input. (Item 6) wherein the processing unit: acquires a second input via the interface; and is configured to determine the presence of the event based on the second input. The communication device according to any one of Items 1 to 5. (Item 7) The communication device according to any one of Items 2 to 6, wherein the second input comprises second event data from a server device via the wireless unit interface. (Item 8) The communication device according to any one of Items 2 to 7, wherein the second input comprises a second audio input from a second microphone via the auditory protector interface. (Item 9) The communication device according to any one of Items 1 to 8, wherein determining the presence of an event comprises determining the second event data based on the second input. (Item 10) wherein the processing unit: determines a second audio output signal based on second event data indicating the event. A communication device according to any one of items 1 to 9, configured to output the first audio output signal and / or the second audio output signal via the interface. (Item 11) The processing unit acquires position data via the interface and / or from a position module of the communication device, A communication device according to any one of items 1 to 10, configured to determine the presence of the event based on the position data. (Item 12) The communication device of item 11, wherein the position data includes first direction data indicating a first direction of the event. (Item 13) The processing unit acquires the first audio output signal from the memory based on a first audio output identifier of the first event data, A communication device according to any one of items 1 to 12, configured to output the first audio output signal via the interface. (Item 14) A method for operating a communication device of an auditory protector, wherein the communication device includes a processing unit, a memory, and an interface connected to the processing unit, The method includes acquiring a first input via the interface, determining the presence of an event based on the first input, determining a first audio output signal based on first event data indicating the event in accordance with the determination that the event is present, and outputting the first audio output signal via the interface. (Item 15) A server device for event monitoring in a communication system, the communication system including the server device and a first communication device for an auditory protector, the server device including one or more processing units, a memory, and an interface, The server device acquires first event data, determines the presence of an event based on the first event data, determines a first input based on the first event data indicating the event in accordance with the determination that the event is present, and is configured to output the first input via the interface.

Explanation of Symbols

[0131] 1: Task-performing user 2: Hearing protection device 3: Hearing protection system 4, 4A, 4B: Communication device 5: Communication system 6, 6A, 6B: Wireless unit 7: First receiver 8: Second receiver 9: First ear protector, first earpiece, first ear muff 10: First connection 11: Second ear protector, second earpiece, second ear muff 12: Second connection 13: Hearing protector 14: Processing unit 16: Wireless unit interface 20: Interface 22: Memory 23: First input 24: First input signal 25: Second input 26: Second input signal 28: First microphone 29: First voice input 30: Second microphone 31: Second voice input 36: Position data 38: Position module 38A: Communication device position module 38B: Hearing protection device position module 40, 40B: Hearing protection device interface 44: First voice output signal 44A: First voice output 46: Second voice output signal 46A: Second voice output 50: Server device 52, 52A, 52B: Processing unit 54: Memory 56: Interface 58: Connection 100: Method for operating a hearing protector 102: Obtaining a first input via an interface 102A: Obtaining the first event data from the server device via the wireless unit interface from the wireless unit 102B: Obtaining the first audio output signal from the memory based on the first audio output identifier of the first event data 102C: Obtaining a second input via the interface 102D: Obtaining location data via the interface 106: Determining the presence of an event based on the first input 106A: Determining the first audio output signal based on the first event data indicating the event according to the determination that the event exists 106AA: Determining the first audio output signal based on the first audio input 106B: Determining the first event data based on the first input 106C: Determining the presence of an event based on the second input 106CC: Determining the second event data based on the second input 106D: Determining the presence of an event based on the location data 110: Outputting the first audio output signal via the interface

Claims

1. A communication device for an auditory protector, the communication device comprising: a processing unit; a memory; an interface connected to the processing unit, wherein the processing unit is configured to: obtain a first input via the interface; determine the presence of an event based on the first input; determine a first audio output signal based on first event data indicating the event in accordance with the determination that the event is present; output the first audio output signal via the interface, wherein the first audio output signal includes a contextual audio output providing a suggestion of the type of the event.

2. The communication device according to claim 1, wherein the interface comprises an auditory protector interface and / or a wireless unit interface.

3. The communication device according to claim 2, wherein the first input comprises first event data from a server device via the wireless unit interface.

4. The communication device according to claim 2 or 3, wherein the first input comprises a first audio input from a first microphone via the auditory protector interface.

5. Determining the presence of an event comprises determining the first event data based on the first input, for the communication device according to any one of claims 1 to 4.

6. The processing unit is further configured to: obtain a second input via the interface; determine the presence of the event based on the second input, for the communication device according to any one of claims 1 to 5.

7. The communication device according to claim 6, wherein the second input comprises second event data from a server device via the interface.

8. The communication device according to claim 6 or 7, wherein the second input comprises a second audio input from a second microphone via the interface.

9. Determining the presence of an event comprises determining the second event data based on the second input, for the communication device according to claim 7.

10. The processing unit is further configured to: determine a second audio output signal based on second event data indicating the event; output the first audio output signal and / or the second audio output signal via the interface, for the communication device according to any one of claims 1 to 9.

11. The processing unit obtains position data via the interface and / or from a position module of the communication device, and is configured to determine the presence of the event based on the position data, a communication device according to any one of claims 1 to 10.

12. The position data includes first direction data indicating a first direction of the event, a communication device according to claim 11.

13. The processing unit obtains the first audio output signal from the memory based on a first audio output identifier of the first event data, and is configured to output the first audio output signal via the interface, a communication device according to any one of claims 1 to 12.

14. The processing unit is configured to simulate that the first audio output signal comes from a first direction of the event by applying a filter function before outputting the first audio output signal, a communication device according to claim 1.

15. A method for operating a communication device of an auditory protector, wherein the communication device includes a processing unit, a memory, and an interface connected to the processing unit, and the method includes obtaining a first input via the interface, determining the presence of an event based on the first input, determining a first audio output signal based on first event data indicating the event according to a determination that the event is present, and outputting the first audio output signal via the interface, wherein the first audio output signal includes a contextual audio output giving a suggestion of the type of the event.

16. The method further includes simulating that the first audio output signal comes from a first direction of the event by applying a filter function before outputting the first audio output signal, the method according to claim 15.

Images