Method and system for facilitating voice call restrictions complying with defined space

Abstract

A system for facilitating voice call restrictions complying with a defined space is provided. The system comprises: a communication device comprising a processor and configured to access a communication network associated with a defined space to transmit and receive audio data; a sound pressure level sensor configured to detect a sound level received by the communication device, where the processor is configured to determine a first sound pressure level associated with a sound emitted from a user of the communication device, determine a second sound pressure level associated with an ambient sound within the defined space, and transmit the first sound pressure level to the second sound pressure level. An adaptive threshold is determined based on the predetermined threshold and the second sound pressure level, the first sound pressure level is compared to the adaptive threshold, and a corrective action is performed in response to determining that the first sound pressure level exceeds the adaptive threshold.

Description

Technical Field

[0001] The present disclosure relates to methods and systems for facilitating compliance with space-limited voice call restrictions. In particular, the present disclosure relates to conditional access to communication services and remediation of violations of communication restrictions (eg, volume levels). Background Art

[0002] The ability to conduct online meetings from virtually any location has become desirable due to a variety of market factors. Travel and mobility are crucial aspects of conducting business, and business travelers are often located in enclosed spaces with other people present (e.g., airport waiting areas, aircraft cabins, high-speed train carriages, etc.).

[0003] Third parties present in various spaces generally prefer a relatively quiet and peaceful environment and generally do not want to overhear communications of others in the space, especially if such communications are with another party remote from the space (e.g., via telecommunications). In fact, telephone communications are prohibited in certain spaces (e.g., aircraft cabins) to reduce or prevent disagreements between passengers over noise levels, etc.

[0004] US 10,714,119 describes a communication device and a communication system for improving the acoustic safety of a user by detecting acoustic security events. Summary of the Invention

[0005] The present inventors have recognized that it is desirable to enable communications within a confined space while enforcing noise thresholds established by the owner of the space.

[0006] Therefore, a system for facilitating compliance with voice call restrictions in a confined space is provided. The system includes a communication device comprising a processor and configured to access a communication network associated with the confined space to transmit and receive audio data; and a sound pressure level sensor configured to detect a sound level received by the communication device. The processor is configured to: determine a first sound pressure level associated with sound emanating from a user of the communication device based on input from the sound pressure level sensor; determine a second sound pressure level associated with ambient sound within the confined space; determine an adaptation threshold based on a predetermined threshold and the second sound pressure level; compare the first sound pressure level to the adaptation threshold; and, in response to determining that the first sound pressure level exceeds the adaptation threshold, perform corrective action on the communication device, wherein the corrective action includes temporarily disabling the communication device and terminating transmission and reception of the audio data.

[0007] By providing such a system, communication can be conducted within a confined space while maintaining a desired level of quiet within the confined space. By using ambient sound to determine the appropriate sound pressure level and correcting any violations of the restrictions (e.g., notifying the user), the system can ensure that the restrictions are effective during communication within the confined space. This can be particularly useful in situations where communication is currently prohibited (e.g., within an aircraft cabin).

[0008] The corrective action may also be notified to the user via a communication device.

[0009] The communication device may include an identifier associated with the communication device and an access code associated with the communication network and the identifier, and the corrective action may include changing or invalidating the access code to terminate access of the communication device to the communication network.

[0010] The communication device may include an image capture device configured to obtain information associated with a predetermined threshold from one or more of a document, a barcode, and the access code.

[0011] The notification may include a timer indicating the length of time from the current time until further corrective action is to be performed.

[0012] The processor may be configured to provide a real-time indication of the first sound pressure level relative to the adaptation threshold.

[0013] The defined space may be a cabin (eg, a passenger cabin) of an aircraft.

[0014] The predetermined threshold may be specific to an airline associated with an aircraft, and the predetermined threshold may be obtained by the communication device via one or more of the communication network and a boarding pass.

[0015] The communication device may be configured to store metadata associated with the audio data, the metadata including the first sound pressure level.

[0016] The processor may be configured to obtain the access code and the predetermined threshold from the communication network in an encrypted format and to decrypt the access code and the predetermined threshold.

[0017] The processor may be configured to obtain the access code and the predetermined threshold from the communication network in an encrypted format and to decrypt the access code and the predetermined threshold.

[0018] The system may further include: a speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device; and a second sound sensor associated with an exterior portion of the speech attenuating device, the second sound sensor configured to receive at least the attenuated speech audio exiting the speech attenuating device 102; the processor further configured to: obtain, using the second sound sensor, ambient audio data associated with ambient sound at a time (T1) when the user is not speaking; obtain, using the second sound sensor, mixed audio data associated with the ambient sound and the attenuated speech audio at a time (T2) when the user is speaking; determine an outlet sound pressure level based on the ambient audio data and the mixed audio data; calculate a coefficient of performance of the speech attenuating device based on the first sound pressure level and the outlet sound pressure level; and provide an indication of the coefficient of performance via the computing device.

[0019] T1 and T2 may be determined based on audio data received by the sound pressure level sensor,

[0020] Determining the outlet sound pressure level based on the ambient audio data and the mixed audio data may include: determining the ambient sound pressure level based on the ambient audio data; determining the mixed sound pressure level based on the mixed audio data; and determining the outlet sound pressure level based on the ambient sound pressure level and the mixed sound pressure level.

[0021] The processor may also be configured to: separate the input received by the sound pressure level sensor into a first ambient component and a first voice component; separate the audio data received by the second sound sensor into a second ambient component and a second voice component; determine a voice performance coefficient based on the first voice component and the second voice component; and determine an environmental performance coefficient based on the first ambient component and the second ambient component, wherein the performance coefficient is further calculated based on at least one of the voice performance coefficient and the environmental performance coefficient.

[0022] Separating the input received by the sound pressure level sensor into a first ambient component and a first speech component and separating the audio data received by the second sound pressure level sensor into a second ambient component and a second speech component may include using a Wiener filter.

[0023] The processor may be further configured to: determine a speech environment comparative performance coefficient based on the first speech component and the first environment component; and provide an indication of the speech environment comparative performance coefficient via the computing device.

[0024] The performance coefficient may be further calculated based on the speech environment comparison performance coefficient.

[0025] The processor may be further configured to: obtain mixed audio data using the second sound sensor; and calculate a cross-correlation product between the input received by the sound pressure level sensor and the audio data received by the second sound sensor; wherein the performance coefficient is further calculated based on the cross-correlation product.

[0026] According to another embodiment, a method for facilitating compliance with voice call restrictions in a confined space is provided. The method includes providing conditional access to a communication network associated with the confined space, the communication network configured to transmit and receive audio data; determining a first sound pressure level associated with sound emanating from a user of a communication device based on input from a sound pressure level sensor; determining a second sound pressure level associated with ambient sound within the confined space; determining an adaptation threshold based on a predetermined threshold and the second sound pressure level; comparing the first sound pressure level to the adaptation threshold; and, in response to determining that the first sound pressure level exceeds the adaptation threshold, performing corrective action, wherein the corrective action includes temporarily disabling the communication device and terminating transmission and reception of the audio data.

[0027] By providing such a method, compliance with communication restrictions within a confined space is facilitated. By using ambient sound to determine the appropriate sound pressure level and correcting any violations of the restrictions (e.g., notifying the user), the system can ensure that the restrictions are effective during communications within the confined space. This can be particularly useful in situations where communication is currently prohibited (e.g., within an aircraft cabin).

[0028] The corrective action may also include issuing a notification to the user via a communication device.

[0029] The corrective action may include changing or invalidating an access code to terminate access to the communications network.

[0030] The method may further include obtaining information associated with the predetermined threshold from one or more of a document, a barcode, and an access code provided for accessing the communication network.

[0031] The method may further comprise providing a real-time indication of the first sound pressure level relative to the adaptation threshold.

[0032] The method may further include: obtaining, using a second sound sensor, ambient audio data associated with the ambient sound at a time (T1) when the user is not speaking, the ambient audio data being associated with the ambient sound, the second sound sensor being associated with an exterior portion of the speech attenuation device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuation device, wherein the second sound sensor is configured to receive at least attenuated speech audio that has exited the speech attenuation device; obtaining, using the second sound sensor, mixed audio data associated with the ambient sound and the attenuated speech audio at a time (T2) when the user is speaking; determining an outlet sound pressure level based on the ambient audio data and the mixed audio data; and calculating a coefficient of performance of the speech attenuation device based on the sound pressure level of the speech audio and the outlet sound pressure level.

[0033] T1 and T2 may be determined based on audio data received by the sound pressure level sensor.

[0034] Determining the outlet sound pressure level based on the ambient audio data and the mixed audio data may include: determining the ambient sound pressure level based on the ambient audio data; determining the mixed sound pressure level based on the mixed audio data; and determining the outlet sound pressure level based on the ambient sound pressure level and the mixed sound pressure level.

[0035] The method may further include separating input received by the sound pressure level sensor into a first ambient component and a first speech component; separating audio data received by a second sound sensor associated with an exterior portion of a speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device, into a second ambient component and a second speech component, wherein the second sound sensor is configured to receive at least attenuated speech audio that exits the speech attenuating device; determining a speech performance coefficient based on the first speech component and the second speech component; and determining an environmental performance coefficient based on the first ambient component and the second ambient component, wherein the performance coefficient is calculated based on at least one of the speech performance coefficient and the environmental performance coefficient.

[0036] Separating the input received by the sound pressure level sensor into a first ambient component and a first speech component and separating the audio data received by the second sound pressure level sensor into a second ambient component and a second speech component may include using a Wiener filter.

[0037] The method may also include determining a speech environment comparative performance coefficient based on the first speech component and the first environment component; and providing an indication of the speech environment comparative performance coefficient via the computing device.

[0038] The performance coefficient may be further calculated based on the speech environment comparison performance coefficient.

[0039] The method may further include obtaining mixed audio data using a second sound sensor associated with an exterior portion of the speech attenuation device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuation device, wherein the second sound sensor is configured to receive at least attenuated speech audio that exits the speech attenuation device; and calculating a cross-correlation product between input received by the sound pressure level sensor and audio data received by the second sound sensor; and calculating a performance coefficient based on the cross-correlation product.

[0040] Unless otherwise contradicted, the elements described above and those in the specification can be combined.

[0041] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure, as claimed.

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Other advantages and features of the present invention will become apparent from reading the following description shown in the accompanying drawings:

[0044] Figure 1 shows an exemplary defined space to which communication restrictions may be applied according to an embodiment of the present disclosure;

[0045] Figure 2A A schematic diagram illustrating an exemplary communication device according to an embodiment of the present disclosure is shown;

[0046] Figure 2B The embodiment according to the present disclosure is shown Figure 2A Schematic diagram of a communication device combined with a speech attenuation device;

[0047] Figure 3 is a flow chart highlighting a method for facilitating compliance with space-limited voice call restrictions according to an embodiment of the present disclosure;

[0048] Figure 4A A schematic diagram showing an exemplary case of obtaining restriction and connection information for a defined space;

[0049] Figure 4B An exemplary interface for authenticating and pairing with a communication facility within a defined space is highlighted;

[0050] Figure 4C Shown for Figure 4B An exemplary interface for initiating communication after verification and pairing;

[0051] Figure 4D shows a user contact list that may be provided for establishing a communication session within a defined space according to an embodiment of the present disclosure; and

[0052] Figure 5 A schematic diagram illustrating a computing portion of an exemplary communication device that may be implemented according to one or more embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0053] Embodiments of the present disclosure are intended to ensure that communication limits (e.g., sound levels) in a confined space are adhered to. The systems and methods disclosed in this specification implement a correction system that is configured to ensure that the user's speech sound pressure level (SPL) is maintained below a given threshold and prevent the user from making further communications if such a level cannot be maintained. These systems and methods provide additional assistance by attenuating the speech audio that leaves an optional speech attenuation device (e.g., a mask) and enabling the user to see the SPL associated with the speech on a communication device. Thus, these systems and methods make it possible not only to warn the user and stop their further communications if a threshold is not adhered to, but also to visualize the level of spoken audio relative to the threshold to help adhere to the set limits.

[0054] Figure 1 An exemplary defined space 100 to which communication restrictions may be applied according to an embodiment of the present disclosure is shown. Defined space 100 may be an enclosed area that is publicly accessible to one or more persons (interchangeably referred to herein as occupants, users, and passengers). For example, defined space 100 may be an airplane cabin 103, the interior of a train, a waiting room, the interior of a bus, the interior of a taxi, a park, a theater, and the like.

[0055] Because defined space 100 may be a public place, a certain level of ambient noise may be present within defined space 100. For example, within the cabin of an airplane, there is typically persistent ambient sound generated by airflow over the exterior of the airplane, as well as sounds generated by the airplane's engines. Similarly, within the interior of a bus or train, ambient sound generated by the vehicle's motion and the occupants therein is typically at a persistent level. For the purposes of this disclosure, such sounds will be referred to as ambient sound.

[0056] For purposes of explaining the systems and methods of the present disclosure, the defined space 100 will be described as a cabin of an aircraft 103 , wherein a plurality of seats spaced apart at defined distances are provided for a plurality of passengers 140 .

[0057] According to embodiments of the present disclosure, the defined space 100 may be associated with a communication provider 150 (e.g., a communication network) configured to provide connectivity and communication capabilities to occupants of the defined space 100. For example, in the cabin of the aircraft 103, a transceiver 160 may be associated with the communication provider 150 (e.g., satellite, terrestrial, hybrid, etc.) to provide connectivity to cellular telephone services, including, for example, cellular and / or WiFi data (e.g., 3G, 4G, 5G, IEEE 802.11, etc.). According to some embodiments, the communication provider 150 may provide a WiFi and / or Bluetooth network within the defined space 100 via the transceiver 160, thereby enabling the communication device 110 to connect to the communication provider 150 via the transceiver.

[0058] Access to the communication provider 150 via the transceiver 160 is conditional and may be based on the communication device 110 being equipped with an identifier and / or access code that is compatible with the communication provider 150 and / or the transceiver 160 that defines the space 100. For example, access information including an access code and / or user credentials may be provided to the passenger 140 in the aircraft cabin 103 upon purchasing a communication option or in conjunction with a boarding pass obtained for boarding. Upon providing the obtained access information to the communication device 110, the communication device 110 may establish a connection with the communication provider 150.

[0059] According to some embodiments, the access information may be encrypted and transmitted from the communication provider 150 to the defined space 100 via the transceiver 160. For example, a passenger in the aircraft cabin 103 may use the communication device 110 to establish an initial connection with the communication provider 150 and may be prompted to pay for the communication service. After paying for the desired service, the access information may be provided (e.g., transmitted and decrypted) to the communication device 110, and the desired level of communication service may be provided to the communication device 110.

[0060] According to some embodiments, restriction data regarding communications may be stored and transmitted by the communication network 150. For example, upon establishing a connection with the communication network 150, the communication device 110 may receive restriction data from the communication network 150, including, for example, predetermined thresholds for the sound level of voice audio. The restriction data may be stored by the communication device 110 during the period that the communication device 110 is connected to the communication network 150. Alternatively or additionally, the communication device 110 may request restriction data from the communication provider 150 as needed (e.g., when a communication session begins).

[0061] Restriction data may include communication restrictions within defined space 100, which may be established by the entity managing defined space 100. For example, restrictions may relate to the SPL of the voice audio of users participating in a communication session, the SPL of the device used to output audio during the session, the length of the communication session, and so on. Therefore, the entity managing defined space 100 may wish to ensure that such restrictions are adhered to and may tie the use of communication services provided by communication provider 150 within defined space 100 to adherence to the established restrictions. For example, an airline operating commercial flights may regulate the SPL of user voice within aircraft cabin 103 and may prohibit the voice volume from exceeding a certain level (e.g., maximum voice SPL = a dB value approximately 30% to 40% below the ambient sound level) for a period greater than a predetermined time period (e.g., 5 seconds). According to such an example, assume that the ambient sound level within the cabin of a commercial airliner is approximately 75 dB. In this case, the maximum SPL of user voice within the cabin may be set at, for example, 50 dB. If the user's voice exceeds 50 dB + 5% for a period greater than 5 seconds, corrective action may be taken.

[0062] The management entity may also define required corrective actions for users who violate established restrictions. For example, the management entity may determine that communications should be terminated immediately when a violation occurs, for example, by disconnecting the communication device from the communication network 150. Alternatively, as another example, the management entity may direct that multiple corrective steps (e.g., in ascending order of severity) be implemented before ultimately terminating the communication session. For example, the user may first be notified that they have violated one or more restrictions, and then a warning may be issued indicating that the violation is continuing or that the user has exceeded a certain number of notifications (e.g., 2 notifications) and that subsequent corrective steps (e.g., lowering the output volume, etc.) will be performed. Finally, in response to ongoing violations, the most severe corrective steps may be taken, for example, the communication session may be terminated, the communication device 110 may be temporarily disabled, etc., as described below.

[0063] Figure 2A Schematic diagram of an exemplary communication device according to an embodiment of the present disclosure is shown. The communication device 110 is configured to perform functions associated with the embodiments of the present disclosure and may include any suitable device for performing such functions. The communication device 110 may include, for example, a display 210, an image capture device 220 (e.g., a camera), an audio input device 231, an audio output device 230 (e.g., a speaker), a receiver 240, etc.

[0064] The communication device 110 shown is intended to encompass any communication device, such as a server, a desktop computer, a laptop / notebook computer, a wireless data port, a smartphone, a personal data assistant (PDA), a tablet communication device, one or more processors within such devices, or any other suitable processing device, including a physical or virtual instance (or both) of the communication device 110. In particular, the communication device 110 includes hardware that enables a user 140 to communicate wirelessly using over-the-air signals to transmit and receive data (e.g., audio data) to and from one or more sources via, for example, a communication provider 150. In the context of this disclosure, the term "communication" refers to any of making and receiving phone calls, online conferencing (e.g., video calls, Facetime, Zoom, MS Teams), virtual conferencing, text messaging, and any other type of communication to a remote party. Because such communication devices are known in the art, not all features of such devices will be described in depth; however, certain additional components of the communication device 110 will be described below.

[0065] The audio input device 231 may include any suitable sound sensor configured to receive various sounds (e.g., voice audio from the user, voice audio from a third party, ambient sounds, etc.). The audio input device 231 may correspond to a microphone installed in the communication device 110 and / or an external microphone connected to the communication device via a wired connection (e.g., USB, serial cable, etc.) or a wireless connection (e.g., Bluetooth, WiFi (e.g., IEEE 802.11), etc.). Although the present disclosure discusses the audio input device 231 as a single device, the communication device 110 may include multiple audio input devices 231. For example, the first microphone is intended to be placed near the user's mouth, and the second microphone is configured to receive the user's voice at a certain distance and receive ambient sounds around the communication device 110.

[0066] The audio output device 230 can be any suitable device configured to provide audio output to the user 140. For example, the audio output device 230 can include a speaker, a headphone jack, etc. The audio output device 230 can also be configured to provide a wireless signal representing the audio output to one or more wireless devices (e.g., Bluetooth speakers, headphones, etc.) configured to convert and amplify the audio output. Although this disclosure discusses the audio output device 230 as a single device, the communication device 110 can include multiple audio output devices 230. For example, a first speaker is intended to be placed near the ear, and a second speaker is configured to amplify the sound so that the user can hold the phone away from the user's ear.

[0067] The display 210 may include any suitable device for providing visual information to the user 140. For example, the display 210 may include an LED, an OLED, an LCD, or other suitable display type. The display 210 may be configured to serve as an interface between the user 140 and the communication device 110, and may provide information to the user 140 and receive information from the user 140. For example, the display may be configured to display text 216 (e.g., notifications to the user), video information 214 (e.g., for a video call), and an SPL indicator 212 to provide feedback to the user 140 or other parties in and around the communication device 110, etc. This information will be discussed in more detail below.

[0068] In addition, the display 210 can be configured as a touch screen to receive input from the user via touch. For example, a capacitive touch LED or OLED screen can be implemented as the display 210. The display 210 is not intended to be limited to a touch screen type device and can receive input via other input devices external to the communication device 110.

[0069] In the case of an embodiment of the present disclosure, the text information 216 on the display 210 can be configured to provide various information to the user 140 operating the communication device 110. For example, the text information can be configured to provide a notification indicating that the user 140 is currently violating one or more restrictions associated with communications within the defined space 100. For example, as described below, when it is determined that the sound pressure level of the user's voice exceeds a specified volume level (e.g., a dB value 5% higher than a predetermined threshold), the text information 216 can provide the user 140 with a warning (e.g., a flashing phrase) to speak more quietly.

[0070] According to some embodiments, the text message 216 may include further information about corrective actions to be taken if the user 140 does not adjust the voice below a specified level. For example, a timer and / or counter may be displayed to the user, along with a notification that the next corrective action (e.g., termination of the communication session) established with the communication provider 150 will be taken when the displayed timer expires and / or the counter reaches a given violation count. For example, the timer may continue to count down as long as the violation is ongoing, while the counter may increment each time the violation recurs.

[0071] The SPL indicator 212 can be configured to provide real-time visual guidance to the user to increase and decrease the SPL of the voice audio based on the threshold set for the SPL limit. For example, the SPL indicator 212 can indicate the current SPL of the user's voice audio relative to an indicator 217, which shows the maximum level at which the voice audio remains below the set threshold within the confines of the space 100.

[0072] Video information 214 may be configured to provide video information related to, for example, video communications to user 140. For example, during a video conference using communication device 110, video streams from one or more parties connected to communication device 110 may be displayed via video information 214. Other video information may also be displayed via video information 214, such as notifications, entertainment (e.g., movies, television programs, etc.).

[0073] The image capture device 220 may be configured to obtain one or more images related to the defined space 100 and / or the restrictions associated therewith. For example, the image capture device 220 may include a camera (e.g., a front-facing or rear-facing camera of a mobile phone), which may form part of the communication device 110. Alternatively or additionally, the image capture device 220 may be an external camera configured to communicate with the communication device 110 via a wired or wireless manner, so that the communication device 110 can obtain images of the environment surrounding the user 140.

[0074] The images captured by the image capture device 220 can be used by the communication device to obtain information related to the restrictions established for the defined space 100 and / or access information (e.g., access code) for the communication provider. For example, the user 140 can scan a paper boarding pass in the aircraft cabin 103 to obtain initial connection information (e.g., network name, preliminary identifier, seat location) for the communication provider 150 and the restriction data for the defined space 100. Such information can be provided, for example, by a barcode or other suitable indicia on the paper boarding pass. Alternatively or additionally, the image capture device can be used to scan a seatback display or other information display located at or near a seat within the defined space 100, which provides connection and / or restriction information to the computing device 110.

[0075] Figure 2B The embodiment according to the present disclosure is shown Figure 2ASchematic diagram of a communication device in combination with a speech attenuating device. While the speech attenuating device 102 is optional, it may be useful for maintaining speech audio levels below a set threshold within the confines of the defined space 100 (e.g., to mask a user's mouth to prevent lip reading). The speech attenuating device 102, also referred to herein as a "face mask," may be configured to be worn on the face of the user 140 and configured to connect to the communication device 110 via a wired or wireless connection. The speech attenuating device 102 may have a shape configured to conform to the face of the user 140 and may define an interior volume configured to surround the mouth of the user 140 without contacting the mouth of the user 140. For example, the speech attenuating device 102 may be cup-shaped or dome-shaped such that an interior surface of the speech attenuating device 102 is directed away from the mouth of the user 140, while an edge of the speech attenuating device 102 may rest on a cheek or other facial part of the user 140.

[0076] The speech attenuating device 102 may be made of any suitable material that provides comfort and fit. For example, the mask may be made of metamaterials, filter materials, sound absorbing materials, and / or any suitable sound absorbing fabrics.

[0077] The voice attenuating device 102 may include one or more features that enable the mask to be secured to the user 140. For example, the voice attenuating device 102 may include one or more straps that are configured to pass around the ears of the user 140 and are configured to be tightened to hold the voice attenuating device 102 on the user's face. According to another example, the mask 102 may be configured to be removably connected to the earphones 109, such as by a detachable clip (e.g., a magnetic clip), as described below.

[0078] According to an embodiment of the present disclosure, the speech attenuation device 102 includes a sound absorber 104 configured to reduce (i.e., attenuate) the sound pressure level (SPL) of speech audio. For example, the sound absorber 104 can be made of a metamaterial, a filter material, a sound-absorbing material, and / or any suitable sound-absorbing fabric. The list of materials provided herein is merely exemplary and non-limiting; any known sound-absorbing material can be used to attenuate speech audio within the speech attenuation device 102.

[0079] The sound absorber 104 may be located in any suitable position relative to the speech attenuating device 102. For example, the sound absorber 104 may be located within the interior volume of the speech attenuating device 102 and / or on an exterior portion of the speech attenuating device 102.

[0080] According to some embodiments, the sound absorber 104 may be formed by one or more of an injection molding process, a 3D printing process, or other suitable manufacturing processes. For example, the sound absorber 104 may be manufactured using a 3D printer using instructions specific to the speech attenuation device 102 .

[0081] The sound absorber 104 and the speech attenuating device 102 may be formed as a single device. For example, the speech attenuating device 102 may be formed by a first molding process, and the sound absorber 104 may be overmolded onto the speech attenuating device 102.

[0082] The sound absorber 104 can have any suitable geometry relative to the speech attenuating device 102 for attenuating the audio of speech spoken by the user 140 within the interior volume of the speech attenuating device 102. For example, the sound absorber 104 can completely cover the interior portion of the speech attenuating device 102. According to another example, the speech attenuating device can be formed entirely of sound absorbers. In yet another example, multiple sound absorbers 104 can be attached to the interior volume of the speech attenuating device 102 at certain locations to maximize the sound attenuation effect of the sound absorbers 104.

[0083] The speech attenuating device 102 and the sound absorber 104 may be configured to redirect air (and therefore, sound energy) from the front of the speech attenuating device 102 to a rear exit region of the speech attenuating device 102. For example, the interior volume of the speech attenuating device 102 may include channels and / or flow paths (not shown) configured to redirect air (and therefore, sound waves) through the speech attenuating device 102 to the exit region.

[0084] The speech attenuating device 102 may include an audio input device 106 configured as a sound sensor to receive speech audio from the user 140. For example, the audio input device 106 may be located within the interior volume of the speech attenuating device 102 at a position configured to maximize speech audio collected from the user 140. According to such an example, when the speech attenuating device 102 is in a worn position on the user 140, the audio input device 106 may be adhered to a wall defining the interior volume of the speech attenuating device at a position directly in front of the user's mouth. When referring to the "worn position" of the speech attenuating device 102, it means that the speech attenuating device is positioned such that the interior volume of the speech attenuating device 102 covers the mouth of the user 140, as shown in FIG. Figure 1 In other words, the speech attenuating device 102 can be temporarily maintained in the worn position and / or secured in the worn position (eg, by a strap) for a longer period of time.

[0085] The audio input device 106 may include any suitable device for capturing speech audio from the user 140 and transmitting an electrical representation of the captured speech audio to the communication device 110. For example, the audio input device 106 may include one or more audio microphones having a desired frequency response, sensitivity, and capture pattern for speech audio within an enclosed space (e.g., the interior volume of the speech attenuating device 102).

[0086] According to another embodiment, the audio input device 106 may include a bone conduction microphone configured to collect sound waves from the user's bones (e.g., the user's jaw and / or ear structure). According to such an embodiment, two or more audio input devices 106 may be implemented, one on each side of the user's face 103, for example, between the voice attenuation device 102 and the user's face 103. Figure 1 The position where the earphone 109 is connected is shown. The type and configuration of any implemented audio input device are only exemplary and not limiting. Any suitable audio input device 106 can be used without departing from the scope of this disclosure.

[0087] The audio input device 106 can be configured to transmit a signal representing the collected sound (e.g., speech audio) via any suitable transmission method. For example, the audio input device 106 can be configured to wirelessly transmit the collected speech audio to the communication device 110 using any suitable wireless transmission protocol (e.g., Bluetooth, IEEE 802.11, 3G / 4G / 5G, etc.). Alternatively or additionally, the audio input device 106 can include a wired connection to a transmitter (not shown) installed in or on the speech attenuation device 102. The transmitter can be configured to transmit the collected sound signal to the communication device 110.

[0088] The speech attenuation device 102 includes another audio input device 108 associated with an exterior portion of the speech attenuation device 102 and configured as a sound sensor to receive at least the attenuated speech audio exiting the speech attenuation device 102. The audio input device 108 may be any suitable device for capturing sound attenuated by the speech attenuation device 102 and / or the sound absorber 104. For example, the audio input device 108 may include a microphone having a desired frequency response, sensitivity, and capture mode for capturing the attenuated speech audio exiting the speech attenuation device 102 at the exit area.

[0089] The audio input device 108 can be located outside the speech attenuating device 102 (i.e., outside the interior volume) and near an edge portion of the exit area. For example, when the speech attenuating device 102 is in the worn position, the audio input device 108 can be located on the speech attenuating device 102 and near the ear of the user 140. This can enable the audio input device 108 to obtain a more accurate measurement of the SPL of the attenuated speech audio leaving the speech attenuating device 102.

[0090] According to some embodiments, two or more audio input devices 108 may be provided external to the speech attenuating device 102 to allow for more accurate determination of the SPL of the attenuated speech audio exiting the speech attenuating device 102. For example, the audio input devices 108 may be located on each side of the user's 140 face, at the exit area of ​​the speech attenuating device 102.

[0091] The audio input device 108 can be configured to transmit a signal representing the collected sound (e.g., attenuated speech audio) via any suitable transmission method. For example, the audio input device 108 can be configured to wirelessly transmit the collected audio to the communication device 110 using any suitable wireless transmission protocol (e.g., Bluetooth, WiFi (IEEE 802.11), 3G / 4G / 5G, etc.). Alternatively or additionally, the second sound sensor 108 can include a wired connection to a transmitter (not shown) mounted in or on the speech attenuation device 102. The transmitter can be configured to transmit the collected sound signal to the communication device 110.

[0092] The receiver 240 of the communication device 110 is configured to receive audio data from the sound sensor 106 and the second sound sensor 108, etc. For example, the receiver 240 may include one or more Bluetooth, WiFi (e.g., IEEE 802.11), cellular, etc. receivers configured to wirelessly receive electronic signals representing audio data (e.g., voice audio and attenuated voice audio) from the audio input devices 106 and 108 and other sensors (e.g., ambient sound sensors). The receiver 240 may be configured to provide the signals to the processor 516 of the communication device 110 via any suitable means, such as via the system bus 503 of the communication device 110.

[0093] According to an embodiment implementing an optional voice attenuation device, the text information 216 may also be configured to provide a visual representation of the utterances received by the communication device 110 via the voice audio spoken by the user 140 and collected by the sound sensor 106. For example, the communication device 110 may include voice recognition software trained for the user 140 so that the utterances spoken by the user can be “recognized” (i.e., voice recognized) and displayed on the display 210 via the text information 216 upon receiving a selection from the user indicating a desire to display text. This feature may be helpful when the user 140 is wearing the voice attenuation device 102 on their face to attenuate the voice audio, but still wishes to converse with someone nearby (e.g., a taxi driver, flight attendant, etc.).

[0094] Based on the voice audio obtained by the communication device 110, it can be determined whether the volume level of the user's voice remains below the threshold limit set for the confined space 100, taking into account the ambient sound. In addition, when the mask 102 is implemented, the attenuated sound pressure level (SPL) of the voice audio signal collected by the second sound sensor 108 can be obtained, thereby facilitating compliance with restrictions within the confined space.

[0095] According to an embodiment of the present disclosure, features of the system 100 are further configured to obtain information capable of determining the ambient SPL surrounding the user 140 and the voice attenuation device 102. For example, the second sound sensor 108 can receive sound information from the surrounding environment and provide the information to the communication device 110 via a wired / wireless connection provided for the second sound sensor 108. Alternatively or additionally, an ambient sound sensor 208 can be provided on the voice attenuation device 102 and configured to obtain the ambient sound information. The ambient sound sensor 208 can be similar to the sound sensor 106 and the second sound sensor 108 and provide similar functionality (e.g., wireless signal transmission, etc.).

[0096] The earphones 109 may be configured to be worn on and / or in the ears of the user 140 and to provide audio information to the user 140. For example, the earphones 109 may include one or more sound transducers (e.g., speakers) configured to transmit sound to the ears of the user 140. The earphones 109 may receive signals related to the sound information via a wired and / or wireless connection (e.g., with the communication device 110). The wireless connection of the earphones 109 may be implemented similarly to the sound sensors 106 and 108, and amplification may be provided by known techniques.

[0097] The earphones 109 may be any suitable device for providing sound information to the user 140. For example, the earphones 109 may include in-ear, over-ear, over-ear, headphones, or any other suitable configuration for conveying sound to the user 140.

[0098] The sound sensor 106, the sound sensor 108, and the headset 109 can each be configured to "pair" with the communication device 110. For example, if a Bluetooth connection is established between the communication device and the sound sensors 106 and 108 and / or the headset 109, the pairing can be performed using techniques known in the art. Pairing can automatically enable the communication device 110 to begin performing operations according to the present disclosure.

[0099] Embodiments of the present disclosure implement a concept for using ambient sound in determining an adaptation threshold SPL to keep speech audio in compliance with constraints within the defined space 100. Feedback can be provided to the user 140 so that the user can adjust the SPL of the speech audio so as not to exceed the specified adaptation threshold volume, and if the user does not comply with the constraints, the communication device 110 and / or the communication provider 150 is configured to perform corrective actions (e.g., termination of communication), as described below.

[0100] Based on the above, the formula for calculating the SPL (d2) at a distance d2 (eg, the position of a third party) using the known SPL (d1) at a distance d1 (ie, at the exit of the voice attenuation device 102) is represented by equation (1).

[0101] L(d2)=L(d1)-20log(d2 / d1)(1

[0102] The inverse operation of equation (1) is shown in equation (2), which enables the calculation of the initial sound level L(d1) at distance d1 when the sound level L(d2) at distance d2 is known.

[0103] L(d1)=L(d2)+20log(d2 / d1)(2

[0104] The formula for calculating distance d2 using the known SPL (d1) at distance d1 and the SPL (d2) at distance d2 is shown in equation (3).

[0105] 10^((L(d1)-L(d2)+20log(d1)) / 20(3

[0106] The following example helps us understand the calculations described. Assuming a user's speech is 80 dB at 20 cm (i.e., within the user's personal space), we can estimate the SPL of that speech at 3 meters as follows:

[0107] L(3)=80-20log(3 / 0.2)

[0108] L(3)=56.5dB

[0109] Next, you can determine at what distance the user's voice reaches 50dB when the user continues speaking at 80dB at 0.2m.

[0110] d2=10^((80-50+20log(0.2)) / 20

[0111] d2=6.32m

[0112] Therefore, the user's voice will reach 50dB at 6.32m.

[0113] According to embodiments of the present disclosure, each defined space 100 may have a specific set of restrictions set by an administrative entity (e.g., the owner of the defined space 100). For example, such restrictions may be provided in the General Conditions of Use (GCU) provided to users of the defined space and may involve, for example, setting restrictions on an adaptation threshold SPL. Based on the restrictions set in the exemplary GCU, the system may perform operations intended to maintain compliance with the restrictions, such as the following example: Figure 3 and the example shown in FIG4 .

[0114] Figure 3 is a flowchart highlighting a method for facilitating compliance with space-limited voice call restrictions according to an embodiment of the present disclosure, and Figure 4A An exemplary representation of a hypothetical situation of obtaining constraint and connectivity information for a defined space is shown. Figures 4B to 4D An exemplary interface for authenticating and pairing with a communication facility within a defined space and initiating communication after authentication and pairing is highlighted. Reference will be made to these figures hereinafter.

[0115] Go to Figure 3 , the communication device 110 may obtain access and restriction data associated with the defined space 100 (step 302). For example, the communication device 110 may obtain restriction data from the communication provider 150 when initially connecting to the communication provider 150 (e.g., when connecting to a network SSID in the defined space 100).

[0116] According to some embodiments, the communication device 110 may be further assigned, for example, a certificate, token, or other authorization "key" to enable the communication device 110 to pair or otherwise communicate with the communication provider 150. This assignment (also referred to as "provisioning") may occur, for example, when a user purchases communication services, scans a boarding pass, connects to a communication provider 150 within the defined space 100, and the like.

[0117] Figure 4A FIG. 1 is a schematic diagram showing an exemplary case of obtaining restriction and connection information for a defined space 100. Figure 4AFor example, the image capture device 220 may be used to scan or otherwise capture an image of a boarding pass 420, ticket, or other document provided to a user to enter the defined space 100. For example, a barcode 425 may be provided on the paper boarding pass 420, which may contain various information related to the user's location within the defined space 100, as well as restrictions and access information for the communication provider 150. According to some embodiments, the barcode 425 may include an encoded version of an identifier and / or access code corresponding to a credential or token for use by the communication device 110 to connect to the communication provider 150 and to perform communications.

[0118] Alternatively or additionally, the user 140 may provide user credentials to the communication provider 150 via the communication device 110, and these credentials may be verified. For example, the user 140 may be provided with a username and password when purchasing communication access, and the user may provide the username and password to the communication provider 150 upon initial connection. The communication provider 150 may then verify the credentials and send an access code to the communication device 110 for accessing the purchased service.

[0119] According to a further embodiment, the initial connection information may be obtained by the communication device 110 via image capture, wherein the restriction data and the access code are provided after the communication provider 150 authenticates the user 140 . Figure 4B An exemplary interface for authenticating and pairing with a communication facility (e.g., communication provider 150) within defined space 100 is highlighted. As shown, communication device 110 can indicate to user 140 the status of connection and / or pairing with communication provider 150. During connection / pairing, restriction data and an access code can be provided to communication device 110. Those skilled in the art will appreciate that the connection techniques described herein are not intended to be limiting, and any method for connecting to, accessing, and authenticating with communication provider 150 may be implemented.

[0120] Once a connection with the communication provider 150 is established and the access code and restriction data have been provided to the communication device 110, the user may be presented with Figure 4C and Figure 4D One or more exemplary interfaces shown. Figure 4C As shown, the user may be presented with a choice among a number of other users 140 that are located within the defined space 100 and have active connections with the communication provider 150. The user 140 may select one or more of the listed users 140 to initiate a communication session.

[0121] like Figure 4D As shown, a user's contact list can also be provided to establish a communication session. The user can select one or more contacts from the list to initiate communication, such as through Zoom TM、Facetime TM , Microsoft Teams TM , a regular phone call, etc. The interfaces shown for initiating a communication session on communication provider 150 are merely exemplary and should not be considered limiting. For example, a dialing interface may be provided to the user, enabling the user to dial a phone number in a known manner via communication device 110. According to some embodiments, the list may only show those contacts within a defined space that are identified within range of communication device 110. Alternatively, the list may show, for example, all of the user's contacts or a user-defined subset.

[0122] Once the communication device 110 has established a communication session with the desired contact via the communication provider 150, the user 140 can begin speaking, causing one or more of the sound sensors 231, 106, and 108 to receive voice audio from the user 140. The voice audio spoken and obtained by the sound sensor 106 can be received by the communication device as a voice audio signal, and the SPL of the signal is determined by the communication device 110 (step 304). For example, when the user is wearing the optional voice attenuation device 102, the sound sensor 106 can provide the voice audio to the computer via a wireless connection (e.g., Bluetooth). The voice audio received at the sound sensor 108 can be attenuated voice audio, and the SPL of the attenuated audio is implemented for further processing, as shown below.

[0123] The communication device 110 may then determine the ambient sound surrounding the user 140 to obtain the SPL of the ambient sound (step 306). For example, the sound sensor 231 may obtain a sound signal corresponding to the ambient sound near the communication device 110, which is used to determine the SPL of the ambient sound. Alternatively or additionally, any other suitable sound sensor (e.g., the second sound sensor 108) may provide the ambient sound signal to the communication device 110 to enable the communication device 110 to determine the SPL associated with the ambient sound.

[0124] Based on the ambient SPL obtained at step 306 and the predetermined threshold associated with the constraint data associated with the defined space 100, the communication device 110 may determine an adaptation threshold for the sound level from the user 140 (step 308). This determination may be made as follows, assuming that the GCU constraint is set to 65 dB SPL at 0.7 meters and using the equation described above.

[0125] L(d1) = GCU - level - obligation + 20log(GCU distance obligation / d1)

[0126] L(d1)=65dB+20log(0.7m / d1)

[0127] Taking the distance d1 (corresponding to the distance at which the voice audio from the user is measured by the computing device or the distance at the outlet of the optional sound attenuation device) equal to 1 cm,

[0128] L(d1)=65+20log(0.7 / 0.10)=~82dB

[0129] Therefore, the SPL from the user's mouth should not exceed 82dB.

[0130] According to some embodiments, the adaptation threshold can be continuously adjusted, for example in real time, based on the ambient SPL of the user's surroundings. For example, when an aircraft begins its descent, the engines typically reduce thrust, and the ambient sound within the aircraft cabin 103 may decrease. During this period, the adaptation threshold can also be changed to account for the decrease in ambient sound. Similarly, if the SPL of the ambient sound increases (e.g., the aircraft engine increases thrust), the adaptation threshold can be changed to account for the increase in ambient sound.

[0131] The determined speech audio SPL can then be compared to the adaptation threshold to determine whether the speech audio SPL exceeds the adaptation threshold (step 310). When the speech audio SPL remains below or equal to the adaptation threshold (step 310: No), no further action is taken. For example, in the above example, where the speech audio SPL is 82 dB and the adaptation threshold is 75 dB (e.g., based on an ambient SPL of 75 dB in the cabin of an aircraft operating at cruising altitude), no corrective action is taken because the SPL at 0.7 m is lower than the ambient SPL.

[0132] According to some embodiments, the GCU may set limits based on location within the defined space. For example, on an airplane, the threshold for first class may be set higher than for economy class, while the threshold for business class may be set between first class and economy class. As discussed herein, this information may be obtained by a communication device, such as by scanning a barcode (e.g., a barcode on a boarding pass or seat tag) from a network connection at a specific location within the defined space 100.

[0133] When it is determined that the voice audio SPL exceeds the adaptation threshold SPL (step 310: yes), the communication device 110 performs corrective actions (step 312). Such corrective actions can be taken in a progressive manner, from the least severe (e.g., visual and / or audible warning to the user) to the most severe (e.g., deactivating the access code provided to the communication device 110 for the duration of time in the confined space 100). For example, an audio notification can be provided to the user 140 via the headset 109 and / or via the speaker 230 of the communication device 110, indicating that the voice audio SPL must be lowered within a certain time limit (e.g., the next 5 seconds) or subsequent corrective actions will be performed (e.g., lowering the audio level of the communication device 110). A list of corrective actions that can be performed can be provided to the user 140 in advance, for example, in a terms of service document agreed to when connecting and authenticating with the communication provider 150.

[0134] When the voice audio SPL remains above the limit for a predetermined period of time and the most severe corrective action is reached, the communication session may be terminated by the communication device 110 and / or the communication provider 150. For example, the communication provider 150 may invalidate the access code provided to the communication device 110, thereby terminating the connection with the communication provider 150. Alternatively or additionally, the communication device 110 may terminate the connection with the communication provider 150, thereby terminating the communication session.

[0135] The communication device 110 may provide a notification to the user 140 via text or other suitable method (eg, a flashing light, etc.) to indicate that the communication session is terminated. For example, a message may be displayed via the text display 216 explaining that the connection was lost.

[0136] According to some embodiments, when a communication is about to be terminated due to failure to comply with restrictions, third parties communicating with user 104 may be notified of the impending disconnection. For example, when a user is in a virtual meeting with participants on communication device 110, the communication device may broadcast a warning (e.g., a flashing notification) to other devices participating in the virtual meeting, indicating that if the voice audio is not reduced, user 104 will be disconnected within a predetermined time period. Thus, other participants can understand why the communication with the user is being terminated before it is terminated.

[0137] According to some embodiments, the entity responsible for managing the defined space 100 can determine that a single corrective action of the desired severity should be implemented when a restriction of the defined space is violated. For example, when it is determined that the voice audio SPL exceeds an adaptation threshold, the communication device 110 can be immediately disabled and / or the communication can be terminated by invalidating the provided access code, rather than providing one or more notifications. The list of corrective actions is not limiting, and any corrective action used to enforce a restriction is intended to fall within the scope of this disclosure. For example, where the restriction is a call time limit, the call can be terminated when the time limit expires, but the communication device 110 can still maintain a connection with the communication provider 150.

[0138] Figure 5 Schematic diagram of a computing portion of an exemplary communication device that can be implemented according to one or more embodiments of the present disclosure. Specifically, Figure 5 A block diagram illustrating components of a computing communication device 110 for providing computing functionality associated with the algorithms, methods, functions, procedures, processes, and programs as described in this disclosure is shown according to one embodiment.

[0139] The communication device 110 may comprise a computer including an input device, such as a keypad, keyboard, touch screen, or other device that accepts user information; and an output device that transmits information associated with the operation of the communication device 110, including digital data, visual or audio information 104, 106 (or a combination of information); or a GUI.

[0140] The communication device 110 may act as a client, a network component, a server, a database or other persistent device, or any other component (or combination of roles) in a computer system for performing the subject matter described in this disclosure. The communication device 110 is shown communicatively coupled to a network 530. In some embodiments, one or more components of the communication device 110 may be configured to operate within an environment including a cloud-based environment, a local environment, a global environment, or other environment (or combination of environments).

[0141] At a high level, the communication device 110 is an electronic communication device that is operable to receive, transmit, process, store, or manage data and information associated with the described subject matter. According to some embodiments, the communication device 110 may also include an application server, an email server, a web server, a cache server, a streaming data server, a business intelligence (BI) server, or other server (or combination of servers), or be communicatively coupled to any of the above servers.

[0142] The communication device 110 may receive requests from a client application (e.g., executing on another communication device 110) via the network 530 and respond to the request by processing the received request in an appropriate software application. Additionally, requests may be sent to the communication device 110 from a local user 140 (e.g., from a command console or through other suitable access methods), an external or third party, other automated applications, and any other suitable entity, individual, system, or computer.

[0143] Each component of the communication device 110 can communicate using the system bus 503. In some embodiments, any or all components (hardware or software (or a combination of hardware and software)) of the communication device 110 can interact with each other or with the interface 504 (or a combination of both) over the system bus 503 using an application programming interface (API) 512 or a service layer 513 (or a combination of the API 512 and the service layer 513).

[0144] The API 512 may include descriptions of routines, data structures, and object classes. The API 512 may be independent of or dependent on a computer language and may refer to a complete interface, a single function, or even a set of APIs. The service layer 513 provides software services to the communication device 110 or other components (whether shown or not) that are communicatively coupled to the communication device 110.

[0145] The functionality of the communication device 110 is accessible to all service consumers using the service layer. Software services, such as those provided by the service layer 513, provide reusable, defined business functionality through defined interfaces. For example, the interface can be software written in Java, C++, or other suitable languages ​​that provide data in Extensible Markup Language (XML) or other suitable formats.

[0146] Although shown as an integrated component of the communication device 110, alternative embodiments may show the API 512 or service layer 513 as separate components relative to or communicatively coupled to the other components of the communication device 110 (whether shown or not). Furthermore, any or all portions of the API 512 or service layer 513 may be implemented as a sub-module or submodule of another software module, enterprise application, or hardware module without departing from the scope of the present disclosure.

[0147] The communication device 110 includes an interface 504. Although Figure 5 A single interface 504 is shown in FIG. 1 , but two or more interfaces 504 may be used depending on the particular needs, desires, or implementation of the communication device 110. The interface 504 is used by the communication device 110 to communicate with other systems in a distributed environment connected to the network 530.

[0148] Generally speaking, the interface 504 includes logic encoded in software or hardware (or a combination of software and hardware) and operable to communicate with the network 530. More specifically, the interface 504 may include software supporting one or more communication protocols associated with the communication so that the network 530 or the hardware of the interface is operable to transmit physical signals within and outside the communication device 110 as shown.

[0149] The communication device 110 includes at least one computer processor 505. Although Figure 5 A single computer processor 505 is shown in FIG. 1 , but two or more processors may be used depending on the particular needs, desires, or implementation of the communication device 110. In general, the computer processor 505 executes instructions and manipulates data to perform the operations of the communication device 110 and any algorithms, methods, functions, procedures, processes, and programs described herein.

[0150] The communication device 110 also includes a non-transitory communication device 110 readable medium or memory 506 that stores data for the communication device 110 or other components that may be connected to the network 530 (or a combination of both). For example, the memory 506 may be a database that stores data consistent with the present disclosure. Figure 5 10. A single memory 506 is shown in FIG. 10, but two or more memories may be used depending on the particular needs, desires, or specific implementation of the computer 110 and the functionality being described. While the memory 506 is shown as an integral component of the computer 110, in alternative embodiments, the memory 506 may be external to the computer 110.

[0151] According to an embodiment of the present disclosure, memory 506 may be configured to store metadata associated with communications conducted with communication device 110 via communication provider 150. For example, metadata may include sound pressure levels associated with voice audio during communications within defined space 100. Such metadata may be used to determine and prove whether user 140 has indeed violated the restrictions set forth in the restriction data if a dispute arises after corrective action is taken. Metadata stored in memory 506 by communication device 110 may also include the length of each communication session, quality of service, and the like.

[0152] Application 507 may be an algorithmic software engine that provides functionality, particularly with respect to the functionality described in the present disclosure, as specifically needed, desired, or according to a particular implementation of computer 110. For example, application 507 may function as one or more components, modules, applications, etc. Furthermore, although illustrated as a single application 507, application 507 may be implemented as multiple applications 507 on computer 110. Furthermore, although illustrated as being integral to computer 110, in alternative implementations, application 507 may be external to computer 110.

[0153] There may be any number of communication devices 110 associated with or external to the network on which the communication device 110 operates, each communicating via the network 530, for example, to conduct a virtual conference. Furthermore, the terms "client," "user," and other suitable terminology may be used interchangeably as appropriate without departing from the scope of this disclosure. Furthermore, this disclosure contemplates that many users may use one computer 110, or that one user may use multiple computers 110.

[0154] Back to Figure 2B In one embodiment, the system is configured to obtain ambient audio data using the audio input device 108 (also referred to as the second sound sensor 108) during a time T1 when the user 140 is not speaking. The ambient audio data represents the ambient sound surrounding the user 140. The system is further configured to obtain mixed audio data using the audio input device 108 during a time T2 when the user 140 is speaking. The mixed audio data represents the ambient sound surrounding the user 140 and the attenuated speech audio transmitted through the speech attenuation device 102.

[0155] In one embodiment, the time period T1 during which the user 140 is silent and the time period T2 during which the user 140 is speaking are determined using audio data or input obtained from the audio input device 106 (also referred to as the sound pressure level sensor 106 or the first sound sensor 106). In one embodiment, the audio data obtained by the first sound sensor 106 is compared with at least one threshold level to determine whether the user 140 is speaking. In one embodiment, the audio data obtained from the first sound sensor 106 is processed before being compared with the at least one threshold level.

[0156] In one embodiment, the ambient audio data acquired at T1 is then processed by computing device 110 to obtain an equivalent level Leq_ambient. In one embodiment, Leq_ambient is an average spectrum of the ambient sound pressure level acquired at T1, where the spectrum indicates the frequencies and amplitudes included in the ambient audio data. Leq_ambient may be stored in memory 506.

[0157] The computing device 110 also processes the mixed audio data acquired at T2 to obtain an equivalent level Leq_mixed. In one embodiment, Leq_mixed is an average spectrum of the ambient sound pressure level acquired at T1, wherein the spectrum indicates frequencies and amplitudes included in the mixed audio data.

[0158] The computing device 110 may then determine an outlet sound pressure level based on Leq_mixed and Leq_ambient. In one embodiment, the outlet sound pressure level may be determined as the difference between Leq_mixed and Leq_ambient. The outlet sound pressure level indicates that the speech of the user 140 is emerging from the speech attenuation device 102.

[0159] The performance coefficient of the speech attenuating device 102 may be defined as the effectiveness of the speech attenuating device 102 in attenuating speech audio originating from the user 140 and exiting the speech attenuating device 102. The performance coefficient may be determined based on an outlet sound pressure level and a sound pressure level of the speech audio determined from audio data from the first sound sensor 106. In one embodiment, the performance coefficient may be determined based on a difference between the outlet sound pressure level and the sound pressure level of the speech audio.

[0160] In one embodiment, the coefficient of performance may be determined based on the difference between the outlet sound pressure level and the sound pressure level of the speech audio, expressed as a percentage of the sound pressure level of the speech audio.

[0161] The speech attenuation device 102 can be associated with a known target attenuation factor, where the target attenuation factor is the amount of attenuation of the speech signal that can be achieved by properly using the speech attenuation device 102. A performance factor can be obtained by comparing the difference between the outlet sound pressure level and the sound pressure level of the speech audio to the target attenuation factor. The difference between the outlet sound pressure level and the sound pressure level of the speech can be referred to as the operating attenuation factor. In one embodiment, the performance factor can be determined based on whether the operating attenuation factor is substantially the same as the target attenuation factor. In alternative embodiments, the performance factor can be determined based on whether the operating attenuation factor is within a given range of the target attenuation factor. Other methods of comparing the operating attenuation factor to the target attenuation factor can also be used.

[0162] The performance coefficient may be provided as an indication to the user 140 (e.g., on the display 210) to enable the user 140 to determine, for example, whether the speech attenuating device 102 has been properly fitted to the face of the user 140 and / or whether the speech attenuating device 102 or the sound absorber 104 is malfunctioning.

[0163] In one embodiment, the maximum expected distance of the attenuated voice audio can be determined based on the outlet sound pressure level and the ambient sound pressure level. In one embodiment, in response to determining that the maximum expected distance exceeds the predetermined distance threshold, a notification is provided to the user 140 that the selected privacy level of the voice audio cannot be ensured.

[0164] When the operating attenuation factor is substantially different from the target attenuation factor, the increased ambient sound may be measured by the first sound sensor 106. This will affect the quality of the received voice audio or call. The above method does not specify the percentage of ambient noise entering the first sound sensor 106.

[0165] In one embodiment, the audio data received by the first sound sensor 106 is separated into a first ambient component and a first speech component. In one embodiment, this separation is achieved by filtering the audio data received by the first sound sensor 106. In one embodiment, the filter is a Wiener filter that filters the audio data received by the first sound sensor 106 based on the average value of the audio data received by the second sound sensor 108. In one embodiment, the Wiener filter is a 200-order filter. In one embodiment, other separation techniques, such as principal component analysis, may be used.

[0166] In one embodiment, the audio data received by the second sound sensor 108 is separated into a second ambient component and a second speech component. In one embodiment, this separation is achieved by filtering the audio data received by the second sound sensor 108. In one embodiment, the filter is a Wiener filter that filters the audio data received by the second sound sensor 106 based on the average value of the audio data received by the first sound sensor 108. In one embodiment, the Wiener filter is a 200-order filter. In one embodiment, other separation techniques, such as principal component analysis, may be used.

[0167] In one embodiment, a speech performance coefficient is determined based on the first speech component and the second speech component. In one embodiment, the speech performance coefficient is calculated as the difference between the first speech component and the second speech component. The speech performance coefficient indicates the effectiveness of the speech attenuation device 102 in attenuating the speech of the user 140.

[0168] In one embodiment, an environmental performance coefficient is determined based on the first environmental component and the second environmental component. In one embodiment, the environmental performance coefficient is calculated as the difference between the first environmental component and the second environmental component. The environmental performance coefficient indicates the effectiveness of the speech attenuating device 102 in attenuating external ambient noise from the first sound sensor 106 within the speech attenuating device 102.

[0169] In one embodiment, the performance coefficient may be further calculated based on the speech performance coefficient and / or the environment performance coefficient.

[0170] In one embodiment, a speech environment comparative performance coefficient is determined based on the first speech component and the first ambient component. The speech environment comparative performance coefficient indicates whether the speech measured by the first sensor 106 is louder than the ambient noise measured by the first sound sensor 106. In one embodiment, the difference between the first speech component and the first ambient noise component is used to determine the speech environment comparative performance coefficient.

[0171] In one embodiment, an indication of the speech environment versus performance coefficient is provided to the user 140 via the computing device. In one embodiment, the performance coefficient may be further calculated based on the speech environment versus performance coefficient.

[0172] In an alternative embodiment, the audio signals measured by the first sound sensor 106 and the second sound sensor 108 may be cross-correlated to obtain a cross-correlation product. The cross-correlation product is a measure of the similarity between the signals measured by the first sound sensor 106 and the second sound sensor 108.

[0173] In one embodiment, the coefficient of performance is calculated based on the cross-correlation product. In one embodiment, the coefficient of performance is calculated based on comparing the cross-correlation product to at least one threshold value.

[0174] If, according to a rule of thumb, a certain amount of signal from 108 appears in 106, it means that the mask is not sealing. On the other hand, if a certain amount of 106 is measured in real time into 108, this will indicate potential sound propagation of the speech to the surrounding environment.

[0175] Further embodiments are outlined in the following items:

[0176] Item 1. A system for facilitating compliance with voice call restrictions in a confined space, the system comprising: a communication device including a processor and configured to access a communication network associated with the confined space to transmit and receive audio data; a sound pressure level sensor configured to detect a sound level received by the communication device, wherein the processor is configured to: determine a first sound pressure level associated with sound emanating from a user of the communication device based on input from the sound pressure level sensor; determine a second sound pressure level associated with ambient sound within the confined space; determine an adaptation threshold based on a predetermined threshold and the second sound pressure level; compare the first sound pressure level to the adaptation threshold; and in response to determining that the first sound pressure level exceeds the adaptation threshold, perform corrective action on the communication device.

[0177] Item 2. The system of Item 1, wherein the corrective action comprises one or more of issuing a notification to a user via the communication device, temporarily disabling the communication device, and terminating transmission and reception of audio data.

[0178] Item 3. A system according to any one of items 1 and 2, wherein the communication device includes an identifier associated with the communication device and an access code associated with the communication network and the identifier, and wherein the corrective action includes changing the access code or invalidating the access code to terminate the communication device's access to the communication network.

[0179] Item 4. The system of Item 3, wherein the communication device comprises an image capture device configured to acquire information associated with the predetermined threshold from one or more of a document, a barcode, and an access code.

[0180] Item 5. The system of any one of Items 2 to 4, wherein the notification includes a timer indicating a length of time from a current time until further corrective action is to be performed.

[0181] Item 6. The system of any one of items 1 to 5, wherein the processor is configured to provide a real-time indication of the first sound pressure level relative to the adaptation threshold.

[0182] Item 7. The system according to any one of Items 1 to 6, wherein the defined space is a cabin of an aircraft.

[0183] Item 8. The system of Item 7, wherein the predetermined threshold is specific to an airline associated with the aircraft, and wherein the predetermined threshold is obtained by the communication device via one or more of a communication network and a boarding pass.

[0184] Item 9. The system of any one of Items 1 to 8, wherein the communication device is configured to store metadata associated with the audio data, the metadata comprising the first sound pressure level.

[0185] Item 10. The system of any one of Items 3 to 9, wherein the processor is configured to obtain the access code and the predetermined threshold value from the communication network in an encrypted format and to decrypt the access code and the predetermined threshold value.

[0186] Item 11 A method for facilitating compliance with voice call restrictions in a confined space, the method comprising: providing conditional access to a communication network associated with the confined space, the communication network being configured to transmit and receive audio data; determining a first sound pressure level associated with sound emanating from a user of a communication device based on input from a sound pressure level sensor; determining a second sound pressure level associated with ambient sound within the confined space; determining an adaptation threshold based on a predetermined threshold and the second sound pressure level; comparing the first sound pressure level to the adaptation threshold; and performing corrective action in response to determining that the first sound pressure level exceeds the adaptation threshold.

[0187] Item 12. The method of Item 11, wherein the corrective action comprises one or more of issuing a notification to a user via the communication device, temporarily disabling the communication device, and terminating transmission and reception of audio data.

[0188] Item 13. The method of any one of Items 11 to 12, wherein the corrective action comprises changing or invalidating an access code to terminate access to the communication network.

[0189] Item 14. A method according to any one of clauses 11 to 13, further comprising obtaining information associated with a predetermined threshold from one or more of a document, a barcode, and an access code for accessing a communications network.

[0190] Item 15. The method according to any one of Items 11 to 14, further comprising: providing a real-time indication of the first sound pressure level relative to the adaptation threshold.

[0191] Throughout the specification (including the claims), unless otherwise indicated, the term "comprising" should be understood as being synonymous with "comprising at least one." Furthermore, unless otherwise indicated, any ranges set forth in the specification (including the claims) should be understood to include their endpoints. Specific values ​​of the elements described should be understood to be within acceptable manufacturing or industry tolerances known to those skilled in the art, and any use of the terms "substantially" and / or "about" and / or "generally" should be understood to mean falling within such acceptable tolerances.

[0192] Where reference is made to a standard of any national, international or other standards body (e.g., ISO, etc.), such reference refers to the standard as defined by that national or international standards body as of the priority date of this specification. Any subsequent substantial changes to such standards are not intended to modify the scope and / or definitions of the present disclosure and / or claims.

[0193] It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims.

[0194] While the present invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that additional embodiments can be designed that do not depart from the spirit of the invention disclosed herein. Accordingly, the scope of the present invention should be limited only by the claims appended hereto.

Claims

1. A system for facilitating compliance with space-limited voice call restrictions, the system comprising: a communication device comprising a processor and configured to access a communication network associated with the defined space to transmit and receive audio data; a sound pressure level sensor configured to detect a sound level received by the communication device, wherein the processor is configured to: determining, based on input from the sound pressure level sensor, a first sound pressure level associated with sound emanating from a user of the communication device; determining a second sound pressure level associated with ambient sound within the defined space; determining an adaptation threshold based on a predetermined threshold and the second sound pressure level; comparing the first sound pressure level with the adaptation threshold; and In response to determining that the first sound pressure level exceeds the adaptation threshold, corrective action is performed on the communication device, wherein the corrective action includes temporarily disabling the communication device and terminating transmission and reception of the audio data.

2. The system according to claim 1, wherein: The corrective action also includes issuing a notification to the user via the communication device.

3. The system according to any one of claims 1 and 2, wherein: The communication device includes an identifier associated with the communication device and an access code associated with the communication network and the identifier, and wherein the corrective action includes changing or invalidating the access code to terminate access of the communication device to the communication network.

4. The system according to claim 3, wherein: The communication device includes an image capture device configured to obtain information associated with the predetermined threshold from one or more of a document, a barcode, and the access code.

5. The system according to any one of claims 2 to 4, wherein: The notification includes a timer indicating the length of time from the current time until further corrective action will be performed.

6. The system according to any one of claims 1 to 5, wherein: The processor is configured to provide a real-time indication of the first sound pressure level relative to the adaptation threshold.

7. The system according to any one of claims 1 to 6, wherein: The confined space is the cabin of an aircraft.

8. The system according to claim 7, wherein: The predetermined threshold is specific to an airline associated with the aircraft, and wherein the predetermined threshold is obtained by the communication device via one or more of the communication network and a boarding pass.

9. The system according to any one of claims 1 to 8, wherein: The communication device is configured to store metadata associated with the audio data, the metadata including the first sound pressure level.

10. The system according to any one of claims 3 to 9, wherein: The processor is configured to obtain the access code and the predetermined threshold from the communication network in an encrypted format and to decrypt the access code and the predetermined threshold.

11. A method for facilitating compliance with space-limited voice call restrictions, the method comprising: providing conditional access to a communication network associated with the defined space, the communication network configured to transmit and receive audio data; determining, based on input from a sound pressure level sensor, a first sound pressure level associated with sound emanating from a user of the communication device; determining a second sound pressure level associated with ambient sound within the defined space; determining an adaptation threshold based on a predetermined threshold and the second sound pressure level; comparing the first sound pressure level with the adaptation threshold; and In response to determining that the first sound pressure level exceeds the adaptation threshold, corrective action is performed, wherein the corrective action includes temporarily disabling the communication device and terminating transmission and reception of the audio data.

12. The method according to claim 11, wherein The corrective action also includes issuing a notification to the user via the communication device.

13. The method according to any one of claims 11 and 12, wherein The corrective action includes changing or invalidating the access code to terminate access to the communication network.

14. The method according to any one of claims 11 to 13, further comprising obtaining information associated with the predetermined threshold from one or more of a document, a barcode, and an access code for accessing the communication network.

15. The method according to any one of claims 11 to 14, further comprising: A real-time indication of the first sound pressure level relative to the adaptation threshold is provided.

16. The system according to any one of claims 1 to 10, further comprising: A speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device; and a second sound sensor associated with an external portion of the speech attenuating device, the second sound sensor being configured to receive at least attenuated speech audio exiting the speech attenuating device 102; The processor is further configured to: obtaining, using the second sound sensor, the ambient audio data associated with the ambient sound at time T1 when the user is silent; obtaining, using the second sound sensor, mixed audio data associated with the ambient sound and the attenuated speech audio at time T2 when the user is speaking; determining an outlet sound pressure level based on the ambient audio data and the mixed audio data; calculating a coefficient of performance of the speech attenuation device based on the first sound pressure level and the outlet sound pressure level; and An indication of the coefficient of performance is provided via the computing device.

17. The system according to claim 16, wherein: T1 and T2 are determined based on audio data received by the sound pressure level sensor.

18. The system according to claim 16 or 17, wherein: Determining the outlet sound pressure level based on the ambient audio data and the mixed audio data includes: determining an ambient sound pressure level based on the ambient audio data; determining a mixed sound pressure level based on the mixed audio data; and The outlet sound pressure level is determined based on the ambient sound pressure level and the mixed sound pressure level.

19. The system according to any one of claims 1 to 10, wherein the processor is further configured to: separating an input received by the sound pressure level sensor into a first ambient component and a first speech component; separating audio data received by the second sound sensor into a second ambient component and a second speech component, the second sound sensor being associated with an external portion of the speech attenuating device, wherein the sound pressure level sensor being located within an interior volume of the speech attenuating device, wherein the second sound sensor is configured to receive at least attenuated speech audio exiting the speech attenuating device; determining a speech performance coefficient based on the first speech component and the second speech component; and determining an environmental performance coefficient based on the first environmental component and the second environmental component, The performance coefficient is further calculated based on at least one of the speech performance coefficient and the environment performance coefficient.

20. The system of claim 19, wherein: Separating the input received by the sound pressure level sensor into a first ambient component and a first speech component and separating the audio data received by the second sound pressure level sensor into a second ambient component and a second speech component includes using a Wiener filter.

21. The system according to claim 19 or 20, wherein the processor is further configured to: determining a speech environment comparative performance coefficient based on the first speech component and the first environment component; and An indication of the speech environment comparative performance coefficient is provided via the computing device.

22. The system of claim 21, wherein: The performance coefficient is further calculated based on the speech environment comparison performance coefficient.

23. The system according to any one of claims 1 to 10, wherein the processor is further configured to: Mixed audio data is obtained using the second sound sensor, the second sound sensor being associated with an external portion of the speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device, wherein the second sound sensor is configured to receive at least attenuated speech audio exiting the speech attenuating device; and calculating a cross-correlation product between the input received by the sound pressure level sensor and the audio data received by the second sound sensor; The performance coefficient is further calculated based on the cross-correlation product.

24. The method according to any one of claims 11 to 15, further comprising: obtaining, using a second sound sensor, ambient audio data associated with the ambient sound at a time T1 when the user is not speaking, the ambient audio data being associated with the ambient sound, the second sound sensor being associated with an exterior portion of the speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device, wherein the second sound sensor is configured to receive at least attenuated speech audio exiting the speech attenuating device; obtaining, using the second sound sensor, mixed audio data associated with the ambient sound and the attenuated speech audio at time T2 when the user is speaking; determining an outlet sound pressure level based on the ambient audio data and the mixed audio data; and A coefficient of performance of the speech attenuation device is calculated based on the sound pressure level of the speech audio and the outlet sound pressure level.

25. The method according to claim 24, wherein T1 and T2 are determined based on audio data received by the sound pressure level sensor.

26. The method according to claim 24 or 25, wherein Determining the outlet sound pressure level based on the ambient audio data and the mixed audio data includes: determining an ambient sound pressure level based on the ambient audio data; determining a mixed sound pressure level based on the mixed audio data; and The outlet sound pressure level is determined based on the ambient sound pressure level and the mixed sound pressure level.

27. The method according to any one of claims 11 to 15, further comprising: separating an input received by the sound pressure level sensor into a first ambient component and a first speech component; separating audio data received by a second sound sensor associated with an exterior portion of the speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device, into a second ambient component and a second speech component, wherein the second sound sensor is configured to receive at least attenuated speech audio exiting the speech attenuating device; determining a speech performance coefficient based on the first speech component and the second speech component; and determining an environmental performance coefficient based on the first environmental component and the second environmental component, The performance coefficient is calculated based on at least one of the speech performance coefficient and the environment performance coefficient.

28. The method according to claim 27, wherein Separating the input received by the sound pressure level sensor into a first ambient component and a first speech component and separating the audio data received by the second sound pressure level sensor into a second ambient component and a second speech component includes using a Wiener filter.

29. The method according to claim 27 or 28, further comprising: determining a speech environment comparative performance coefficient based on the first speech component and the first environment component; and An indication of the speech environment comparative performance coefficient is provided via the computing device.

30. The method according to claim 30, wherein The performance coefficient is further calculated based on the speech environment comparison performance coefficient.

31. The method according to any one of claims 11 to 15, further comprising: obtaining mixed audio data using a second sound sensor associated with an exterior portion of a speech attenuating device, wherein the sound pressure level sensor is located within an interior volume of the speech attenuating device, wherein the second sound sensor is configured to receive at least attenuated speech audio exiting the speech attenuating device; and calculating a cross-correlation product between the input received by the sound pressure level sensor and the audio data received by the second sound sensor; A coefficient of performance is calculated based on the cross-correlation product.

Images