Superposition of high-frequency copies of radiated sound

Abstract

An acoustic radiator configured to radiate sound creates a high frequency copy of the sound to be radiated. The high frequency copy of the sound is superimposed on the sound resulting in a composite signal. The composite signal is radiated by the radiator. The high frequency copy is at a frequency inaudible to humans, allowing a receiver to distinguish between the radiator and / or the sound.

Description

[Technical Field]

[0001] The present invention relates to identifying emitted sound from an emitter device, and more particularly to transmitting and receiving information that identifies emitted sound received from an emitter device in a receiving device. [Background technology]

[0002] There are many situations in which electronically generated sound is picked up by an acoustic receiver intended to pick up or process other sounds. Sound that is not intended to reach a given acoustic receiver is often referred to as "noise."

[0003] For example, feedback generated by an audio system can be considered "noise." This occurs when a microphone picks up sound produced by the speaker playing back the sound from the microphone. As a result, the microphone picks up its own sound and the sound being played back by the speaker. In this case, the sound produced by the speaker is usually considered noise from the microphone's perspective.

[0004] Voice-controlled devices are often used in environments where other devices are producing sound, such as music or television programs. In these situations, noise from other devices can frequently obscure voice commands, preventing the voice-controlled device from performing its intended task.

[0005] Furthermore, it is not uncommon for telephone conversations to take place in environments where noise is present due to electronic sources such as public announcements, music, or television. In these situations, electronically generated background noise can make it difficult for the other party to hear what you are saying. [Overview of the project]

[0006] Some embodiments of this disclosure may be shown as methods. The method includes obtaining an acoustic signal that will be emitted from a radiating device. The method further includes processing a copy of the acoustic signal, applying a frequency modifier configured for the radiating device, and obtaining an inaudible frequency copy of the acoustic signal. The method further includes transmitting the acoustic signal and the inaudible frequency copy of the acoustic signal simultaneously, wherein the receiving device is configured to both reverse the frequency modifier configured for the radiating device onto the received inaudible frequency copy of the acoustic signal, discover the copy of the acoustic signal, and use the discovered copy of the acoustic signal.

[0007] Furthermore, some embodiments of the present disclosure may be shown as a computer program product including a computer-readable storage medium, wherein the computer-readable storage medium has program instructions embedded therein, and the program instructions are executable by a computer to cause the computer to perform the methods described above.

[0008] Some embodiments of this disclosure may be shown as a system. The system may comprise memory and a central processing unit (CPU). The CPU may be configured to execute instructions for performing the methods described above.

[0009] The above summary is not intended to describe each illustrated embodiment or all implementations of the present disclosure.

[0010] The drawings included in this application are incorporated herein and form part thereof. They illustrate embodiments of the disclosure and, together with the specification, serve to illustrate the principles of the disclosure. The drawings are merely illustrative of specific embodiments and do not limit the disclosure. As the following detailed description progresses and by reference to the drawings, the features and advantages of various embodiments of the claimed subject matter will become apparent. In the drawings, similar reference numerals indicate similar parts. [Brief explanation of the drawing]

[0011] [Figure 1] This is a schematic diagram showing a plurality of radiating and receiving devices according to some embodiments of the present disclosure. [Figure 2] This flowchart illustrates exemplary methods performed by exemplary radiating and exemplary receiving devices according to some embodiments of the present disclosure. [Figure 3] This is a flowchart illustrating an exemplary embodiment of the method shown in Figure 2. [Figure 4] Figure 2 is a further flowchart illustrating an exemplary embodiment of the method. [Figure 5A] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 5B] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 5C] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 5D] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 5E] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 5F] A block diagram showing exemplary signals at various stages of an exemplary signal processing method according to some embodiments of the present disclosure. [Figure 6] This is a block diagram of an exemplary system including a radiating device and a receiving device according to some embodiments of the present disclosure. [Figure 7] This is an exemplary high-level block diagram of a computer system that may be used when carrying out embodiments of the present disclosure. [Modes for carrying out the invention]

[0012] Although the present invention is subject to various changes and alternative forms, specific examples thereof are shown in the drawings and will be described in more detail below. It should be understood, however, that the intention is not to limit the present invention to the specific embodiments described. In contrast, the intention is to cover all modifications, equivalents, and alternatives falling within the scope of the present invention.

[0013] For simplicity and clarity of illustration, the elements shown in the figures are not necessarily drawn to scale. For example, some of the dimensions of the elements may be exaggerated relative to other elements for clarity. Further, reference numerals may be repeated among the figures where appropriate to indicate corresponding or similar features.

[0014] Aspects of the present disclosure relate to systems and methods for identifying a sound source. More specific aspects relate to superimposing a high-frequency copy of the emitted sound within the sound to identify the emitter of the sound.

[0015] When the acoustic receiver is aware of what is noise in the input, it is possible to remove that noise before performing the intended operation on the input (e.g., before converting speech to text). This can be done by adding an inverted copy of the noise, i.e., a copy that effectively cancels out the noise, to the input. Noise cancellation has been a well-solved problem for repetitive speech. This is because after two cycles of the repeated speech, the controller can continuously perform the above and remove the repetitive noise from the input. However, for non-repetitive speech, the controller cannot predict the noise. In such cases, it is necessary to let the controller know which portion of the acoustic input is noise through other means.

[0016] Current methods for transferring noise information to controllers require transmitting the noise information through another channel such as Wi-Fi®, wires, or Bluetooth®. As a result, receiving devices are connected to a network shared by the noise-producing devices, and the noise information is transmitted through the network. In addition to the problem of connecting all devices to the same network, this also increases the amount of traffic transmitted through the network.

[0017] Systems and methods according to this disclosure enable the identification of acoustic signals that are electronically generated in one or more radiating devices and received in a receiving device, by using inaudible frequency sound waves.

[0018] Throughout this disclosure, acoustic signals are referred to. As used herein, a “composite” signal consists of a “base” signal and a “copy” signal. The “base” signal refers to an electronically generated acoustic signal originally intended to be emitted by a radiating device such as a speaker. The systems and methods of this disclosure enable the generation of a copy of the base signal and the combination of the base signal and the copy signal into a composite signal. The composite signal can then be emitted by a radiator and received by a receiver.

[0019] As an example for illustrative purposes, the base signal to be emitted by a radiator may include a musical song to be played by a speaker. A human listener may want to listen to the song, but may also want to issue voice commands to a receiving device, such as a smart assistant, which may include a microphone. Both the smart assistant and the listener may be in close proximity to the speaker. Typically, the song may be picked up by the smart assistant's microphone, preventing the listener from issuing voice commands to the smart assistant. However, a system according to this disclosure may produce a high-frequency copy of the song, embedding the copy within the song, resulting in a composite signal (i.e., an acoustic signal containing both the song and the copy). The speaker may then emit this composite signal. The copy is at a high frequency that is inaudible to humans, and therefore, to the listener, the speaker would appear to be simply playing the base signal (i.e., the song only) as usual. However, because the smart assistant's microphone has the ability to receive the high-frequency copy, the copy can be "heard" by the smart assistant. Smart assistants can use copies to identify songs as noise. Therefore, smart assistants can filter out songs from their input, thus improving the listener's ability to give voice commands to the smart assistant effectively.

[0020] By radiating a copy of the acoustic signal along with the base signal, information about the electronically generated base acoustic signal is provided to the receiving device. The copy is converted into an inaudible frequency signal and embedded within the base signal, resulting in a composite signal containing both the base signal and the copy. A receiving device, such as an acoustic receiver with a microcontroller, can receive and interpret the inaudible frequency copy to identify the base signal. By using the inaudible frequency copy of the base signal, it is not necessary for the receiving device to receive information using other channels.

[0021] Composite acoustic signals can be used in various ways. For example, composite acoustic signals can be used to cancel out noise acoustic signals in a receiving device. If the receiving device determines that the composite signal contains a base signal that it considers to be noise, it can create an inverted copy of the base signal and superimpose it on the received composite signal to cancel out the noise.

[0022] As another example, a composite acoustic signal may inform a receiving device about an identified acoustic signal. This can be achieved by embedding information within the frequency of the copy. For example, a standard may indicate that an inaudible frequency copy with a minimum frequency of 45,000 Hz corresponds to a base signal that is a musical song, while an inaudible frequency copy with a minimum frequency of 50,000 Hz corresponds to a base signal that is an emergency broadcast. Therefore, a receiver may receive a first composite signal containing an inaudible frequency copy with a lower frequency of 45,000 Hz, informing the receiver that the first composite signal is music (more specifically, that the first composite signal contains a base signal that is music). The receiver may also receive a second composite signal containing an inaudible frequency copy with a lower frequency of 50,000 Hz, informing the receiver that the second composite signal contains a base signal that is an emergency broadcast.

[0023] Furthermore, information can also be embedded through frequency changes (i.e., the difference between the frequency of the copy signal and the frequency of the base signal) used in the conversion to an inaudible frequency signal. For example, a predefined standard indicates that musical songs should be identified by embedding an inaudible frequency copy at 1,050 times the frequency of the base signal, while emergency broadcasts should be identified at 1,300 times the frequency of the base signal. Therefore, a radiating device configured to emit a base signal containing a musical song with a frequency range of 40 Hz to 13,000 Hz may generate an inaudible frequency copy of the song in the range of 42,000 Hz to 13,650,000 Hz (i.e., 40 Hz * 1,050 to 13,000 Hz * 1,050). If the base signal is instead an emergency broadcast, the radiator may generate an inaudible frequency copy in the range of 52,000 Hz to 16,900,000 Hz. In either case, the copy is outside the range of human hearing, but a specific frequency range of the copy (relative to the base signal) can transmit useful information to the receiver.

[0024] Similarly, the embedded information may include information that identifies the radiator. For example, a first radiator may be configured to generate an inaudible frequency copy with a minimum frequency of 30,000 Hz, while a second radiator may be configured to generate an inaudible frequency copy with a minimum frequency of 32,000 Hz. Therefore, if a receiver receives a composite signal containing an inaudible frequency copy with a minimum frequency of 32,000 Hz, the receiver may be led to believe that the composite signal was received from the second radiator.

[0025] The method described above allows a receiving device to identify which portion of the sound it receives originates from an electronic source, even if the only input to the receiving device is sound. A possible use case for this is to remove sound generated by other electronic devices from the receiving input before processing the input for its intended purpose. Another use case would be to identify sound as having been received as an emergency broadcast that takes precedence over other receiving inputs in the receiving device.

[0026] Figure 1 is a schematic diagram 100 showing a plurality of radiating and receiving devices according to some embodiments of the present disclosure. Two exemplary radiators, namely radiating device 110 and radiating device 120 (collectively, “radiators 110 and 120”), are shown. Radiators 110 and 120 provide audio outputs that are received by a receiving device 150. Specifically, radiator 110 provides an audio output 119, while radiator 120 provides an audio output 129.

[0027] The receiving device 150 can be any device that receives and processes an acoustic signal. For optimal function, the receiving device 150 may need to focus on a specific input. For example, the receiving device 150 could be a telephone device, a computer with a microphone for video or voice calls, or a voice-controlled device such as a personal assistant device. The radiators 110 and 120 can be sound-emitting electron devices. For example, in a home environment, the radiators 110 and 120 may include a television, a computer, or a music device, or a combination thereof, all of which may have a built-in or external speaker system. As an additional example, in a public environment, the radiators 110 and 120 may be a public address system, a music device, etc.

[0028] The radiating device 110 includes a radiating device signal identification system 112 to enable identification of the audio output 119. The radiating device signal identification system 112 includes a base signal obtaining component 114 to obtain the acoustic signal that will be radiated from the radiating device 110. For example, the radiating device 110 may be a speaker, and the base signal obtaining component 114 may be configured to receive an acoustic signal (such as a song) that the user wants to hear through the speaker. The radiating device signal identification system 112 further includes a high-frequency copy adding component 116 to generate a high-frequency copy of the acoustic signal. The high-frequency copy may have frequencies outside the range of human hearing. The radiating device signal identification system 112 also includes a composite sound output component 118 for simultaneously transmitting a composite signal (i.e., a signal comprising a base acoustic signal and a combination of inaudible frequency copies of the acoustic signal). The composite sound output component 118 may be, for example, a physical speaker. Similarly, the radiating device 120 includes a radiating device signal identification system 122, a base signal acquisition component 124, a high-frequency copy addition component 126, and a composite sound output component 128, which may function similarly to their counterparts in the radiating device 110.

[0029] In one embodiment, each of the radiators 110 and 120 can apply different frequency modifications to their acoustic signals. For example, radiator 110 may be configured to radiate a first base signal, and radiator 120 may be configured to radiate a second base signal. Radiator 110 may generate a first high-frequency copy of the first base signal via a high-frequency copy addition component 116 and add the first high-frequency copy to the first base signal. The first high-frequency copy may have a frequency of, for example, 20,000 Hz or 20 kilohertz (kHz). On the other hand, radiating device 120 may generate a second high-frequency copy of the second base signal via a high-frequency copy addition component 126 and add the second high-frequency copy to the base signal. The second high-frequency copy may have a frequency of, for example, 30,000 Hz. Therefore, since radiators 110 and 120 emit a composite signal having high-frequency copy signals at different frequencies, the receiving device 150 can distinguish which radiating device (e.g., radiator 110 or radiator 120) the acoustic signal originated from, as will be described in more detail below.

[0030] Depending on the embodiment, the high-frequency copy addition component 116 may apply multiple different frequency modifications simultaneously or sequentially to create multiple inaudible frequency copies of the acoustic signal, thereby improving security.

[0031] The receiving device 150 includes a receiver-device-signal identifying system 152 that provides the functionality described above in the receiving device 150. Although a single receiving device 150 is shown in Figure 1, multiple receiving devices 150 may be provided.

[0032] The receiving device signal identification system 152 includes a composite sound receiving component 154 (e.g., a microphone) for receiving composite sound signals, such as signal 119 or signal 129 or both, which include both a base sound signal from a radiating device such as radiator 110 or radiator 120 or both, and an inaudible frequency copy of the sound signal. Multiple composite signals may be received simultaneously or at overlapping points in time. The receiving device signal identification system 150 includes a high-frequency copy retrieving component 156 for filtering out inaudible frequency copies of the sound signal. The receiving device signal identification system 150 further includes a base signal obtaining component 158 ​​for reversing the frequency conversion of the sound signal to a high-frequency copy and discovering a copy of the base sound signal. The receiving device signal identification system 152 also includes a base signal using component 160 for using the discovered copy of the base signal. The base signal utilization component 160 can be used in a number of ways, including canceling out acoustic signals received from the radiator 110 or 120, identifying the radiator 110 or 120 as the source of the acoustic signal, and prioritizing the acoustic signal from the radiating device 110 or 120.

[0033] As an example for illustrative purposes, the receiving device 150 may be, for example, a smart assistant device. The receiving device 150 may receive the entire input signal, including a voice command from the user (not shown in Figure 1), a composite signal 119, and a composite signal 129, via a composite voice receiving component 154. The receiving device 150 may identify a first high-frequency copy signal in the composite signal 119 and a second high-frequency copy signal contained in the composite signal 129, via a high-frequency copy search component 156. For example, the receiving device 150 may apply a high-pass filter to the composite signal 119 via component 156. The high-pass filter may have a lower limit corresponding to the upper limit of the human hearing range. For example, the high-pass filter may have a lower limit of 20,000 Hz.

[0034] The receiving device 150 may, via the base signal acquisition component 158, discover a first base signal contained within the composite signal 119 and a second base signal contained within the composite signal 129. The receiving device 150 may, via the base signal utilization component 160, identify that the first base signal (i.e., the signal contained within the composite signal 119) is a song and that the radiator 110 is a personal speaker. The receiving device 150 may further, via the base signal utilization component 160, cancel the first base signal from the entire input signal. The receiving device 150 may also, via the base signal utilization component 160, identify that the second base signal (i.e., the base signal contained within the composite signal 129) is an emergency broadcast and that the radiator 120 is an emergency alarm system. Based on the identification of the composite signal 129, the receiving device 150 may further, via the base signal utilization component 160, leave the composite signal 129 in the entire input signal. Therefore, songs radiated by the radiating device 110 can be filtered / canceled from all input signals, but both voice commands and emergency broadcasts can still be received by the processing system of the receiving device 150.

[0035] Figure 2 is a flowchart 200 illustrating an exemplary method carried out by an exemplary radiating device 210 and an exemplary receiving device 250 according to some embodiments of the present disclosure.

[0036] In the radiating device 210, the method can obtain a base acoustic signal S of the sound that will be radiated from the radiating device 210 (212). The method can copy the base acoustic signal (214), apply frequency modifications to the copy, and obtain an inaudible frequency copy C of the acoustic signal. The inaudible frequency may be beyond the human audible frequency range. The method can also apply a predetermined amplitude ratio, such as a configured amplitude reduction, to the inaudible frequency copy to reduce the volume of the copied signal. In some embodiments, the acoustic signal copy may be inverted in the radiating device 210 such that the inaudible frequency copy C becomes an inverted copy. The applied frequency modifications and any amplitude modifications for the radiating device 210 may be communicated to the receiving device as part of the handshake process.

[0037] Frequency changes in copies to higher frequencies may result in shorter durations of the signal compared to the original audio signal, and the inaudible frequency copies may be repeated within the duration of the original audio signal. Alternatively, a gap may be provided before or after the shorter-duration inaudible frequency copies.

[0038] In controlled environments such as homes, the frequency range can be specified for each radiating device so that the origin of the signal can be identified using inaudible frequency copies. This may allow any receiving device in the environment, such as receiver 150, to identify the source of all electronically produced sound audible to a receiving device using the method described above.

[0039] Frequency modification can be applied in such a way as to ensure that there is no overlap between the frequencies of the base signal S and the inaudible copy C. Furthermore, frequency modification can be applied so that the copy of the acoustic signal completely exceeds the human audible frequency range. Thus, modification can be applied so that the lowest frequency component of the acoustic signal exceeds both the human audible frequency range and the highest frequency component of the acoustic signal. For example, the base signal S may have a frequency range of 3,000 Hz to 10,000 Hz, and the human audible frequency range may be 20 Hz to 20,000 Hz. Therefore, in this example, frequency modification can be applied to copy C of S so that the lowest frequency of copy C (i.e., the portion corresponding to the 3,000 Hz portion of the base signal S) exceeds both the highest frequency of the base signal S (i.e., above 10,000 Hz) and the highest frequency of the human audible frequency range (i.e., 20,000 Hz). Therefore, the inaudible copy C may have a frequency range of 20,100Hz to 27,100Hz (by shifting the frequency upward by 17,100Hz). In some cases, even if the highest frequency of the base signal S is inaudible to humans, the lowest frequency of the inaudible copy C may be higher than the highest frequency of the base signal S. In some cases, instead of shifting the frequency by a set amount, the frequency may be multiplied by a coefficient f. For example, the coefficient f may be 7, which would allow the inaudible copy C to have a frequency range of 21,000Hz to 30,000Hz (by multiplying by 3,000Hz*7 and 10,000Hz*7).

[0040] In some embodiments, frequency changes can be altered over time by a series of applied frequency changes configured for the radiating device. In some embodiments, multiple frequency changes at different frequencies can be applied to an acoustic signal to result in multiple different inaudible frequency copies of the acoustic signal being transmitted simultaneously.

[0041] This method can transmit a composite signal S+C219 including a base acoustic signal and an inaudible frequency copy of the acoustic signal (216). As a result, buffering of the original acoustic signal can be used to create a processing delay before transmitting the original acoustic signal, which can enable the generation of the inaudible frequency copies to be generated. In embodiments in which multiple different inaudible frequency copies of the acoustic signal are generated, this method transmits the acoustic signal and each of the multiple inaudible frequency copies (216).

[0042] In the receiving device 250, the method receives a composite signal S+C containing a base acoustic signal and an inaudible frequency copy of the acoustic signal (252), and discovers the acoustic signal by applying a reverse modifier to the frequency of the inaudible copy signal to convert it back to an audible frequency and obtain an audible copy acoustic signal S' (254). The receiving device 250 is aware of the frequency deviation (and optionally, amplitude deviation) for a given radiating device from which it is receiving the acoustic signal. This may be agreed upon between devices by a handshake procedure.

[0043] This method can use the discovered acoustic signal S' to cancel, for example, the base acoustic signal S (256). In an embodiment in which the acoustic signal copy is inverted in the radiating device 210 so that the inaudible frequency copy C becomes an inverted copy, the audible copy of the acoustic signal S' obtained in the receiving device 250 is already an inverted copy suitable for canceling the acoustic signal S.

[0044] Another use of the obtained acoustic signal S' is, for example, to draw the user's attention to the acoustic signal S in order to prioritize it over other incoming signals or signals transmitted from the receiving device 250. The method can also identify the radiating device using the frequency of the inaudible copy C (258).

[0045] When radiating devices such as radiators 110 or 120 or both radiate sound that is not intended to be a useful input for any receiving device such as receiver 150, they superimpose an inaudible frequency copy of the sound at a predetermined frequency and amplitude-to-sound ratio onto their outputs. The inaudible frequency can be sufficiently high so that it is not audible to humans. The human audible frequency range is considered to be 20 Hz to 20 kHz. Since there are already numerous devices and applications in homes that transmit high-frequency signals to each other, transmitting high-frequency signals in this area does not pose a problem for pets or other animals in the home.

[0046] The receiving device 150 may assume that any input within a specified frequency range outside the range of human hearing is a copy of sound produced by a radiating device, such as radiating device 110 or 120 or both. Using all unintended inaudible copies of sound, the receiving device 150 can discover the correct audible sound wave signals produced by radiating devices 110, 120. This is done by performing an inversion of the algorithm used to create the high-frequency copies.

[0047] A further benefit to the systems and methods of this disclosure is that, because the copied signals are inaudible, receiving devices such as receiver 150 only need to be made aware of sounds produced by other devices that would actually be audible to them. This is not necessarily true when using networks such as Wi-Fi® to communicate what noise is being produced by devices, because Wi-Fi® networks do not perceive the acoustic effects and proximity of devices within a given environment, specifically where people move or doors are opened and closed.

[0048] As an illustrative example, a smart assistant and two speakers may be located in a home connected to a Wi-Fi® network. The Wi-Fi® network may transmit information to the smart assistant describing the noise generated by the two speakers. The first speaker may be playing a song and may be located very close to the smart assistant, while the second speaker may be outputting sound for a movie and may be located in a different room relatively far from the smart assistant. The smart assistant may receive information describing the noise generated by both speakers. However, only the noise from the first speaker (i.e., the song) may be "audible" to the smart assistant. Therefore, computing resources (processing power, network bandwidth, etc.) spent on the noise from the second speaker (i.e., movie sound) may be wasted. By utilizing the systems and methods according to this disclosure, the smart assistant only needs to receive information about the noise that it actually "hears," thus saving resources.

[0049] Figure 3 is a flowchart 300 of an exemplary embodiment of the method of Figure 2. Flowchart 300 shows an exemplary embodiment that includes inversion of the acoustic signal from the radiating device 310 to cancel out the acoustic signal at the receiving device 350.

[0050] As shown in the flowchart 300, in the radiating device 310, the acoustic signal S(x)311 is copied and inverted (C -1 (x)(312), apply frequency change and inaudible copy signal fC -1 (x) is created (313). The combination of the acoustic signal and the inaudible copy signal S(x)+fC -1 (x) is transmitted from the radiating device 310 (314).

[0051] In the receiving device 350, the acoustic signal and the inaudible copy signal are combined S(x) + fC -1(x) is received (321) and filtered to obtain an inaudible copy signal f.C -1 (x) is obtained (322), and as a result of reversing the frequency change, an inverted copy signal C -1 (x) is generated (323), and the incoming acoustic signal is canceled using it (S(x) + C -1 (x) = 0) (324).

[0052] For further prevention, a long series of frequency ranges may be pre - agreed upon as part of the handshake or configuration process, and the frequency of the signal may be sequentially changed within the agreed range so that malicious actors cannot decipher them. This can improve security because it will make it difficult for an intruder to thoroughly superimpose corrective audio to disrupt this method.

[0053] Figure 4 is a further flowchart 400 showing an exemplary embodiment including the inversion of an acoustic signal from a radiation device 440 to cancel the acoustic signal at a receiving device 480, and applying a plurality of frequency changes to the acoustic signal.

[0054] As shown in flowchart 400, in radiation device 440, an acoustic signal S(x) 441 is copied and inverted (C -1 (x)) (342). The copied and inverted signal has a plurality of frequency changes, and these plurality of frequency changes are applied to different frequency coefficients f k to give a plurality of inaudible copy signals f k .C -1 (x) (443). The combination of the acoustic signal and the plurality of inaudible copy signals S(x) + f1.C -1 (x) + f2.C -1 (x) + f3.C -1 (x) + … + f n .C -1 (x) is transmitted from radiation device 440 (444).

[0055] At receiving device 480, the combination of the acoustic signal and the plurality of inaudible copy signals, S(x) + f1.C -1(x)+f2.C -1 (x)+f3.C -1 (x) + ... + f n .C -1 (x) is received at 481. At 482, the incoming composite signal is divided into n+1 tracks, and at 483, the frequency change of each track is reversed to produce an inverted copy signal C. -1 We obtain (x). The "true" acoustic signal can be determined to be the sound present in all n transposed tracks. In 484, we use the true acoustic signal to cancel out the incoming acoustic signal and obtain S(x)+C -1 (x) can be set to 0.

[0056] To prevent false noise cancellation in high-frequency audio inputs not originating from devices using this protocol, multiple high-frequency copies of the sound may be transmitted using multiple high-frequency ranges. When the high-frequency copies are converted to the range of human hearing, a default copy among them, such as the lowest frequency, is selected for use.

[0057] Referring to Figures 5A to 5F, the sound wave diagrams show a simplified example of the method described above.

[0058] Figure 5A shows sound waves 500 produced by a single radiating device, such as a speaker. The first sound wave 501 represents a sound wave produced within the range of human hearing (i.e., the original speech). The second sound wave 502 is shown to have a much higher frequency, representing a high-frequency output from the speaker that is outside the range of human hearing. In this example, the high-frequency signal is repeated over the duration of the first sound wave 501.

[0059] The second sound wave 502 is computed by the emitting device using an algorithm before output, so that other digital devices can pick it up, reverse engineer it, and decipher the original sound 501 emitted by that device.

[0060] The algorithm inverts the original sound and then increases its frequency by a coefficient f until it reaches a frequency inaudible to humans, where f is determined by the radiator. The coefficient f ensures that, when inverted, the frequency of the sound wave 501, which occurs at the lowest end of the human hearing range (e.g., approximately 20 Hz), exceeds at least the minimum frequency required to be beyond human hearing (e.g., above approximately 20,000 Hz).

[0061] Figure 5B shows sound waves 510 picked up by a single microphone of a receiving device. The first and second sound waves 511, 512 are the same as sound waves 501 and 502 in Figure 5A. The third sound wave 513 is the desired input for the microphone. For example, sound wave 513 could be a speech input to a smart assistant device.

[0062] Figure 5C shows the output 520 of Figure 5B after passing through a high-pass filter whose threshold frequency is set to the lowest frequency audible to human hearing multiplied by the aforementioned f. This produces only the separated high-frequency second sound wave 512.

[0063] Figure 5D shows the output 530 of Figure 5C after reducing the frequency of the second sound wave 512 by a coefficient of f, thereby reversing the frequency change of the original sound wave. The resulting sound wave is then inverted. This yields a fourth sound wave 514, which is the inversion of the original sound wave 501 from Figure 5A.

[0064] Figure 5E shows the output of Figure 5B after passing through a low-pass filter with the addition of sound wave 514 from Figure 5D (540). The first sound wave 511 and the fourth sound wave 514 cancel each other out because they are inverted sound waves. Sound wave 512 is removed by filtering through the low-pass filter.

[0065] Figure 5F shows the sound wave 513 obtained by superimposing all the lines in Figure 5E, which is the intended input for a microphone from which the sound from the speaker has been removed (550).

[0066] The method described above can cancel out multiple interfering noises within the range of human hearing. This method dynamically removes frequencies by filtering based on superimposed sounds outside the range of human hearing. This method can distinguish ambient noise created by digital devices from noise from natural sources.

[0067] A single receiving device microphone can be used without requiring a microphone positioned closer to the desired sound source.

[0068] In an exemplary implementation, multiple sound speakers may be radiating devices used throughout the house as part of a home sound system, including a TV soundbar and other standalone speakers in the room. A voice-activated personal assistant may be the receiving device. When a user asks a question to the voice-activated personal assistant or attempts to request a command, the personal assistant may use the method described above to eliminate any background noise coming from music or TV audio being played through the speakers.

[0069] In addition, smart speakers, televisions, laptops, and mobile phones may include built-in assistant functionality. All of these devices may generate background noise, but nevertheless, they may also require listening to voice commands and, using their smartphones, to hear audio for calls. This is another example of an implementation of the method described above. Noise cancellation can be implemented if all devices are manufactured by the same entity or, by agreement between the entities, operate using agreed-upon inaudible frequencies.

[0070] Figure 6 is a block diagram of an exemplary acoustic device 600, including a radiating device and a receiving device, according to some embodiments of the present disclosure. This enables the acoustic device 600 to cancel noise from a receiving input without requiring any other input method to be transmitted.

[0071] The acoustic device 600 may include at least one processor 601, a hardware module, or circuitry for performing the functions of the components described above. In some cases, the components described above may be software units running on at least one processor. Multiple processors may be provided to run parallel processing threads that enable parallel processing of some or all of the functions of the components. Memory 602 may be configured to provide computer instructions 603 for performing the functionality of the components to at least one processor 601. The processors 601 and memory 602 may be microcontrollers.

[0072] The acoustic device 600 includes a microphone 604 for receiving acoustic signals and an acoustic output 605 for transmitting acoustic signals.

[0073] The acoustic device 600 may include a radiating device signal identification system 610 and a receiving device signal identification system 650 for providing device identification, such as those described above with reference to Figure 1.

[0074] The radiating device signal identification system 610 includes an emitted sound obtaining component 606 for obtaining an acoustic signal that will be emitted from the radiating device. The radiating device signal identification system 610 further includes an inaudible copy addition component 607 for processing a copy of the acoustic signal and applying frequency modifications to obtain an inaudible frequency copy of the acoustic signal. The radiating device signal identification system 610 further includes a composite sound output component 608 for simultaneously transmitting the acoustic signal and the inaudible frequency copy of the acoustic signal.

[0075] The radiating device signal identification system 610 may also include a signal inverting component 611 for inverting a copy of the acoustic signal. The radiating device signal identification system 610 may also include a multiple frequency component 612 for simultaneously applying multiple frequency changes at different frequencies to result in multiple inaudible frequency copies. The radiating device signal identification system 610 may also include a sequence frequency component 613 for sequentially applying multiple frequency changes at different frequencies to change the applied frequency changes over time.

[0076] The receiving device signal identification system 650 includes a composite voice receiving component 621 for receiving an acoustic signal and an inaudible frequency copy of the acoustic signal. The receiving device signal identification system 650 further includes an inaudible copy retrieving component 622 for filtering out inaudible frequency copies of the acoustic signal. The receiving device signal identification system 650 further includes a sound copy obtaining component 623 for reversing the frequency change of the acoustic signal to an inaudible frequency copy and discovering the copy of the acoustic signal. The receiving device signal identification system 650 further includes a sound copy using component 624 for using the discovered copy of the acoustic signal.

[0077] The receiving device signal identification system 650 may include a signal inversion component 651 for inverting a copy of the acoustic signal and canceling out the received acoustic signal. The receiving device signal identification system 650 may include a multi-frequency component 652 for simultaneously reversing multiple frequency changes at different received frequencies, resulting in multiple inaudible frequency copies. The receiving device signal identification system 650 may include a sequence frequency component 653 for sequentially reversing multiple frequency changes at different frequencies as the applied frequency changes over time. The receiving device signal identification system 650 may include an emitter identifying component 654 for identifying a emitting device based on the frequencies of the filtered inaudible frequency copies.

[0078] The radiating device signal identification system 610 and the receiving device signal identification system 650 may each be provided in a device, either in combination or individually, depending on the functionality of the device.

[0079] Referring next to Figure 7, a high-level block diagram of an exemplary computer system 700 that may be configured to perform various aspects of the present disclosure, including, for example, the methods described with reference to flow diagrams 200, 300, and 400. The exemplary computer system 700 may be used to perform one or more of the methods or modules described herein (for example, using one or more processor circuits or computer processors of a computer) as embodied in the present disclosure, as well as any related functions or operations. Depending on the embodiment, the main components of the computer system 700 may include one or more CPUs 702, a memory subsystem 708, a terminal interface 716, a storage interface 718, an I / O (input / output) device interface 720, and a network interface 722. These may all be communicatively coupled, directly or indirectly, for intercomponent communication via the memory bus 706, the I / O bus 714, and the I / O bus interface unit 712.

[0080] The computer system 700 may comprise one or more general-purpose programmable processors 702 (such as a central processing unit (CPU)), which are collectively referred to herein as CPUs 702, and which may comprise one or more cores 704A, 704B, 704C, and 704N, in part or in whole. In some embodiments, the computer system 700 may comprise multiple processors, which is typical for a relatively large system, while in other embodiments, the computer system 700 may alternatively be a single-CPU system. Each CPU 702 may execute instructions stored in a memory subsystem 708 on a CPU core 704 and may include one or more levels of onboard cache.

[0081] Depending on the embodiment, the memory subsystem 708 may include random-access semiconductor memory, storage devices, or storage media (either volatile or non-volatile) for storing data and programs. Depending on the embodiment, the memory subsystem 708 may represent the entire virtual memory of computer system 700, and may also include the virtual memory of other computer systems coupled to or connected via a network to computer system 700. Conceptually, the memory subsystem 708 may be a single monolithic entity, but depending on the embodiment, the memory subsystem 708 may be a more complex mechanism, such as a hierarchy of caches and other memory devices. For example, memory may exist in multiple levels of caches, which may be further divided by function, so that one cache holds instructions while another holds non-instruction data used by a processor or group of processors. Memory may be further distributed and associated with different CPUs or sets of CPUs, as is known in any of the various so-called unequal memory-access (NUMA) computer architectures. Depending on the embodiment, the main memory or memory subsystem 708 may include elements for controlling and managing the flow of memory used by the CPU 702. This may include a memory controller 710.

[0082] In Figure 7, the memory bus 706 is shown as a single bus structure providing a direct communication path between the CPU 702, the memory subsystem 708, and the I / O bus interface 712. However, depending on the embodiment, the memory bus 706 may include multiple different buses or communication paths, which can be arranged in any of a variety of forms, such as hierarchical, star or web-based point-to-point links, multi-tier buses, parallel and redundant paths, or any other suitable type of configuration. Furthermore, although the I / O bus interface 712 and I / O bus 714 are shown as single units, the computer system 700 may, depending on the embodiment, encompass multiple I / O bus interface units 712, multiple I / O buses 714, or both. Additionally, although multiple I / O interface units are shown to isolate the I / O bus 714 from various communication paths extending to various I / O devices, in other embodiments, some or all of the I / O devices may be directly connected to one or more system I / O buses.

[0083] Depending on the embodiment, the computer system 700 may be a multi-user mainframe computer system, a single-user system, or a server computer, or a similar device that has little or no direct user interface but receives requests from other computer systems (clients). Furthermore, depending on the embodiment, the computer system 700 may be implemented as a desktop computer, a portable computer, a laptop or notebook computer, a tablet computer, a pocket computer, a telephone, a smartphone, a mobile device, or any other suitable type of electronic device.

[0084] It should be noted that Figure 7 is intended to show typical key components of an exemplary computer system 700. However, depending on the embodiment, individual components may have a higher or lower complexity than those shown in Figure 7, and there may be components other than those shown in Figure 7, or additional components, and the number, types, and configuration of such components may vary.

[0085] The present invention may be a system, method, or computer program product, or a combination thereof, at any possible level of technical detail of integration. The computer program product may include a computer-readable storage medium (or group of mediums) having computer-readable program instructions for causing a processor to carry out aspects of the present invention.

[0086] A computer-readable storage medium can be a tangible device capable of holding and storing instructions for use by an instruction execution device. A computer-readable storage medium may, for example, be an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. A non-exhaustive list of more specific examples of computer-readable storage mediums includes mechanically encoded devices such as portable computer diskettes, hard disks, random-access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random-access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, perforated card, or grooved raised structures on which instructions are recorded, as well as any suitable combination thereof. Computer-readable storage media, when used herein, should not be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses passing through optical fiber cables), or electrical signals transmitted through wires.

[0087] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, or a wireless network, or a combination thereof. The network may include copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers, or edge servers, or a combination thereof. A network adapter card or network interface within each computing / processing device receives computer-readable program instructions from the network and transfers them for storage on a computer-readable storage medium within the respective computing / processing device.

[0088] The computer-readable program instructions for performing the operation of the present invention may be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, configuration data for integrated circuits, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, C++, or similar, and procedural programming languages ​​such as the C programming language or similar. The computer-readable program instructions may run entirely on the user's computer, on some user computers, as a standalone software package, on some user computers and some remote computers, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or wide area network (WAN), or a connection to an external computer may be made (for example, via the Internet using an Internet service provider). Depending on the embodiment, an electronic circuit mechanism including, for example, a programmable logic circuit mechanism, a field-programmable gate array (FPGA), or a programmable logic array (PLA) may execute computer-readable program instructions by individualizing the electronic circuit mechanism using state information of computer-readable program instructions in order to carry out aspects of the present invention.

[0089] Aspects of the present invention are described herein with reference to flowcharts or block diagrams, or both, of methods, apparatus (systems), and computer program products according to embodiments of the present invention. It will be understood that each block in a flowchart or block diagram, or both, and combinations of blocks within a flowchart or block diagram, or both, can be implemented by computer-readable program instructions.

[0090] These computer-readable program instructions may be provided to a computer or other programmable data processing device processor for creating machines, such that instructions executed via the processor of the computer or other programmable data processing device generate means for performing a specified function / operation in a flowchart or block diagram or a set of blocks or blocks in either. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing device, or other device, or a combination thereof, to function in a particular way, such that the computer-readable storage medium having internally stored instructions contains a product containing instructions that perform a specified mode of function / operation in a flowchart or block diagram or a set of blocks or blocks in either.

[0091] Computer-readable program instructions can also be loaded onto a computer, other programmable device, or other device so that instructions executed on the computer, other programmable device, or other device perform functions / operations specified in a block or set of blocks in a flowchart or block diagram, or both, causing a series of operational steps to be performed on the computer, other programmable device, or other device, thereby creating a computer-executed process.

[0092] The flowcharts and block diagrams in the drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of instructions containing one or more executable instructions for performing a specified logical function. Depending on alternative implementations, the functions described within a block may occur in a manner not necessarily in the order shown in the drawing. For example, two consecutively shown blocks may actually be performed as a single step, simultaneously, substantially simultaneously, partially or completely overlapping in time, or blocks may sometimes be executed in reverse order, depending on the functionality they contain. It should also be noted that each block in a block diagram or flowchart, or both, and any combination of blocks in a block diagram or flowchart, or both, may be implemented by a dedicated hardware-based system that performs a specified function or operation, or executes a combination of dedicated hardware and computer instructions.

[0093] While descriptions of various embodiments of this disclosure are presented for illustrative purposes, they are not intended to be exhaustive or limitful to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the embodiments described above. The terminology used herein has been selected to describe the principles of the embodiments, their practical applications, or technical improvements to technologies found in the market, or to enable those skilled in the art to understand the embodiments disclosed herein.

[0094] Improvements and modifications can be made to the above without departing from the scope of the present invention.

Claims

1. Obtaining the acoustic signal that will be emitted from the radiating device, Creating a plurality of inaudible frequency copies of the acoustic signal, wherein the creation includes simultaneously applying a plurality of frequency changes at different frequencies to the acoustic signal, resulting in the plurality of inaudible frequency copies. The acoustic signal and the plurality of inaudible frequency copies of the acoustic signal are transmitted simultaneously. A method that includes this.

2. The method according to claim 1, further comprising applying the configured amplitude reduction to the plurality of inaudible frequency copies of the acoustic signal to reduce the volume of the plurality of inaudible frequency copies.

3. The method according to claim 1 or 2, wherein applying the plurality of frequency changes changes the plurality of inaudible frequency copies of the acoustic signal to each inaudible frequency that does not overlap with the acoustic signal.

4. The method according to any one of claims 1 to 3, wherein the creation further comprises inverting the acoustic signal, and the plurality of inaudible frequency copies of the acoustic signal are the inverted plurality of inaudible frequency copies.

5. The method according to any one of claims 1 to 4, further comprising setting a plurality of coefficients for the plurality of frequency changes for the radiating device and communicating the plurality of coefficients to a receiving device.

6. The simultaneous reception of a first acoustic signal and multiple second acoustic signals from a radiating device, The detection of each of the plurality of second acoustic signals being an inaudible frequency copy of the first acoustic signal, The radiating device is configured to identify multiple frequency changes at different frequencies, The plurality of frequency changes of the plurality of second acoustic signals are reversed simultaneously to produce a plurality of copies of the first acoustic signal, Using the multiple copies of the first acoustic signal, A method that includes this.

7. The method according to claim 6, wherein using the plurality of copies of the first acoustic signal includes canceling out the first acoustic signal.

8. The aforementioned cancellation is, The process involves inverting the plurality of copies of the first acoustic signal, The inverted copies of the first acoustic signal are superimposed on the first acoustic signal to cancel out the first acoustic signal, The method according to claim 7, including the method described in claim 7.

9. Each of the plurality of second acoustic signals is an inverted inaudible frequency copy of the first acoustic signal. Reversing the multiple frequency changes of the multiple second acoustic signals results in multiple inverted copies of the first acoustic signal. The method according to claim 7, wherein the cancellation includes superimposing the inverted plurality of copies of the first acoustic signal on top of the first acoustic signal to cancel out the first acoustic signal.

10. The method according to any one of claims 6 to 9, further comprising identifying the radiating device based on the minimum frequency of the inaudible frequency copy.

11. Simultaneously receiving a first acoustic signal and a second acoustic signal from a radiating device, To detect that the second acoustic signal is an inaudible frequency copy of the first acoustic signal, Identifying the frequency change configured for the radiating device, The frequency change of the second acoustic signal is reversed to produce a copy of the first acoustic signal, Using the copy of the first acoustic signal It includes, and further, Identifying the radiating device based on the minimum frequency of the inaudible frequency copy. Methods that include...

12. Memory and The system comprises a processor coupled to the memory, and the processor is To obtain a first acoustic signal that will be emitted from the radiating device, To generate a copy of the first acoustic signal, The application involves simultaneously applying multiple frequency changes at different frequencies to the copy of the first acoustic signal, resulting in multiple second acoustic signals, wherein the multiple second acoustic signals are multiple inaudible frequency copies of the first acoustic signal. The first acoustic signal and the plurality of second acoustic signals are radiated simultaneously, A system configured to execute instructions that perform a specific action.

13. The aforementioned processor, The simultaneous reception of a third acoustic signal and multiple fourth acoustic signals from a radiating device, The detection of each of the plurality of fourth acoustic signals being an inaudible frequency copy of the third acoustic signal, Identifying multiple frequency changes configured for the radiating device, The plurality of frequency changes of the plurality of fourth acoustic signals are reversed to produce a plurality of copies of the third acoustic signal, Using the multiple copies of the third acoustic signal, The system according to claim 12, further configured to perform the following:

14. The processor is further configured to detect that the inaudible frequency copy of the third acoustic signal is an inverted inaudible frequency copy of the third acoustic signal. The system according to claim 13.

15. The system according to claim 13 or 14, wherein the processor is further configured to identify the radiating device based on the minimum frequency of the plurality of fourth acoustic signals.

16. A computer program comprising program code adapted to perform the steps of any one of claims 1 to 11 when executed on a computer.

17. A computer-readable storage medium recording the computer program described in claim 16.

Images