Modification of the audio signal based on the ambient noise collected by the speaker

Abstract

In an example, an electronic device includes a first speaker port, a second speaker port, and a storage device including a first port attribute corresponding to the first speaker port and a second port attribute corresponding to the second speaker port. The storage device includes executable code. The electronic device includes a processor coupled to the first and second speaker ports and the storage device. The processor, when executing the executable code, is used to: in response to the first port attribute indicating that the first speaker corresponding to the first speaker port is to be used as a microphone and the second port attribute indicating that the second speaker corresponding to the second speaker port is to be used as a speaker, collect ambient noise data using the first speaker. The processor is used to modify an audio output signal using the ambient noise data collected using the first speaker. The processor is used to provide the modified audio output signal to the second speaker port.

Description

Background Art

[0001] Personal computers, such as laptops and notebooks, typically include speakers built into the computer's chassis. The speakers provide audio output, such as music, voice communication from another person via a Voice over Internet Protocol (VoIP) line, and the like. For various reasons, some computer users choose not to use such built-in speakers for audio output functionality, and instead choose to use an audio output peripheral. Examples of such audio output peripherals include external speakers, BLUETOOTH ® Headphones, ear buds, etc., which receive audio signals from the computer either wirelessly or via an audio jack. BRIEF DESCRIPTION OF THE DRAWINGS

[0002] Various examples are described below with reference to the following figures:

[0003] Figures 1A-1C An electronic device with access to multiple speakers according to various examples is depicted.

[0004] Figure 2A-2B An electronic device with access to built-in speakers and external speakers according to various examples is depicted.

[0005] Figure 3 is a flow chart of a method for modifying an audio signal using ambient noise collected by a speaker, according to various examples. DETAILED DESCRIPTION

[0006] The sound quality provided by speakers built into the computer's chassis can be compromised by ambient noise. For example, a user enjoying music played by built-in speakers may suffer a poor listening experience if others are nearby having a conversation. The use of audio output peripherals, such as external speakers and earbuds, does not address this ambient noise challenge. The result is a computer with at least two speakers (one built into the chassis and one external to the chassis), neither of which adequately prevents ambient noise from negatively impacting the listening experience.

[0007] The present disclosure describes a technology in which a computer with access to at least two speakers uses one of the speakers as a microphone for detecting ambient noise. The computer then uses the detected ambient noise to correct the audio output signal provided to the other speaker. For example, a computer may have a built-in speaker and an external speaker connected to the computer via an audio jack. As used herein, a built-in speaker is a speaker positioned within a housing formed in a computer case. As used herein, an external speaker is a speaker positioned outside the computer case and communicatively coupled to the computer via a wire or wirelessly. The user may choose to use an external speaker to listen to music, and the built-in speaker may be unused. In such a case, the computer may use the built-in speaker as a microphone, thereby using the built-in speaker to receive input audio (e.g., ambient noise of a conversation occurring nearby) instead of providing output audio. The computer may then use the ambient noise of the conversation to correct the audio output signal provided to the external speaker, such as by increasing the amplitude (e.g., volume) of the audio output signal provided to the external speaker. In this way, speakers that are otherwise not used are engaged for the useful and beneficial purpose of improving the user's listening experience.

[0008] Figure 1A An electronic device 100 according to various examples is depicted. The electronic device 100 may be, for example, a desktop computer, a laptop computer, a notebook computer, a mobile phone such as a smartphone, a television, a shopping checkout kiosk, a portable game console, or any other electronic device that has or can be adapted to have access to multiple speakers and would benefit from improved sound quality. The remainder of this description generally assumes that the electronic device 100 is a laptop computer, but the scope of the present disclosure is not limited in this regard.

[0009] The electronic device 100 includes a processor 102, a storage device 106, and speaker ports 114, 116. In an example, the storage device 106 includes a single type of storage device, such as a hard drive, a random access memory (RAM, such as a non-volatile (NV) RAM), a read-only memory (ROM, such as a serial peripheral interface (SPI) ROM), etc. In an example, the storage device 106 represents a collection of different types of memory, such as a hard drive, RAM, or ROM. In an example, the storage device 106 can be in a single location, and in other examples, the storage device 106 can include distributed memory, for example, memory within the chassis of the electronic device 100, memory external to such a chassis but coupled to such a chassis, and / or memory accessible via the Internet (e.g., on the cloud). In an example, the speaker ports 114, 116 include hardware ports via which the processor 102 can communicate with the speaker. The speaker ports 114, 116 are bidirectional, meaning that the processor 102 can provide audio output signals to the speakers via the speaker ports 114, 116, and the processor 102 can receive audio input signals from the speakers via the speaker ports 114, 116. The speaker ports 114, 116 can be configurable by programming port properties, such as by modifying port property registers 118, 120, as explained in further detail below.

[0010] The storage device 106 includes executable code 108, port settings 110, 111, and port attributes 112, 113. In an example, the executable code 108 causes the processor 102 to perform some or all actions attributed to the processor 102 and / or the electronic device 100 herein. In an example, the executable code 108 includes a basic input / output system (BIOS) 122, an operating system (OS) 124, and an audio driver 126. The BIOS 122 includes executable code that can be used to perform a power-on self-test (POST), which includes hardware initialization, testing, and configuration during the boot process. The BIOS 122 further includes executable code that can be used to start a boot loader from a master boot record (MBR) and use the boot loader to start the OS 124. After starting the OS 124, the BIOS 122 can be used to provide OS runtime services (e.g., communication with peripheral devices) for the OS 124 and applications. In an example, the unified extensible firmware interface (UEFI) can be used instead of the BIOS 122. Like BIOS, UEFI includes executable code that can be used to perform hardware initialization, testing and configuration during the boot process to start OS 124 and provide OS runtime services for OS 124 and applications. However, UEFI uses a globally unique identifier (GUID) partition table (GPT) instead of MBR. For convenience and brevity, this disclosure uses BIOS 122 (and the general term BIOS) to refer to both BIOS and UEFI. The operating system includes executable code that manages both hardware and executable code (e.g., applications) after the computer has been booted. In an example, when the electronic device 100 is powered on, the processor 102 executes BIOS 122, and then executes OS 124 during a period called OS runtime. During OS runtime, the processor 102 can execute various parts of the executable code 108, for example, any of various applications and drivers, including audio driver 126.

[0011] As shown, speaker port 114 communicates with a speaker, and speaker port 116 communicates with a different speaker. Although two speaker ports are depicted, in the example, any number of speaker ports (and corresponding speakers) may be used, as long as the number is two or more. In the example, the speakers corresponding to speaker ports 114, 116 are positioned inside the chassis of the electronic device 100. For example, the speaker may be built into the chassis of the electronic device 100. In the example, the speakers corresponding to speaker ports 114, 116 are positioned outside the chassis of the electronic device 100. In the example, the speaker corresponding to speaker port 114 is positioned inside the chassis of the electronic device 100, and the speaker corresponding to speaker port 116 is positioned outside the chassis of the electronic device 100. In the example, the speaker corresponding to speaker port 114 is positioned outside the chassis of the electronic device 100, and the speaker corresponding to speaker port 116 is positioned inside the chassis of the electronic device 100. Any such variations are contemplated and included within the scope of the present disclosure.

[0012] In an example, one or both of the speakers in communication with the speaker ports 114, 116 are wired speakers, meaning that the speakers have a hardwired connection to their corresponding ports. In the case of external speakers, the hardwired connection may take the form of a wire connected to an audio jack built into the chassis of the electronic device 100. In an example, one or both of the speakers in communication with the speaker ports 114, 116 are wireless speakers, meaning that the speakers have a wireless connection to their corresponding ports. In the case of external speakers, the wireless connection may be, for example, a BLUETOOTH connection. ® connect.

[0013] During operation, it is assumed that one of the speakers is used as a speaker and the other speaker is not used. For example, an external speaker may be used to play music, and a built-in speaker (built into the chassis of the electronic device 100) may not be used. In such a case, the user can configure the unused speaker to operate as a microphone, as described in more detail below. Therefore, the electronic device 100 receives ambient noise data via the unused speaker that is operating as a microphone, and the electronic device 100 uses the ambient noise data to modify the audio output signal (e.g., by increasing or decreasing the amplitude) provided to the speaker being used. In this way, the speaker that would otherwise be dormant is used to improve the sound quality provided by the speaker in use.

[0014] Now describe Figure 1ASpecific operating details of the electronic device 100. When the electronic device 100 is powered on, the processor 102 begins to execute the BIOS 122. The period during which the processor 102 executes the BIOS 122 is referred to herein as BIOS execution. During BIOS execution, a user of the electronic device can press a hot key (e.g., F10 on a keyboard) to enter a BIOS setup mode. In the BIOS setup mode, the user can configure the port settings 110 to set the state of the speaker port 114 (and, by extension, the speaker communicatively coupled to the speaker port 114) to a speaker or a microphone. In the BIOS setup mode, the user can configure the port settings 111 to set the state of the speaker port 116 (and, by extension, the speaker communicatively coupled to the speaker port 116) to a speaker or a microphone. In this description, for the sake of illustration, it will be assumed that the user configures the port settings 110 of the speaker port 114 to "microphone" and the port settings 111 of the speaker port 116 to "speaker". The port settings 110, 111 may, for example, include a single binary bit that indicates "microphone" when set to 0 (or 1) and indicates "speaker" when set to 1 (or 0). Other alternatives are contemplated and are within the scope of the present disclosure. BIOS execution may then resume.

[0015] In some examples, port settings 110, 111 are user-configurable during BIOS execution, as described above. However, in some examples, port settings 110, 111 are user-configurable during OS runtime, such as by executing an executable code (e.g., a utility program) that provides a user with the opportunity to configure port settings 110, 111. In at least some examples, the electronic device 100 should be restarted after such OS runtime configuration of port settings 110, 111, so that BIOS execution can occur and port settings 110, 111 can take effect. The rest of this description assumes that port settings 110, 111 are configured by the user during BIOS execution, as described above. Although port settings (e.g., port settings 110, 111) and port attributes (e.g., port attributes 112, 113) are similar in that both of them indicate the desired operation of the port (e.g., a speaker, or a speaker operating as a microphone), the difference between port attributes and port settings is that the port attributes may not be directly manipulated by the user or by executable code (e.g., an application) during OS runtime. Instead, the port properties can be accessed by the BIOS during the boot process. The BIOS can adjust the port properties during boot, and after the BIOS has started the OS, the OS and other applications can read rather than write the port properties.

[0016] After the user configures the port settings 110, 111 during BIOS execution, and once the BIOS execution is resumed thereafter, the BIOS 122 causes the processor 102 to read the port settings 110, 111 and apply the port settings 110, 111 to the port attributes 112, 113. In an example, the processor 102 applies the port settings 110, 111 to the port attributes 112, 113 during BIOS execution and before OS runtime. In an example, the processor 102 applies the port settings 110, 111 to the port attributes 112, 113 near the end of BIOS execution but before OS runtime (e.g., after the electronic device 100 has audibly output any BIOS error beep code via any speaker). In an example, the processor 102 applies the port settings 110, 111 to the port attributes 112, 113 at any time during BIOS execution, regardless of whether a BIOS error beep code has been audibly output. After BIOS execution is completed, the processor 102 begins executing the OS 124, thereby starting the OS runtime.

[0017] During OS runtime, the processor 102 executes the audio driver 126. The audio driver 126 is part of the executable code 108. When executed by the processor 102, the audio driver 126 causes the processor 102 to drive the speaker ports 114, 116 and their corresponding speakers. For the purposes of this description, the audio driver 126 collectively represents the executable code 108 for driving both the speaker ports 114, 116 and their corresponding speakers, but in some examples, a separate audio driver may also be used.

[0018] As a result of executing the audio driver 126, the processor 102 reads the port attributes 112, 113. After reading the port attributes 112, 113, the processor 102 can store the port attributes 112, 113 in the port attribute registers 118, 120, although in some examples, such registers can be omitted. The remainder of this description assumes that the port attribute registers 118, 120 are included and used.

[0019] The processor 102 then reads the values ​​of the port attribute registers 118, 120 and operates the corresponding speaker ports 114, 116 (and, by extension, the corresponding speakers) accordingly. For example, if one of the port attributes indicates that the corresponding speaker port is to be used as a speaker, the processor 102 operates the speaker port (and the corresponding speaker) as a speaker. However, if one of the port attributes indicates that the corresponding speaker port is to be used as a microphone, the processor 102 operates the speaker port (and the corresponding speaker) as a microphone. The processor 102 operating the speaker as a microphone includes the processor 102 collecting ambient noise data from the speaker, just as it would collect ambient noise data from a microphone or other audio input device. In some examples, the processor 102 determines the port attributes of multiple speaker ports and uses this determination when operating one of those multiple speaker ports. For example, the processor 102 may determine that the port attribute register 118 indicates that the speaker port 114 is to be operated as a microphone, but before operating the speaker corresponding to the speaker port 114 as a microphone, the processor 102 checks the port attribute register 120 to confirm that the corresponding port attribute indicates that the speaker corresponding to the speaker port 116 is to be used as a speaker. In this way, at least one speaker is always available to the user.

[0020] After collecting the ambient noise data, the processor 102 uses the ambient noise data to modify the audio output signal provided to another speaker that is not being used as a microphone. For example, if the speaker port 114 and its corresponding speaker are being used as microphones, the processor 102 can collect ambient noise data from the surrounding environment of the electronic device 100 via the speaker of the speaker port 114. The data can be stored in, for example, a storage device 106. Subsequently, the processor 102 can use the ambient noise data to modify the audio output signal provided to the speaker port 116 and its corresponding speaker. In examples where more than two speakers are available, two or more such speakers can be operated as microphones, and in such instances, more ambient noise data can be collected and used for more complex audio output signal adjustments. Modifications to the audio output signal can include adjustments to the amplitude (increase or decrease), noise cancellation, echo cancellation, double talk detection, and the like.

[0021] Figure 1B yes Figure 1AThe electronic device 100 includes a processor 102, a storage device 106, and speaker ports 114, 116, which are communicatively coupled to corresponding speakers. The speakers can be inside the electronic device 100 and / or outside the electronic device 100. The speakers can be coupled to the electronic device 100 using wires or wirelessly. The storage device 106 stores executable code 108 and port attributes 112. The executable code 108 causes the processor 102 to perform various actions attributed to the processor 102 and / or the electronic device 100 in this document. Although Figure 1B yes Figure 1A A simplified version of Figure 3 The operation can still be performed by Figure 1B The processor 102 may be implemented by the electronic device 100. For example, the port attribute 112 may indicate the value of the port setting configured by the user, and the processor 102 may operate the speaker port 114 and the corresponding speaker as a microphone based on the value of the port attribute 112. The processor 102 may thereby collect ambient noise data from the speaker via the speaker port 114, and may use the ambient noise data to modify the audio output signal provided to the speaker port 116 for output via the corresponding speaker.

[0022] Figure 1C yes Figure 1A Another simplified version of . Figure 1C Specifically identifying some executable code 108 stored in the storage device 106, Figure 1C The components of the electronic device 100 specifically depicted in Figure 1B As shown, executable code 108 includes instructions for identifying port properties of a speaker port during OS runtime. Executable code 108 includes instructions for receiving ambient noise data via the first speaker in response to the port properties indicating that a first speaker corresponding to the speaker port is to be operated as a microphone. Executable code 108 includes instructions for modifying an audio output signal based on the ambient noise data. Executable code 108 includes instructions for providing the modified audio output signal to a second speaker. Thus, as Figure 1C The executable code 108 depicted in Figure 3 Method 300.

[0023] As explained above, the speaker may be internal to the chassis of the electronic device 100 (eg, an internal speaker built into the chassis) and / or external to such chassis. Figure 2A An electronic device 200 is depicted including a built-in speaker 217 built into a housing 201 of the electronic device 200 . Figure 2AThe presence of an external speaker external to chassis 201 is also depicted, although the external speaker itself is not specifically depicted. Chassis 201 includes processor 202 having properties matching properties of processor 102; storage device 206 having properties matching properties of storage device 106; speaker port 214 having properties matching properties of speaker port 114; speaker port 216 having properties matching properties of speaker port 116; executable code 208 having properties matching properties of executable code 108; BIOS 222 having properties matching properties of BIOS 122; OS 224 having properties matching properties of OS 124; audio driver 226 having properties matching properties of audio driver 126; port settings 210 having properties matching properties of port settings 110; port attributes 212 having properties matching properties of port attributes 112; and port attribute registers 218 having properties matching properties of port attribute registers 118. In addition, the chassis 201 includes an audio output interface, which can be a transceiver or an audio jack 221. The processor 102 uses the audio jack in the case where the external speakers are wired speakers, and the processor 102 uses the transceiver in the case where the external speakers are wireless speakers, such as wireless earphones or headphones, wireless earbuds, wireless desktop speakers, etc.

[0024] The operation of the electronic device 200 matches the operation of the electronic device 100, and therefore, except for a brief overview, it is not repeated here. As a result of executing the executable code 208, the processor 202 performs at least some of its operations. In the case of executing the BIOS 222, the processor 202 allows the user to configure the port settings 210. During the BIOS execution, the processor 202 reads the port settings 210 and applies it to the port attributes 212. The processor 202 then executes the US 224 to start the OS runtime. During the OS runtime, the processor 202 reads the port attributes 212 and can store it in the port attribute register 218. During the OS runtime, and as a result of executing the audio driver 226, the processor 202 reads the port attribute register 218 and operates the speaker port 214 and the built-in speaker 217 as a microphone based on its value. In some examples, before operating the speaker port 214 and the built-in speaker 217 as a microphone, the processor 202 verifies that the port attribute corresponding to the speaker port 216 indicates that the corresponding speaker is to be operated as a speaker instead of a microphone. In the case where both speaker ports correspond to port attributes indicating that the corresponding speaker is to be operated as a microphone, the processor 202 can operate one of the speakers as a microphone and the other speaker as a speaker, thereby overwriting one of the port attributes. In this way, the speaker is still available to the user. The processor 202 collects environmental noise data via the built-in speaker 217 and the speaker port 214. The processor 202 can store the environmental noise data in, for example, a storage device 206. The processor 202 uses the environmental noise data to modify the audio output signal provided to the speaker port 216, for example, as described above. The audio signal can be provided to an external speaker via the transceiver / audio jack 221. Figure 2B yes Figure 2A A simplified version of Figure 2B The operation of the electronic device 200 is Figures 1A-1C The electronic device 100, Figure 2A The operation of the electronic device 200 and the method 300 is consistent. Therefore, it is not repeated here. Figure 2B operation.

[0025] Figure 3A flow chart of an example method 300 of operation of electronic devices 100 and 200 is depicted. The method 300 begins when the computer is powered on (302). The method 300 includes: the processor begins execution of the BIOS (304). The method 300 includes: the processor reads the port settings during the BIOS execution (306). The method 300 includes: the processor sets the port attributes based on the port settings and before the BIOS execution is completed (308). The method 300 includes: the processor begins OS execution (310). The method 300 includes: the processor reads the port attributes as a result of executing the audio driver (312). The method 300 includes: the processor determines whether the port attribute indicates a microphone and whether another port attribute (corresponding to another speaker port and a second speaker) indicates a speaker (314). If the port attribute does not indicate a microphone, or if the other port attribute does not indicate a speaker, the method 300 includes: the processor operates a first speaker corresponding to the port attribute as a speaker (316). Otherwise, if the port attribute indicates a microphone and the other port attribute indicates a speaker, the method 300 includes: the processor operates the first speaker as a microphone and collects ambient noise data through the first speaker (318). In addition, the method 300 includes: the processor uses the ambient noise data collected via the first audio device to modify the audio output signal of the second speaker (320).

[0026] In this specification and claims, the terms "include" and "comprising" are used in an open manner, and should therefore be interpreted as meaning "including, but not limited to...". In addition, the term "coupled" is intended to be broad enough to cover both indirect and direct connections. Therefore, if a first device is coupled to a second device, the connection can be through a direct connection, or through an indirect connection via other devices, components and connections. As used herein, including in the claims, the word "or" is used in an inclusive manner. For example, "A or B" means any one of the following: "A" alone, "B" alone, or both "A" and "B". In addition, when used herein including in the claims, the word "approximately" means within the range of +10% or -10% of the value.

[0027] The above discussion is meant to illustrate the principles and various examples of the present disclosure. Once the above disclosure is fully appreciated, many variations and modifications will become apparent to those skilled in the art. The following claims are intended to be interpreted as covering all such variations and modifications.

Claims

1. An electronic device, comprising: First speaker port; Second speaker port; a storage device including a first port attribute corresponding to a first speaker port and a second port attribute corresponding to a second speaker port, the storage device including executable code; as well as a processor coupled to the first speaker port and the second speaker port and the memory device, wherein the processor, when executing the executable code, is configured to: in response to a first port attribute indicating that a first speaker corresponding to the first speaker port is to be used as a microphone and a second port attribute indicating that a second speaker corresponding to the second speaker port is to be used as a speaker or is to be used as a microphone, using the first speaker as a microphone and using the second speaker as a speaker; Using the first speaker to collect ambient noise data; modifying an audio output signal using ambient noise data collected using the first speaker; as well as The modified audio output signal is provided to the second speaker port. 2 . The electronic device according to claim 1 , wherein the processor, when executing the executable code, is configured to: set the port attribute based on the port setting during execution of a basic input / output system BIOS.

3. The electronic device of claim 2, wherein the port settings are user configurable during BIOS execution. 4 . The electronic device according to claim 3 , wherein when the processor executes the executable code, it is configured to: set the port attribute after causing the first speaker to output a BIOS error beep code. 5 . The electronic device according to claim 4 , wherein the processor, when executing the executable code, is configured to: operate the first speaker as a microphone when a port attribute is identified while executing the audio driver. The electronic device according to claim 1 , wherein the first speaker is housed in a housing of the electronic device. The electronic device of claim 1 , wherein the first speaker is external to the electronic device.

8. An electronic device comprising: Chassis; a first speaker housed in the chassis; a first speaker port received in the chassis, the first speaker port coupled to a first speaker; a second speaker port housed in the chassis; a storage device housed within the chassis and including executable code; as well as a processor coupled to the first speaker port and the second speaker port and the memory device, wherein the processor, when executing the executable code, is configured to: in response to a first port attribute of a first speaker port indicating that the first speaker is to be operated as a microphone and a second port attribute of a second speaker port indicating that a second speaker corresponding to the second speaker port is to be operated as a speaker or is to be operated as a microphone, operating the first speaker as a microphone and operating the second speaker as a speaker; Collecting ambient noise data using the first speaker operation; as well as The audio output signal is modified based on the ambient noise data collected using the first speaker before being provided to the second speaker port.

9. The electronic device of claim 8, wherein the processor, when executing the executable code, is configured to: set the first and second port attributes based on a port setting that is user configurable during execution of a basic input / output system (BIOS).

10. The electronic device of claim 8, wherein the processor, when executing the executable code, is configured to modify the audio output signal by adjusting the amplitude of the audio output signal.

11. A computer readable medium comprising executable code which, when executed by a processor, causes the processor to: identifying, during runtime of an operating system (OS), a first port attribute of a first speaker port and a second port attribute of a second speaker port, the first and second port attributes being set based on user-configurable port settings during execution of a basic input / output system (BIOS), the first and second port settings corresponding to the first speaker port and the second speaker port; in response to a first port attribute indicating that a first speaker corresponding to the first speaker port is to be operated as a microphone and a second port attribute indicating that a second speaker corresponding to the second speaker port is to be operated as a speaker or is to be operated as a microphone, operating the first speaker as a microphone and operating the second speaker as a speaker; Using the first speaker to collect ambient noise data; modifying an audio output signal based on ambient noise data collected using the first speaker; as well as The modified audio output signal is provided to a second speaker port corresponding to a second speaker.

12. The computer readable medium of claim 11, wherein when executed by a processor, the executable code causes the processor to: A first port setting for a first speaker port is identified during execution of the BIOS, the first port setting indicating whether the first speaker is to be operated as a microphone.

13. The computer readable medium of claim 12, wherein when executed by a processor, the executable code causes the processor to: Prior to completion of the BIOS execution and after output of the BIOS error beep code, first and second port attributes are set based on the first and second port settings.

14. The computer-readable medium of claim 11, wherein when executed by a processor, the executable code causes the processor to: in response to the first port attribute indicating that the first speaker is to be operated as a microphone and the second port attribute indicating that the second speaker is to be operated as a speaker, collect ambient noise data using the first speaker.

15. The computer-readable medium of claim 11, wherein the first speaker is housed within a computer case, and wherein the second speaker is external to the computer case.

Images