Method and apparatus for controlling audio parameters

Abstract

A method and apparatus for controlling audio parameters is provided. A method for controlling headphones with external microphone signal pass-through includes controlling a display to present a geometric shape on the display and receiving an indication of finger movement from a sensor system associated with the display. The sensor system includes a touch sensor system or a gesture sensor system. The indication includes an indication of the direction of the finger movement relative to the display. The method also includes controlling the display to present a sequence of images showing the geometric shape expanding or contracting depending on the direction of the finger movement, and changing a headphone transparency setting according to the current size of the geometric shape. The headphone transparency setting corresponds to an external microphone signal gain setting and / or a media signal gain setting of the headphones.

Description

Technical Field

[0001] Cross - Reference to Related Applications This application claims the benefit of U.S. Provisional Patent Application No. 62 / 733,469, filed Sep. 19, 2018, and U.S. Provisional Patent Application No. 62 / 863,509, filed Jun. 19, 2019, which are hereby incorporated by reference in their entirety.

[0002] Technical Field The present disclosure relates to the control of audio parameters.

Background Art

[0003] The use of audio devices such as headphones and earbuds has become very common. Such audio devices can, at least in part, block out sound from the outside world. Some headphones can create a substantially closed system between the headphone speakers and the eardrums where sound from the outside world is significantly attenuated. There are various potential benefits to attenuating sound from the outside world through headphones or other such audio devices, such as eliminating distortion of the media signal reproduced by the headphones and providing flat equalization.

[0004] However, when wearing such an audio device, a user may not be able to hear sounds from the outside world that it would be beneficial to hear, such as the sound of an approaching car or the voice of a friend.

Summary of the Invention

Problems to be Solved by the Invention

[0005] As used herein, the term "headphone" or "headphones" refers to an ear device having at least one speaker configured to be disposed near an ear, the speaker being attached in a physical form (referred to herein as a "headphone unit") that at least partially blocks the acoustic path from the sound generated around the user wearing the headphones. Some headphone units may be ear cups configured to significantly attenuate sound from the outside world. Such sound may be referred to herein as "ambient" sound. "Headphones" as used herein may or may not include a headband or other physical connection between the headphone units.

[0006] Some headphones may include at least one headphone microphone outside the headphones. Such a headphone microphone may be referred to herein as an "ambient" microphone. This is because signals from such a microphone can provide ambient sound to the user even when the headphone unit significantly attenuates ambient sound when worn. Some headphones with a pass-through function for external microphone signals may be configured to process both the microphone and media signals such that the ambient microphone signal becomes audible louder than the media signal when mixed. It can be difficult to determine appropriate gains for the ambient microphone signal and media signal of headphones having a pass-through function for external microphone signals. **Means for Solving the Problem**

[0007] Some of the disclosed implementations provide a method for controlling audio parameters for such headphones. Some such methods may involve controlling a display to present a geometric shape on the display and receiving an indication of finger movement from a sensor system associated with the display. The display may be, for example, the display of a mobile display device such as a cellular phone. The sensor system may include a touch sensor system and / or a gesture sensor system. The indication of finger movement may be an indication of the direction of finger movement relative to the display. The method may involve controlling the display to present a series of images indicating that the geometric shape is expanding or contracting depending on the direction of finger movement. The method may include changing a headphone transparency setting according to the current size of the geometric shape. The headphone transparency setting may correspond to an external microphone signal gain setting and / or a media signal gain setting of the headphones. In some cases, the current size of the geometric shape may correspond to an automatic noise cancellation (ANC) setting. According to some examples, the geometric shape may be a circle that expands when the direction of finger movement is towards the top of the display.

[0008] Some of the disclosed implementations provide a similar method for controlling an audio recording process. Some such methods may involve changing an equalization curve intensity setting for the audio recording process according to the current size of the geometric shape. The equalization curve may be, for example, a selectable preset equalization curve.

[0009] Such implementations have various potential advantages. Some such implementations provide a graphical user interface (GUI) that is easy to use even for users lacking in-depth knowledge of audio engineering principles. For example, a user need not know specific external microphone signal gain settings, specific media signal gain settings, or specific ANC settings corresponding to the size of a geometric shape, and can simply control the GUI to obtain a desired combination of these settings. Similarly, a user need not know specific intensity settings of an equalization curve for an audio recording process corresponding to the size of a geometric shape. Instead, the user can simply control the GUI to obtain a desired intensity setting.

[0010] Details of one or more implementations of the subject matter described in this specification are set forth in the accompanying drawings and the description below. Other features, aspects, and advantages will be apparent from the specification, the drawings, and the claims. Note that the relative dimensions of the following figures may not be drawn to scale.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 3D

Figure 3E

Figure 3F

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

[0012] Like reference numerals and designations in the various drawings indicate like elements.

DETAILED DESCRIPTION OF THE INVENTION

[0013] The following description is directed to certain implementations for the purpose of describing some innovative aspects of the present disclosure, as well as examples of contexts in which these innovative aspects may be implemented. However, the teachings of this specification can be applied in a variety of different ways. For example, while various implementations are described with respect to specific applications and environments, the teachings of this specification are widely applicable to other known applications and environments. Further, the described implementations can be implemented, at least in part, in various devices and systems such as hardware, software, firmware, cloud-based systems, and the like. Thus, the teachings of the present disclosure are not intended to be limited to the implementations shown in the figures and / or described in this specification, but rather have broad applicability.

[0014] As described above, an audio device that provides at least some degree of sound shielding provides various potential benefits, such as an improvement in the ability to control audio quality. Other benefits include attenuation of distracting or potentially diverting sounds from the external world. However, users of such audio devices may sometimes be unable to hear external sounds that it would be advantageous to hear, such as the sound of an approaching vehicle, a car horn, a public announcement, etc.

[0015] Therefore, one or more types of sound masking management may be desirable. The various implementations described herein relate to sound masking management when a user is listening to a media stream of audio data via headphones, earbuds, or other such audio devices. As used herein, the terms "media stream," "media signal," and "media input audio data" may be used to refer to audio data corresponding to music, podcasts, movie soundtracks, etc., as well as audio data corresponding to sounds received for playback as part of a telephone conversation. In some implementations, such as an earbud implementation, a user may be able to hear a significant amount of external sound even while listening to audio data corresponding to a media stream. However, some audio devices (such as headphones) can significantly attenuate external sound. Thus, some implementations may also involve providing microphone data to the user. The microphone data may provide sound from the external world.

[0016] When a microphone signal corresponding to external sound outside an audio device such as headphones is mixed with a media signal and played back through the headphones' speakers, the media signal often masks the microphone signal, making the external sound inaudible or unintelligible to the listener. Therefore, it is desirable to process both the microphone signal and the media signal so that the microphone signal is more audible than the media signal when mixed and both the processed microphone signal and the media signal remain perceptually natural to hear. To achieve this effect, it is useful to consider models of perceptual loudness and partial loudness, such as those disclosed in International Publication No. WO 2017 / 217621 entitled "Media Compensated Pass-Through and Mode Switching." [Patent Document 1] International Publication No. WO 2017 / 217621

[0017] Some methods may involve determining a first level of at least one of a plurality of frequency bands of media input audio data and determining a second level of at least one of a plurality of frequency bands of microphone input audio data. Some such methods may involve generating media output audio data and microphone output audio data by adjusting the levels of one or more of the first plurality of frequency bands and the second plurality of frequency bands. For example, some methods may involve adjusting the levels such that a first difference between the perceived loudness of the microphone input audio data and the perceived loudness of the microphone output audio data in the presence of the media output audio data is less than a second difference between the perceived loudness of the microphone input audio data and the perceived loudness of the microphone input audio data in the presence of the media input audio data. Some such methods may involve mixing the media output audio data and the microphone output audio data to generate mixed audio data. Some such examples may involve providing the mixed audio data to a speaker of an audio device such as a headset or earbuds.

[0018] In some implementations, the above adjustment may simply involve boosting the level of one or more of the plurality of frequency bands of the microphone input audio data. However, in some examples, the above adjustment may involve both boosting the level of one or more of the plurality of frequency bands of the microphone input audio data and attenuating the level of one or more of the plurality of frequency bands of the media input audio data. The perceived loudness of the microphone output audio data in the presence of media output audio data is, in some examples, substantially equal to the perceived loudness of the microphone input audio data. According to some examples, the overall loudness of the media and microphone output audio data may be within a range between the overall loudness of the media and microphone input audio data and the overall loudness of the media and microphone output audio data. However, in some cases, the overall loudness of the media and microphone output audio data may be substantially equal to the overall loudness of the media and microphone input audio data, or may be substantially equal to the overall loudness of the media and microphone output audio data.

[0019] Some implementations may involve receiving (or determining) a mode-switching indicator and modifying one or more processes, at least in part, based on the mode-switching indicator. For example, some implementations may involve modifying at least one of the above receiving, determining, generating, or mixing processes, at least in part, based on the mode-switching indicator. In some examples, the modification may involve increasing the relative loudness of microphone output audio data relative to the loudness of media output audio data. According to some such examples, increasing the relative loudness of microphone output audio data may involve suppressing media input audio data or pausing the media stream. Some such implementations provide one or more types of pass-through modes. In a pass-through mode, the media signal may be reduced in volume and conversation between the user and other people (or other external sounds of interest to the user as indicated by the microphone signal) may be mixed into the audio signal provided to the user. In some examples, the media signal may be temporarily silenced.

[0020] The above method, along with other related methods disclosed in Patent Document 1, may be referred to herein as the MCP (media-compensated pass-through) method. However, the headset-related methods disclosed herein are not limited to controlling MCP headsets and are generally applicable to headsets having a pass-through function for any type of external microphone signal.

[0021] FIG. 1 is a block diagram showing an example of components of an apparatus that can implement various aspects of the present disclosure. In some implementations, apparatus 100 may be, or may include, a mobile display device such as a cellular phone. In this example, apparatus 100 includes a display system 105, a control system 110, and a sensor system 115. The display system may include one or more displays such as a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a liquid crystal display, a micro LED display, and the like.

[0022] The control system 110 may include, for example, a general purpose single or multi-chip processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, discrete gates or transistor logic, and / or discrete hardware components. In some implementations, the control system 110 may be capable of performing, at least in part, the methods disclosed herein.

[0023] In this example, apparatus 100 includes a sensor system 115 having one or more sensors. According to this implementation, the sensor system 115 includes a touch sensor system and / or a gesture sensor system associated with at least one display of the display system 105. For example, the sensor system 115 may include a touch sensor system and / or a gesture sensor system that overlays or is located under at least a portion of one display of the display system 105. In some examples, the sensor system 115 may include one or more force sensors, pressure sensors, accelerometers, and / or gyroscopes.

[0024] The ear device 120 may be or may include one or more headphones, earbuds, etc. In this example, the ear device 120 includes a microphone system 120. The microphone system 125 includes, in this example, one or more microphones that are on or proximate to the outer portion of the ear device 120, such as the outer portion of one or more headphone units.

[0025] According to this implementation, the ear device 120 includes a speaker system 130 having one or more speakers. In some examples, at least a portion of the speaker system 130 may be within or on the surface of a pair of headphone units.

[0026] Although not shown in FIG. 1, the device 100 and the ear device 120 may each include an interface system. For example, the interface system(s) may include one or more wireless interfaces and / or one or more external device interfaces (such as one or more universal serial bus (USB) interfaces) that permit communication between the device 100 and the ear device 120. In some implementations, the interface system may include, in addition to the sensor system 115, one or more network interfaces and / or one or more user interfaces.

[0027] In some implementations, the interface system may include at least one user interface system. The user interface system may be configured to receive input from a user. In some examples, the user interface system may incorporate at least a portion of the sensor system 105. For example, the user interface system may include one or more touch and / or gesture detection sensor systems, one or more inertial sensor devices, etc. In some implementations, the user interface system may be configured to provide feedback to the user. According to some examples, the user interface system may include a device that provides tactile feedback, such as a motor, a vibrator, etc.

[0028] In some examples, the interface system may include one or more interfaces between the control system 110 and a memory system (not shown in FIG. 1). However, the control system 110 may include a memory system.

[0029] Some or all of the methods described herein may be performed by one or more devices according to instructions (e.g., software) stored on one or more non-transitory media that may be part of a memory system as referred to above. Such non-transitory media may include memory devices such as, but not limited to, random access memory (RAM) devices, read-only memory (ROM) devices, etc., of the type described herein. Thus, various innovative aspects of the subject matter disclosed herein can be implemented in one or more non-transitory media storing software. The software may include, for example, instructions for controlling at least one device to perform the methods disclosed herein. The software may be executable by one or more components of a control system, such as the control system 110 of FIG. 1, for example.

[0030] In some implementations, at least a portion of the control system 110 may be located within different devices. For example, at least a portion of the control system 110 may be located in a device configured to communicate with the device 100, such as an ear device 120, a server, a component of an audio recording system, a component of a home entertainment system, and the like.

[0031] FIG. 2 is a flowchart outlining an example of a method that may be implemented by a device as shown in FIG. 1. The blocks of method 200 are not necessarily implemented in the order shown, similar to other methods described herein. Further, such a method may include more or fewer blocks than those shown and / or described.

[0032] In this example, method 200 is related to controlling settings for headphones having a pass-through function for an external microphone signal. According to this implementation, block 205 is related to controlling the display to present a geometric shape on the display. Block 205 may be related to, for example, the control system 110 of FIG. 1 controlling the display of the display system 105.

[0033] According to this example, block 210 is related to receiving an indication of a finger movement from a sensor system associated with the display. Block 210 may be related to the control system 110 of FIG. 1 receiving an indication from the touch sensor system or gesture sensor system of the sensor system 105. In this example, the indication includes an indication of the direction of a finger movement relative to the display. For example, the indication may include an indication of an upward, downward, left, right, diagonal, or other direction of a finger movement relative to the display.

[0034] In this implementation, block 215 is involved in controlling the display to present a sequence of images where the geometric shape expands or contracts depending on the direction of finger movement. The sequence of images may include two or more images of the geometric shape. In some such examples, block 215 may be involved in indicating that the geometric shape expands in response to a predetermined direction of finger movement, such as an upward finger movement.

[0035] According to this example, block 220 is involved in changing the headset transparency setting according to the current size of the geometric shape. In this example, the headset transparency setting corresponds to the external microphone signal gain setting and / or the media signal gain setting of the headset. In some examples, the headset transparency setting may correspond to both the external microphone signal gain setting and the media signal gain setting. In some implementations, block 220 is involved in making a smooth transition between a first headset transparency setting and a second headset transparency setting. A smooth transition may involve, for example, changing the external microphone signal gain setting and / or the media signal gain setting of the headset from the first headset transparency setting to the second headset transparency setting over a predetermined time interval. Alternatively or additionally, the current size of the geometric shape may correspond to an automatic noise cancellation setting.

[0036] According to some examples, method 200 may be involved in providing some type of haptic feedback. In some such examples, device 100 and / or ear device 120 may include devices for providing haptic feedback, such as one or more motors, vibrators, etc. In some examples, method 200 may be involved in providing haptic feedback when a setting selected by the user (for example, a setting corresponding to the current size of geometric shape 300 in response to the detected movement of the user's finger on the display of device 100) corresponds to a default setting, a minimum setting, and / or a maximum setting. Alternatively or additionally, method 200 may be involved in providing haptic feedback when a setting selected by the user corresponds to a setting previously selected by the user.

[0037] Figures 3A - 3C show some examples of geometric shapes that may be displayed when implementing the method of Figure 2. In these examples, geometric shape 300 is a circle. However, in other implementations, geometric shape 300 may be other shapes such as an ellipse, triangle, rectangle, pentagon, hexagon, heptagon, octagon, nonagon, etc. According to some examples, the shape may not be a geometric shape and instead may be an image (for example, an image of an ear, microphone, speaker, headphones, etc.). Figure 3A may be the first display provided on display system 105 after device 100 or ear device 120 has received user input indicating that the user desires to control a setting such as the headphone transparency setting in some examples. The user input may vary depending on the specific implementation. In some examples, the user input may be a touch, gesture, force, acceleration, etc. detected by the sensor system of device 110 or ear device 120. In other examples, the user input may be an audio command received by the microphone of device 110 or ear device 120.

[0038] In this example, the size of the geometric shape 300 shown in FIG. 3A is the default size and corresponds to the default headphone transparency setting. According to some examples, the geometric shape 300 may first be displayed in the default size. If the user desires, the user can adjust this size. Alternatively or additionally, if the user has previously indicated a setting such as a preferred headphone transparency setting, the geometric shape 300 may first be displayed in a size corresponding to the preferred headphone transparency setting.

[0039] According to the example shown in FIG. 3B, the arrow 310 indicates the direction of finger movement with respect to the display. According to this example, the arrow 310 indicates that a downward swipe of the finger has been detected by the sensor system 115, which may be a touch sensor system or a gesture sensor system. In response to the finger movement indicator from the sensor system, the control system of the device 100 controls the display system 105 to present a sequence of images indicating that the geometric shape 300 is shrinking. Thus, at the point in time corresponding to FIG. 3B, the geometric shape 300 is displayed in a smaller size compared to the geometric shape 300 shown in FIG. 3A. The sequence of images may include two or more images of the geometric shape 300. For example, the sequence of images may include at least the geometric shape 300 shown in FIG. 3A (the geometric shape 300 at the default size 305) and the geometric shape 300 shown in FIG. 3B.

[0040] In an alternative implementation, the control system of device 100 may control display system 105 to present a sequence of images showing that geometric shape 300 shrinks in response to other types of user input, such as swipes in different directions (e.g., upward or horizontal). According to some examples, the control system may control display system 105 to present a sequence of images showing that geometric shape 300 expands or shrinks in response to a detected multi-touch input, such as a detected two-finger pinch, a detected two-finger spread, etc.

[0041] In the example shown in FIG. 3B, the relatively smaller size of geometric shape 300 corresponds to a different headphone transparency setting than that shown in FIG. 3A. For example, the relatively smaller size of geometric shape 300 may indicate that the corresponding headphone transparency setting is less transparent than that indicated by the size of geometric shape 300 in FIG. 3A. A "less transparent" setting may be a setting in which ambient sound is relatively less apparent to a person wearing the headphones. In some examples, the minimum size of geometric shape 300 may correspond to a minimum external microphone signal gain setting. According to some such examples, the minimum size of geometric shape 300 may correspond to a minimum external microphone signal gain setting and an automatic noise cancellation setting in which automatic noise cancellation is enabled.

[0042] In FIG. 3C, the geometric shape 300 is shown at a relatively larger size than that shown in FIG. 3A or FIG. 3B. In this example, the relatively larger size of the geometric shape 300 corresponds to different headphone transparency settings. For example, the relatively larger size of the geometric shape 300 may indicate that the corresponding headphone transparency setting has a higher transparency than that indicated by the size of the geometric shape 300 in FIGS. 3A and 3B. The "higher transparency" setting may be a setting in which environmental sound is relatively more apparent to a person wearing the headphones. In some examples, the maximum size of the geometric shape 300 may correspond to the maximum external microphone signal gain setting. According to some such examples, the maximum size of the geometric shape 300 may correspond to the maximum external microphone signal gain setting and the automatic noise cancellation setting in which automatic noise cancellation is not enabled. In some such examples, other transparency settings may also correspond to the automatic noise cancellation setting in which automatic noise cancellation is not enabled.

[0043] FIGS. 3D to 3F show some alternative examples of geometric shapes that may be displayed when implementing the method of FIG. 2. In these examples, the geometric shape 300 is rectangular. More specifically, the geometric shape 300 is square in these embodiments. In some implementations, the size of the geometric shape 300 shown in FIG. 3A is the default size and corresponds to the default headphone transparency setting. In some alternatives, the size of the geometric shape 300 shown in FIG. 3D may correspond to a previously selected preferred setting, such as a preferred headphone transparency setting.

[0044] According to the example shown in FIG. 3E, arrow 310 indicates the direction of finger movement with respect to the display. According to this example, arrow 310 indicates that a downward swipe of the finger has been detected by sensor system 115. In response to an indication of finger movement from the sensor system, the control system of device 100 controls display system 105 to present a sequence of images indicating that geometric shape 300 is shrinking. Thus, at the point in time corresponding to FIG. 3E, geometric shape 300 is displayed in a smaller size relative to the geometric shape 300 shown in FIG. 3D. In an alternative implementation, the control system of device 100 may control display system 105 to present a sequence of images indicating that geometric shape 300 is shrinking in response to other types of user input.

[0045] In the example shown in FIG. 3E, the relatively smaller size of geometric shape 300 corresponds to a headphone transparency setting different from that shown in FIG. 3E, which may be a relatively lower headphone transparency setting.

[0046] In FIG. 3F, geometric shape 300 is displayed in a relatively larger size than that shown in FIG. 3A or FIG. 3B. The relatively larger size of geometric shape 300 corresponds to a different headphone transparency setting, for example, a headphone transparency setting with a higher transparency than that indicated by the size of geometric shape 300 in FIGS. 3A and 3B.

[0047] Figures 4A and 4B are examples of geometric shapes that may be displayed when implementing the disclosed method. In this example, the method involves controlling a noise reduction process. In some examples, the noise reduction process may be implemented via the ANC system of the ear device 120. The method may or may not involve controlling the transparency setting of the ear device 120, depending on the specific implementation. In other examples, the noise reduction process may be implemented as part of an audio recording process. In some such examples, the noise reduction process may involve applying filters such as low-pass filters, high-pass filters, notch filters, etc.

[0048] Either of Figure 4A or Figure 4B may be the first display provided on the display system 105 after the device 100 or the ear device 120 receives a user input indicating that the user desires to control the ANC setting. The user input may be a touch, gesture, force, acceleration, voice command, etc., and may vary depending on the specific implementation.

[0049] For example, when the noise reduction process is implemented via the ANC system of the ear device 120, which of Figure 4A or Figure 4B becomes the first display provided on the display system 105 depends on whether the ANC system is currently on or off.

[0050] According to the examples shown in FIGS. 4A and 4B, arrow 310 indicates the direction of finger movement with respect to the display. According to the example shown in FIG. 4A, arrow 310 indicates that a downward swipe of the finger has been detected by a sensor system 115, which may be a touch sensor system or a gesture sensor system. In response to an indicator of finger movement from the sensor system, the control system of device 100 controls the display system 105 to present a relatively smaller size of the geometric shape 300. The relatively smaller size indicates that the noise reduction process is currently off or is about to be turned off. In the example shown in FIG. 4B, arrow 310 indicates that an upward swipe of the finger has been detected by the sensor system 115. In response to an indicator of finger movement from the sensor system, the control system of device 100 controls the display system 105 to present a relatively larger size of the geometric shape 300. The relatively larger size indicates that the noise reduction process is currently on or is about to be turned on.

[0051] FIG. 5 is a flowchart outlining another example of a method that may be performed by an apparatus as shown in FIG. 1. The blocks of method 500 are not necessarily executed in the order shown, similar to other methods described herein. Further, such a method may include more or fewer blocks than those illustrated and / or described.

[0052] In this example, method 500 is involved in controlling one or more settings of an audio recording process. According to this implementation, block 505 is involved in controlling the display to present a geometric shape on the display. Block 505 may be involved, for example, in the control system 110 of FIG. 1 controlling the display of the display system 105. In some examples, the geometric shape may be a circle. However, in some implementations, the geometric shape may be a rectangle or another geometric shape. In some examples, block 505 may be involved in controlling the display to present an image. The image may correspond to, for example, a musical instrument, musical note, recording device, loudspeaker, etc.

[0053] According to this example, block 510 is involved in receiving an indication of finger movement from a sensor system associated with the display. Block 510 may be involved in the control system 110 of FIG. 1 receiving an indication from the touch sensor system or gesture sensor system of the sensor system 105. In this example, the indication includes an indication of the direction of finger movement relative to the display, which may be an upward, downward, left, right, diagonal, or other direction of finger movement relative to the display.

[0054] In this implementation, block 515 is involved in controlling the display to present a sequence of images indicating that a geometric shape expands or contracts depending on the direction of finger movement. The sequence of images may include two or more images of the geometric shape. In some such examples, block 515 may be involved in indicating that the geometric shape expands in response to a predetermined direction of finger movement, such as upward or downward finger movement.

[0055] According to this example, block 520 is involved in changing the intensity setting of the equalization curve for the audio recording process according to the current size of the geometric shape. In some examples, the current size of the geometric shape may correspond to gain settings for a range of frequencies. In some cases, the intensity setting may correspond to the shape of the equalization curve. The equalization curve may be, for example, a selectable preset equalization curve.

[0056] Figure 6 shows an example of a display presenting a plurality of icons, each icon corresponding to a different preset equalization curve. In this example, device 100 is a cellular phone. In this example, the control system of device 100 controls display system 105 to display a plurality of icons 605. Each of icons 605 corresponds to a different preset equalization curve, and the user can select it for audio recording by touching the corresponding area of sensor system 115. Thus, in some examples, method 500 may be involved in receiving an indication of a touch in the area of the display corresponding to icon 605 from sensor system 115. Method 500 may be involved in selecting the preset equalization curve corresponding to that icon. The preset equalization curve may be used for audio recording.

[0057] Figure 7 shows an example of a display that may be presented after one of the icons shown in Figure 6 is selected. According to this example, since the user selected the icon 605 labeled "Amped" by touching the corresponding area of the sensor system 115, the device 100 will call up the preset equalization curve corresponding to the "Amped" icon for audio recording. However, in the example shown in Figure 7, the device 100 controls the display system 105 to provide a GUI that allows the user to change the intensity setting of the equalization curve according to the current size of the geometric shape 300 according to the indicator of the direction of finger movement detected by the sensor system 115. The device 100 may be configured to control the display system 105 to present a sequence of images indicating that the geometric shape 300 expands or contracts depending on the detected direction of finger movement. According to some examples, the control system of the device 100 causes the display system 105 to show that the geometric shape 300 expands in response to the detected upward finger movement. However, in some examples, the geometric shape 300 may expand or contract according to other detected finger movements. For example, the geometric shape 300 may contract in response to the detected upward finger movement.

[0058] In some examples, the current size of the geometric shape 300 may correspond to the gain setting for a range of frequencies. In some cases, the intensity setting may correspond to the shape of the equalization curve. In this example, the default size 305 of the geometric shape 300 corresponds to the default intensity setting.

[0059] Figure 8A shows an example of an equalization curve with the default intensity setting. The default intensity setting may correspond to, for example, a preset equalization curve represented by one of the icons shown in Figure 6. In this example, the graph 800 shows decibels on the vertical axis and frequency on the horizontal axis. The frequency range over which the equalization curve 805 extends may include the range of human audible frequencies, such as 20 Hz to 20,000 Hz.

[0060] B in FIG. 8 shows an example of a display presenting a geometric shape corresponding to the equalization curve of A in FIG. 8. In this example, the default size 305 of the geometric shape 300 corresponds to the default intensity setting.

[0061] A in FIG. 9 shows an example of an equalization curve at the intensity setting selected by the user. B in FIG. 9 shows an example of a display presenting a geometric shape corresponding to the equalization curve of A in FIG. 9. According to the example shown in B of FIG. 9, the arrow 310 indicates the direction of the detected finger movement with respect to the display system 105. According to this example, the arrow 310 indicates that a downward swipe of the finger has been detected by the sensor system 115. In response to an indication of finger movement from the sensor system, the control system of the device 100 controls the display system 105 to present a sequence of images indicating that the geometric shape 300 shrinks with respect to the size of the geometric shape 300 in B of FIG. 8 and the default size 305. In this example, the smaller size of the geometric shape 300 corresponds to a relatively lower intensity of the equalization curve 905 compared to the intensity of the equalization curve 805.

[0062] A in FIG. 10 shows another example of an equalization curve at the intensity setting selected by the user. B in FIG. 10 shows an example of a display presenting a geometric shape corresponding to the equalization curve of A in FIG. 10. According to the example shown in B of FIG. 10, the arrow 310 indicates the direction of the detected finger movement with respect to the display system 105. According to this example, the arrow 310 indicates that an upward swipe of the finger has been detected by the sensor system 115. In response to an indication of finger movement from the sensor system 115, the control system of the device 100 controls the display system 105 to present a sequence of images indicating that the geometric shape 300 expands with respect to the size of the geometric shape 300 in B of FIG. 8 or B of FIG. 9. In this example, the size of the geometric shape 300 is larger than the default size 305. Therefore, the larger size of the geometric shape 300 corresponds to a relatively higher intensity of the equalization curve 1005 compared to the default intensity setting of the equalization curve 805.

[0063] According to some examples, method 500 may be involved in providing some type of tactile feedback. In some such examples, device 100 and / or ear device 120 may include devices for providing tactile feedback, such as one or more motors, vibrators, etc. In some examples, method 500 may be involved in providing tactile feedback when a setting selected by the user (for example, a setting corresponding to the current size of geometric shape 300 in response to the detected movement of the user's finger on the display of device 100) corresponds to a default setting, a minimum setting, and / or a maximum setting. For example, the device may provide tactile feedback to the user's finger when the detected direction of the finger movement brings geometric shape 300 within a predetermined range (for example, a predetermined number of pixels) of the default size 305. Alternatively or additionally, method 500 may be involved in providing tactile feedback when a setting selected by the user corresponds to a setting previously selected by the user.

[0064] Various modifications to the implementations described in this disclosure may be readily apparent to those skilled in the art. The general principles defined herein may be applied to other implementations without departing from the scope of this disclosure. Thus, the claims are not intended to be limited to the implementations shown herein, but should be accorded the widest scope consistent with the disclosure, principles, and novel features disclosed herein.

[0065] Some aspects will be described. [Aspect 1] A method for controlling a headset having an external microphone signal pass-through function, comprising: controlling a display to present a geometric shape on the display; Receiving an indication of finger movement from a sensor system associated with the display, wherein the sensor system includes a touch sensor system or a gesture sensor system, and the indication includes an indication of the direction of finger movement relative to the display; Controlling the display to present a sequence of images indicating that the geometric shape expands or contracts depending on the direction of the finger movement; Changing a headphone transparency setting according to the current size of the geometric shape, wherein the headphone transparency setting corresponds to an external microphone signal gain setting or a media signal gain setting of the headphones, including the steps of; Method. [Aspect 2] The method according to aspect 1, wherein the headphone transparency setting corresponds to both an external microphone signal gain setting and a media signal gain setting. [Aspect 3] The method according to aspect 1, wherein the current size of the geometric shape also corresponds to an automatic noise cancellation setting. [Aspect 4] The method according to aspect 3, wherein the minimum size of the geometric shape corresponds to a headphone transparency setting having a minimum external microphone signal gain setting and an automatic noise cancellation setting in which automatic noise cancellation is enabled. [Aspect 5] The method according to aspect 3, wherein the maximum size of the geometric shape corresponds to a headphone transparency setting having a maximum external microphone signal gain setting and an automatic noise cancellation setting in which automatic noise cancellation is not enabled. [Aspect 6] The method according to any one of aspects 1 to 5, including controlling the display to present a sequence of images indicating that the geometric shape expands when the direction of the finger movement is towards the upper part of the display. [Aspect 7] The method according to any one of aspects 1 to 6, wherein the geometric shape includes a circle. 〔Aspect 8〕 The method according to any one of Aspects 1 to 7, wherein changing the headphone transparency setting includes performing a smooth transition between a first headphone transparency setting and a second headphone transparency setting. 〔Aspect 9〕 A method for controlling an audio recording process, comprising: controlling a display to present a geometric shape on the display; receiving an indication of finger movement from a sensor system associated with the display, the sensor system including a touch sensor system or a gesture sensor system, the indication including an indication of the direction of finger movement; controlling the display to present a sequence of images indicating that the geometric shape expands or contracts depending on the direction of the finger movement; changing an intensity setting of an equalization curve for the audio recording process according to the current size of the geometric shape. A method. 〔Aspect 10〕 The method according to Aspect 9, wherein the current size of the geometric shape corresponds to a gain setting for a certain frequency range. 〔Aspect 11〕 The method according to Aspect 9, wherein the intensity setting corresponds to the shape of the equalization curve. 〔Aspect 12〕 The method according to any one of Aspects 9 to 11, wherein the equalization curve includes selectable preset equalization curves. 〔Aspect 13〕 The method according to Aspect 12, further comprising controlling the display to display a plurality of icons on the display, each of the plurality of icons corresponding to a different preset equalization curve. 〔Aspect 14〕 receiving an indication of a touch in a region of the display corresponding to an icon from the sensor system; selecting a preset equalization curve corresponding to the icon. The method according to Aspect 13. [Aspect 15] The method according to any one of Aspects 9 to 14, including controlling the display to present a sequence of images indicating that the geometric shape expands when the direction of the finger movement is towards the upper part of the display. [Aspect 16] The method according to any one of Aspects 9 to 15, wherein the geometric shape includes a circle. [Aspect 17] One or more non-transitory media storing software, One or more non-transitory media storing software including instructions for controlling one or more devices to execute the method according to any one of Aspects 1 to 16. [Aspect 18] A display; A sensor system related to the display, the sensor system including a touch sensor system or a gesture sensor system; A control system having one or more processors, the control system being configured to execute the method according to any one of Aspects 1 to 16. An apparatus. [Aspect 19] A display; A sensor system related to the display, the sensor system including a touch sensor system or a gesture sensor system; An apparatus having control means for executing the method according to any one of Aspects 1 to 16. An apparatus.

Claims

1. A method for controlling an audio recording process, comprising: Controlling a display to present a geometric shape on the display; Receiving an indication of finger movement from a sensor system associated with the display, the sensor system including a touch sensor system or a gesture sensor system, the indication including an indication of the direction of finger movement; Controlling the display to present a sequence of images indicating that the geometric shape expands or contracts depending on the direction of the finger movement; Changing an intensity setting of an equalization curve for the audio recording process according to the current size of the geometric shape, providing haptic feedback when the setting corresponding to the current size of the geometric shape corresponds to a default setting or a minimum setting, allowing a user to obtain a desired intensity setting by making an indication of the finger movement on a GUI without knowing a specific intensity setting of the equalization curve for the audio recording process corresponding to the size of the geometric shape; The current size of the geometric shape corresponds to a gain setting for a certain frequency range, and the equalization curve for the audio recording process represents the relationship between gain and frequency in the audio recording process; A method.

2. The method according to claim 1, wherein the intensity setting corresponds to the shape of the equalization curve.

3. The method according to any one of claims 1 and 2, wherein the equalization curve includes selectable preset equalization curves.

4. The method according to claim 3, further comprising controlling the display to display a plurality of icons on the display, each icon of the plurality of icons corresponding to a different preset equalization curve.

5. Receiving an indication of a touch in the area of the display corresponding to an icon from the sensor system; Further comprising selecting a preset equalization curve corresponding to the icon; The method according to claim 4.

6. The method according to any one of claims 1 to 5, comprising controlling the display to present a sequence of images indicating that the geometric shape expands when the direction of the finger movement is towards the upper part of the display.

7. The method according to any one of claims 1 to 6, wherein the geometric shape includes a circle. **Claim 8** One or more non-transitory media storing software, The one or more non-transitory media storing software including instructions for controlling one or more devices to execute the method according to any one of claims 1 to 7. **Claim 9** A display; A sensor system associated with the display, the sensor system including a touch sensor system or a gesture sensor system; A control system having one or more processors, the control system being configured to execute the method according to any one of claims 1 to 7, An apparatus.

Images