Audio control based on display region
By associating audio controls with display regions and applying these settings based on the position of application windows, the system addresses the challenge of intuitive audio control in multi-tasking scenarios, enhancing user experience and situational awareness.
Patent Information
- Application Number
- PCT/US2024/055465
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-17
- Filing Date
- 2024-11-12
- Publication Date
- 2025-05-22
AI Technical Summary
Existing mobile computing devices struggle with intuitive audio control when multiple applications are assigned to different display regions, making it difficult for users to manage audio processing across multiple applications.
The system associates audio controls with display regions, allowing users to specify volume parameters, audio effect parameters, and audio routing parameters for each display region. These settings are applied to audio data based on the display region where an application is positioned, enabling intuitive control of audio by moving application windows between display regions.
This approach provides users with intuitive and situational awareness of audio control settings, allowing them to easily manage audio for multiple applications by simply moving application windows between display regions, thus enhancing the user experience.
Smart Images

Figure US2024055465_22052025_PF_FP_ABST
Abstract
Description
AUDIO CONTROL BASED ON DISPLAY REGIONI. Cross-Reference to Related Applications
[0001] The present application claims the benefit of priority from the commonly owned Indian Provisional Patent Application No. 202341078081, filed November 17, 2023, the contents of which are expressly incorporated herein by reference in their entirety.IL Field
[0002] The present disclosure is generally related to audio control based on a display region associated with an application.III. Description of Related Art
[0003] Advances in technology have resulted in smaller and more powerful computing devices. For example, there currently exist a variety of portable personal computing devices, including wireless telephones such as mobile and smart phones, tablets and laptop computers that are small, lightweight, and easily carried by users. These devices can communicate voice and data packets over wireless networks. Further, many such devices incorporate additional functionality such as a digital still camera, a digital video camera, a digital recorder, and an audio file player. Also, such devices can process executable instructions, including software applications, such as a web browser application, that can be used to access the Internet. As such, these devices can include significant computing capabilities.
[0004] Many of these devices are configured to interact with users via one or more displays. There have been significant advances in display technology since the early days of computers, such as the widespread availability of small, portable devices with integrated displays (e.g., smart phones, tablet computers, laptop computers, etc.) and display controllers that simplify multi-tasking in such displays (e.g., using application specific display windows, display screen tiling, etc.). While such advances can improve a user's experience with visual aspects of multi-tasking, they do not address audio aspects of multi-tasking. For example, when using multiple applications assigned tomultiple displays or display regions, it can be challenging for a user to control audio processing associated with each of the applications.IV. Summary
[0005] In a particular implementation, a device includes one or more processors and a memory configured to store mapping data that associates audio settings with display regions. The one or more processors are configured to obtain a display region identifier indicating a display region for a first application and obtain, based on the display region identifier and the mapping data, a volume parameter for audio data associated with the first application. The one or more processors are configured to process the audio data associated with the first application using the volume parameter.
[0006] In a particular implementation, a method includes obtaining a display region identifier indicating a display region for a first application. The method also includes obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application. The method further includes processing the audio data associated with the first application using the volume parameter.
[0007] In a particular implementation, a non - transitory computer - readable medium includes instructions that, when executed by one or more processors, cause the one or more processors to obtain a display region identifier indicating a display region for a first application and obtain, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application. The instructions further cause the one or more processors to process the audio data associated with the first application using the volume parameter.
[0008] In a particular implementation, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application. The apparatus also includes means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application. The apparatus further includes means forprocessing the audio data associated with the first application using the volume parameter.
[0009] In a particular implementation, a device includes one or more processors and a memory configured to store mapping data that associates audio settings with display regions. The one or more processors are configured to obtain a display region identifier indicating a display region for a first application and obtain, based on the display region identifier and the mapping data, an audio effect parameter for audio data associated with the first application. The one or more processors are configured to process the audio data associated with the first application using the audio effect parameter.
[0010] In a particular implementation, a method includes obtaining a display region identifier indicating a display region for a first application. The method also includes obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application. The method also includes processing the audio data associated with the first application using the audio effect parameter.
[0011] In a particular implementation, a non - transitory computer - readable medium includes instructions that, when executed by one or more processors, cause the one or more processors to obtain a display region identifier indicating a display region for a first application and obtain, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application. The instructions further cause the one or more processors to process the audio data associated with the first application using the audio effect parameter.
[0012] In a particular implementation, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application. The apparatus also includes means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application. The apparatus further includes means for processing the audio data associated with the first application using the audio effect parameter.
[0013] Other aspects, advantages, and features of the present disclosure will become apparent after review of the entire application, including the following sections: Brief Description of the Drawings, Detailed Description, and the Claims.V. Brief Description of the Drawings
[0014] FIG. l is a block diagram of a particular illustrative aspect of a system operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0015] FIGS. 2A, 2B, 2C, 2D, 2E, and 2F are diagrams of an illustrative aspect of user interfaces for setting audio processing parameters for different display regions, in accordance with some examples of the present disclosure.
[0016] FIG. 3 illustrates an example of an integrated circuit operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0017] FIG. 4 is a diagram of a mobile device operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0018] FIG. 5 is a diagram of a mixed reality or augmented reality glasses device operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0019] FIG. 6 is a diagram of a wearable electronic device operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0020] FIG. 7 is a diagram of a voice-controlled speaker system operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0021] FIG. 8 is a diagram of a camera operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0022] FIG. 9 is a diagram of a headset, such as a virtual reality, mixed reality, or augmented reality headset, operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0023] FIG. 10 is a diagram of a first example of a vehicle operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0024] FIG. 11 is a diagram of a second example of a vehicle operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.
[0025] FIG. 12 is a diagram of a first implementation of a method of controlling audio processing based on a display region associated with an application that may be performed by the system of FIG. 1, in accordance with some examples of the present disclosure.
[0026] FIG. 13 is a diagram of a second implementation of a method of controlling audio processing based on a display region associated with an application that may be performed by the system of FIG. 1, in accordance with some examples of the present disclosure.
[0027] FIG. 14 is a block diagram of a particular illustrative example of a device that is operable to control audio processing based on a display region associated with an application, in accordance with some examples of the present disclosure.VI Detailed Description
[0028] In recent years, thanks to improvements in various technologies, mobile computing devices (e.g., tablet computers, laptop computers, smartphones, and similardevices) have become nearly ubiquitous. Generally, mobile computing devices are designed with various goals in mind, such as small form factor to improve portability, high performance processing capabilities to provide a wide range of utility and a satisfactory user experience, and efficient power usage to increase battery life. Other goals may also be considered, but form factor, processing capability, and efficiency highlight challenges with mobile computing device design. For example, small form factor devices may have less room for batteries and less room for heat management solutions (e.g., heat exchangers), so decreasing the form factor may increase the challenge of meeting power and heat management goals. Similarly, more powerful processors are generally larger, generate more heat, and may require more power; thus, increasing performance can introduce challenges for achieving other goals.
[0029] Another challenge faced during the design of a mobile computing device is the problem of conflicts between portability and usability. For example, smaller devices are more easily carried from place to place by a user, however, smaller devices have less space available for user interfaces, especially displays. A recent trend to address this problem is using multiple displays, foldable displays, and / or displays that can be reconfigured in a similar manner. Multi-display devices and foldable display devices generally strive to increase display space available to the user while limiting overall size increase of the device. Thay can also simplify multi-tasking by allowing a user to assign different tasks or different applications to different display regions.
[0030] While multi-tasking improves some parts of the user experience, it can create problems with other user interactions. For example, two applications executing on a mobile computing device can be assigned to different display regions, as described above. In this example, the user is able to visually multi-task by looking between the display regions, but the user will have difficulty interacting with audio of the two applications. To illustrate, it may be unclear to the user which application is generating particular audio content. As another example, such mobile computing devices often include only a few physical buttons, e.g., a volume up and a volume down button, and it may be unclear to the user which application’s audio will be adjusted by interaction with such volume control buttons.
[0031] Disclosed embodiments solve these and other problems by associating audio controls with display regions. The display regions can include different display screens, different portions of a single display screen, or both (e.g., two regions in one screen and two regions in another screen). The audio controls can include, for example, volume controls, audio effect controls, audio routing, and the like, to be applied to audio output from an application, to be applied to audio input to the application, or both. In particular embodiments, the audio controls associated with each display region are user specified, e.g., indicated in user controllable settings.
[0032] As a first example, the user can assign first volume parameters to a first display region and second volume parameters to a second display region. In this example, the user can readily control the audio output from an application by moving the application between the first and second display regions. When two or more applications are in use and associated with audio data, the display regions associated with the applications can be modified to control the volume associated with each application. Such exchange of display regions can be performed responsive to user input (e.g., swiping, or dragging and dropping a window associated with an application) or automatically (e.g., in response to a detected circumstance).
[0033] As a second example (which can be combined with or independent of the first example above), the user can assign first audio effect parameters to a first display region and second audio effect parameters to a second display region to enable control of audio effects by moving application(s) between the first and second display regions. The audio effect parameters can indicate, for example, equalizer settings, an audio mode, filtering operation to be performed, etc. Similar to the first example above, the user can readily control the audio effects from an application by moving the application between the first and second display regions. When two or more applications are in use and associated with audio data, the display regions associated with the applications can be modified (by the user or automatically) to control the audio effects associated with each application.
[0034] As a third example (which can be combined with either or both of the first and second examples above, or can be independent thereof), the user can assign first audio routing parameters to a first display region and second audio effect parameters to asecond display region to enable routing of audio to particular devices by moving application(s) between the first and second display regions. The audio routing parameters can indicate, for example, an output device to which an application sends audio data, an input device from which the application receives audio data, or both. Similar to the first and second examples above, the user can readily control routing of audio data to or from an application by moving the application between the first and second display regions. When two or more applications are in use and associated with audio data, the display regions associated with the applications can be modified (by the user or automatically) to control the audio routing associated with each application.
[0035] Associating audio controls with display regions solves the problem of providing intuitive audio control for applications in situations where multiple displays or display regions are present. For example, by tying audio control parameters to display regions, the user can move display windows associated with one or more applications among various display regions to indicate the audio control parameters to be assigned to the applications. Thus, a user can use intuitively simple actions, such as swiping a display window from one display region to another display region, to control audio.
[0036] Associating audio controls with display regions also solves the problem of providing the user with situational awareness of what audio control settings are associated with an application. For example, during a communication session (e.g., a telephone call, a video conference, etc.), it can be useful for a user to be able to readily determine whether near-end audio is muted (e.g., the user’s audio is being transmitted to other participants in the communication session). In this example, the disclosed embodiments can provide the user with an intuitively simple mechanism to determine whether the near-end audio is muted. To illustrate, a particular display region can be associated with audio control parameters that mute near-end audio. If a display window of the application associated with the communication session is assigned to that particular display region, then the near-end audio is muted.
[0037] Particular aspects of the present disclosure are described below with reference to the drawings. In the description, common features are designated by common reference numbers. As used herein, various terminology is used for the purpose of describingparticular implementations only and is not intended to be limiting of implementations. For example, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Further, some features described herein are singular in some implementations and plural in other implementations. To illustrate, FIG. 1 depicts a device 102 including one or more processors ("processor(s)" 190 of FIG. 1), which indicates that in some implementations the device 102 includes a single processor 190 and in other implementations the device 102 includes multiple processors 190. For ease of reference herein, such features are generally introduced as "one or more" features and are subsequently referred to in the singular or optional plural (as indicated by "(s)") unless aspects related to multiple of the features are being described.
[0038] In some drawings, multiple instances of a particular type of feature are used. Although these features are physically and / or logically distinct, the same reference number is used for each, and the different instances are distinguished by addition of a letter to the reference number. When the features as a group or a type are referred to herein e.g., when no particular one of the features is being referenced, the reference number is used without a distinguishing letter. However, when one particular feature of multiple features of the same type is referred to herein, the reference number is used with the distinguishing letter. For example, referring to FIG. 1, multiple applications are illustrated and associated with reference numbers 130A, 130B, and 13 ON. When referring to a particular one of these applications, such as an application 130A, the distinguishing letter "A" is used. However, when referring to any arbitrary one of these applications or to these applications as a group, the reference number 130 is used without a distinguishing letter.
[0039] As used herein, the terms "comprise," "comprises," and "comprising" may be used interchangeably with "include," "includes," or "including." Additionally, the term "wherein" may be used interchangeably with "where." As used herein, "exemplary" indicates an example, an implementation, and / or an aspect, and should not be construed as limiting or as indicating a preference or a preferred implementation. As used herein, an ordinal term (e.g., "first," "second," "third," etc.) used to modify an element, such as a structure, a component, an operation, etc., does not by itself indicate any priority ororder of the element with respect to another element, but rather merely distinguishes the element from another element having a same name (but for use of the ordinal term). As used herein, the term "set" refers to one or more of a particular element, and the term "plurality" refers to multiple (e.g., two or more) of a particular element.
[0040] As used herein, "coupled" may include "communicatively coupled," "electrically coupled," or "physically coupled," and may also (or alternatively) include any combinations thereof. Two devices (or components) may be coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) directly or indirectly via one or more other devices, components, wires, buses, networks (e.g., a wired network, a wireless network, or a combination thereof), etc. Two devices (or components) that are electrically coupled may be included in the same device or in different devices and may be connected via electronics, one or more connectors, or inductive coupling, as illustrative, non-limiting examples. In some implementations, two devices (or components) that are communicatively coupled, such as in electrical communication, may send and receive signals (e.g., digital signals or analog signals) directly or indirectly, via one or more wires, buses, networks, etc. As used herein, "directly coupled" may include two devices that are coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) without intervening components.
[0041] In the present disclosure, terms such as "determining," "calculating," "estimating," "shifting," "adjusting," etc. may be used to describe how one or more operations are performed. It should be noted that such terms are not to be construed as limiting and other techniques may be utilized to perform similar operations. Additionally, as referred to herein, "generating," "calculating," "estimating," "using," "selecting," "accessing," and "determining" may be used interchangeably. For example, "generating," "calculating," "estimating," or "determining" a parameter (or a signal) may refer to actively generating, estimating, calculating, or determining the parameter (or the signal) or may refer to using, selecting, or accessing the parameter (or signal) that is already generated, such as by another component or device.
[0042] Referring to FIG. 1, a particular illustrative aspect of a system configured to control audio processing based on a display region associated with an application isdisclosed and generally designated 100. The system 100 includes a device 102 that is coupled to or includes one or more displays 160 and one or more audio devices 112. The device 102 is configured to use an audio controller 194 to control processing of audio data 114 of one or more applications 130 based on where window(s) (or other content) associated with the application(s) are displayed in the display(s) 160. The device 102 can be coupled to the one or more audio devices 112 via one or more audio device interfaces 110, via a modem 170, or both. For example, the device 102 can be coupled to a first audio device 112A via one of the audio device interface(s) 110 and coupled to a second audio device 112B via the modem 170. Optionally, the modem 170 can be configured to facilitate communication between the device 102 and one or more remove devices 172 to exchange the audio data 114 (or a portion thereof). For example, the remote device(s) 172 can include a server of a video conferencing system that provides audio data of a video conference to the device 102 for play out by one of the applications 130 via one or more of the audio device(s) 112.
[0043] The device 102 includes one or more processors 190 coupled to a memory 120 and to one or more audio device interfaces 110. In the example illustrated in FIG. 1, the processor(s) 190 include a user interface (UI) manager 192 and the audio controller 194. The UI manager 192 is configured to control presentation of content in the display(s) 160. For example, the UI manager 192 can control how and where application windows 164 (including application window 164 A and application window 164B in FIG. 1) are displayed, the size of each application window 164, the arrangement or layering of application windows 164 (e.g., which is on top if two application windows 164 overlap), etc.
[0044] The UI manager 192 also controls designation of various portions of the display(s) 160 as respective display regions 162 (such as display region 162A and display region 162B in FIG. 1). The display regions 162 can include different display screens (e.g., physically distinct display devices), different display tiles (e.g., two or more areas of one physical device that are distinguished in software), or a combination thereof (e.g., two or more physically distinct display devices at least one of which is divided into two or more display tiles). The UI manager 192 can assign a display region identifier (ID) 104 (e.g., a display region ID 104A, a display region ID 104B, or adisplay region ID 104H, where H is an integer greater than or equal to three) to each display region 162. Additionally, or alternatively, the display region ID 104 for each display region 162 is pre-assigned or is based on unique identifying information for the display region 162 (e.g., display coordinates bounding the display region 162). The display regions 162 can be defined in hardware (e.g., one region per display), can be defined by the UI manager 192, can be predefined (e.g., based on firmware settings), can be user-defined (e.g., based on user specified settings, or a combination thereof (e.g., some display regions 162 can be user defined and some can be defined by the UI manager 192 or predefined).
[0045] Regardless of how the display region IDs 104 are assigned to the display regions 162, the UI manager 192 can determine a display region ID 104 associated with an application 130 (e.g., a first application 130A, a second application BOB, or an Nth application BON, where N is an integer greater than or equal to three) based on where in the display(s) 160 an application window 164 of the application 130 is positioned.For example, in FIG. 1, the first application BOA may be associated with an application window 164A displayed in a display region 162A, and the second application BOB may be associated with an application window 164B displayed in a display region 162B. In this example, the UI manager 192, based on determining that the application window 164A is positioned in the display region 162A and that the display region 162A is associated with display region ID 104A, determines that the first application BOA is associated with the display region ID 104A. Likewise, the UI manager 192, based on determining that the application window 164B is positioned in the display region 162B and that the display region 162B is associated with display region ID 104B, determines that the second application BOB is associated with the display region ID 104B.
[0046] The audio controller 194 is configured to process audio data 114 associated with an application 130 based on which of the display regions 162 the application 130 is associated with. For example, the audio controller 194 can obtain a display region ID 104 for an application 130 from the UI manager 192. In this example, the audio controller 194 accesses mapping data 140 in the memory 120 to determine audio settings 142 (e.g., any of audio settings 142 A, audio settings 142B, or audio settings 142M, where M is an integer greater than or equal to 3) for the application 130 based onthe display region ID 104. The mapping data 140 associates particular audio settings 142 with each display regions 162 based on display region IDs 104. For example, in FIG. 1, the display region ID 104A is associated with first audio settings 142A, and the display region IDs 104B and 104H are associated with second audio settings 142B. In some embodiments, the mapping data 140 is user configurable. For example, a user can change the mapping data 140 to associate the display region ID 104H with the Mth audio settings 142M.
[0047] The audio settings 142 can specify various parameters used to process audio data 114, which may include input audio data, output audio data, or both, associated with one or more of the applications 130. To illustrate, in FIG. 1, each of the audio settings 142 specifies one or more volume parameters 150, one or more audio routing parameters 152, one or more audio effect parameters 154, or a combination thereof.
[0048] The volume parameter(s) 150 can include, for example, a volume level to be associated with audio data 114 of a particular application. In this example, the volume level is a numerical value used to indicate the volume of audio data. To illustrate, the volume level can indicate a value in a range from 0% (e.g., muted) to 100% (e.g., a maximum allowed volume). During playout of audio, an audio driver (e.g., of an audio device interface 110 or of an audio device 112) uses the volume level to control amplification of output audio based on the audio data 114. During capture of sound, the volume level may be included with the audio data 114 to represent, for example, relative sound levels of various sound sources of the captured audio. Other examples of volume parameter(s) 150 can include volume limits (e.g., a maximum or minimum volume level), mixing ratios (e.g., a ratio of a volume level associated with one sound source to a volume level associated with another sound source), etc.
[0049] The audio routing parameter(s) 152 indicate one or more audio sources (e.g., which audio device(s) 112 the audio data 114 is to be received from), one or more audio sinks (e.g., which audio device(s) 112 the audio data 114 is to be sent to), or both. For example, based on the audio routing parameter(s) 152, a portion of the audio data 114 associated with the first application 130A may be sent to the first audio device 112A for output, and a portion of the audio data 114 associated with the second application 130Bmay be sent to the second audio device 112B for output. As another example, based on the audio routing parameter(s) 152, a portion of the audio data 114 associated with the first application 130A may be received from the first audio device 112A for output, and a portion of the audio data 114 associated with the second application 13 OB may be received from the second audio device 112B for output. As still another example, based on the audio routing parameter(s) 152, a portion of the audio data 114 associated with the first application 130A may be sent to the first audio device 112A for output, and a portion of the audio data 114 associated with the second application 13 OB may be received from the second audio device 112B for output.
[0050] The audio effect parameter(s) 154 indicate one or more audio processing modes, one or more filter operations, one or more equalizer settings, one or more other audio effects, or a combination thereof, to be used for particular audio data 114. Examples of audio processing modes that can be indicated in the audio effect parameter(s) 154 include an audio format, such as whether audio data should be processed to generate single channel (mono) audio, stereo audio, or spatial audio (e.g., Ambisonics, Dolby Atmos®, or other proprietary audio formats)( Dolby Atmos® is a registered trademark of Dolby Laboratories, Inc. of San Francisco, CA). Examples of filter operations include noise reduction filtering, voice enhancement filtering, echo reduction filtering, etc. Equalizer settings indicate gains or amplitudes for particular frequency ranges. The equalizer settings can be selected from among pre-configured settings or can include custom (e.g., user specified) settings.
[0051] In some embodiments, the different audio processing modes can have different levels of computational complexity, different levels of audio fidelity, different levels of compression, different levels of resource utilization, etc. To illustrate, a first audio processing mode can generate a single channel audio signal whereas a second audio processing mode can generate multiple channel audio signals representing binauralized spatial audio data. In this example, spatial audio processing and binauralization is generally more computationally complex and resource intensive (in terms of processor time, memory, power utilization, etc.) than single channel processing. In other examples, the various audio processing modes can include a stereo mode, a surround sound mode, as well as other modes. In such embodiments, the user can control theaudio processing mode (and the resulting audio quality, resource utilization, etc.) by assigning the applications 130 to display regions 162 associated with particular audio settings 142.
[0052] In some implementations, the device 102 corresponds to or is included in one of various types of devices. In an illustrative example, the processor 190 is integrated in at least one of a mobile phone or a tablet computer device, as described with reference to FIG. 4; a mixed reality or augmented reality glasses device, as described with reference to FIG. 5; a wearable electronic device, as described with reference to FIG. 6; a voice- controlled speaker system, as described with reference to FIG. 7; a camera device, as described with reference to FIG. 8; or a virtual reality, mixed reality, or augmented reality headset, as described with reference to FIG. 9. In another illustrative example, the processor 190 is integrated into a vehicle, such as described further with reference to FIG. 10 and FIG. 11.
[0053] During operation, the audio controller 194 controls the audio settings 142 used to process the audio data 114 based, at least partially, on the display region 162 in which an application window 164 of an application 130 associated with the audio data 114 is positioned. For example, when the first application 130A is executing at the device 102, the UI manager 192 determines (e.g., controls or detects) where an application window (e.g., the application window 164A) associated with the first application 130A is displayed. The UI manager 192 determines a display region ID 104 (e.g., the display region ID 104A) that identifies a display region 162 (e.g., the display region 162A) in which the application window 164A is displayed and associates the display region ID 104 A with the first application 130A.
[0054] Continuing the example above, when the audio controller 194 determines that the audio data 114 includes audio data associated with the first application 130A, the audio controller 194 obtains the display region ID 104A associated with the first application 130A from the UI manager 192 or from the memory 120. The audio controller 194 determines, based on the display region ID 104A and the mapping data 140, which audio settings 142 to use to process the audio data 114 associated with the first application BOA. To illustrate, in FIG. 1, the mapping data 140 indicates that thedisplay region ID 104A is associated with the first audio settings 142A. Based on the audio settings 142 indicated by the mapping data 140, the audio controller 194 sets volume parameter(s), audio routing parameter(s), audio effect parameter(s), and possibly other parameters to control processing of the audio data 114 for the first application 130A.
[0055] If the application window 164 associated with an application 130 is relocated to a different display region 162, the operations above are repeated to modify the audio settings 142 use for audio data associated with the application 130. To illustrate, continuing the example above in which the application window 164A is associated with the first application 130A, the application window 164 A can be relocated from the display region 162A to the display region 162B. In this situation, the UI manager 192 can determine that display region ID 104B identifies the display region 162B, and the audio controller 194 can determine, based on the display region ID 104B and the mapping data 140, that the second audio settings 142B are to be used to process the audio data 114 associated with the first application 130A.
[0056] The relocation of an application window 164 to a different display region 162 can be user initiated (e.g., using a drag and drop operation, a swipe operation, or another similar operation). Thus, the user can change audio settings 142 applied to audio data 114 of an application 130 by moving the application window 164 associated with the application 130. To illustrate, the user can mute audio to or from an application 130 by moving the application window 164 of the application 130 to a display region 162 associated with muted audio settings 142. Similarly, the user can change where the audio from an application 130 is output (or where audio provided to the application 130 is received from) by moving the application window 164 to a display region 162 associated with particular audio routing parameters 152. Likewise, the user can change audio effects applied to audio of an application 130 by moving the application window 164 to a display region 162 associated with particular audio effect parameters 154.
[0057] Optionally, the UI manager 192 can automatically position an application window 164 in a particular display region 162. For example, if the first application 130A is associated with the application window 164A and the second application 130Bis associated with the application window 164B and a user moves the application window 164A to the display region 162B, the UI manager 192 can automatically move the application window 164B to the display region 162A (or to another display region 162, such as a default display region). In this example, the user can selectively move one application window 164 to modify the audio settings 142 applied to audio associated with multiple applications 130. As a specific use case example, to mute audio from the second application 130B and emphasize (e.g., unmute or increase the volume of) audio from the first application 130A, the user can drag the application window 164A to the display region 162B. In this use case example, the UI manager 192 responds to the user's movement of the application window 164A to the display region 162B occupied by the application window 164B by moving the application window 164B to the display region 162A previously occupied by the application window 164A, causing the audio controller 194 to update audio settings 142 associated with both the first application 130A and the second application 13 OB.
[0058] As another example, an application 130 can optionally be associated with settings (e.g., metadata or configuration settings) that cause an application window 164 associated with the application 130 to open in a particular display region 162 at startup of the application 130. To illustrate, when the first application 130A is initialized, the UI manager 192 can determine an initial placement location of the application window 164 A of the first application 130 A based on settings associated with the first application BOA. Optionally, if an application window (e.g., the application window 164B) associated with another application 130 is already in the location indicated for initial placement of the first application BOA, the UI manager 192 can relocate the other application window 164B resulting in modification of the audio settings 142 associated with the other application 130. As a specific use case example, the user may be using the second application BOB to watch a video via the application window 164B, which is positioned in the display region 162B. In this use case example, the device 102 can receive an incoming communication (e.g., a voice or video call) associated with the Nth application BON. The user can start a communication session by accepting the incoming communication, which opens an application window associated with the Nth application BON at an initial placement location. If the initial placement location of theNth application 130N is in the display region 162B, the UI manager 192 can relocate the application window 164B to the display region 162A and open an application window associated with the Nth application 130N in the display region 162B. This may have the effect, for example, of muting audio from the second application 13 OB and causing audio from the Nth application 130N to be output instead.
[0059] In some embodiments, each of the application(s) 130 is associated with a priority parameter, and the UI manager 192 uses the priority parameters to determine which application 130 to assign to each of various display regions 162. For example, the first application 130A may be associated with a first priority parameter and the second application 130B may be associated with a second priority parameter. In this example, the UI manager 192 compares the first and second priority parameters to determine which of the first and second applications 130 to assign to a particular display region 162 (e.g., a display region 162 associated with a particular audio device 112, associated with particular volume parameters, associated with particular audio effects, etc.). To illustrate, an application 130 with a higher priority may be assigned to a display region 162 associated with a higher volume level, higher fidelity audio effects, a higher quality audio device 112, or a combination thereof.
[0060] In some such embodiments, an application 130 can be associated with more than one priority parameter, such as a set of conditional priority parameters associated with specific operations of the application 130. In such embodiments, the particular conditional priority parameter used by the UI manager 192 depends on an operation being performed by the application 130. For example, a communication application may be capable of supporting audio only calls, video calls, and instant messaging. In this example, the communication application may be assigned a first priority when it is performing instant messaging operations, may be assigned a second priority when it is performing audio only call operations, and may be assigned a third priority when it is performing video call operations, where the first, second, and third priorities are different from one another. In such embodiments, the UI manager 192 may be configured to detect when the operations being performed by an application 130 change and update the display region 162 assigned to the application 130 in response to the change of operations of the application 130.
[0061] Although the examples above relate primarily to output audio from an application, similar examples apply to input audio. For example, if the Nth application 130N is a communication application that sends locally captured (e.g., near-end) audio to the remote device(s) 172 as part of a communication session, the user can mute the near-end audio (or make other changes to the volume, audio routing, or audio effect parameters) by moving the application window associated with the Nth application 13 ON.
[0062] Although FIG. 1 only illustrates audio settings 142 that are associated with respective display regions 162, optionally, in some embodiments, the device 102 is also configured to store and utilize audio settings associated with various of the applications 130 (e.g., application-specific audio settings). For example, configuration data associated with the first application 130 A may indicate a volume setting or other audio settings associated with the first application 130A. To illustrate, the audio settings associated with the first application 130 A can indicate a volume associated with the first application 130A the last time the first application 130A was used. In such embodiments, the audio settings associated with the application 130 and the audio settings 142 can both be used to determine how the audio data 114 associated with an application 130 is processed. For example, the audio settings 142 associated with the display region 162 in which a display window 164 of the application is displayed may indicate a first volume level (e.g., 70%), and the audio settings associated with the application 130 can indicate a second volume level (e.g., 50%). In this example, the volume level applied to the audio data 114 of the application 130 may be the higher of the two volume levels (e.g., 70%), the lower of the two volume levels (e.g., 50%), an average of the two volume levels (e.g., 60%), or a combination of the two volume levels (e.g., 50% of 70% = 35%). How the two volume levels are used can be specified by the user in configuration settings or can be preconfigured.
[0063] Alternatively, in embodiments in which application-specific audio settings are stored, an initial placement location of the application 130 can be selected based on the application-specific audio settings. For example, an application window 164 for the application 130 can be initially positioned in a display region 162 that is associated with audio settings 142 that most nearly match the application-specific audio settings. Toillustrate, if the user last used the first application 130A at a volume level of 70%, when the user opens the first application 130A, the UI manager 192 can determine which display region 162 is associated with audio settings 142 that specify a volume level nearest to 70% and open an application window 164 for the first application 130A in that display regions 162.
[0064] Optionally, in some embodiments, if no location for initial placement of an application window 164 for an application 130 is specified, the UI manager 192 can determine an initial placement location for the application window 164 based on audio settings 142 associated with the application 130. For example, if no initial placement of the application window 164A of the first application 130A is specified, the UI manager 192 can determine audio settings 142 associated with the first application BOA. In this example, the UI manager 192 can use the mapping data 140 to identify a display region ID 104 corresponding to a set of audio settings 142 that most nearly match the audio settings 142 associated with the first application BOA and use a display region identified by the display region ID 104 as the initial placement for the application window 164 A.
[0065] Optionally, in some embodiments, the UI manager 192 is configured to present control elements to establish or modify audio settings 142 for a particular display region 162 in the particular display region 162. For example, the UI manager 192 can generate a graphical user interface in the display region 162A that includes control elements to modify the first audio settings 142 A because the first audio settings 142 A are associated with the display region 162A in the mapping data 140. Similarly, the UI manager 192 can generate a graphical user interface in the display region 162B that includes control elements to modify the second audio settings 142B because the second audio settings 142B are associated with the display region 162B in the mapping data 140. FIGS. 2A- 2F illustrate examples of graphical user interfaces to establish or modify the specific audio settings 142 associated with various display regions 162.
[0066] Thus, the system 100 enables a user to easily and intuitively change the audio settings 142 associated with an application 130 by moving the display window 164 of the application 130 between various display regions 162. Further, in someembodiments, the system 100 enables a user to easily and intuitively modify the audio settings 142 associated with various display regions 162 by presenting control elements to modify the audio settings 142 in the respective display region 162 based on the mapping data 140.
[0067] Although the display(s) 160 and the audio device(s) 112 are illustrated as being coupled to the device 102, in other embodiments one or more of the display(s) 160, one or more of the audio device(s) 112, or a combination thereof, are integrated in the device 102. Further, although the UI manager 192 and the audio controller 194 are illustrated as integrated within the device 102, in some embodiments, the UI manager 192 and the audio controller 194 can be integrated in different devices.
[0068] The number of applications 130, display regions 104, audio settings 142, and audio devices 112 illustrated in FIG. 1 is merely to facilitate description of various aspects of the system 100 and is not limiting. Similarly, although only two display regions 162 are illustrated in FIG. 1, the UI manager 192 can designate or manage more than two display regions 162. In some embodiments, the number and arrangement of the display regions 162 can be user configurable. In some embodiments, each display region 162 corresponds to a separate display 160 (e.g., a separate device). In other embodiments, a display 160 can be divided into multiple display regions 162. The display regions 162 can be approximately the same size or different sizes. To illustrate, a display region 162 associated with audio settings 142 that mute output audio data 114 may be smaller than a display region 162 associated with audio settings 142 that do not mute output audio data 114.
[0069] FIGS. 2A- 2F are diagrams of illustrative aspects of graphical user interfaces for establishing or modifying audio processing parameters (e.g., audio settings 142 of FIG. 1) for different display regions 162, in accordance with some examples of the present disclosure. As described with reference to FIG. 1, two display regions 162A and 162B are illustrated merely as one example. In other embodiments, the display(s) 160 are divided into more than two display regions 162, such as one display region 162 per display 160 or two or more display regions 162 per display 160. Further, although the display regions 162 in FIGS. 2A-2F are approximately the same size and shape, in otherembodiments, various of the display regions 162 can differ in size, shape, or both. For example, in some embodiments, the size, shape, and / or location of the display regions 162 can be user defined in configuration settings associated with the UI manager 192 of FIG. 1.
[0070] FIG. 2A illustrates a first example of a graphical user interface (GUI) 200. In the GUI 200, a first set of control elements 202 for audio settings of the display region 162A are displayed in the display region 162A, and a second set of control elements 204 for audio settings of the display region 162B are displayed in the display region 162B. The first set of control elements 202 include, for example, a control element 202A, a control element 202B, and a control element 202L, where L indicates that any reasonable number of additional control elements may be present. Likewise, the second set of control elements 204 include, for example, a control element 204A, a control element 204B, and a control element 204L.
[0071] In the example illustrated in FIG. 2A, each control element 202A, 202B, 202L of the first set of control elements 202 is associated with a specific parameter type of the audio settings 142 of FIG. 1. For example, the control element 202A can be used to specify one or more volume parameters (e.g., the volume parameter(s) 150 of FIG. 1) for the display region 162A, the control element 202B can be used to specify one or more audio routing parameters (e.g., the audio routing parameter(s) 152 of FIG. 1) for the display region 162A, and the control element 202L can be used to specify one or more audio effect parameters (e.g., the audio effect parameter(s) 154 of FIG. 1) for the display region 162A. Likewise, in this example, the control element 204A can be used to specify one or more volume parameters for the display region 162B, the control element 204B can be used to specify one or more audio routing parameters for the display region 162B, and the control element 204L can be used to specify one or more audio effect parameters for the display region 162B.
[0072] FIG. 2A illustrates two sets of control elements 202, 204 and two display regions 162 A, 162B merely as one example. The number and arrangement of the display regions 162A, 162B can be different in different embodiments. In embodiments with more than two display regions 162A, 162B, the GUI 200 can include more thantwo sets of control elements 202, 204, such as one set of control elements for each display region.
[0073] Arranging control elements 202, 204 for audio settings 142 in the display regions 162 to which those audio settings 142 apply enables the user to intuitively control configuration of audio settings that are specific to particular display regions. FIGS. 2A-2F illustrate examples of control elements 202, 204 to establish or modify various types of audio settings.
[0074] FIG. 2B illustrates an example of a GUI 210 including control elements 212, 214, 216, 218 related to configuring volume parameters (e.g., the volume parameter(s) 150 of FIG. 1). The control elements 212, 214, 216, 218 are specific examples of the control elements 202, 204 of FIG. 2 A.
[0075] The control elements 212, 214 are disposed in the display region 162A and are configured to receive user input to configure volume parameters for the display region 162A. Likewise, the control elements 216, 218 are disposed in the display region 162B and are configured to receive user input to configure volume parameters for the display region 162B.
[0076] In the example illustrated in FIG. 2B, the control elements 212, 216 are configured to represent a volume level associated with each respective display region 162A, 162B based on a position of a slider on a slide bar. In this example, a user can move the slider up on the slide bar to designate a higher volume level and can move the slider down on the slide bar to designate a lower volume level. In this example, the control elements 214, 218 provide graphical representations of the volume level, and optionally, can be used to control muting or unmuting of the audio associated with the display regions 162A, 162B. For example, selecting the control element 214 can cause audio associated with the display region 162 A to be muted, which may be graphically represented in the GUI 210 via a symbol 215 overlaying the control element 214. In some embodiments, muting the audio associated with the display region 162A also causes the slider of the control element 212 to move to the bottom of the slide bar of the control element 212.
[0077] FIG. 2C illustrates an example of a GUI 220 including control elements 222, 224 related to configuring audio effect parameters (e.g., the audio effect param eter(s) 154 of FIG. 1). The control elements 222 are disposed in the display region 162A and are configured to receive user input to configure audio effect parameters for the display region 162A, and the control elements 224 are disposed in the display region 162B and are configured to receive user input to configure audio effect parameters for the display region 162B. The control elements 222, 224 are specific examples of the control elements 202, 204 of FIG. 2 A.
[0078] In the example illustrated in FIG. 2C, the control elements 222 are configured to receive user input to select various filter operations to be performed on audio associated with the display region 162A. For example, a control element 222A is selectable to activate or deactivate filter operations associated with voice enhancement. As another example, a control element 222B is selectable to activate or deactivate filter operations associated with noise reduction. As another example, control element 222C is selectable to activate or deactivate filter operations associated with echo reduction selection. Control elements 224A, 224B, and 224C are selectable to activate or deactivate the same filter operations for audio associated with the display region 162B.
[0079] In the example illustrated in FIG. 2C, the GUI 220 is configured to allow activation or deactivation of multiple audio effects (e.g., multiple filter operations) for each display region 162 in a single GUI 220. To illustrate, a user can select the control element 224A and the control element 224C to activate both voice enhancement filter operations and echo reduction filter operations.
[0080] FIG. 2D illustrates another example of a GUI 230 including control elements 232, 234 related to configuring audio effect parameters (e.g., the audio effect parameter(s) 154 of FIG. 1). The control elements 232 are disposed in the display region 162 A and are configured to receive user input to configure audio effect parameters for the display region 162A, and the control elements 234 are disposed in the display region 162B and are configured to receive user input to configure audio effect parameters for the display region 162B. The control elements 232, 234 are specific examples of the control elements 202, 204 of FIG. 2 A.
[0081] In the example illustrated in FIG. 2D, the control elements 232 are configured to receive user input to select various audio formats for audio associated with the display region 162A. For example, a control element 232A is selectable to activate or deactivate a mono audio format. As another example, a control element 232B is selectable to activate or deactivate a stereo audio format. As another example, a control element 232C is selectable to activate or deactivate a spatial audio format. As another example, a control element 232D is selectable to activate or deactivate a proprietary audio format. Control elements 234A, 234B, 234C, and 234D are selectable to activate or deactivate the same audio formats for audio associated with the display region 162B.
[0082] In the example illustrated in FIG. 2D, the GUI 230 is configured to allow activation or deactivation of a single audio effect for each display region 162. To illustrate, user selection of the control element 234A to activate the mono audio mode would automatically deselect the control element 234C and deactivate the spatial audio mode.
[0083] FIG. 2E illustrates another example of a GUI 240 including control elements 242, 244 related to configuring audio effect parameters (e.g., the audio effect parameter(s) 154 of FIG. 1). The control elements 242 are disposed in the display region 162 A and are configured to receive user input to configure audio effect parameters for the display region 162A, and the control elements 244 are disposed in the display region 162B and are configured to receive user input to configure audio effect parameters for the display region 162B. The control elements 242, 244 are specific examples of the control elements 202, 204 of FIG. 2 A.
[0084] In the example illustrated in FIG. 2E, the control elements 242 are configured to receive user input to select various equalizer parameters for audio associated with the display region 162A. For example, a control element 242A is selectable to activate or deactivate a first equalizer preset (EQ PRESET l) representing a first set of equalizer parameters (e.g., first frequency specific gains). As another example, a control element 242B is selectable to activate or deactivate a second equalizer preset (EQ PRESET 2) representing a second set of equalizer parameters (e.g., second frequency specific gains). As another example, a control element 242C is selectable to activate ordeactivate a third equalizer preset (EQ PRESET S) representing a third set of equalizer parameters (e.g., third frequency specific gains). As another example, a control element 242D is selectable to activate or deactivate custom equalizer settings (CUSTOM EQ) representing a user-specified set of equalizer parameters (e.g., fourth frequency specific gains). Control elements 244A, 244B, 244C, and 244D are selectable to activate or deactivate the same equalizer settings for audio associated with the display region 162B.
[0085] Equalizer preset parameters are illustrated in FIG. 2E merely as one example, in other embodiments, custom equalizer parameters can be set for each display region 162 using slide bars for various frequency ranges. Examples of equalizer presets include equalizer parameters configured for particular types of music (e.g., classical music v. rock music), equalizer parameters configured for particular types of audio (e.g., music v. speech), etc.
[0086] FIG. 2F illustrates another example of a GUI 250 including control elements 252, 254 related to configuring audio routing parameters (e.g., the audio routing parameter(s) 152 of FIG. 1). The control elements 252 are disposed in the display region 162 A and are configured to receive user input to configure audio routing parameters for the display region 162A, and the control elements 254 are disposed in the display region 162B and are configured to receive user input to configure audio routing parameters for the display region 162B. The control elements 252, 254 are specific examples of the control elements 202, 204 of FIG. 2 A.
[0087] In the example illustrated in FIG. 2F, the control elements 252 are configured to receive user input to select an input audio device or an output audio device (e.g., one or more of the audio devices 112 of FIG. 1) for audio associated with the display region 162A. In the example illustrated in FIG. 2F, a single list of audio devices (associated with control elements 252A, 252B, and 252C) is illustrated for the display region 162A; however, in some embodiments, the GUI 250 includes selections for both an audio input device and an audio output device to be associated with the display region 162A.Control elements 254A, 254B, and 254C are configured to receive user input to select an input audio device, an output audio device, or both, for audio associated with the display region 162B.
[0088] The particular types and arrangements of control elements in FIGS. 2A-2F are merely for illustration and are not limiting. Further, FIGS. 2B-2F illustrate examples of GUIs 210, 220, 230, 240, 250, respectively, configure to receive user input to specify a single type of parameter of the audio settings 142 of FIG. 1; however, in other embodiments, a GUI can include control elements to receive user input to control multiple types of parameters of the audio settings 142. For example, a single GUI can include control elements for any combination of volume parameters 150, audio routing parameters 152, and audio effect parameters 154, and optionally, other settings specific to a display region 162.
[0089] FIG. 3 depicts an implementation 300 of the device 102 as an integrated circuit 302 that includes the processor(s) 190, which include the UI manager 192, the audio controller 194, or both. The integrated circuit 302 also includes an input 304, such as one or more bus interfaces, to enable audio data 310 to be received for processing. The integrated circuit 302 also includes an output 306, such as a bus interface, to enable sending processed audio data 312. The processed audio data 312 may include audio data processed based on a display region in which an application window of an application associated with the audio data 310 is located. The integrated circuit 302 enables control of audio processing based on a display region of an application as a component in a system, such as a mobile phone or tablet as depicted in FIG. 4, a mixed reality or augmented reality glasses device as depicted in FIG. 5, a wearable electronic device as depicted in FIG. 6, a voice-controlled speaker system as depicted in FIG. 7, a camera as depicted in FIG. 8, a virtual reality, mixed reality, or augmented reality headset as depicted in FIG. 9, or a vehicle as depicted in FIG. 10 or FIG. 11.
[0090] FIG. 4 depicts an implementation 400 in which the device 102 includes a mobile device 402, such as a phone or tablet, as illustrative, non-limiting examples. The mobile device 402 is illustrated in two views in which a first view 430 and a second view 440 are rotated 180 degrees relative to one another (e.g., the first view 430 illustrates the back of the mobile device 402 from the perspective illustrated in the second view 440, and vice versa).
[0091] In the example illustrated in FIG. 4, the mobile device 402 includes two sections 410, 412 that are foldable via a hinge 420. The mobile device 402 of FIG. 4 includes multiple display screens 404 (e.g., a display screen 404A, a display screen 404B, and a display screen 404C), the configuration of which can be changed depending on the position of the sections 410, 412 about the hinge 420. In some embodiments, the mobile device 402 includes one or more additional display screens (such as one or more display screens on surface 442). In other examples, the mobile device 402 is not foldable or is foldable in a different manner than illustrated in FIG. 4.
[0092] In the embodiment illustrated in FIG. 4, each of the sections 410, 412 of the mobile device 402 includes one or more microphones. For example, the section 410 in FIG. 4 includes a microphone 406 A, and the section 412 includes a microphone 406B, a microphone 406C, and a microphone 406D. Further, in FIG. 4, each of the sections 410, 412 of the mobile device 402 includes one or more speakers. For example, the section 410 in FIG. 4 includes a speaker 408 A, and the section 412 includes a speaker 408B, and a speaker 408C. In other embodiments, the mobile device 402 includes more or fewer speakers 408 and / or more or fewer microphones 406. Additionally, or alternatively, the speakers 408, the microphones 406, or both, can be arranged differently than illustrated. In some embodiments, each of the microphones 406 and each of the speakers 408 corresponds to a respective one of the audio devices 112 of FIG. 1. In some embodiments, two or more of the microphones 406 together correspond to a single one of the audio devices 112 of FIG. 1. To illustrate, two microphones 406 can form a microphone array that represents a single audio device 112 in FIG. 1. In some embodiments, two or more of the speakers 408 together correspond to a single one of the audio devices 112 of FIG. 1. To illustrate, two speakers 408 can form a speaker array that represents a single audio device 112 in FIG. 1.
[0093] The mobile device 402 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region associated with the application. In some embodiments, each of the display screens 404 of the mobile device 402 corresponds to one of the display regions 162 of FIG. 1. In other embodiments, one or more of the display screens 404 can be divided into more than one display region 162. Further, insome embodiments, the number and arrangement of display regions 162 of the mobile device 402 depends on the relative positions of the sections 410, 412 about the hinge 420. To illustrate, when the mobile device 402 is folded in a first manner (e.g., partially closed), the display screens 404 are divided into a first count of display regions, when the mobile device 402 is folded in a second manner (e.g., fully open), the display screens 404 are divided into a second count of display regions, and when the mobile device 402 is folded in a third manner (e.g., fully closed), the display screens 404 are divided into a third count of display regions.
[0094] In the same or different embodiments, the number and arrangement of display regions 162 of the mobile device 402 depends on an orientation of the mobile device 402. To illustrate, when the mobile device 402 is oriented as illustrated in FIG. 4 (e.g., with a hinge line of the hinge 420 vertical or near vertical), the display screens 404 are divided into a first count of display regions, and when the mobile device 402 is rotated 90 degrees from the orientation illustrated in FIG. 4 (e.g., such that the hinge line is horizontal or near horizontal), the display screens 404 are divided into a second count of display regions different from the first count of display regions. Further, the specific number and arrangement of display regions 162 in any or all of the above-described embodiments can be user configurable.
[0095] Inclusion of the processor(s) 190 (and components thereof) in the mobile device 402 improves user experience by enabling intuitive control of audio, especially when a user is taking advantage of the multiple display screens 404 by using multiple applications (e.g., multitasking). For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display screen 404A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display screen 404B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by switching the display screens on which the application windows are displayed. To illustrate, the user can select the first application window and swipe toward the second display region to move the first application window to the second display region and thereby to assign audio settings associatedwith the second display region to the first application. In this illustrative example, the mobile device 402 can automatically move the second application window to the first display region in response to the user moving the first application window. Thus, using an intuitive select and swipe operation the user can change audio settings associated with both applications.
[0096] As one specific example, first audio settings associated with the display screen 404A can indicate a low volume level or a muted volume level, and second audio settings associated with the display screen 404B can indicate a higher volume level. In this example, if the user is using a first application to watch a video on the display screen 404B and receives notification of a request to initiate a communication session (e.g., an incoming call or video call), the user can accept the request to cause an application window associated with a communication application (e.g., a phone application or a video call application) to open in the display screen 404B. In this example, the first application is moved to the display screen 404A to mute or reduce the volume level associated with the video.
[0097] As another specific example, first audio settings associated with the display screen 404A can indicate a reduced or muted volume level for audio from all of the microphones 406, and second audio settings associated with the display screen 404B can indicate a higher volume level for at least a subset of the microphones 406. In this example, if the user is using a communication application (e.g., a phone application or a video call application) to conduct a communication session, the user can position an application window for the communication application in the display screen 404A to mute near-end audio. Subsequently, when the user needs to make a comment, the user can move the application window to the display screen 404B to set an appropriate nonmuted audio volume level for the near-end audio and make the desired comment. The user can then move the application window back to the display screen 404A to mute near-end audio. In addition to providing a simple and intuitive interaction to modify the audio settings in this example, the location of the application window in the display screens 404 also provides useful feedback to the user to help the user track whether the near-end audio is muted or not.
[0098] FIG. 5 depicts an implementation 500 in which the device 102 includes a portable electronic device that corresponds to augmented reality or mixed reality glasses 502. In the example illustrated in FIG. 5, the glasses 502 include one or more microphones 508 and one or more speakers 510. In some examples, the glasses 502 include a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the glasses 502.
[0099] The glasses 502 include one or more holographic projection units 504 configured to project visual data onto surfaces of one or more lenses 506 or to reflect the visual data off of the surface(s) of the lenses 506 and onto the wearer’s retina. Thus, one or both of the lenses 506 is used as a display that can be divided into one or more of the display regions 162 of FIG. 1.
[0100] The glasses 502 also include the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region associated with an application. In some embodiments, each of the lenses 506 of the glasses 502 corresponds to one of the display regions 162 of FIG. 1. In other embodiments, each of the lenses 506 can include more than one display region 156. In other embodiments, only one of the lenses (e.g., lens 506A or lens 506B) is associated with a holographic projection unit 504 and is used as a display including one or more display regions 156. The specific number and arrangement of the display regions 156 can be user configurable or preconfigured.
[0101] Including the processor(s) 190 (and components thereof) in the glasses 502 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the lens 506A), and a second application window associated with a second application can be displayed in a second display region (e.g., the lens 506B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by switching the display screens on which the application windows are displayed. The user can also readilydetermine which application is associated with particular audio settings, such as which application, if any, is being provided audio captured by the microphone(s) 508 or which application is the source for audio being played out at the speaker(s) 510.
[0102] FIG. 6 depicts an implementation 600 in which the device 102 includes a wearable electronic device 602, illustrated as a "smart watch." In the example illustrated in FIG. 6, the wearable electronic device 602 includes one or more microphones 608 and one or more speakers 610. In some examples, the wearable electronic device 602 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the wearable electronic device 602.
[0103] In FIG. 6, the wearable electronic device 602 includes one or more displays 604. The display(s) 604 correspond to examples of the display(s) 160 of FIG. 1. The wearable electronic device 602 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 606 associated with an application. In FIG. 6, the display(s) 604 are illustrated as divided into two display regions 606, including a display region 606A and a display region 606B; however, the specific number and arrangement of the display regions 606 can be different in different embodiments, and in some embodiments can be user configurable.
[0104] Including the processor(s) 190 (and components thereof) in the wearable electronic device 602 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 606A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 606B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 606 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is beingprovided audio captured by the microphone(s) 608 or which application is the source for audio being played out at the speaker(s) 610.
[0105] FIG. 7 is an implementation 700 in which the device 102 includes a wireless speaker and voice activated device 702. In the example illustrated in FIG. 7, the wireless speaker and voice activated device 702 includes one or more microphones 708 and one or more speakers 710. In some examples, the wireless speaker and voice activated device 702 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the wireless speaker and voice activated device 702.
[0106] In FIG. 7, the wireless speaker and voice activated device 702 includes one or more displays 704. The display(s) 704 correspond to examples of the display(s) 160 of FIG. 1. The wireless speaker and voice activated device 702 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 706 associated with an application. In FIG. 7, the display(s) 704 are illustrated as divided into four display regions 706, including a display region 706A, a display region 706B, a display region 706C, and a display region 706D; however, the specific number and arrangement of the display regions 706 can be different in different embodiments, and in some embodiments can be user configurable.
[0107] Including the processor(s) 190 (and components thereof) in the wireless speaker and voice activated device 702 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 706A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 706B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 706 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is beingprovided audio captured by the microphone(s) 708 or which application is the source for audio being played out at the speaker(s) 710.
[0108] FIG. 8 depicts an implementation 800 in which the device 102 includes a portable electronic device that corresponds to a camera device 802. In some embodiments, the camera device 802 includes one or more microphones and one or more speakers (e.g., on a front side, opposite the side illustrated in FIG. 8). In some examples, the camera device 802 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the camera device 802.
[0109] In FIG. 8, the camera device 802 includes one or more displays 804, such as a display 804A and a display 804B. The display(s) 804 correspond to examples of the display(s) 160 of FIG. 1. The camera device 802 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 806 associated with an application. In FIG. 8, the display(s) 804 are illustrated as divided into three display regions 806, including a display region 806A, a display region 806B, and a display region 806C; however, the specific number and arrangement of the display regions 806 can be different in different embodiments, and in some embodiments can be user configurable.
[0110] Including the processor(s) 190 (and components thereof) in the camera device 802 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 806A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 806C). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 806 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is being provided audio captured by microphone(s) of the cameradevice 802 or which application is the source for audio being played out at speaker(s) of the camera device 802.[OHl] FIG. 9 depicts an implementation 900 in which the device 102 includes a portable electronic device that corresponds to a virtual reality, mixed reality, or augmented reality headset 902. In the example illustrated in FIG. 9, the headset 902 includes one or more microphones 908 and one or more speakers 910. In some examples, the headset 902 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the headset 902.
[0112] In FIG. 9, the headset 902 includes one or more displays 904 (illustrated in dashed lines to indicate components that are not visible in the perspective illustrated). The display(s) 904 correspond to examples of the display(s) 160 of FIG. 1. The headset 902 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 906 associated with an application. In FIG. 9, the display(s) 904 are illustrated as divided into two display regions 906, including a display region 906A and a display region 906B; however, the specific number and arrangement of the display regions 906 can be different in different embodiments, and in some embodiments can be user configurable.
[0113] Including the processor(s) 190 (and components thereof) in the headset 902 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 906A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 906B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 906 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as whichapplication, if any, is being provided audio captured by the microphone(s) 908 or which application is the source for audio being played out at the speaker(s) 910.
[0114] FIG. 10 depicts an implementation 1000 in which the device 102 corresponds to, or is integrated within, a vehicle 1002, illustrated as a manned or unmanned aerial device (e.g., a package delivery drone). In the example illustrated in FIG. 10, the vehicle 1002 includes one or more microphones 1008 and one or more speakers 1010. In some examples, the vehicle 1002 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from the vehicle 1002.
[0115] In FIG. 10, the vehicle 1002 includes one or more displays 1004. The display(s) 1004 correspond to examples of the display(s) 160 of FIG. 1. The vehicle 1002 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 1006 associated with an application. In FIG. 10, the display(s) 1004 are illustrated as divided into two display regions 1006, including a display region 1006A and a display region 1006B; however, the specific number and arrangement of the display regions 1006 can be different in different embodiments, and in some embodiments can be user configurable.
[0116] Including the processor(s) 190 (and components thereof) in the vehicle 1002 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 1006A), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 1006B). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 1006 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is being provided audio captured by the microphone(s) 1008 or which application is the source for audio being played out at the speaker(s) 1010.
[0117] FIG. 11 depicts another implementation 1100 in which the device 102 corresponds to, or is integrated within, a vehicle 1102, illustrated as a car. In the example illustrated in FIG. 11, the vehicle 1102 includes one or more microphones 1108 and one or more speakers 1110 (including a speaker 1110A and a speaker 1 HOB). In some examples, the vehicle 1102 includes a modem (e.g., the modem 170 of FIG. 1) to enable a wireless connection to one or more audio devices (e.g., earbuds that include microphones, speakers, or both) separate from or within the vehicle 1102.
[0118] In FIG. 11, the vehicle 1102 includes one or more displays 1104. For example, in FIG. 11, the display(s) 1104 include a display 1104A in a dashboard of the vehicle 1102. Additionally, or alternatively, as illustrated in FIG. 11, the display(s) 1104 can include a display 1104B projected onto a windshield of the vehicle 1102 by a projector 1112. The display(s) 1104 correspond to examples of the display(s) 160 of FIG. 1.
[0119] The vehicle 1102 also includes the processor(s) 190 of FIG. 1, which include the UI manager 192, the audio controller 194, or both, to enable control of audio for an application based on a display region 1106 associated with an application. In FIG. 11, the display(s) 1104 are illustrated as divided into a total of four display regions 1106, including a display region 1106A, a display region 1106B, a display region 1106C, and a display region 1106D; however, the specific number and arrangement of the display regions 1106 can be different in different embodiments, and in some embodiments can be user configurable.
[0120] Including the processor(s) 190 (and components thereof) in the vehicle 1102 improves user experience by enabling intuitive control of audio. For example, a first application window associated with a first application can be displayed in a first display region (e.g., the display region 1106C), and a second application window associated with a second application can be displayed in a second display region (e.g., the display region 1106A). In this example, audio for each application is controlled based on the location of the application window for the application. Thus, the user can quickly and intuitively change the audio settings associated with both applications by changing the display region 1106 of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such aswhich application, if any, is being provided audio captured by the microphone(s) 1108 or which application is the source for audio being played out at the speaker(s) 1110.
[0121] Referring to FIG. 12, a particular implementation of a method 1200 of controlling audio processing based on a display region associated with an application is shown. In a particular aspect, one or more operations of the method 1200 are performed by the UI manager 192, the audio controller 194, the processor(s) 190, the device 102, the system 100 of FIG. 1, or a combination thereof.
[0122] The method 1200 includes, at block 1202, obtaining a display region identifier indicating a display region for a first application. For example, the audio controller 194 of FIG. 1 can obtain a display region ID 104 indicating a display region 162 for a first application 130A from the memory 120 or from the UI manager 192.
[0123] The method 1200 includes, at block 1204, obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application. For example, the audio controller 194 of FIG. 1 can obtain the volume parameter(s) 150 for the audio data 114 associated with the first application 130A based on the display region ID 104 associated with the first application 130A and the mapping data 140.
[0124] The method 1200 includes, at block 1206, processing the audio data associated with the first application using the volume parameter. For example, the audio controller 194 of FIG. 1 can process the audio data 114 associated with the first application 130A based on the volume parameter(s) 150 of the audio settings 142 associated with the display region ID 104 of the first application 130.
[0125] In some embodiments, the method 1200 also includes, based on relocation of the first application from the display region to a second display region, obtaining a second display region identifier; obtaining, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and processing the audio data associated with the first application using the second volume parameter. For example, referring to FIG. 1, in response to determining that an application window 164 A associated with the first application 130A has movedfrom the display region 162A to the display region 162B, the UI manager 192 can update the display region ID 104 associated with the first application 130A (e.g., from the display region ID 104A to the display region ID 104B). The audio controller 194 can obtain the updated display region ID (e.g., the display region ID 104B) for the first application 130A from the UI manager 192 or from the memory 120 and can look up the audio settings 142B associated with the display region ID 104B in the mapping data 140. After obtaining the audio settings 142B, the audio controller 194 can process the audio data 114 associated with the first application 130A using the audio settings 142B, which can include second volume parameter(s). To illustrate, the first application includes a communication application. In this illustrative example, the UI manager 192 can automatically relocate the first application 130 to the second display region 162B responsive to a request to initiate a communication session. Relocating the first application 130 to the second display region 162B causes the second audio settings 142B to be applied to the audio data 114 associated with the first application 130.
[0126] In some embodiments, the method 1200 also includes obtaining, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and processing the audio data associated with the first application using the audio effect parameter. To illustrate, referring to FIG. 1, in addition to the volume parameter(s) 150, the audio settings 142 associated with a display region ID 104 can include audio effect parameter(s) 154. For example, the audio effect parameter(s) 154 can indicate one or more equalizer settings to be applied to the audio data 114 associated with an application 130 based on the display region ID 104 associated with the application 130. As another example, the audio effect parameter(s) 154 can indicate an audio mode for processing the audio data 114 associated with the application 130 based on the display region ID 104 associated with the application 130. As another example, the audio effect parameter(s) 154 can indicate one or more filtering operations to be applied to the audio data 114 associated with the application 130 based on the display region ID 104 associated with the application 130.
[0127] In some embodiments, the mapping data associates audio routing parameters with the display regions. For example, the audio settings 142 of FIG. 1 associated with a particular display region ID 104 can include audio routing parameters 152. In some suchembodiments, the method 1200 also includes routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier. The audio routing parameter can identify one or more audio output devices associated with the display region identifier, one or more audio input devices associated with the display region identifier, or both.
[0128] In some embodiments, the method 1200 includes generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements. To illustrate, the user interface can display the first control elements in the first display region and the second control elements in the second display region. For example, the user interface can include any of the GUIs 200, 210, 220, 230, 240, or 250 of FIGS. 2A-2F, each of which includes control elements associated with a respective display region. The control elements for a particular display region in the GUIs 200, 210, 220, 230, 240, 250 can be used to specify particular audio settings, such as volume parameters, audio effect parameters, or audio routing parameters, which are used to update the corresponding audio settings 142 of the mapping data 140 of FIG. 1.
[0129] In some embodiments, the method 1200 also includes, based on initiation of the first application, obtaining the display region identifier for the first application based on application preference data that indicates start-up parameters for each of one or more applications. For example, the display region ID 104A for the first application 130A can be indicated in user-specified start-up parameters or other metadata for the first application 130 A.
[0130] In some embodiments, the method 1200 also includes obtaining a second display region identifier indicating a second display region for a second application; obtaining, based on the second display region identifier and the mapping data, a second volume parameter for second audio data associated with the second application; and processing the second audio data associated with the second application using the second volumeparameter. Optionally, in some such embodiments, the method 1200 can include concurrently outputting the audio data and the second audio data. In some such implementations, the method 1200 includes receiving user volume control input; and based on the user volume control input, selectively, based on control mapping data, modifying an output volume of the audio data, the second audio data, or both. For example, in FIG. 1, the mapping data 140 indicates that the display region ID 104A is associated with the first audio settings 142A and both the display region ID 104B and the display region ID 104H are associated with the second audio settings 142B. Thus, if the user volume control input modifies the first audio settings 142 A, only the audio data 114 associated with an application assigned to the display region ID 104A is affected. However, if the user volume control input modifies the second audio settings 142B, the audio data 114 associated with an application assigned to the display region ID 104B and an application assigned to the display region ID 104H, if any, are both affected.
[0131] In some embodiments, the method 1200 also includes obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application. The priority parameters can be assigned to the applications or can be based on operations performed by the applications. To illustrate, the method 1220 can include obtaining the first priority parameter associated with the first application based on an operation being performed by the first application. In embodiments in which the priority parameters depend on operations being performed, the method 1200 can include, based on a change of the operation being performed by the first application, obtaining an updated first priority parameter associated with the first application; performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determining one or more updated display regions associated with one or more applications based on the comparison; and processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0132] The method 1200 improves user experience by enabling intuitive control of audio. For example, the user can quickly and intuitively change the audio settingsassociated with one or more applications by changing the display region of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is being provided near-end audio or which application is the source for audio being played out at an audio device.
[0133] The method 1200 of FIG. 12 may be implemented by a field-programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a processing unit such as a central processing unit (CPU), a DSP, a controller, another hardware device, firmware device, or any combination thereof. As an example, the method 1200 of FIG. 12 may be performed by a processor that executes instructions, such as described with reference to FIG. 14.
[0134] Referring to FIG. 13, a particular implementation of a method 1300 of controlling audio processing based on a display region associated with an application is shown. In a particular aspect, one or more operations of the method 1300 are performed by the UI manager 192, the audio controller 194, the processor(s) 190, the device 102, the system 100 of FIG. 1, or a combination thereof.
[0135] The method 1300 includes, at block 1302, obtaining a display region identifier indicating a display region for a first application. For example, the audio controller 194 of FIG. 1 can obtain a display region ID 104 indicating a display region 162 for a first application 130A from the memory 120 or from the UI manager 192.
[0136] The method 1300 includes, at block 1304, obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application. For example, the audio controller 194 of FIG. 1 can obtain the audio effect param eter(s) 154 for the audio data 114 associated with the first application 130A based on the display region ID 104 associated with the first application 130A and the mapping data 140. In some embodiments, the audio effect parameter(s) 154 indicate one or more equalizer settings to be applied to the audio data 114 associated with an application 130 based on the display region ID 104 associated with the application 130. In the same or different embodiments, the audio effect parameter(s) 154 indicate an audio mode for processingthe audio data 114 associated with the application 130 based on the display region ID 104 associated with the application 130. In the same or different embodiments, the audio effect parameter(s) 154 can indicate one or more filtering operations to be applied to the audio data 114 associated with the application 130 based on the display region ID 104 associated with the application 130.
[0137] The method 1300 includes, at block 1306, processing the audio data associated with the first application using the audio effect parameter. For example, the audio controller 194 of FIG. 1 can process the audio data 114 associated with the first application 130A based on the audio effect param eter(s) 154 of the audio settings 142 associated with the display region ID 104 of the first application 130.
[0138] In some embodiments, the method 1300 also includes, based on relocation of the first application from the display region to a second display region, obtaining a second display region identifier; obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; and processing the audio data associated with the first application using the second audio effect parameter. For example, referring to FIG. 1, in response to determining that an application window 164 A associated with the first application 130A has moved from the display region 162A to the display region 162B, the UI manager 192 can update the display region ID 104 associated with the first application 130A (e.g., from the display region ID 104A to the display region ID 104B). The audio controller 194 can obtain the updated display region ID (e.g., the display region ID 104B) for the first application 130A from the UI manager 192 or from the memory 120 and can look up the audio settings 142B associated with the display region ID 104B in the mapping data 140. After obtaining the audio settings 142B, the audio controller 194 can process the audio data 114 associated with the first application 130A using the audio settings 142B, which can include second audio effect parameter(s). To illustrate, the first application includes a communication application. In this illustrative example, the UI manager 192 can automatically relocate the first application 130 to the second display region 162B responsive to a request to initiate a communication session.Relocating the first application 130 to the second display region 162B causes the secondaudio settings 142B to be applied to the audio data 114 associated with the first application 130.
[0139] In some embodiments, the method 1300 also includes obtaining, based on the display region identifier and the mapping data, a volume parameter for the audio data associated with the first application; and processing the audio data associated with the first application using the volume parameter. For example, the audio settings 142 of FIG. 1 associated with a particular display region ID 104 can include volume parameter(s) 150, which can be used, along with the audio effect parameter(s) 154 to process the audio data 114 for a particular application 130 based on a display region ID 104 associated with the application 130.
[0140] In some embodiments, the mapping data associates audio routing parameters with the display regions. For example, the audio settings 142 of FIG. 1 associated with a particular display region ID 104 can include audio routing parameters 152. In some such embodiments, the method 1300 also includes routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier. The audio routing parameter can identify one or more audio output devices associated with the display region identifier, one or more audio input devices associated with the display region identifier, or both.
[0141] In some embodiments, the method 1300 includes generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements. To illustrate, the user interface can display the first control elements in the first display region and the second control elements in the second display region. For example, the user interface can include any of the GUIs 200, 210, 220, 230, 240, or 250 of FIGS. 2A-2F, each of which includes control elements associated with a respective display region. The control elements for a particular display region in the GUIs 200, 210, 220, 230, 240, 250 can be used to specify particular audio settings, such as volumeparameters, audio effect parameters, or audio routing parameters, which are used to update the corresponding audio settings 142 of the mapping data 140 of FIG. 1.
[0142] In some embodiments, the method 1300 also includes, based on initiation of the first application, obtaining the display region identifier for the first application based on application preference data that indicates start-up parameters for each of one or more applications. For example, the display region ID 104A for the first application 130A can be indicated in user-specified start-up parameters or other metadata for the first application 130A.
[0143] In some embodiments, the method 1300 also includes obtaining a second display region identifier indicating a second display region for a second application; obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter for second audio data associated with the second application; and processing the second audio data associated with the second application using the second audio effect parameter.
[0144] In some embodiments, the method 1300 also includes obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application. The priority parameters can be assigned to the applications or can be based on operations performed by the applications. To illustrate, the method 1320 can include obtaining the first priority parameter associated with the first application based on an operation being performed by the first application. In embodiments in which the priority parameters depend on operations being performed, the method 1300 can include, based on a change of the operation being performed by the first application, obtaining an updated first priority parameter associated with the first application; performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determining one or more updated display regions associated with one or more applications based on the comparison; and processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0145] The method 1300 improves user experience by enabling intuitive control of audio. For example, the user can quickly and intuitively change the audio settings associated with one or more applications by changing the display region of one or more of the application windows. The user can also readily determine which application is associated with particular audio settings, such as which application, if any, is being provided near-end audio or which application is the source for audio being played out at an audio device.
[0146] The method 1300 of FIG. 13 may be implemented by a field-programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a processing unit such as a central processing unit (CPU), a DSP, a controller, another hardware device, firmware device, or any combination thereof. As an example, the method 1300 of FIG. 13 may be performed by a processor that executes instructions, such as described with reference to FIG. 14.
[0147] Referring to FIG. 14, a block diagram of a particular illustrative implementation of a device is depicted and generally designated 1400. In various implementations, the device 1400 may have more or fewer components than illustrated in FIG. 14. In an illustrative implementation, the device 1400 may correspond to the device 102. In an illustrative implementation, the device 1400 may perform one or more operations described with reference to FIGS. 1-13.
[0148] In a particular implementation, the device 1400 includes a processor 1406 (e.g., a central processing unit (CPU)). The device 1400 may include one or more additional processors 1410 (e.g., one or more DSPs). In a particular aspect, the processor(s) 190 of FIG. 1 corresponds to the processor 1406, the processors 1410, or a combination thereof. The processors 1410 may include a speech and music coder-decoder (CODEC) 1408 that includes a voice coder ("vocoder ") encoder 1436, a vocoder decoder 1438, the UI manager 192, the audio controller 194, or a combination thereof.
[0149] The device 1400 may include the memory 120 and a CODEC 1434. The memory 120 may include instructions 1456, that are executable by the one or more additional processors 1410 (or the processor 1406) to implement the functionality described with reference to the UI manager 192, the audio controller 194, or both. Thememory 120 can also include the mapping data 140 indicating audio settings (e.g., the audio settings 142 of FIG. 1) associated with particular display regions (e.g., the display regions 104 of FIG. 1). The device 1400 may include the modem 170 coupled, via a transceiver 1450, to an antenna 1452.
[0150] The device 1400 may include a display controller 1426 coupled to one or more display(s) 1428. In some embodiments, the UI manager 192 is integrated with the display controller 1426.
[0151] The device 1400 includes a CODEC 1434, which in some embodiments, include or are included in the audio device interface(s) 110 of FIG. 1. The one or more audio devices 112 can be coupled to the CODEC 1434. For example, the audio device(s) 112 can include one or more speakers 1492, one or more microphones 1494, or both. The CODEC 1434 may include a digital-to-analog converter (DAC) 1402, an analog-to- digital converter (ADC) 1404, or both. In a particular embodiment, the CODEC 1434 may receive analog signals from one or more of the microphone(s) 1494, convert the analog signals to digital signals using the analog-to-digital converter 1404, and provide the digital signals to the speech and music codec 1408. The speech and music codec 1408 may process the digital signals, and the digital signals may further be processed by the audio controller 194 based on audio settings associated with a display region of an application as indicated by the mapping data 140. In a particular implementation, the speech and music codec 1408 may provide digital signals to the CODEC 1434. The CODEC 1434 may convert the digital signals to analog signals using the digital-to- analog converter 1402 and may provide the analog signals to one or more of the speaker(s) 1492.
[0152] In a particular embodiment, the device 1400 is included in a system-in-package or system-on-chip device 1422. In a particular embodiment, the memory 120, the processor 1406, the processors 1410, the display controller 1426, the CODEC 1434, and the modem 170 are included in the system-in-package or system-on-chip device 1422. In a particular embodiment, an input device 1430 and a power supply 1444 are coupled to the system-in-package or the system-on-chip device 1422. Moreover, in a particular implementation, as illustrated in FIG. 14, the display(s) 1428, the input device 1430, thespeaker(s) 1492, the microphone(s) 1494, the antenna 1452, and the power supply 1444 are external to the system-in-package or the system-on-chip device 1422. In a particular implementation, each of the display(s) 1428, the input device 1430, the speaker(s) 1492, the microphone(s) 1494, the antenna 1452, and the power supply 1444 may be coupled to a component of the system-in-package or the system-on-chip device 1422, such as an interface (e.g., the audio device interface(s) 110) or a controller.
[0153] The device 1400 may include a smart speaker, a speaker bar, a mobile communication device, a smart phone, a cellular phone, a laptop computer, a computer, a tablet, a personal digital assistant, a display device, a television, a gaming console, a music player, a radio, a digital video player, a digital video disc (DVD) player, a tuner, a camera, a navigation device, a vehicle, a headset, an augmented reality headset, a mixed reality headset, a virtual reality headset, an aerial vehicle, a home automation system, a voice-activated device, a wireless speaker and voice activated device, a portable electronic device, a car, a computing device, a communication device, an internet-of- things (loT) device, a virtual reality (VR) device, a base station, a mobile device, or any combination thereof.
[0154] In conjunction with the described implementations, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application. For example, the means for obtaining the display region identifier can correspond to the UI manager 192, the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in-package or the system-on-chip device 1422, one or more other circuits or components configured to obtain a display region identifier, or any combination thereof.
[0155] The apparatus also includes means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application. For example, the means for obtaining the volume parameter can correspond to the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in-package or the system-on-chipdevice 1422, one or more other circuits or components configured to obtain a volume parameter based on a display region identifier and mapping data, or any combination thereof.
[0156] The apparatus also includes means for processing the audio data associated with the first application using the volume parameter. For example, the means for processing the audio data associated with the first application using the volume parameter can correspond to the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in- package or the system-on-chip device 1422, one or more other circuits or components configured to process audio data using a volume parameter, or any combination thereof.
[0157] In conjunction with the described implementations, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application. For example, the means for obtaining the display region identifier can correspond to the UI manager 192, the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in-package or the system-on-chip device 1422, one or more other circuits or components configured to obtain a display region identifier, or any combination thereof.
[0158] The apparatus also includes means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application. For example, the means for obtaining the audio effect parameter can correspond to the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in-package or the system-on-chip device 1422, one or more other circuits or components configured to obtain an audio effect parameter based on a display region identifier and mapping data, or any combination thereof.
[0159] The apparatus also includes means for processing the audio data associated with the first application using the audio effect parameter. For example, the means for processing the audio data associated with the first application using the audio effectparameter can correspond to the audio controller 194, the processor(s) 190, the device 102, the system 100, the integrated circuit 302, the processor 1406, the processor(s) 1410, the system-in-package or the system-on-chip device 1422, one or more other circuits or components configured to process audio data using an audio effect parameter, or any combination thereof.
[0160] In some implementations, a non-transitory computer-readable medium (e.g., a computer-readable storage device, such as the memory 120) includes instructions (e.g., the instructions 1456) that, when executed by one or more processors (e.g., the processor(s) 1410, the processor 1406, or the processor(s) 190), cause the one or more processors to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
[0161] In some implementations, a non-transitory computer-readable medium (e.g., a computer-readable storage device, such as the memory 120) includes instructions (e.g., the instructions 1456) that, when executed by one or more processors (e.g., the processor(s) 1410, the processor 1406, or the processor(s) 190), cause the one or more processors to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
[0162] Particular aspects of the disclosure are described below in sets of interrelated Examples:
[0163] According to Example 1, a device includes a memory configured to store mapping data that associates audio settings with display regions and one or more processors configured to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and the mapping data, avolume parameter for audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
[0164] Example 2 includes the device of Example 1, wherein the one or more processors are configured to, based on relocation of the first application from the display region to a second display region, obtain a second display region identifier; obtain, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and process the audio data associated with the first application using the second volume parameter.
[0165] Example 3 includes the device of Example 1 or Example 2, wherein the first application includes a communication application, and wherein the one or more processors are configured to automatically relocate the first application to the second display region responsive to a request to initiate a communication session.
[0166] Example 4 includes the device of any of Examples 1 to 3, wherein the one or more processors are configured to obtain, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
[0167] Example 5 includes the device of Example 4, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0168] Example 6 includes the device of Example 4 or Example 5, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0169] Example 7 includes the device of any of Examples 4 to 6, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0170] Example 8 includes the device of any of Examples 1 to 7, wherein the mapping data further associates audio routing parameters with the display regions and the one ormore processors are configured to route the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0171] Example 9 includes the device of Example 8, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0172] Example 10 includes the device of Example 8 or Example 9, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0173] Example 11 includes the device of any of Examples 1 to 10, wherein the one or more processors are configured to generate a user interface including first control elements associated with a first display region and second control elements associated with a second display region; update a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and update a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0174] Example 12 includes the device of Example 11, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0175] Example 13 includes the device of any of Examples 1 to 12, wherein the memory is configured to store application preference data that indicates start-up parameters for each of one or more applications and the one or more processors are configured to, based on initiation of the first application, obtain the display region identifier for the first application based on the application preference data.
[0176] Example 14 includes the device of Example 13, wherein the display region identifier for the first application is indicated in the start-up parameters for the first application based on user input.
[0177] Example 15 includes the device of any of Examples 1 to 14, wherein the memory is configured to store application preference data that indicates priority parameters for each of one or more applications and the one or more processors are configured to obtain the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0178] Example 16 includes the device of Example 15, wherein the application preference data include conditional priority parameters for the first application, wherein the conditional priority parameters indicate priority values that are based on types of operations that the first application can perform, and wherein the one or more processors are configured to obtain the first priority parameter associated with the first application based on an operation being performed by the first application.
[0179] Example 17 includes the device of Example 16, wherein the one or more processors are configured to, based on a change of the operation being performed by the first application, obtain an updated first priority parameter associated with the first application; perform a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determine one or more updated display regions associated with one or more applications based on the comparison; and process audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0180] Example 18 includes the device of any of Examples 1 to 17, wherein the one or more processors are configured to obtain a second display region identifier indicating a second display region for a second application; obtain, based on the second display region identifier and the mapping data, a second volume parameter for second audio data associated with the second application; process the second audio data associated with the second application using the second volume parameter; and concurrently output the audio data and the second audio data.
[0181] Example 19 includes the device of Example 18 and further includes an interface coupled to the one or more processors and configured to receive user volume controlinput, wherein the one or more processors are configured to, based on the user volume control input, selectively, based on control mapping data, modify an output volume of the audio data, the second audio data, or both.
[0182] Example 20 includes the device of any of Examples 1 to 19 and further includes a modem communicatively coupled to the one or more processors and configured to receive one or more signals from a remote device and to provide the audio data associated with the first application based on the one or more signals.
[0183] Example 21 includes the device of any of Examples 1 to 20, wherein the one or more processors are integrated in at least one of a vehicle, a mobile phone, a tablet computer device, a wearable electronic device, a camera device, a virtual reality headset, a mixed reality headset, or an augmented reality headset.
[0184] According to Example 22, a method includes obtaining a display region identifier indicating a display region for a first application; obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application; and processing the audio data associated with the first application using the volume parameter.
[0185] Example 23 includes the method of Example 22 and further includes based on relocation of the first application from the display region to a second display region, obtaining a second display region identifier; obtaining, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and processing the audio data associated with the first application using the second volume parameter.
[0186] Example 24 includes the method of Example 22 or Example 23, wherein the first application includes a communication application, and further comprising automatically relocating the first application to the second display region responsive to a request to initiate a communication session.
[0187] Example 25 includes the method of any of Examples 22 to 24 and further includes obtaining, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and processing the audio data associated with the first application using the audio effect parameter.
[0188] Example 26 includes the method of Example 25, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0189] Example 27 includes the method of Example 25 or Example 26, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0190] Example 28 includes the method of any of Examples 25 to 27, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0191] Example 29 includes the method of any of Examples 22 to 28, wherein the mapping data further associates audio routing parameters with the display regions and further comprising routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0192] Example 30 includes the method of Example 29, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0193] Example 31 includes the method of Example 29 or Example 30, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0194] Example 32 includes the method of any of Examples 22 to 31 and further includes generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; updating a portion of the mapping data associated with the first display regionresponsive to first input received via the first control elements; and updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0195] Example 33 includes the method of Example 32, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0196] Example 34 includes the method of any of Examples 22 to 33 and further includes, based on initiation of the first application, obtaining the display region identifier for the first application based on application preference data that indicates start-up parameters for each of one or more applications.
[0197] Example 35 includes the method of Example 34, wherein the display region identifier for the first application is indicated in user-specified start-up parameters for the first application.
[0198] Example 36 includes the method of any of Examples 22 to 35 and further includes obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0199] Example 37 includes the method of Example 36 and further includes obtaining the first priority parameter associated with the first application based on an operation being performed by the first application.
[0200] Example 38 includes the method of Example 37 and further includes based on a change of the operation being performed by the first application, obtaining an updated first priority parameter associated with the first application; performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determining one or more updated display regions associated with one or more applications based on the comparison; and processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0201] Example 39 includes the method of any of Examples 22 to 38 and further includes obtaining a second display region identifier indicating a second display region for a second application; obtaining, based on the second display region identifier and the mapping data, a second volume parameter for second audio data associated with the second application; processing the second audio data associated with the second application using the second volume parameter; and concurrently outputting the audio data and the second audio data.
[0202] Example 40 includes the method of Example 39 and further includes receiving user volume control input; and based on the user volume control input, selectively, based on control mapping data, modifying an output volume of the audio data, the second audio data, or both.
[0203] According to Example 41, a non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
[0204] Example 42 includes the non-transitory computer-readable medium of Example 41, wherein the instructions are executable to cause the one or more processors to, based on relocation of the first application from the display region to a second display region, obtain a second display region identifier; obtain, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and process the audio data associated with the first application using the second volume parameter.
[0205] Example 43 includes the non-transitory computer-readable medium of Example 41 or Example 42, wherein the first application includes a communication application, and wherein the instructions are executable to cause the one or more processors to automatically relocate the first application to the second display region responsive to a request to initiate a communication session.
[0206] Example 44 includes the non-transitory computer-readable medium of any of Examples 41 to 43, wherein the instructions are executable to cause the one or more processors to obtain, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
[0207] Example 45 includes the non-transitory computer-readable medium of Example 44, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0208] Example 46 includes the non-transitory computer-readable medium of Example 44 or Example 45, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0209] Example 47 includes the non-transitory computer-readable medium of any of Examples 44 to 46, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0210] Example 48 includes the non-transitory computer-readable medium of any of Examples 41 to 47, wherein the mapping data further associates audio routing parameters with the display regions, and wherein the instructions are executable to cause the one or more processors to route the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0211] Example 49 includes the non-transitory computer-readable medium of Example 48, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0212] Example 50 includes the non-transitory computer-readable medium of Example 48 or Example 49, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0213] Example 51 includes the non-transitory computer-readable medium of any of Examples 41 to 50, wherein the instructions are executable to cause the one or more processors to generate a user interface including first control elements associated with a first display region and second control elements associated with a second display region; update a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and update a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0214] Example 52 includes the non-transitory computer-readable medium of Example 51, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0215] Example 53 includes the non-transitory computer-readable medium of any of Examples 41 to 52, wherein the instructions are executable to cause the one or more processors to, based on initiation of the first application, obtain the display region identifier for the first application based on application preference data.
[0216] Example 54 includes the non-transitory computer-readable medium of Example 53, wherein the display region identifier for the first application is indicated in user- specified start-up parameters for the first application.
[0217] Example 55 includes the non-transitory computer-readable medium of any of Examples 41 to 54, wherein the instructions are executable to cause the one or more processors to obtain the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0218] Example 56 includes the non-transitory computer-readable medium of Example55, wherein the instructions are executable to cause the one or more processors to obtain the first priority parameter associated with the first application based on an operation being performed by the first application.
[0219] Example 57 includes the non-transitory computer-readable medium of Example56, wherein the instructions are executable to cause the one or more processors to, based on a change of the operation being performed by the first application, obtain an updated first priority parameter associated with the first application; perform a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determine one or more updated display regions associated with one or more applications based on the comparison; and process audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0220] Example 58 includes the non-transitory computer-readable medium of any of Examples 41 to 57, wherein the instructions are executable to cause the one or more processors to obtain a second display region identifier indicating a second display region for a second application; obtain, based on the second display region identifier and the mapping data, a second volume parameter for second audio data associated with the second application; process the second audio data associated with the second application using the second volume parameter; and concurrently output the audio data and the second audio data.
[0221] Example 59 includes the non-transitory computer-readable medium of Example 58, wherein the instructions are executable to cause the one or more processors to receive user volume control input; and based on the user volume control input, selectively, based on control mapping data, modify an output volume of the audio data, the second audio data, or both.
[0222] According to Example 60, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application; means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the firstapplication; and means for processing the audio data associated with the first application using the volume parameter.
[0223] Example 61 includes the apparatus of Example 60 and further includes means for obtaining a second display region identifier based on relocation of the first application from the display region to a second display region, ; means for obtaining, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and means for processing the audio data associated with the first application using the second volume parameter.
[0224] Example 62 includes the apparatus of Example 60 or Example 61, wherein the first application includes a communication application, and further comprising means for relocating the first application to the second display region responsive to a request to initiate a communication session.
[0225] Example 63 includes the apparatus of any of Examples 60 to 62 and further includes means for obtaining, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and means for processing the audio data associated with the first application using the audio effect parameter.
[0226] Example 64 includes the apparatus of Example 63, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0227] Example 65 includes the apparatus of Example 63 or Example 64, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0228] Example 66 includes the apparatus of any of Examples 63 to 65, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0229] Example 67 includes the apparatus of any of Examples 60 to 66, wherein the mapping data further associates audio routing parameters with the display regions and further comprising means for routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0230] Example 68 includes the apparatus of Example 67, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0231] Example 69 includes the apparatus of Example 67 or Example 68, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0232] Example 70 includes the apparatus of any of Examples 60 to 69 and further includes means for generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; means for updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and means for updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0233] Example 71 includes the apparatus of Example 70, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0234] Example 72 includes the apparatus of any of Examples 60 to 71 and further includes means for obtaining the display region identifier for the first application, responsive to initiation of the first application, based on application preference data that indicates start-up parameters for each of one or more applications.
[0235] Example 73 includes the apparatus of Example 72, wherein the display region identifier for the first application is indicated in user-specified start-up parameters for the first application.
[0236] Example 74 includes the apparatus of any of Examples 60 to 73 and further includes means for obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0237] Example 75 includes the apparatus of Example 74 and further includes means for obtaining the first priority parameter associated with the first application based on an operation being performed by the first application.
[0238] Example 76 includes the apparatus of Example 75 and further includes means for obtaining, based on a change of the operation being performed by the first application, an updated first priority parameter associated with the first application; means for performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; means for obtaining one or more updated display regions associated with one or more applications based on the comparison; and means for processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0239] Example 77 includes the apparatus of any of Examples 60 to 76 and further includes means for obtaining a second display region identifier indicating a second display region for a second application; means for obtaining a second volume parameter for second audio data associated with the second application based on the second display region identifier and the mapping data; means for processing the second audio data associated with the second application using the second volume parameter; and means for concurrently outputting the audio data and the second audio data.
[0240] According to Example 78, a device includes a memory configured to store mapping data that associates audio settings with display regions; and one or more processors configured to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and the mapping data, an audio effect parameter for audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
[0241] Example 79 includes the device of Example 78, wherein the one or more processors are configured to, based on relocation of the first application from the display region to a second display region, obtain a second display region identifier; obtain, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; and process the audio data associated with the first application using the second audio effect parameter.
[0242] Example 80 includes the device of Example 78 or Example 79, wherein the first application includes a communication application, and wherein the one or more processors are configured to automatically relocate the first application to the second display region responsive to a request to initiate a communication session.
[0243] Example 81 includes the device of any of Examples 78 to 80, wherein the one or more processors are configured to obtain, based on the display region identifier and the mapping data, a volume parameter for the audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
[0244] Example 82 includes the device of any of Examples 78 to 81, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0245] Example 83 includes the device of any of Examples 78 to 82, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0246] Example 84 includes the device of any of Examples 78 to 83, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0247] Example 85 includes the device of any of Examples 78 to 84, wherein the mapping data further associates audio routing parameters with the display regions and the one or more processors are configured to route the audio data associated with thefirst application based on an audio routing parameter associated with the display region identifier.
[0248] Example 86 includes the device of Example 85, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0249] Example 87 includes the device of Example 85 or Example 86, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0250] Example 88 includes the device of any of Examples 78 to 87, wherein the one or more processors are configured to generate a user interface including first control elements associated with a first display region and second control elements associated with a second display region; update a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and update a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0251] Example 89 includes the device of Example 88, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0252] Example 90 includes the device of any of Examples 78 to 89, wherein the memory is configured to store application preference data that indicates start-up parameters for each of one or more applications and the one or more processors are configured to, based on initiation of the first application, obtain the display region identifier for the first application based on the application preference data.
[0253] Example 91 includes the device of Example 90, wherein the display region identifier for the first application is indicated in the start-up parameters for the first application based on user input.
[0254] Example 92 includes the device of any of Examples 78 to 91, wherein the memory is configured to store application preference data that indicates priorityparameters for each of one or more applications and the one or more processors are configured to obtain the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0255] Example 93 includes the device of Example 92, wherein the application preference data include conditional priority parameters for the first application, wherein the conditional priority parameters indicate priority values that are based on types of operations that the first application can perform, and wherein the one or more processors are configured to obtain the first priority parameter associated with the first application based on an operation being performed by the first application.
[0256] Example 94 includes the device of Example 93, wherein the one or more processors are configured to, based on a change of the operation being performed by the first application, obtain an updated first priority parameter associated with the first application; perform a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determine one or more updated display regions associated with one or more applications based on the comparison; and process audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0257] Example 95 includes the device of any of Examples 78 to 94, wherein the one or more processors are configured to obtain a second display region identifier indicating a second display region for a second application; obtain, based on the second display region identifier and the mapping data, a second audio effect parameter for second audio data associated with the second application; process the second audio data associated with the second application using the second audio effect parameter; and concurrently output the audio data and the second audio data.
[0258] Example 96 includes the device of Example 95 and further includes an interface coupled to the one or more processors and configured to receive user control input, wherein the one or more processors are configured to, based on the user control input,selectively, based on control mapping data, modify an output audio effect of the audio data, the second audio data, or both.
[0259] Example 97 includes the device of any of Examples 78 to 96 and further includes a modem communicatively coupled to the one or more processors and configured to receive one or more signals from a remote device and to provide the audio data associated with the first application based on the one or more signals.
[0260] Example 98 includes the device of any of Examples 78 to 97, wherein the one or more processors are integrated in at least one of a vehicle, a mobile phone, a tablet computer device, a wearable electronic device, a camera device, a virtual reality headset, a mixed reality headset, or an augmented reality headset.
[0261] According to Example 99, a method includes obtaining a display region identifier indicating a display region for a first application; obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and processing the audio data associated with the first application using the audio effect parameter.
[0262] Example 100 includes the method of Example 99 and further includes based on relocation of the first application from the display region to a second display region, obtaining a second display region identifier; obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; and processing the audio data associated with the first application using the second audio effect parameter.
[0263] Example 101 includes the method of Example 99 or Example 100, wherein the first application includes a communication application, and further comprising automatically relocating the first application to the second display region responsive to a request to initiate a communication session.
[0264] Example 102 includes the method of any of Examples 99 to 101 and further includes obtaining, based on the display region identifier and the mapping data, avolume parameter for the audio data associated with the first application; and processing the audio data associated with the first application using the volume parameter.
[0265] Example 103 includes the method of any of Examples 99 to 102, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0266] Example 104 includes the method of any of Examples 99 to 103, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0267] Example 105 includes the method of any of Examples 99 to 104, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0268] Example 106 includes the method of any of Examples 99 to 105, wherein the mapping data further associates audio routing parameters with the display regions and further comprising routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0269] Example 107 includes the method of Example 106, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0270] Example 108 includes the method of Example 106 or Example 107, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0271] Example 109 includes the method of any of Examples 99 to 108 and further includes generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0272] Example 110 includes the method of Example 109, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0273] Example 111 includes the method of any of Examples 99 to 110 and further includes, based on initiation of the first application, obtaining the display region identifier for the first application based on application preference data that indicates start-up parameters for each of one or more applications.
[0274] Example 112 includes the method of Example 111, wherein the display region identifier for the first application is indicated in user-specified start-up parameters for the first application.
[0275] Example 113 includes the method of any of Examples 99 to 112 and further includes obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0276] Example 114 includes the method of Example 113 and further includes obtaining the first priority parameter associated with the first application based on an operation being performed by the first application.
[0277] Example 115 includes the method of Example 114 and further includes based on a change of the operation being performed by the first application, obtaining an updated first priority parameter associated with the first application; performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; determining one or more updated display regions associated with one or more applications based on the comparison; and processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0278] Example 116 includes the method of any of Examples 99 to 115 and further includes obtaining a second display region identifier indicating a second display region for a second application; obtaining, based on the second display region identifier and themapping data, a second audio effect parameter for second audio data associated with the second application; processing the second audio data associated with the second application using the second audio effect parameter; and concurrently outputting the audio data and the second audio data.
[0279] Example 117 includes the method of Example 116 and further includes receiving user control input; and based on the user control input, selectively, based on control mapping data, modifying an output audio effect of the audio data, the second audio data, or both.
[0280] According to Example 118, a non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
[0281] Example 119 includes the non-transitory computer-readable medium of Example 118, wherein the instructions are executable to cause the one or more processors to, based on relocation of the first application from the display region to a second display region, obtain a second display region identifier; obtain, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; and process the audio data associated with the first application using the second audio effect parameter.
[0282] Example 120 includes the non-transitory computer-readable medium of Example 118 or Example 119, wherein the first application includes a communication application, and wherein the instructions are executable to cause the one or more processors to automatically relocate the first application to the second display region responsive to a request to initiate a communication session.
[0283] Example 121 includes the non-transitory computer-readable medium of any of Examples 118 to 120, wherein the instructions are executable to cause the one or moreprocessors to obtain, based on the display region identifier and the mapping data, a volume parameter for the audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
[0284] Example 122 includes the non-transitory computer-readable medium of any of Examples 118 to 121, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0285] Example 123 includes the non-transitory computer-readable medium of any of Examples 118 to 122, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0286] Example 124 includes the non-transitory computer-readable medium of any of Examples 118 to 123, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0287] Example 125 includes the non-transitory computer-readable medium of any of Examples 118 to 124, wherein the mapping data further associates audio routing parameters with the display regions, and wherein the instructions are executable to cause the one or more processors to route the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0288] Example 126 includes the non-transitory computer-readable medium of Example 125, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0289] Example 127 includes the non-transitory computer-readable medium of Example 125 or Example 126, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0290] Example 128 includes the non-transitory computer-readable medium of any of Examples 118 to 127, wherein the instructions are executable to cause the one or more processors to generate a user interface including first control elements associated with a first display region and second control elements associated with a second display region; update a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and update a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0291] Example 129 includes the non-transitory computer-readable medium of Example 128, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0292] Example 130 includes the non-transitory computer-readable medium of any of Examples 118 to 129, wherein the instructions are executable to cause the one or more processors to, based on initiation of the first application, obtain the display region identifier for the first application based on application preference data.
[0293] Example 131 includes the non-transitory computer-readable medium of Example 130, wherein the display region identifier for the first application is indicated in user- specified start-up parameters for the first application.
[0294] Example 132 includes the non-transitory computer-readable medium of any of Examples 118 to 131, wherein the instructions are executable to cause the one or more processors to obtain the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0295] Example 133 includes the non-transitory computer-readable medium of Example 132, wherein the instructions are executable to cause the one or more processors to obtain the first priority parameter associated with the first application based on an operation being performed by the first application.
[0296] Example 134 includes the non-transitory computer-readable medium of Example 133, wherein the instructions are executable to cause the one or more processors to, based on a change of the operation being performed by the first application, obtain an updated first priority parameter associated with the first application; perform a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; obtain one or more updated display regions associated with one or more applications based on the comparison; and process audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0297] Example 135 includes the non-transitory computer-readable medium of any of Examples 118 to 134, wherein the instructions are executable to cause the one or more processors to obtain a second display region identifier indicating a second display region for a second application; obtain, based on the second display region identifier and the mapping data, a second audio effect parameter for second audio data associated with the second application; process the second audio data associated with the second application using the second audio effect parameter; and concurrently output the audio data and the second audio data.
[0298] Example 136 includes the non-transitory computer-readable medium of Example 135, wherein the instructions are executable to cause the one or more processors to receive user control input; and based on the user control input, selectively, based on control mapping data, modify an output audio effect of the audio data, the second audio data, or both.
[0299] According to Example 137, an apparatus includes means for obtaining a display region identifier indicating a display region for a first application; means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and means for processing the audio data associated with the first application using the audio effect parameter.
[0300] Example 138 includes the apparatus of Example 137 and further includes means for obtaining a second display region identifier based on relocation of the firstapplication from the display region to a second display region; means for obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; and means for processing the audio data associated with the first application using the second audio effect parameter.
[0301] Example 139 includes the apparatus of Example 137 or Example 138, wherein the first application includes a communication application, and further comprising means for relocating the first application to the second display region responsive to a request to initiate a communication session.
[0302] Example 140 includes the apparatus of Example 137 or Example 139 and further includes means for obtaining, based on the display region identifier and the mapping data, a volume parameter for the audio data associated with the first application; and means for processing the audio data associated with the first application using the volume parameter.
[0303] Example 141 includes the apparatus of any of Examples 137 to 140, wherein the audio effect parameter indicates one or more equalizer settings to be applied to the audio data associated with the first application based on the display region identifier.
[0304] Example 142 includes the apparatus of any of Examples 137 to 141, wherein the audio effect parameter indicates an audio mode for processing the audio data associated with the first application based on the display region identifier.
[0305] Example 143 includes the apparatus of any of Examples 137 to 142, wherein the audio effect parameter indicates one or more filtering operations to be applied to the audio data associated with the first application based on the display region identifier.
[0306] Example 144 includes the apparatus of any of Examples 137 to 143, wherein the mapping data further associates audio routing parameters with the display regions and further comprising means for routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
[0307] Example 145 includes the apparatus of Example 144, wherein the audio routing parameter identifies one or more audio output devices associated with the display region identifier.
[0308] Example 146 includes the apparatus of any of Examples 144 or Example 145, wherein the audio routing parameter identifies one or more audio input devices associated with the display region identifier.
[0309] Example 147 includes the apparatus of any of Examples 137 to 146 and further includes means for generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; means for updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and means for updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
[0310] Example 148 includes the apparatus of Example 147, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
[0311] Example 149 includes the apparatus of any of Examples 137 to 148 and further includes means for obtaining the display region identifier for the first application, responsive to initiation of the first application, based on application preference data that indicates start-up parameters for each of one or more applications.
[0312] Example 150 includes the apparatus of Example 149, wherein the display region identifier for the first application is indicated in user-specified start-up parameters for the first application.
[0313] Example 151 includes the apparatus of any of Examples 137 to 150 and further includes means for obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
[0314] Example 152 includes the apparatus of Example 151 and further includes means for obtaining the first priority parameter associated with the first application based on an operation being performed by the first application.
[0315] Example 153 includes the apparatus of Example 152 and further includes means for obtaining, based on a change of the operation being performed by the first application, an updated first priority parameter associated with the first application; means for performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application associated with second audio data; means for determining one or more updated display regions associated with one or more applications based on the comparison; and means for processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
[0316] Example 154 includes the apparatus of any of Examples 137 to 153 and further includes means for obtaining a second display region identifier indicating a second display region for a second application; means for obtaining a second audio effect parameter for second audio data associated with the second application based on the second display region identifier and the mapping data; means for processing the second audio data associated with the second application using the second audio effect parameter; and means for concurrently outputting the audio data and the second audio data.
[0317] Those of skill would further appreciate that the various illustrative logical blocks, configurations, modules, circuits, and algorithm steps described in connection with the implementations disclosed herein may be implemented as electronic hardware, computer software executed by a processor, or combinations of both. Various illustrative components, blocks, configurations, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or processor executable instructions depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particularapplication, such implementation decisions are not to be interpreted as causing a departure from the scope of the present disclosure.
[0318] The steps of a method or algorithm described in connection with the implementations disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disk, a removable disk, a compact disc read-only memory (CD-ROM), or any other form of non-transient storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor may read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application-specific integrated circuit (ASIC). The ASIC may reside in a computing device or a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a computing device or user terminal.
[0319] The previous description of the disclosed aspects is provided to enable a person skilled in the art to make or use the disclosed aspects. Various modifications to these aspects will be readily apparent to those skilled in the art, and the principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope possible consistent with the principles and novel features as defined by the following claims.
Claims
WHAT IS CLAIMED IS:
1. A device comprising: a memory configured to store mapping data that associates audio settings with display regions; and one or more processors configured to: obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and the mapping data, a volume parameter for audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
2. The device of claim 1, wherein the one or more processors are configured to: based on relocation of the first application from the display region to a second display region, obtain a second display region identifier; obtain, based on the second display region identifier and the mapping data, a second volume parameter associated with the audio data of the first application; and process the audio data associated with the first application using the second volume parameter.
3. The device of claim 2, wherein the first application includes a communication application, and wherein the one or more processors are configured to automatically relocate the first application to the second display region responsive to a request to initiate a communication session.
4. The device of claim 1, wherein the one or more processors are configured to: obtain, based on the display region identifier and the mapping data, an audio effect parameter for the audio data associated with the first application; and process the audio data associated with the first application using the audio effect parameter.
5. The device of claim 4, wherein the audio effect parameter indicates an equalizer setting, an audio mode, a filtering operation, or a combination thereof, to be applied to the audio data associated with the first application based on the display region identifier.
6. The device of claim 1, wherein the mapping data further associates audio routing parameters with the display regions, and wherein the one or more processors are configured to route the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
7. The device of claim 1, wherein the one or more processors are configured to: generate a user interface including first control elements associated with a first display region and second control elements associated with a second display region; update a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and update a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
8. The device of claim 7, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
9. The device of claim 1, wherein the memory is configured to store application preference data that indicates start-up parameters for each of one or more applications, and wherein the one or more processors are configured to, based on initiation of the first application, obtain the display region identifier for the first application based on the application preference data.
10. The device of claim 1, wherein the memory is configured to store application preference data that indicates priority parameters for each of one or more applications, and wherein the one or more processors are configured to obtain the display region identifier for the first application based, in part, on a first priority parameter associatedwith the first application and a second priority parameter associated with a second application.
11. The device of claim 10, wherein the application preference data includes conditional priority parameters for the first application, wherein the conditional priority parameters indicate priorities based on types of operations that the first application can perform, and wherein the one or more processors are configured to obtain the first priority parameter associated with the first application based on an operation being performed by the first application.
12. The device of claim 11, wherein the one or more processors are configured to: based on a change of the operation being performed by the first application, obtain an updated first priority parameter associated with the first application; perform a comparison of the updated first priority parameter to the second priority parameter associated with the second application; determine one or more updated display regions associated with one or more applications based on the comparison; and process audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
13. The device of claim 1, wherein the one or more processors are configured to: obtain a second display region identifier indicating a second display region for a second application; obtain, based on the second display region identifier and the mapping data, a second volume parameter for second audio data associated with the second application; process the second audio data associated with the second application using the second volume parameter; and concurrently output the audio data and the second audio data.
14. The device of claim 13, further comprising an interface coupled to the one or more processors and configured to receive user volume control input, wherein the one or more processors are configured to, based on the user volume control input, selectively, basedon control mapping data, modify an output volume of the audio data, the second audio data, or both.
15. The device of claim 1, further comprising a modem communicatively coupled to the one or more processors and configured to receive one or more signals from a remote device and to provide the audio data associated with the first application based on the one or more signals.
16. The device of claim 1, wherein the one or more processors are integrated in at least one of a vehicle, a mobile phone, a tablet computer device, a wearable electronic device, a camera device, a virtual reality headset, a mixed reality headset, or an augmented reality headset.
17. The device of claim 1, further comprising: a display associated with the display regions; and one or more speakers configured to output sound corresponding to the processed audio data associated with the first application.
18. A method compri sing : obtaining a display region identifier indicating a display region for a first application; obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and processing the audio data associated with the first application using the audio effect parameter.
19. The method of claim 18, further comprising: based on relocation of the first application from the display region to a second display region, obtaining a second display region identifier; obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter associated with the audio data of the first application; andprocessing the audio data associated with the first application using the second audio effect parameter.
20. The method of claim 19, wherein the first application includes a communication application, and further comprising automatically relocating the first application to the second display region responsive to a request to initiate a communication session.
21. The method of claim 18, wherein the mapping data further associates audio routing parameters with the display regions and further comprising routing the audio data associated with the first application based on an audio routing parameter associated with the display region identifier.
22. The method of claim 18, further comprising: generating a user interface including first control elements associated with a first display region and second control elements associated with a second display region; updating a portion of the mapping data associated with the first display region responsive to first input received via the first control elements; and updating a portion of the mapping data associated with the second display region responsive to second input received via the second control elements.
23. The method of claim 22, wherein the user interface is configured to display the first control elements in the first display region and to display the second control elements in the second display region.
24. The method of claim 18, further comprising, based on initiation of the first application, obtaining the display region identifier for the first application based on application preference data that indicates start-up parameters for each of one or more applications.
25. The method of claim 18, further comprising obtaining the display region identifier for the first application based, in part, on a first priority parameter associated with the first application and a second priority parameter associated with a second application.
26. The method of claim 25, further comprising obtaining the first priority parameter associated with the first application based on an operation being performed by the first application.
27. The method of claim 26, further comprising: based on a change of the operation being performed by the first application, obtaining an updated first priority parameter associated with the first application; performing a comparison of the updated first priority parameter to the second priority parameter associated with the second application; determining one or more updated display regions associated with one or more applications based on the comparison; and processing audio data associated with the one or more applications based on the mapping data and the one or more updated display regions.
28. The method of claim 18, further comprising: obtaining a second display region identifier indicating a second display region for a second application; obtaining, based on the second display region identifier and the mapping data, a second audio effect parameter for second audio data associated with the second application; processing the second audio data associated with the second application using the second audio effect parameter; and concurrently outputting the audio data and the second audio data.
29. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to: obtain a display region identifier indicating a display region for a first application; obtain, based on the display region identifier and mapping data that associates audio settings with display regions, a volume parameter for audio data associated with the first application; and process the audio data associated with the first application using the volume parameter.
30. An apparatus comprising: means for obtaining a display region identifier indicating a display region for a first application; means for obtaining, based on the display region identifier and mapping data that associates audio settings with display regions, an audio effect parameter for audio data associated with the first application; and means for processing the audio data associated with the first application using the audio effect parameter.
Citation Information
Patent Citations
Method and device for audio management
US20180165059A1
Volume adjustment on hinged multi-screen device
US20180329672A1
Method for controlling audio output by application through earphones and electronic device implementing same
US20200186926A1