Systems and methods for increasing the volume of an audio output by a device

Abstract

First device, comprehensive: - at least one processor; - a microphone that at least one processor can access; and - a memory accessible to at least one processor and containing instructions executable by at least one processor, for: - Receiving input from the microphone; - Determine, based on the microphone input, whether a sound from a second device meets a sound criterion; and - in response to the determination, issuing an instruction to increase the volume of an audio output from a third device; - wherein the instructions are further executable by at least one processor to determine that a user is paying attention to the audio output through the third device, and the instruction is issued based on the determination that the user is paying attention to the audio output through the third device.

Description

BACKGROUND

[0001] When a user listens to audio output, such as a song or a television show, they naturally want to hear the audio clearly. However, as illustrated here, a user might either move to a location farther away from the device presenting the audio output but still want to hear it, or their ability to hear the audio output might be obstructed by noise generated by another device. There is currently no adequate solution to this computer-related technological problem.

[0002] From US patent 2017 / 0033753A1, a volume control method is known which includes: acquiring volume information from a first device; in response to the acquired volume information from the first device satisfying a predetermined condition, determining at least one second device; and controlling the volume of the at least one second device. SUMMARY

[0003] The object of the present invention is to provide an improved device, an improved method and an improved apparatus for increasing the volume of an audio output by a device.

[0004] This problem is solved by the subject matter of main claim 1 and the subject matter of dependent claims 11 and 16, which define the present invention.

[0005] Preferred embodiments of the present invention are the subject of the dependent claims.

[0006] The details of the present principles, both in terms of their structure and operation, can best be understood with reference to the accompanying drawings, in which similar reference symbols refer to similar parts, and in which: BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram of an example system according to the principles presented; Fig. 2 is a block diagram of an example network of devices according to the principles presented here; Fig. 3-5 example representations according to the principles presented here are shown; Fig. 6. A flowchart of an example algorithm according to the principles presented here is; and Fig. 7-9 examples of user interfaces (UIs) according to the principles presented here are shown. DETAILED DESCRIPTION

[0007] According to these principles, a user's personal device, such as a wearable or smartphone, can help coordinate sound output across multiple other devices. For example, if a user is listening to audio from a first device while wearing a smartwatch with its own microphone, the user can set an optimal volume for the first device's audio output. Then, as the user moves around, the volume of the first device's audio output can be increased or decreased based on the user's changing distance (determined by the wearable), so that the volume appears to the user as an optimal level in different locations.

[0008] If the user's portable device can hear sound from multiple devices, the portable device can decide, or the user can tell it, which device is focused on. Based on this, the portable device can increase the volume of the focused device and / or decrease the volume of the other devices.

[0009] If multiple people use their respective personal devices to listen to different audio outputs within the same environment at the same time, an acknowledgment monitoring or a precedent / priority can be set up for which audio to increase the volume and which audio to decrease the volume.

[0010] For example, if a user leaves an audio device in the user's kitchen and goes to the user's living room and turns on the television in the living room, the portable device can automatically decrease the volume of the kitchen device and / or increase the volume of the television when the user sits down in the living room.

[0011] In yet another example, if a father or mother is watching TV and their child's separate device is also outputting audio, the father's / mother's portable device can reduce the volume of the audio output from the child's device, based on the fact that the father / mother has a higher user priority.

[0012] In yet another example, a noisy device can pause when a user is listening to music or watching TV. Or, if the TV is already on and someone else starts a noisy dishwasher cycle, a device based on these principles can instruct the dishwasher to delay the start of the cycle until the TV is switched off.

[0013] With regard to any of the computer systems discussed herein, a system can comprise server and client components connected via a network, enabling the exchange of data between the client and server components. The client components can include one or more computing devices, such as televisions (e.g., smart TVs, internet-enabled TVs), computers like desktop computers, laptops, tablet computers, so-called convertible devices (which, for example, have both tablet and laptop configurations), and other mobile devices, including smartphones. These client devices can, as non-limiting examples, run operating systems from Apple, Google, or Microsoft. Unix or a similar operating system such as Linux can be used.These operating systems can use one or more browsers, including a browser from Microsoft, Google, or Mozilla, or another browser program that can access websites and web applications hosted by internet servers over a network such as the internet, a local intranet, or a virtual private network.

[0014] As used herein, instructions refer to computer-implemented steps for processing information within the system. Instructions can be implemented as software, firmware, or hardware, or combinations thereof, and include any type of programmed steps performed by components of the system; for this reason, explanatory components, blocks, modules, circuits, and steps are sometimes described in terms of their functionality.

[0015] A processor can be any conventional general-purpose processor with one or more chips, capable of executing logic using various lines such as address lines, data lines, control lines, registers, and shift registers. Furthermore, any logic blocks, modules, and circuits described herein, in addition to a general-purpose processor, can be used or implemented in or by a digital signal processor (DSP), a field-programmable gate array (FPGA), or any other programmable logic device such as an application-specific integrated circuit (ASIC), discrete gate or transistor logic, discrete hardware components, or a combination thereof, configured to perform the functions described herein. A processor can be implemented by a control or state machine, or by a combination of computer devices.

[0016] Software modules and / or applications, which can be described by means of flowcharts and / or user interfaces, may comprise various subroutines, procedures, etc. Without limiting the disclosure, a defined logic may be executed by a particular module, which may be distributed across other software modules, combined into a single module, and / or available in a shared library.

[0017] A logic, when using software, can be written in a suitable language, including C# or C++, and can be stored and transferred to a computer-readable storage medium (which, for example, cannot be a volatile, propagating signal in itself) such as random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM), or other optical disk storage such as the Digital Versatile Disc (DVD), disk storage, or other magnetic storage devices, including removable USB flash drives, etc.

[0018] In one example, a processor can access information from a data storage device, such as a computer-readable storage medium, via its input lines, and / or the processor can wirelessly access information from an internet server to send and receive data. When received, the data is typically converted from analog to digital signals by a circuit between the antenna and the processor's registers, and when sent, it is converted from digital to analog. The processor then processes the data through its shift registers to output computed data on output lines for display on the device.

[0019] The components included in one embodiment can be used in a suitable combination in other embodiments. For example, various components described herein and / or illustrated in the figures can be combined, exchanged, or omitted in other embodiments.

[0020] “A system that has at least one of A, B, and C” (similar to “A system that has at least one of A, B, or C” and “a system that has at least one of A, B, C”) includes systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together and / or A, B, and C together, etc.

[0021] The term "circuit" or "circuit" may be used in the abstract, description, and / or claims. As is well known in the field, the term "circuit" encompasses all levels of integration, i.e., from discrete logic circuits to the highest level of circuit integration such as VLSI, and includes programmable logic components programmed to perform the functions of an embodiment, as well as general-purpose processors or processors for a specific purpose programmed with instructions to perform such functions.

[0022] Now specifically with regard to Fig. Figure 1 shows an example of a block diagram of an information handling system or computer system 100, which is known to have an enclosure for the components described below. Note that in some embodiments, the system 100 may be, for example, a desktop computer system such as the ThinkCentre® or ThinkPad® line of personal computers distributed by Lenovo (US) Inc. of Morrisville, NC, or a workstation computer such as the ThinkStation®, distributed by Lenovo (US) Inc. of Morrisville, NC; however, as can be seen from the description herein, a client device, server, or other machine conforming to the present principles may include other features or only some of the features of the system 100. The system 100 may also be a game console such as an Xbox®, and / or the system 100 may include a wireless phone, a notebook computer, and / or another computerized device.

[0023] As in Fig. As shown in Figure 1, the System 100 can include a so-called chipset 110. A chipset refers to a group of integrated circuits or chips designed to work together. Chipsets are usually offered as individual products (consider, for example, chipsets marketed by Intel®, AMD®, etc.).

[0024] In the example of the Fig. 1. The chipset 110 has a specific architecture that may vary to some extent depending on the brand or manufacturer. The architecture of the chipset 110 includes a core and memory control group 120 and an I / O control node 150, which exchange information (e.g., data, signals, commands, etc.), for example, through a Direct Management Interface or a Direct Media Interface (DMI) 142 or a link controller 144. In the example of Fig. 1. The DMI 142 is a chip-to-chip interface (sometimes referred to as a connection between a "Northbridge" and a "Southbridge").

[0025] The core and memory control group 120 comprises one or more processors 122 (e.g., single-core or multi-core, etc.) and a memory control node 126, which exchange information via a front-side bus (FSB) 124. As described herein, different components of the core and memory control group 120 can be integrated into a single processor cube, e.g., to create a chip that replaces the conventional "northbridge" architecture.

[0026] Memory control node 126 is connected to memory 140. Memory control node 126 can, for example, provide support for DDR SDRAM memory (e.g., DDR, DDR2, DDR3, etc.). Generally, memory 140 is a type of random access memory. It is often called "system memory."

[0027] The memory control node 126 may also include a low-voltage differential signaling (LVDS) interface 132. The LVDS 132 may be a so-called LVDS display interface (LDI) for supporting a display device 192 (e.g., a CRT, a flat panel display, a projector, a touchscreen display, etc.). A block 138 includes some examples of technologies that can be supported via the LVDS interface 132 (e.g., serial digital video, HDMI / DVI, DisplayPort). The memory control node 126 also includes one or more PCI Express (PCI-E) interfaces 134, for example, to support discrete graphics 136. Discrete graphics using a PCI-E interface have become an alternative approach to an Accelerated Graphics Port (AGP). For example, the memory control node 126 can include a 16-lane (x16) PCI-E port for an external PCI-E-based graphics card (with, for example, one or more GPUs).An example system could include AGP or PCI-E for graphics support.

[0028] In examples where it is used, the I / O control node 150 can include a variety of interfaces. The example of Fig. 1 includes a SATA interface 151, one or more PCI-E interfaces 152 (optionally one or more legacy PCI interfaces), one or more USB interfaces 153, a LAN interface 154 (usually a network interface for communication over at least one network such as the Internet, a WAN, a LAN, etc., under the direction of the processors 122), a general-purpose I / O interface (GPIO) 155, a low-pin-count interface (LPC) 170, a power management interface 161, a clock generator interface 162, an audio interface 163 (e.g., for speakers 194 for audio output), a total cost of ownership (TCO) interface 164, a system management bus interface (e.g., a serial multi-master computer bus interface) 165, and a serial peripheral flash memory / control interface (SPI flash) 166, which in the example of Fig. The BIOS includes version 168 and boot code 190. Regarding network connectivity, the I / O control node can include 150 integrated Gigabit Ethernet control lines multiplexed with a PCI-E interface port. Other network functions can operate independently of the PCI-E interface.

[0029] The interfaces of the I / O control node 150 can provide communication with various devices, networks, etc. For example, the SATA interface 151, where used, provides reading, writing, or both reading and writing information to one or more drives 180, such as HDDs, SSDs, or a combination thereof. In any case, the drives 180 are understood as concrete, computer-readable storage media that do not transmit volatile signals. The I / O control node 150 can also include an Advanced HotS Controller Interface (AHCI) to support one or more drives 180. The PCI-E interface 152 enables wireless connections 182 with devices, networks, etc. The USB interface 153 allows the connection of input devices 184, such as keyboards, mice, and various other devices (e.g., laptops, tablets, etc.).Cameras, including both cameras for the visible spectrum and cameras such as forward-looking infrared cameras, phones, storage devices, media players, etc.).

[0030] In the example of the Fig. The LPC interface 170 enables the connection of one or more ASICs 171, a Trusted Platform Module (TPM) 172, a Super I / O 173, a Firmware Node 174, BIOS support 175, and various types of memory 176 such as ROM 177, Flash 178, and non-volatile RAM (NVRAM) 179. Regarding the TPM 172, this module can be in the form of a chip that can be used to authenticate software and hardware devices. For example, a TPM can be capable of performing platform authentication and can be used to verify that an access-seeking system is the expected system.

[0031] After being powered on, the System 100 can be configured to execute a boot code 190 for the BIOS 168, as stored within the SPI Flash 166, and subsequently processes data under the control of one or more operating systems and application software (such as those stored in the system memory 140). An operating system can be stored in a variety of locations and accessed, for example, according to the instructions of the BIOS 168.

[0032] Additionally, the system 100 can include an audio receiver / microphone 191 that provides input from the microphone to the processor 122, based on an audio / sound output captured according to the present principles. In some embodiments, the microphone 191 can actually be an array of multiple microphones. The microphones in the array can be, for example, fiber optic microphones, pressure gradient microphones, unidirectional microphones, cardioid microphones, and / or so-called "shotgun" microphones, etc.

[0033] The system 100 can also include a camera 193 that captures one or more images and provides related input to the processor 122. The camera can be a thermal imaging camera, a digital camera such as a webcam, a three-dimensional (3D) camera, and / or a camera that is integrated into the system 100 in any other way and is controllable by the processor 122 to capture images and / or videos. Furthermore, the system 100 can include a GPS transceiver 195 configured to communicate with at least one satellite to receive / identify geographic position information and provide this geographic position information to the processor 122.

[0034] However, it is understandable that, according to the principles at hand, a different suitable position receiver than a GPS receiver can be used to determine the location of System 100.

[0035] Although not shown for clarity, in some embodiments the system 100 may also include a gyroscope that senses and / or measures the orientation of the system 100 and provides an input relating thereto to the processor 122, as well as an accelerometer that senses acceleration and / or movement of the system 100 and provides an input relating thereto to the processor 122.

[0036] It is understandable that an example client device or other machine / computer may have fewer or more features than the depicted system. Fig. 1. In any case, it is at least understandable based on the foregoing that System 100 is configured to execute the current principles.

[0037] Well Fig. Turning to Section 2, exemplary devices are shown that communicate via a Network 200, such as the Internet or a Bluetooth network, in accordance with the present principles. In some embodiments, the Network 200 may specifically be an Internet of Things network. It is understood that each of the devices that, with regard to Fig. 2, may exhibit at least some of the features, components and / or elements of the system 100 described above. In fact, any of the devices disclosed herein may exhibit at least some of the features, components and / or elements of the system 100 described above.

[0038] Fig. Figure 2 shows a notebook computer and / or convertible computer 202, a desktop computer 204, a portable device 206 such as a smartwatch, a smart television (TV) 208, a smartphone 210, a tablet computer 212, a smart device 216, and a server 214 such as an internet server that can provide cloud storage which devices 202-212 and 216 can access. Describing the smart device 216 in more detail, it could be a smart oven / cooker, a smart dishwasher, a smart microwave, a smart fan, a smart mixer, etc. It is understood that devices 202-216 are configured to communicate with each other over the network 200 to execute the current principles.

[0039] Now the Fig. 3 and Fig. 4. Descriptive, these corresponding exemplary representations 300 and 400 show in accordance with the present principles. In both representations 300 and 400, a user 302 is shown. In representation 300, the user 302 is shown on a couch 304 in a living room 306 of a private home, while watching audio-video content presented via a smart television 308. In representation 400, the user 302 has moved from the living room 306 to an adjacent kitchen 310 (near a table 312), and it is understood that the user 302 is further away from the TV 308 in the kitchen 310 than when sitting on the couch 304.

[0040] In both Fig. 3 and Fig. 4 is understood to mean that user 302 is wearing a smartwatch 314, although this is only in Fig. 4 is shown. In accordance with the present principles, a microphone on the smartwatch 314 can detect audio output from the TV 308 via the TV's speaker as part of the audio-video content presented by the TV 308. If the user 302 is on the couch 304 in front of the TV 308, as shown in Fig. As shown in Figure 3, the smartwatch 314 can detect the volume level of the audio device at the location of the smartwatch 314 and consequently at the location of the user 302. The smartwatch 314 can then communicate with the TV 308 to send an instruction to the TV 308 (e.g., via the internet, a Bluetooth network, or a local area network (LAN)) to adjust the volume output by the TV 308 so that, at the location of the user 302 on the couch 304, the audio signal is at a predefined volume level (e.g., in decibels).

[0041] Then, if user 302 is in kitchen 310, which is further away from TV 308, as in Fig. As shown in Figure 4, the smartwatch 314 can detect the volume level of the audio signal at the location of the smartwatch 314 and consequently at the location of the user 302 (in this case, the user's location is 302 when he / she is in the kitchen 310) and can communicate with the TV 308 to issue a command to increase the volume output by the TV 308, so that the audio output at the user's location in the kitchen 310 remains at the same predefined volume level. Thus, if the user moves back and forth between the living room 306 and the kitchen and other locations within their home, the volume of the audio output from the TV 308 can be increased proportionally to the increase in distance from the TV 308 (the source of the audio output) to the user, and decreased proportionally to the decrease in distance from the TV 308 to the user 302.Accordingly, the audio output produced by the TV 308 may appear the same to user 302, even though user 302 is moving closer to or further away from the TV 308.

[0042] Fig. Figure 5 shows another representation 500 according to the present principles. User 302 is again shown sitting on the couch 304 in the living room 306, watching audio-video content presented on the TV 308. However, in representation 500, a second user 502 is also present within the living space, specifically in the kitchen 310. This second user 502 is working with a tablet computer 504 and is sitting at the head of the table 312. It is also understood that the tablet computer 504 is presenting audio-video content through its own speakers and display.

[0043] This different audio-video content, as presented via the tablet computer 504, now interferes with the ability of user 302 to clearly hear and enjoy the audio output from the TV 308, since user 302 can now also hear the audio output from the tablet computer 504 in the adjacent kitchen 310. The microphone on the smartwatch 314, which is still being worn by the user (but which is in Fig. (5 is not shown for the sake of simplicity), can perceive the audio output from the tablet computer 504 and the smartwatch 314 can perform a corresponding action based on this.

[0044] For example, the smartwatch 314 can send a command to the tablet computer 504 to decrease the volume of the audio output from the tablet computer 504. Additionally or alternatively, the smartwatch 314 can send a command to the TV 308 to increase the volume of the audio output from the TV 308, so that the user can hear the audio output from the TV 308 more clearly than the audio output from the tablet computer 504. The smartwatch 314 can perform one or both of these actions based on the fact that the audio output from the TV 308 is no longer audible to the smartwatch 314 due to additional audio output from the tablet computer 504.The smartwatch 314 can also perform one or both of these things, based on the fact that the audio output from the tablet computer 504, as perceived by the smartwatch 314 at the user's location 302, is above a threshold decibel level at the user's location 302.

[0045] Once the TV 308 has finished presenting the audio-video content it was displaying, for example, when the device is muted or turned off, the smartwatch 314 can send a different instruction to the tablet computer 504. This different instruction can be to instruct the tablet computer 504 to resume audio output at the same level at which it was previously outputting audio before the smartwatch 314 instructed it to decrease the audio output level.

[0046] Now, with reference to Fig. Section 6 shows an exemplary logic that can be executed by a device such as the System 100, the Smartwatch 314, or any other device in accordance with the present principles. The device that executes the logic of Fig. The device that performs step 6 is referred to below as the "first device".

[0047] Starting with block 600, the first device can identify another device and / or specific content being observed / focused on by a user. This can be accomplished, for example, by receiving images from a camera within the user's environment (such as a camera on a TV the user is watching) and running eye-tracking software to identify, using these images, a specific device the user is looking at. It can also be achieved by tracking the user's location and / or the location of the user's personal device (such as their smartwatch or smartphone, or, in this example, the first device of the Fig. 6) be executed and by determining the nearest device, relative to the user / device location, that is currently displaying content. Voice and other user inputs (e.g., touch input on a display) can also be used, such as when a user instructs the first device to "focus on" another device that is currently presenting the audio-video content, so that the volume of the other device / content can be adjusted to allow a user to continue hearing the audio output, as detailed below.

[0048] Additionally, a user-defined priority can be used to determine which device / content a user views. For example, a device can set a priority for all devices currently presenting audio output, ensuring that a higher-priority device is selected before a lower-priority device. This allows volume adjustments to be made so that the user hears the audio output from the higher-priority device over the sound from the lower-priority device. The user can set this priority by providing input to a user interface (UI), which is displayed on a priority setting screen.

[0049] The logic of block 600 can be derived from the Fig. 6 then move to block 602. At block 602, the first device can receive input from a microphone on the first device, indicating a sound. The logic can then continue to a decision diamond 604, where the first device can determine whether the sound displayed in the microphone input is from, or otherwise associated with, the content / device that the user has determined to be observing. The determination at diamond 604 can be performed, for example, if it appears that only sound from one device is displayed in the input, with no other devices currently outputting sound. This can be determined based on the microphone input and / or communication with other devices communicating over the same network as the first device to identify which other devices are currently outputting audio.

[0050] Acoustic source localization can also be used to perform the determination at diamond 604. For example, input from a microphone array (such as one of the arrays discussed above in relation to microphone 191) on the first device can be used to calculate a time-of-arrival difference to determine the direction from which the sound originated. Then, based on known locations of other devices within the environment where the first device is located, and an identification of the first device's current location (as identified based on input from the first device's GPS transceiver), the first device can determine which other device is located relative to the first device's current location in the direction of the sound, thereby determining which of the other devices is the sound source.From there, the first device can determine whether the other device, which is the source of the sound, is also the device being viewed by the user.

[0051] A confirmatory determination can cause the logic to proceed to decision diamond 606. In diamond 606, the first device can determine whether the audio output from the observed device / content—the sound displayed by the microphone input—meets a first sound criterion, such as whether it is intelligible to the first device. Whether the audio output is intelligible can be based on whether the first device can convert words in the audio output to text using speech-to-text software. If words in the audio output can be converted to text, it can be determined that the audio output is intelligible; if the words cannot be converted to text, it can be determined that the audio output is not intelligible.

[0052] Whether the audio output is intelligible can also depend on whether the first device can identify a song or other sound from the audio output. Regarding songs, the song can be identified based on the microphone input using music and / or sound identification software, such as the Google Play or Shazam apps. Similarly, the audio output itself can be identified as if it were associated with specific content, and the first device can then determine whether that specific content (e.g., a movie or TV show) is the same content being presented on the device being viewed by the user.Other sound identification software can also be used to determine whether the audio output is intelligible, such as software for identifying specific sounds within the audio output, like birdsong, rain falling to earth, or other nonverbal sounds that can be identified. If something from the audio output, or the audio output itself, can be identified using one of these methods, the audio output can be determined to be intelligible. If not, the audio output can be determined to be intelligible.

[0053] A negative determination at diamond 606 can cause the logic to proceed to block 610, which will be described shortly. However, it should first be noted that a confirmatory determination at diamond 606 can cause the logic to proceed to decision diamond 608. At diamond 608, the first device can determine whether the audio output indicated by the microphone input meets a second sound criterion, namely, whether it is above a threshold volume level (e.g., a decibel level threshold and / or a user-defined optimal volume level). A decibel measurement application and / or sound measurement application running on the first device can be used to perform the determination at diamond 606 based on the microphone input.The second sound criterion itself can be set up by a manufacturer of the first device and / or by a user, based on user input, as discussed below.

[0054] A negative determination at block 608 can cause the logic to proceed to block 610. At block 610, the first device can provide an instruction to another device that outputs the audio in question, to increase the volume of the audio output being produced by the other device. The instruction can be to increment the volume of the audio output from a first increment to the next higher increment, in which case the logic can proceed to block 612, where it can return to block 600 or 602 and proceed from there to determine whether the volume increase results satisfy the second sound criterion, such as increasing the volume of the audio output to or above the first threshold volume level, or whether the volume should be increased by another increment.

[0055] The instruction can also be to increase the audio output by a specific amount (e.g., more than one increment) based on the fact that a volume increase determined by the first device results in the second sound criterion being met. For example, this could be an increase in the volume of the observed audio output, as perceived at the location of the first device, to the first threshold level. If the first device determines, for instance, that the current volume level at its location is half the first threshold volume level, the instruction can be to double the volume of the considered audio output as it is output by the other device. In this example, the logic can also continue from block 610 to block 612 to proceed from there.

[0056] Returning to decision diamond 608, note that an affirmative determination at diamond 608 may cause the logic to proceed to block 614 rather than block 610. At block 614, the first device may adjust / instruct an audio output by the other device to be at a user-defined optimal volume level (which in some examples may be the same level as the first threshold volume level). This may be accomplished by the first device determining a volume level of the audio outputs under consideration at the location of the first device, and then determining by how many volume increments the observed audio output may be increased or decreased to achieve the user-defined optimal level at the location of the first device. From block 614, the logic may proceed to block 612 and then continue from there.

[0057] Still on Fig. 6. Referring back to, but with reference to, decision diamond 604, if a negative determination is found instead of an affirmative one, the logic can proceed from diamond 604 to decision diamond 616. In diamond 616, the first device can determine whether the audio output from the device / content under consideration satisfies a third sound criterion such that it is intelligible, even though other sound besides the audio output is present, as determined based on the microphone input. Whether the audio output is intelligible, for example, can be based on one or more of the methods disclosed above with respect to diamond 606.

[0058] A negative determination at hashtag 616 can cause the logic to proceed to block 620, which will be described shortly. First, however, note that an affirmative determination at hashtag 616 causes the logic to proceed to decision hashtag 618. At hashtag 618, the first device can determine whether the sound other than the audio output from the content / device under consideration meets a fourth sound criterion, such as whether it exceeds a second threshold volume level (e.g., a threshold decibel level and / or a user-defined maximum sound volume level). A decibel measurement application and / or sound measurement application running on the first device can be used to perform the determination at hashtag 618 based on the microphone input.The second fourth sound criterion itself can be set by a manufacturer of the first device and / or by a user based on user input that specifies a user-defined maximum sound level for the sound from devices other than the device being considered.

[0059] A negative statement at hashtag 618 can cause the logic to proceed to block 612, where it can return to block 600 or 602 and continue from there. However, an affirmative statement at hashtag 618 can instead cause the logic to proceed to block 620. At block 620, the first device can provide an instruction to the other device, which presents the audio output under consideration, to increase the volume of the audio output. The instruction can be to increase the audio output stepwise from an initial increment to the next higher increment, to increase the audio output by another predefined amount, to increase the audio output to a user-defined optimal level, and / or to increase the audio output to or above the initial threshold volume level, as described above.

[0060] In Block 612, in addition to or instead of increasing the volume of the audio being considered in Block 620, the first device can provide an instruction to reduce the sound from the device generating the other sound. If the device generating the sound is a smart oven / cooker, smart dishwasher, smart microwave, smart fan, or smart blender, the instruction to reduce the sound can be to turn the device off, to change the device's operating state to one that produces less sound, or to pause its operation. For example, if the device is a smart dishwasher, the instruction for the dishwasher to wash the dishes can be to use a "gentle cycle" instead of a "normal cycle," which produces comparatively more sound.If the device generating the sound is a computer or another device that outputs its own audio (which may be different from the audio output under consideration), the instruction to reduce the sound could be to turn off the function generating the sound, mute the audio output, pause the audio output, turn off the other device, or reduce the volume of the sound being output.

[0061] The logic of block 620 can be derived from the Fig. 6 then proceed to block 622. At block 622, when the audio output viewed by the user has ceased to be presented, the first device can provide an instruction to raise the sound from the other sound-producing device to its previous level. If the sound-producing device is, for example, a household appliance, the instruction to raise the sound to its previous level can be an instruction to turn on the device, an instruction for the device to return its operation to the previous state that may have been changed at block 620, or an instruction for the device to resume its operation. If the sound-producing device is a computer or other device that has its own audio output (e.g., the input of a computer), the instruction to raise the sound to its previous level can be an instruction to turn on the device, an instruction for the device to return to its previous state of operation, which may have been changed at block 620.If the audio output is different from the one being considered, the instruction that raises the sound back to its previous level can be an instruction to turn on the function that generates the sound, not to mute the audio output, not to pause / return to presenting the audio output, to turn on the other device, or to increase the volume of the sound being output back to a level before the volume was reduced, which may have been based on an instruction provided at block 620. From block 622, the logic can then continue to block 612 and proceed from there.

[0062] Continuing the detailed description with reference to Fig. Figure 7 shows an exemplary user interface (UI) 700, which may be presented on a display of the user's personal device and / or on a display accessible on or otherwise from a device that outputs audio, which is viewed by a user in accordance with these principles. The UI 700 may include video content 702 associated with audio content that is presented, such as video content from a television show or film that also includes audio content.

[0063] UI 700 can also include a 704 indication that another device has started producing a sound, as detected by a separate wearable device belonging to the user while being carried by the user, or by a separate smartphone belonging to the user while on or near the user. In this example, a tablet computer associated with another person, named Sophie, is shown to be presenting a video game. This can be determined by the device displaying the viewed content and / or by the user's separate personal device, based on network communication with Sophie's tablet computer and / or based on an identification that the sound from Sophie's tablet computer is associated with a video game.

[0064] Note 704 can also display an instruction or action to be performed by the device presenting the viewed content or by the user's separate personal device, such as an instruction that can be provided at block 620 as described above. In this example, the instruction displayed is to lower the volume on Sophie's tablet computer.

[0065] The UI 700 can also include one or more selectors 706, 708, 710, which can be selected by a user. For example, each selector can be selected by providing voice input that selects the corresponding selector, by manipulating a mouse or other cursor device movement to select the corresponding selector, and / or by providing touch input on a portion of the display that represents the corresponding selector. Selector 706 can be selected to instruct the user's separate personal device (e.g., the device that runs the logic of the Fig. 6 executes the user's portable device (which is being worn and / or the user's smartphone), to "focus" more on the audio output from Sophie's computer than on the audio output associated with video content 702. In this way, the audio output for Sophie's computer can be increased to a user-defined optimal level and / or a threshold volume level, while the volume of the audio output associated with video content 792 can be decreased.

[0066] Selector 708 can be selected to instruct Sophie's tablet computer not to increase or decrease the audio output and / or to continue its current operation without change. Selector 710 can be selected to mute the audio output from Sophie's tablet computer.

[0067] Fig. Figure 8 shows another example UI 800, which may be displayed on a screen of the user's personal device and / or on a screen accessible from or otherwise by a device that outputs the audio from a

[0068] Users are viewed and the output is in accordance with current principles. The UI 800 can include video content 802 associated with the audio content being displayed, such as video content from a television show or film that also includes audio.

[0069] The UI 800 can also include an 804 alert indicating that a household appliance has started producing sound, which can be detected by the user's separate portable device while being carried by the user, or by the user's separate smartphone while on or near the user. In this example, a dishwasher is shown as being switched on. This could have been determined by the device presenting the content and / or by the user's separate personal device, based on network communication with the dishwasher and / or based on an identification of the sound from the dishwasher as associated with the dishwasher's operation.

[0070] Note 804 can also display an instruction or action to be performed by the device presenting the content or by the user's separate personal device, such as an instruction that can be provided by Block 620 as described above. In this example, the instruction displayed is to modify the dishwasher's operation to reduce the noise emanating from it.

[0071] The UI 800 can also have one or more selectors 806 and 808, which can be selected by a user. Selector 806 can be selected to specify the user's separate personal device (e.g., the device that runs the logic of the Fig. 6. Selector 808 is not configured to instruct the user's portable device (which is being worn and / or the user's smartphone) to change the dishwasher's operation. Selector 808 can be selected to provide an instruction for the dishwasher to delay its operation and / or to put the dishwasher into a power-off state.

[0072] Well Fig. 9. Describing, this shows an example of a UI 900 that can be displayed on a screen accessible by a device executing the present principles, such as the screen of a device that implements the logic of Fig. 6. The UI 900 can be used to configure the device settings according to the principles outlined below. Each option described below can be selected by direct input (e.g., touch input) to the corresponding checkbox shown next to the option.

[0073] The UI 900 can include an initial option 902, which can be selected to turn on the device to execute the principles outlined above. For example, option 902 can be selected to configure the device, one or more, and in some cases all, parts of the logic. Fig. 6. The UI 900 can also include a second option 904, selectable to configure the device not only to increase the volume of the audio output viewed by the user, but also to decrease the volume of sound produced by other devices not viewed by the user, in accordance with the present principles. Furthermore, the UI 900 can include an option 906, selectable to configure the device to increase, after decreasing, the volume of sound produced by other devices not viewed by the user, in accordance with the present principles. For example, option 906 can be selected to turn on the device to block 622 of the Fig. 6 to execute.

[0074] UI 900 can also include a setting 908, where a user can set a maximum volume to which the audio output of the viewed content can be increased. The maximum volume can be specified by the user by providing input in an input box 910 or by selecting a selector 912 to initiate a test in which sounds of increased volume are displayed until the user selects one of these volumes as the one to be used as the maximum audio volume. In this way, the volume of the audio output viewed by the user will not be increased beyond the user's maximum desired volume, even if the user moves further and further away from the device presenting the audio output.The maximum desired volume can refer to the volume as perceived at the user's location or to the current volume output of the device itself.

[0075] The UI 900 can also include a setting 914, which allows a user to set a maximum volume for all sounds from all devices within a given environment (such as the user's home or a specific room within the home). This maximum volume setting can therefore apply not only to the audio output being viewed by the user, but to all sounds produced by devices within the environment. An input specifying the maximum volume for this setting can be provided in input box 916.

[0076] Additionally, option 918 can be displayed on UI 900. Option 918 can be selected to configure the device to exceed the volume limits for one or both settings 908 and 914 based on the number of people present. This allows the sound / audio output to be increased beyond the volume limits when the number of people reaches a certain threshold. An input specifying the number of people to be used can be directed to input box 920. The people themselves can be determined by the device based on images from a camera communicating with the device, using object recognition to identify the number of people.

[0077] Further referring to Fig. 9. UI 900 can also include a setting 922, in which a user specifies a desired optimal volume level for audio output from a device under consideration, so that the audio output volume can be adjusted to the optimal level at the user's location, even if the user is closer to or farther away from the device. An input specifying the optimal level can be provided through input box 924 or through a process similar to that described above with reference to selector 912. Furthermore, as an alternative to using the optimal volume setting, the user can select option 926 to configure the device to adjust the audio output volume based on what the audio output is intelligible to the device, as revealed herein.

[0078] UI 900 can also include one or more settings that correspond to user-defined priorities. For example, setting 928 can determine which device to focus on over others, allowing a user to hear audio output from the focused device (e.g., at the user's optimal volume level). Option 930 can be selected to configure the device, learn priorities, and set a time period during which the user provides instructions that select a different device than the one the user wishes to focus on / view.A selector 932 can also be displayed, whereby selecting selector 932 can cause the device to present a different user interface. In this interface, a user can rank various devices connected via the same network in a priority order from highest to lowest. Priorities can also be set based on users, such that audio output viewed by some users is prioritized over audio output focused on by other users.

[0079] The UI 900 can also include a setting 934, which concerns an action the device performs to reduce the sound generated by other devices not viewed by the user, but which are still producing sound that is picked up by the device's microphone. Corresponding options 936 can be displayed, which can be selected to configure the device to reduce the sound from such other devices by turning off the other device, by adjusting the other device to a comparatively quieter operating state, by reducing the volume of the audio output from the other device, and by muting the other device.

[0080] Further from the Fig.As stated in paragraph 9, it is understandable, in accordance with the present principles, that in some embodiments a user location alone (rather than a microphone input) can be used to adjust the volume up or down. For example, if a user is listening to audio output from a device in an environment where there are currently no other sound-producing devices, location data from the user's portable device (e.g., GPS data) can be used such that, if the user moves away from the audio device, the volume of the audio device can be increased, and, if the user moves closer to the audio device, the volume of the audio device can be decreased.

[0081] Additionally, it is understandable that a digital assistant can be run by a device that executes the principles outlined herein to provide instructions to other devices, as disclosed herein. For example, the digital assistant can generally be similar to Amazon's Alexa or Apple's Siri.

[0082] Before concluding, it is understandable that although, for example, a software application for executing these principles can be sold with a device such as System 100, these principles can also be applied in examples where such an application is downloaded from a server to a device via a network such as the Internet. Furthermore, these principles are applied in examples where, for example, such an application is contained in a computer-readable storage medium that is to be sold and / or made available, where the computer-readable storage medium is neither a volatile signal nor a signal in itself.

[0083] It is understood that, while the present principles have been described with reference to some exemplary embodiments, these are not intended to be limiting and that various alternative arrangements can be used to carry out the subject matter claimed herein. Components included in one embodiment can be used in other embodiments in any suitable combination. For example, any different components described herein and / or shown in the figures can be combined, exchanged, or excluded from other embodiments.

Claims

[1] First device comprising: - at least one processor; - a microphone accessible by at least one processor; and - a memory accessible by the at least one processor and carrying instructions executable by the at least one processor for: - Receiving input from the microphone; - Determining, based on the input from the microphone, whether a sound from a second device meets a sound criterion; and - in response to the determination, issuing an instruction to increase the volume of an audio output of a third device; - wherein the instructions are further executable by the at least one processor to determine that a user is paying attention to the audio output by the third device, and the instruction is issued based on the determination that the user is paying attention to the audio output by the third device. [2] The first device according to claim 1, wherein the third device is the same device as the second device. [3] The first device of claim 2, wherein the criterion is determined based at least in part on user output indicative of a desired volume level. [4] The first device according to claim 1, wherein the third device is different from the second device. [5] The first device of claim 4, wherein the instructions are executable by the at least one processor to: - Determining that a user is paying attention to the audio output by the third device based at least in part on one or more of: executing eye tracking software, determining a location where the first device is located, determining a location where the user is located. [6] The first device of claim 4, wherein the instructions are executable by the at least one processor to: - in response to the determination, issuing an instruction that decreases the volume of the sound from the second device. [7] The first device of claim 6, wherein the instructions are executable by the at least one processor to: - issuing the instruction that decreases the volume of the sound from the second device by one or more of: issuing an instruction to turn off the second device, issuing an instruction to change the operation of the second device, issuing an instruction to decrease the volume of the sound from the second device. [8] The first device according to claim 1, wherein the first device is a portable device. [9] The first device according to claim 1, wherein the sound criterion relates to a threshold decibel level. [10] The first device of claim 1, wherein the sound criterion relates to whether the audio output by the third device is intelligible to the first device. [11] A method for a first device comprising a microphone, the method comprising: - Receiving input from the microphone; - Determining, based on the input from the microphone, whether an audio output from a second device meets a sound criterion; and - in response to determining, issuing an instruction to a third device to increase the volume of an audio output by the third device; - wherein the method further comprises determining that a user is paying attention to the audio output by the third device, and the instruction is issued based on the determination that the user is paying attention to the audio output by the third device. [12] The method of claim 11, wherein the third device is the same device as the second device. [13] The method of claim 12, wherein the instruction issued instructs the third device to increase the volume of the audio output to no more than a user-defined volume maximum. [14] The method of claim 11, wherein the third device is different from the second device. [15] The method of claim 14, further comprising: - Determining, based on the input from the microphone, that the sound from the second device meets the sound criterion; - in response to determining that the sound from the second device meets the sound criterion, issuing an instruction to the second device to decrease the volume of the sound from the second device; and - in response to determining that the third device is no longer outputting audio, issuing an instruction to the second device to increase the volume of sound from the second device. [16] Device comprising: - a first processor; - a network adapter; and - a memory carrying instructions executable by at least a second processor of a first device for: - Receiving input from a microphone of the first device - Determining, based on the input from the microphone, whether a sound from a second device meets a sound criterion; and - in response to determining, providing an instruction to increase the volume of an audio output by a third device; - wherein the instructions are further executable by the at least one second processor to determine that a user is paying attention to the audio output by the third device, and the instruction is issued based on the determination that the user is paying attention to the audio output by the third device; and - wherein the first processor transmits the instructions to the first device over a network and by means of a network adapter. [17] The apparatus of claim 16, wherein the third device is the same device as the second device. [18] The apparatus of claim 16, wherein the third device is different from the second device.

Images