Control devise and control method

Abstract

To facilitate listener's perception of sound from a device that outputs sound, in a case where a device that emits drive sounds exists.SOLUTION: A control device includes: a drive information acquisition unit (11) that acquires first drive information concerning a drive state of a first device (10) that outputs sound and second drive information concerning a drive state of a second device (20); and a control unit (12) that executes device control processing to control at least one of the first device and the second device based on at least one of the first drive information and the second drive information, so that a listener of the first device can hear the sound, when the first device is outputting sound.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a control device and a device control method. [Background technology]

[0002] Patent Document 1 discloses a technology for controlling the output of an output device that outputs sound. The sound output of the output device is controlled based on a captured image of the surroundings of the output device and the ambient sound around the output device. For example, if the ambient noise is loud, the volume of the audio output device is increased. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-026997 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-described conventional technology may have difficulty in adequately dealing with loud drive noises from other devices. For example, when a loud drive noise is emitted from a device located far from the audio output device but close to the listener, it is not easy to make the audio output from the audio output device easy for the listener to hear.

[0005] One aspect of the present invention aims to provide a control device and a device control method that make it easier for a listener to hear audio from a device that outputs audio when there is a device that emits drive sound. [Means for solving the problem]

[0006] In order to solve the above problem, a control device according to one embodiment of the present invention includes a drive information acquisition unit that acquires first drive information relating to the drive state of a first device that outputs audio and second drive information relating to the drive state of a second device, and a control unit that, when the first device is outputting audio, executes a device control process to control at least one of the first device and the second device based on at least one of the first drive information and the second drive information so that a listener of the first device can hear the audio. [Effects of the Invention]

[0007] According to one aspect of the present invention, it is possible to realize a control device and a device control method that make it easier for a listener to hear sound from a device that outputs sound when there is a device that emits drive sound. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram illustrating a configuration of a control system according to an embodiment of the present invention. [Figure 2] 4 is a timing chart showing a control process in a control system according to an embodiment of the present invention. [Figure 3] 3 is a flowchart illustrating a device control method according to the first embodiment of the present invention. [Figure 4] FIG. 10 is a diagram illustrating a table showing the correspondence between devices and their installation locations. [Figure 5] FIG. 10 is a diagram illustrating an example of a display for confirming cooperation. [Figure 6] FIG. 2 is a diagram illustrating an example of the positional relationship between a first device, a second device, and a viewer. [Figure 7] 1 is a table showing the correspondence between voice and other parameters. [Figure 8] 10A and 10B are diagrams illustrating an example of changes in the state of the first and second devices and the environment before and after a device control process. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment 1] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described in detail. Fig. 1 is a block diagram showing the configuration of a control system 1 according to an embodiment of the present invention.

[0010] The control system 1 includes a first device 10 and a second device 20. The first device 10 is a device that outputs sound, such as a television set. The second device 20 is, for example, a household electrical appliance that emits driving sounds (e.g., an air conditioner, an electric fan, a humidifier, a dehumidifier, an air purifier, and a washing machine). A viewer (hereinafter also referred to as a "listener") P of the first device 10 is sitting on a sofa SE and watching the video and audio of the first device 10.

[0011] The first device 10 and the second device 20 can communicate with each other via a network (not shown), either wired or wirelessly. This network may include a server device for supporting communication and control between the first device 10 and the second device 20. That is, the control system 1 may include, in addition to the first device 10 and the second device 20, a device, such as a server device, for controlling at least one of the first device 10 and the second device 20.

[0012] (First device 10) The first device 10 has a drive information acquisition unit 11, a control unit 12, a video / audio drive unit 13, an imaging unit 14, a display unit 15, and an audio output unit 16. The first device 10 functions as a control device including: a drive information acquisition unit 11 that acquires first drive information related to the drive state of the first device 10 and second drive information related to the drive state of the second device 20; and a control unit that, when the first device is outputting audio, executes device control processing to control at least one of the first device 10 and the second device 20 based on at least one of the first drive information and the second drive information so that a listener P of the first device 10 can hear the audio.

[0013] The drive information acquisition unit 11 acquires first drive information relating to the drive state of the first device 10 that outputs sound, and second drive information relating to the drive state of the second device 20. Details of the first drive information and the second drive information will be described later.

[0014] The control unit 12 is, for example, a CPU (Central Processing Unit), and when the first device 10 is outputting audio, executes a device control process S15 (described later) that controls at least one of the first device 10 and the second device 20 based on at least one of the first drive information and the second drive information so that the viewer P of the first device 10 can hear the audio.

[0015] The video / audio driver 13 drives the display unit 15 and the audio output unit 16 with the video signal IS and the audio signal SS. As a result, video is displayed on the display unit 15 and audio is output from the audio output unit 16. The viewer P can view the video on the display unit 15 and the audio from the audio output unit 16.

[0016] The imaging unit 14 acquires an image of the viewer P, etc. This image functions as information representing the position of the viewer P relative to the first device 10, for example, information representing a first distance L1 between the first device 10 and the viewer P.

[0017] (Second device 20) The second device 20 includes a driving unit 21, a control unit 22, and an imaging unit .

[0018] The driving unit 21 executes processing to cause the second device 20 to exhibit its functions. If the second device 20 is an air conditioner, the driving unit 21 is a cooling mechanism for cooling the surrounding air. If the second device 20 is an electric fan, the driving unit 21 is a blowing mechanism for sending air to the viewer P. If the second device 20 is a humidifier, the driving unit 21 is a humidifying mechanism for humidifying the surrounding air. If the second device 20 is a dehumidifier, the driving unit 21 is a dehumidifying mechanism for dehumidifying the surrounding air. If the second device 20 is an air purifier, the driving unit 21 is an air cleaning mechanism for purifying the surrounding air. If the second device 20 is a washing machine, the driving unit 21 is a washing mechanism for washing clothes, etc.

[0019] The driving unit 21 generates a driving sound depending on the driving state. This driving sound may interfere with the viewer P's ability to hear the sound from the first device 10. In this embodiment, at least one of the first device 10 and the second device 20 is controlled based on at least one of the first and second driving information, making it easier for the viewer P to hear the sound from the first device 10.

[0020] The control unit 22 controls the driving unit 21 and the imaging unit 23, and communicates with the first device.

[0021] The imaging unit 23 acquires an image of the viewer P, etc. This image functions as information representing the position of the viewer P relative to the second device 20, for example, information representing the second distance L2 between the second device 20 and the viewer P.

[0022] Fig. 2 is a timing chart showing the control process in the control system 1 according to the embodiment of the present invention. Fig. 3 is a flowchart showing the device control method according to the first embodiment of the present invention.

[0023] (1) Startup and link confirmation (steps S11 and S12) The first device 10 is started up by a start switch or the like (step S11). When the first device 10 is started up, it connects to the network and checks cooperation with the second device 20 (step S12).

[0024] This confirmation is performed when the first device 10 and the second device 20 are located close to each other, for example, in the same room. These locations are represented in a device management table MT. The device management table MT can be held by an appropriate device on the network, for example, a server device, the first device 10, or the second device 20.

[0025] 4 is a diagram showing an example of a device management table MT. The device management table MT shows the correspondence between devices, their installation locations (such as the living room), and floor numbers. In this example, a television, an air conditioner, a washing machine, and an air purifier are shown as devices. In this example, the television, air conditioner 1, and air purifier 1 are located in the same room (the living room) and are targets of coordination.

[0026] The linkage is confirmed, for example, by a confirmation display on the display unit 15 of the first device. FIG. 5 is a diagram showing an example of a linkage confirmation display. Display D1 indicates that a second device 20 (air conditioner) has been detected on the first device 10 (television), and prompts the viewer P to input whether or not to link the second device 20 (air conditioner) with the first device 10 (television). The viewer P can input whether or not to link by selecting the button "Yes" or "No." Display D2 shows a state in which an air conditioner, humidifier, and washing machine have been detected, and an input has been made to link the humidifier and washing machine. The viewer P can select whether or not to link using a toggle button.

[0027] Here, whether or not to link is selected by the viewer P. However, this link may be performed automatically regardless of the viewer P. For example, devices to be linked may be registered in a device management table MT, and detected devices may be automatically linked based on the device management table MT.

[0028] (2) Acquisition process (step S13) Control unit 12 acquires first driving information relating to the driving state of first device 10 that outputs audio and second driving information relating to the driving state of second device 20 via driving information acquisition unit 11. Details of the first driving information and the second driving information will be described below.

[0029] (Details of the first driving information) The first driving information may include information indicating the driving state of the first device 10, and further information related to the influence that the driving state of the first device 10 has on the viewer P (for example, the influence on the general environment of the viewer P). Examples of the first driving information include the following (1) to (3). (1) Setting volume level of the first device 10, volume level (2) A first distance L1 between the first device 10 and the viewer P (3) The volume level of the sound from the first device 10 at the viewer P (hereinafter also referred to as the “listening volume level”)

[0030] The listening volume level may be obtained from a microphone or the like placed near the viewer P, but as described below, it may also be determined from the volume level (or set volume level) of the first device 10 and a first distance L1 between the first device 10 and the viewer P.

[0031] The drive information acquisition unit 11 can acquire the set volume level of the first device 10 from the video / audio drive unit 13 as the volume level.

[0032] The drive information acquisition unit 11 can acquire information about the position of the viewer P relative to the first device 10, for example, a first distance L1, from the imaging unit 14. The drive information acquisition unit 11 may acquire the information about the position of the viewer P from a sensor other than the imaging unit 14. The first device 10 may have, for example, a millimeter-wave radar, and the drive information acquisition unit 11 may acquire the information about the position of the viewer P from the millimeter-wave radar.

[0033] The actuation information acquisition unit 11 may acquire information about the position of the viewer P relative to the first device 10 from a source other than the first device 10. The actuation information acquisition unit 11 may acquire information about the position of the viewer P from a device held by the viewer P, such as a remote control for controlling the first device 10, a portable watch, or a mobile phone. If these devices have a position sensor such as a GPS (Global Positioning System), the actuation information acquisition unit 11 can acquire information about the position of the viewer P relative to the first device 10.

[0034] (Details of the second driving information) The second driving information may include information indicating the driving state of the second device 20, and further information related to the influence that the driving state of the second device 20 has on the viewer P (for example, the influence on the general environment of the viewer P). Examples of the second driving information include the following (1) to (5). (1) Power consumption level of the second device 20 (2) Operation mode of the second device 20 (for example, silent mode: an operation mode in which the drive of the drive unit 21 is suppressed to reduce the drive noise generated by the drive unit 21; weak mode: an operation mode in which the drive of the drive unit 21 is suppressed, and is essentially a silent mode; normal mode: an operation mode in which the drive of the drive unit 21 is not suppressed, and the drive unit 21 operates effectively) (3) The result of adjustment when the second device 20 is a device that adjusts the environment around the viewer P (for example, the indoor temperature with an air conditioner, the indoor humidity with a dehumidifier, or a humidifier). (4) A second distance L2 between the second device 20 and the viewer P (5) Driving sound level from the second device 20 at the listener P

[0035] The driving information acquisition unit 11 can acquire the power consumption level and operation mode of the second device 20 from the driving unit 21.

[0036] The drive information acquisition unit 11 can acquire information about the position of the viewer P relative to the second device 20, for example, the second distance L2, from the imaging unit 23. The drive information acquisition unit 11 may also acquire information about the position of the viewer P from a sensor other than the imaging unit 23. This is substantially the same as the information about the position of the viewer P relative to the first device 10, so a detailed description will be omitted.

[0037] (3) Judgment process (step S14) The control unit 12 makes a determination based on at least one of the first drive information and the second drive information, and determines the content of the device control process (step S15).

[0038] If the first device 10 is not outputting audio based on the first drive information, the control unit 12 may determine not to execute the device control process (S15: process of controlling at least one of the first device 10 and the second device 20 so that the viewer P of the first device 10 can hear the audio) (steps S141, S153).

[0039] That is, the control unit 12 may execute a drive noise level acquisition process to acquire the drive noise level of the second device 20 based on the second drive information, and if the drive noise level is greater than a reference level, determine to execute a device control process (S15) (steps S142, S151, S152).

[0040] In the drive sound level acquisition process, the control unit 12 may acquire the power consumption level of the second device 20 and a second distance L2 between the second device 20 and the viewer P, and acquire the drive sound level based on the power consumption level and the second distance L2. This will be described in detail later.

[0041] Here, the reference level can be determined, for example, by the following (a) and (b).

[0042] (a) The control unit 12 may execute a volume level acquisition process to acquire the volume level of the first device 10 based on the first drive information (e.g., the set volume level), and may determine a reference level based on the volume level.

[0043] (b) The control unit 12 may execute a listening volume level acquisition process to acquire a listening volume level, which is the volume level of the viewer P, based on the first drive information, and determine the reference level based on the listening volume level.

[0044] The control unit 12 may acquire a first distance L1 between the first device 10 and the viewer P, and determine a listening volume level based on the first drive information and the first distance L1.

[0045] The details of obtaining the volume level and the drive sound level are explained below. Fig. 6 is a diagram showing an example of the positional relationship between the first device 10, the second device 20, and the viewer P. Here, the viewer P is located at a first distance L1 (for example, 5 [m]) from the first device 10 and at a second distance L2 (for example, 2 [m]) from the second device 20.

[0046] 7 is a table showing the correspondence between sound and other parameters. Table T0 shows the relationship between distance L and sound attenuation. Table T1 shows the relationship between the set volume level of first device 10 and the sound pressure of the sound. Table T2 shows the relationship between the power consumption of second device 20 and the sound pressure of the drive sound.

[0047] Here, sound pressure is used as an example of the volume level and drive noise level. Furthermore, power consumption itself is used as an example of the power consumption level. The volume level, drive noise level, and power consumption level can be defined as appropriate, separately from the sound pressure and power consumption itself.

[0048] The control unit 12 can obtain the drive sound level (e.g., sound pressure) based on the tables T0 and T2, the power consumption level, and the second distance L2. For example, when the power consumption level of the second device 20 is 400 [W], the drive sound level (here, sound pressure) of the second device 20 is 40 dB, and the drive sound level at the viewer P located at the second distance L2 (here, 2 [m]) away therefrom is 40-6=34 dB.

[0049] The control unit 12 can obtain the volume level (e.g., sound pressure) based on the tables T0 and T1, the set volume level, and the first distance L1. For example, when the volume level of the first device 10 is 20 and the first distance L1 is 5 [m], the listening volume level of the viewer P is 30-14=16 dB.

[0050] Here, if the listening volume level of 16 dB is taken as a reference level, the drive sound level of 34 dB for the viewer P is greater than the reference level, and it may be determined in the determination process (S14) that the device control process (S15) should be executed (steps S142, S151, S152).

[0051] (4) Device control process (step S15) In the device control process (S15), the control unit 12 performs at least one of restricting the driving of the second device 20 (S151) and increasing the volume level of the first device 10 (S152). The restriction on the driving of the second device 20 is, for example, a transition from the normal mode to the silent mode (or low volume mode) or a reduction in power consumption in the normal mode.

[0052] If the second device 20 is an environmental adjustment device (e.g., an air conditioner, a fan, a humidifier, or a dehumidifier) ​​that adjusts the environment around the viewer P, the control unit 12 acquires the environmental level around the viewer P, and in the device control process (S15), prioritizes either limiting the operation of the second device 20 (step S151) or increasing the volume level of the first device 10 (step S152) based on the environmental level.

[0053] Here, if the second device 20 is in normal mode ("Yes" in step S144), the second device 20 is switched to silent mode (or low-noise mode) to limit driving, and if the second device 20 is in silent mode (or low-noise mode) ("No" in step S144), the volume level (e.g., set volume level) of the first device 10 is increased.

[0054] However, when the second device 20 is in the silent mode (or the low volume mode), the operation of the second device 20 may be limited. For example, when the second device 20 is in the silent mode (or the low volume mode), the volume level (e.g., the set volume level) of the first device 10 may be increased, and the operation of the second device 20 may be limited (e.g., power consumption may be reduced).

[0055] For example, if the second device 20 is a device that adjusts the temperature or humidity around the viewer P (e.g., an air conditioner, electric fan, humidifier, or dehumidifier), the control unit 12 acquires the temperature level or humidity level around the viewer P, and if the temperature level or humidity level is within a predetermined appropriate level ('Yes' in S143), prioritizes restricting the operation of the second device 20 in the device control process (S15) (S151), and if the temperature level or humidity level is outside the predetermined appropriate level ('No' in S143), prioritizes increasing the volume level of the first device 10 in the device control process (S15) (S152).

[0056] That is, if the second device 20 is an air conditioner or an electric fan, it is determined based on the room temperature information whether to increase the volume level of the first device 10 or set the operating mode of the second device 20 to low or quiet mode.

[0057] For example, when the room temperature is appropriate and the driving noise of the second device 20 is loud, the volume level of the first device 10 is increased and the second device 20 is set to silent mode (or low mode). On the other hand, when the room temperature is too high (e.g., above 28°C) or too low (e.g., below 18°C), the driving of the second device 20 is prioritized, the driving of the second device 20 is maintained, and the volume level of the first device is increased in order to prevent the viewer P's physical condition from deteriorating.

[0058] Furthermore, if the second device 20 is a dehumidifier or a humidifier, it is determined whether to increase the volume level of the first device 10 or set the operating mode of the second device 20 to silent mode (or low volume mode) based on the humidity information of the room.

[0059] For example, when the humidity is 40% or less, priority is given to driving the second device 20 (humidifier), so that driving of the second device 20 (humidifier) ​​is maintained and the volume level of the first device 10 is increased.

[0060] On the other hand, if the second device 20 is not involved in adjusting the environment of the viewer P, for example, a washing machine, priority is given to driving the first device 10. That is, the volume level of the first device 10 may be increased, or the second device 20 (washing machine) may be temporarily stopped, or both may be performed.

[0061] In the device control process (S15), control unit 12 may increase the volume level (e.g., set volume level) of first device 10 within a predetermined range. For example, during device cooperation, the predetermined range may be set to a maximum value of the volume level (set volume level) of first device 10. If the drive sound level of second device 20 is high, control unit 12 may increase the volume level (set volume level) of first device 10 within the predetermined range.

[0062] If the volume level (e.g., the set volume level) of the first device 10 exceeds a predetermined range, the control unit 12 may limit the operation of the second device 20 in the device control process (S15). For example, when the volume level (set volume level) of the first device 10 reaches a set maximum value, the control unit 12 may transition the second device 20 from the normal mode to the silent mode (or the low volume mode).

[0063] In the device control process (S15), the control unit 12 may execute an input prompt process to prompt the viewer P to select whether to prioritize limiting the operation of the second device 20 or increasing the volume level of the first device 10, and may execute the process selected by the viewer P in the input prompt process with priority. For example, a pop-up menu may be displayed on the display unit 15 of the first device 10 to prompt the viewer P to select whether to set the second device 20 to silent mode (or low volume mode) (or to stop the operation of the second device 20).

[0064] In this way, a pop-up menu may be displayed on the first device 10 to notify the operation of the second device 20 and to allow the user to select whether or not to restrict the operation of the second device 20.

[0065] The remote control of the primary device (e.g., a television) may be used to input this selection. For example, a button for controlling a linked device may be added to the remote control. When this button is pressed, the secondary device 20 may be put into silent mode or stopped.

[0066] In the device control process (S15), control unit 12 may both limit the driving of second device 20 and increase the volume level of first device 10.

[0067] 8 is a diagram showing an example of changes in the state of the first device 10 (television), the second device 20 (air conditioner), and the environment (room temperature) before and after the device control process (S15). Here, in cases 1 to 3, the first distance L1 and the second distance L2 are constant at 1 m and 2 m, respectively, and the power consumption of the second device 20 is constant at 300 W, but the set volume level of the first device 10 or the room temperature changes.

[0068] In Case 1, before the device control process (S15), the room temperature is a comfortable temperature (25°C), and the set volume level of the first device 10 is 10. As described above, the power consumption of the second device 20 is 300 [W], and the first distance L1 and the second distance L2 are 1 [m] and 2 [m], respectively. In this case, the drive sound level at the viewer P is 30-6=24 dB, and the listening volume level (here, also the "reference level") is 15-0=15 dB.

[0069] In this case, the volume level of the first device 10 may be increased and the second device 20 may be set to silent mode (or low volume mode). Here, the volume setting of the first device 10 is increased to 15 and the power consumption level of the second device 20 is reduced to 250 W. As a result, the room temperature rises slightly from 25°C to 26°C.

[0070] In Case 2, before the device control process (S15), the room temperature is higher than the optimum temperature (30°C), but the other conditions are the same as in Case 1. In this case, the volume level of the first device 10 is increased, and the operation of the second device 20 is not restricted (the operation state is maintained). Here, the volume level of the first device 10 is set to 18, and the power consumption level of the second device 20 is maintained at 300 [W]. As a result, the room temperature drops from 30°C to 28°C, reaching the optimum temperature.

[0071] In Case 3, before the device control process (S15), the volume level of the first device 10 is high at 20. The drive sound level at the viewer P is 24 dB, and the listening volume level (reference level) is 30-0=30 dB. In this case, the drive sound level at the viewer P is lower than the reference level (listening volume level), so the states of the first device 10 and the second device 20 are maintained. As a result, the room temperature drops from 30°C to 28°C, reaching the appropriate temperature.

[0072] [Modification] Modifications of the present invention will be described below. For the sake of convenience, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0073] (Variation 1) In the first embodiment, the first device 10 has the driving information acquisition unit 11 and the control unit 12 and functions as a control device. On the other hand, the server device can function as a control device if it has the driving information acquisition unit 11 and the control unit 12. That is, either or both of the first device 10 and the server device may be the control device.

[0074] (Variation 2) In the first embodiment, the driving noise level of the second device is calculated from its power consumption. In contrast, the first device 10 may have a sound collector (microphone), and the control unit 12 may estimate the driving noise level of the second device 20 based on ambient sounds collected from the sound collector.

[0075] (Variation 3) When it is determined based on the image of the imaging unit 14 that the viewer P is not in front of the first device 10 or that the viewer P is not watching the first device 10, the control unit 12 may not execute the device control process (S15).

[0076] (Variation 4) The device control process (S15) may also not be executed when no audio is being output from the audio output unit 16 of the first device 10 to the outside (for example, when the viewer P is listening to audio from the first device 10 via a contact-type or proximity-type audio output unit such as headphones, earphones, or a neck speaker).

[0077] The configurations of the above-described modified examples 1 to 4 can be combined with the configuration of the embodiment as appropriate. Also, the configurations of modified examples 1 to 4 may be combined with each other as appropriate.

[0078] [Software implementation example] The functions of the first device 10 (hereinafter referred to as the "device") can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block (particularly the control unit 12) of the device.

[0079] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0080] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0081] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0082] 〔summary〕 A control device according to aspect 1 of the present invention includes a drive information acquisition unit that acquires first drive information relating to the drive state of a first device that outputs audio and second drive information relating to the drive state of a second device, and a control unit that, when the first device is outputting audio, executes a device control process that controls at least one of the first device and the second device based on at least one of the first drive information and the second drive information so that a listener of the first device can hear the audio.

[0083] According to the above configuration, when the second device emits a drive sound, at least one of the first device and the second device is controlled based on at least one of the first drive information and the second drive information, thereby making it easier for the listener to hear the sound from the first device.

[0084] A control device according to aspect 2 of the present invention may be such that, in aspect 1 above, the control unit executes a drive noise level acquisition process to acquire a drive noise level of the second device based on the second drive information, and determines to execute the device control process when the drive noise level is greater than a reference level.

[0085] According to the above configuration, when the drive sound level is higher than the reference level, the device control process is executed, thereby making it easier for the listener to hear the sound from the first device.

[0086] A control device according to aspect 3 of the present invention may be such that, in aspect 2 above, the control unit executes a volume level acquisition process to acquire the volume level of the first device based on the first driving information, and determines the reference level based on the volume level.

[0087] According to the above configuration, the reference level is determined based on the volume level of the first device, making it easier for the listener to hear the sound from the first device.

[0088] In the control device according to aspect 4 of the present invention, in aspect 2 or 3 above, the control unit may execute a listening volume level acquisition process to acquire a listening volume level, which is the volume level for the listener, based on the first drive information, and determine the reference level based on the listening volume level.

[0089] According to the above configuration, the reference level is determined based on the listening volume level, which is the volume level of the listener, thereby making it easier for the listener to hear the sound from the first device.

[0090] A control device according to aspect 5 of the present invention may be such that, in aspect 4 above, the control unit acquires a first distance between the first device and the listener, and determines the listening volume level based on the first driving information and the first distance.

[0091] According to the above configuration, the reference level is determined based on the listening volume level based on the first distance, making it easier for the listener to hear the sound from the first device.

[0092] A control device according to aspect 6 of the present invention is any of aspects 2 to 5 above, wherein the control unit, in the drive sound level acquisition process, acquires a power consumption level of the second device and a second distance between the second device and the listener, and acquires the drive sound level based on the power consumption level and the second distance.

[0093] According to the above configuration, by obtaining the drive sound level based on the power consumption level of the second device and the second distance, it is possible to make it easier for the listener to hear the sound from the first device.

[0094] A control device according to aspect 7 of the present invention is any of aspects 1 to 6 above, wherein the control unit, in the device control processing, may perform at least one of restricting the driving of the second device and increasing the volume level of the first device.

[0095] According to the above configuration, by limiting the driving of the second device and / or increasing the volume level of the first device, it is possible to make it easier for the listener to hear the sound from the first device.

[0096] A control device according to aspect 8 of the present invention may be such that, in the above-mentioned aspect 7, the control unit executes an input prompt process that prompts the listener to select whether to prioritize limiting the operation of the second device or increasing the volume level of the first device in the device control process, and the process selected by the listener in the input prompt process is executed as a priority.

[0097] According to the above configuration, the listener can select whether to prioritize limiting the drive of the second device or increasing the volume level of the first device, making it easier for the listener to hear the sound from the first device.

[0098] A control device according to a ninth aspect of the present invention is the control device of the seventh or eighth aspect, wherein the control unit increases the volume level within a predetermined range in the device control process.

[0099] According to the above configuration, the listener can select whether to prioritize limiting the drive of the second device or increasing the volume level of the first device, making it easier for the listener to hear the sound from the first device.

[0100] A control device according to aspect 10 of the present invention may be such that, in aspect 9 above, when the volume level exceeds the predetermined range, the control unit restricts the operation of the second device in the device control processing.

[0101] According to the above configuration, the listener can select whether to prioritize limiting the drive of the second device or increasing the volume level of the first device, making it easier for the listener to hear the sound from the first device.

[0102] A control device according to aspect 11 of the present invention is any of aspects 7 to 10 above, wherein the control unit, in the device control processing, may both limit the driving of the second device and increase the volume level of the first device.

[0103] According to the above configuration, the listener can select whether to prioritize limiting the drive of the second device or increasing the volume level of the first device, making it easier for the listener to hear the sound from the first device.

[0104] A control device according to aspect 12 of the present invention is configured such that, in any of aspects 7 to 11 above, when the second device is an environmental adjustment device that adjusts the environment around the listener, the control unit acquires an environmental level around the listener, and in the device control processing, prioritizes either limiting the operation of the second device or increasing the volume level of the first device based on the environmental level.

[0105] According to the above configuration, by prioritizing either limiting the drive of the second device or increasing the volume level of the first device based on the environmental level around the listener, it is possible to balance the listener's surrounding environment with the ability to hear the sound from the first device.

[0106] In the control device of aspect 13 of the present invention, in the above aspect 12, when the second device is a device that adjusts the temperature or humidity around the listener, the control unit acquires the temperature level or humidity level around the listener, and if the temperature level or humidity level is within a predetermined appropriate level, prioritizes restricting the operation of the second device in the device control process, and if the temperature level or humidity level is outside the predetermined appropriate level, prioritizes increasing the volume level of the first device in the device control process.

[0107] According to the above configuration, by prioritizing either limiting the operation of the second device or increasing the volume level of the first device based on the temperature or humidity around the listener, it is possible to balance the temperature or humidity around the listener with the ability to hear sound from the first device.

[0108] A control device according to a fourteenth aspect of the present invention is any one of the first to thirteenth aspects, wherein the control device is the first device or a server device.

[0109] According to the above configuration, the first device or the server device can make it easier for the listener to hear the sound from the first device.

[0110] A device control method according to aspect 15 of the present invention includes an acquisition process for acquiring first driving information relating to the driving state of a first device that outputs audio and second driving information relating to the driving state of a second device, and a device control process for controlling at least one of the first device and the second device based on at least one of the first driving information and the second driving information when the first device is outputting audio so that a listener of the first device can hear the audio.

[0111] According to the above configuration, when the second device emits a drive sound, at least one of the first device and the second device is controlled based on at least one of the first drive information and the second drive information, thereby making it easier for the listener to hear the sound from the first device.

[0112] The control device according to each aspect of the present invention may be realized by a computer. In this case, the control program of the control device that realizes the control device by the computer by making the computer operate as each part (software element) of the control device, and the computer-readable recording medium on which the control program is recorded, also fall within the scope of the present invention.

[0113] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment. [Explanation of symbols]

[0114] 1. Control System 10 First Device 11. Driving information acquisition unit 12 Control Unit 13 Audio driver 14 Imaging unit 15 Display section 16 Audio output section 20 Second Device 21 Drive unit 22 Control Unit 23 Imaging unit

Claims

1. a drive information acquisition unit that acquires first drive information relating to a drive state of a first device that outputs sound and second drive information relating to a drive state of a second device; a control unit that executes a device control process to control at least one of the first device and the second device based on at least one of the first drive information and the second drive information when the first device is outputting sound so that a listener of the first device can hear the sound; A control device comprising:

2. The control unit executes a drive noise level acquisition process to acquire a drive noise level of the second device based on the second drive information; The control device according to claim 1 , wherein the control device determines to execute the device control process when the drive noise level is greater than a reference level.

3. The control unit executing a volume level acquisition process for acquiring a volume level of the first device based on the first drive information; The control device of claim 2 , further comprising: determining the reference level based on the volume level.

4. The control unit executing a listening volume level acquisition process for acquiring a listening volume level, which is a volume level for the listener, based on the first drive information; The control device of claim 2 , further comprising: determining the reference level based on the listening volume level.

5. The control unit obtaining a first distance between the first device and the listener; The control device according to claim 4 , wherein the listening volume level is determined based on the first drive information and the first distance.

6. In the drive noise level acquisition process, the control unit obtaining a power consumption level of the second device and a second distance between the second device and the listener; The control device according to claim 2 , wherein the drive noise level is obtained based on the power consumption level and the second distance.

7. The control device according to claim 1 , wherein the control unit performs at least one of limiting the driving of the second device and increasing a volume level of the first device in the device control process.

8. In the device control process, the control unit executing an input prompting process for prompting the listener to input a selection as to which of limiting the operation of the second device and increasing the volume level of the first device should be prioritized; The control device according to claim 7 , wherein the process selected by the listener in the input prompt process is executed with priority.

9. The control device according to claim 7 , wherein the control unit increases the volume level within a predetermined range in the device control process.

10. If the volume level exceeds the predetermined range, The control device according to claim 9 , wherein the control unit limits driving of the second device in the device control process.

11. The control device according to claim 7 , wherein the control unit, in the device control process, both restricts driving of the second device and increases a volume level of the first device.

12. the second device is an environmental conditioning device that adjusts the environment around the listener, The control unit obtaining an environmental level around the listener; The control device according to claim 7 , wherein in the device control process, priority is given to either limiting the operation of the second device or increasing the volume level of the first device based on the environmental level.

13. If the second device is a device for adjusting the temperature or humidity around the listener, The control unit obtaining a temperature level or a humidity level around the listener; When the temperature level or humidity level is within a predetermined appropriate level, prioritizing the restriction of operation of the second device in the device control process; The control device of claim 12 , wherein if the temperature level or humidity level is outside the predetermined optimum level, the device control process prioritizes increasing the volume level of the first device.

14. The control device according to claim 1 , wherein the control device is the first device or a server device.

15. an acquisition process for acquiring first driving information relating to a driving state of a first device that outputs audio and second driving information relating to a driving state of a second device; a device control process for controlling at least one of the first device and the second device based on at least one of the first drive information and the second drive information when the first device is outputting audio so that a listener of the first device can hear the audio; A device control method comprising:

Images