Control device, control method, and program

Abstract

When a user listening to the first acoustic signal is not in a concentrated state or when the degree of concentration of the user is lower than a first reference, the first acoustic signal is changed in accordance with a second acoustic signal different from the first acoustic signal or a notification relating to the second acoustic signal. When the user is in a concentrated state or when the degree of concentration is equal to or greater than a first reference, a second control process is performed in which the first control process is not performed, and when the user is in the concentrated state or when the degree of concentration is equal to or greater than a first reference.

Description

Technical Field

[0001] The present invention relates to a technique for controlling reproduction of an acoustic signal. Background Art

[0002] There are known sound signal output devices that do not completely block the external auditory canal, such as open-ear-type (open-type) earphones and headphones. A user wearing such a sound signal output device can listen to favorite reproduction sounds such as music while listening to surrounding sounds.

[0003] However, even when a user uses such an audio signal output device, if the volume of the reproduced sound is high, there is a concern that the user may not notice calls from people around him or notifications from terminal devices such as smartphones, thereby hindering communication with others. On the other hand, sometimes the user deliberately listens to the reproduced sound at a high volume so as not to interrupt the concentration state.

[0004] In this regard, the following technology is disclosed in Non-Patent Document 1: if a user who listens to the reproduced sound through headphones speaks a sound, the reproduced sound is automatically temporarily stopped or muted. In addition, Patent Document 1 discloses the following technology: based on the detection result of a sensor, the user's action is estimated, and based on the estimated result, the maximum allowable volume of the reproduced sound is controlled.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1:

[0008] Japanese Patent Publication No. 2021-052262

[0009] Non-patent literature

[0010] Non-patent document 1:

[0011] ,[online],Sony Corporation,[retrieved on June 1, 2022],Internet<https: / / helpguide.sony.net / mdr / hpc / v1 / ja / contents / TP0002935777.html> Summary of the invention

[0012] Problems to be solved by the invention

[0013] However, in the technology of non-patent document 1, if the user does not speak, the reproduced sound is not controlled, and there is a concern that communication with others may be hindered if the user does not pay attention to the call, calling sound, notification sound, etc. In addition, in the technology of patent document 1, even if the user deliberately listens to the reproduced sound at a high volume so as not to interrupt the concentration state, the maximum allowable volume of the reproduced sound is controlled.

[0014] Such a problem is common not only when a user listens to reproduced sound using an acoustic signal output device that does not block the external auditory canal, but also when a user who listens to a first acoustic signal is in an environment where the user can also listen to a second acoustic signal different from the first acoustic signal.

[0015] In view of the above, the present invention provides a technology that allows a user who hears a first sound signal to easily communicate with others when the user is not concentrating and to easily maintain the concentration state when the user is concentrating in an environment where the user can also hear a second sound signal different from the first sound signal.

[0016] Means for solving problems

[0017] When a user who hears the first sound signal is not in a concentrated state or when the user's concentration level is lower than a first standard, a first control process is performed to change the first sound signal based on a second sound signal different from the first sound signal or a notification related to the second sound signal so that the user can easily hear the second sound signal, and when the user is in a concentrated state or when the concentration level is higher than the first standard, a second control process is performed without performing the first control process.

[0018] Effects of the Invention

[0019] Thus, in an environment where a user who hears a first sound signal can also hear a second sound signal different from the first sound signal, it is easy for the user to communicate with others when the user is not concentrating, and it is easy for the user to maintain the concentration state when the user is concentrating. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a diagram for illustrating the configuration of an audio signal reproduction system according to an embodiment.

[0021] Figure 2 is a flowchart for illustrating a control method according to an embodiment.

[0022] Figure 3 This is a diagram for illustrating the configuration of an audio signal reproduction system according to an embodiment.

[0023] Figure 4 This is a block diagram for illustrating the hardware configuration of the control device according to the embodiment. DETAILED DESCRIPTION

[0024] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0025] [First embodiment]

[0026] <Structure>

[0027] like Figure 1 As illustrated, the sound signal reproduction system 1 according to the first embodiment includes a control device 11 , a user sensor 12 , a sound signal sensor 13 , and a sound signal output device 14 .

[0028] The control device 11 includes an input unit 111 , a reproduction unit 112 , a storage unit 113 , a concentration state estimation unit 114 , a control unit 115 , and an environment estimation unit 116 .

[0029] The user sensor 12 is a sensor for detecting the state of the user 101. The user sensor 12 includes, for example, at least one of a biometric signal sensor for detecting a biometric signal of the user 101, an acceleration information sensor for detecting the posture, movement, orientation, etc. of the user 101, or a position sensor for detecting the position of the user 101. Examples of the biometric signal sensor are a sensor for detecting the pulse and heart rate of the user 101, a sensor for detecting brain waves, a sensor for detecting eye movement, etc. Examples of the acceleration information sensor are an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, a 9-axis sensor, etc. Examples of the position sensor are a geomagnetic sensor, a camera, an electrostatic capacitance sensor, an ultrasonic sensor, a potentiometer, etc.

[0030] The acoustic signal sensor 13 is a microphone, a volume sensor, or the like that detects an ambient acoustic signal AC2 (a second acoustic signal).

[0031] The sound signal output device 14 is, for example, an earphone, a headphone, a neck speaker, a bone conduction speaker, or other speakers that outputs the sound signal AC1 (first sound signal). The sound signal output device 14 may be a type that does not completely block the external auditory canal of the user 101, or a type that completely blocks the external auditory canal of the user 101.

[0032] <Pretreatment>

[0033] In the pre-processing, the storage unit 113 stores “information for estimating the concentration state” for estimating the concentration state of the user 101 based on the “input information”. The “input information” may be, for example, “detection information” detected by the user sensor 12 or its function value, or “other information” related to the “detection information” and the concentration state of the user 101 or their function values, or the “other information” or its function value. The “other information” may be, for example, information indicating the content of the task of the user 101, information indicating the duration of the task of the user 101, information indicating the time when the user 101 performed the task, information indicating the intention of the user 101 (intentions such as “want to concentrate”, “can communicate”, “want to turn off notifications”, “want to turn on notifications”, etc. The “information for estimating the concentration state” may be, for example, information for obtaining “information indicating whether the user 101 is in a concentration state” for the “input information”, or information for obtaining “information indicating the degree of concentration of the user 101” for the “input information”. In addition, the higher the concentration, the more concentrated the state is, and the lower the concentration, the less concentrated the state is. "Information for estimating the concentrated state" can be, for example, a table that associates "input information" with "information indicating whether it is in a concentrated state", or a table that associates "input information" with "information indicating the concentration degree", or a threshold value of "input information" used to determine "whether it is in a concentrated state". These tables and threshold values ​​are predetermined based on, for example, past "detection information", past task logs, duration of past tasks, time when past tasks were performed, etc. In addition, "information for estimating the concentrated state" can be, for example, an estimation model that outputs "information indicating whether it is in a concentrated state" for "input information", or an estimation model that outputs "information indicating the concentration degree" for "input information". Examples of estimation models are models based on deep learning, hidden Markov models, SVM (Support Vector Machine), etc. These models are obtained, for example, by machine learning using a learning model. An example of a learning model is supervised learning data that associates "input information for learning" (past detection information, past task logs, duration of past tasks, time when past tasks were performed, etc.) with labels indicating "whether in a concentrated state", "degree of concentration", etc. There is no limitation on the method for estimating the concentration state, and a known estimation method such as the technology disclosed in Japanese Patent Application Laid-Open No. 2014-158600, etc. may be used.

[0034] <Processing>

[0035] Control device 11 ( Figure 1) outputs a reproduction signal representing an acoustic signal AC1 (first acoustic signal) heard by the user 101 under the control of the control unit 115. The acoustic signal AC1 is, for example, music, voice, ambient sound, or other acoustic content. The reproduction signal is transmitted to the acoustic signal output device 14 by wire or wirelessly, and the acoustic signal output device 14 outputs the acoustic signal AC1 based on the transmitted reproduction signal. The user 101 hears the acoustic signal AC1 outputted from the acoustic signal output device 14.

[0036] The user sensor 12 detects the state of the user 101, and sends the detected “detection information” to the concentration state estimation unit 114. When the user sensor 12 includes a biological signal sensor, the “detection information” includes information indicating the biological signal of the user 101. When the user sensor 12 includes an acceleration information sensor, the “detection information” includes information indicating the posture, movement, direction, etc. of the user 101, such as the acceleration and angular acceleration of the user 101. When the user sensor 12 includes a position sensor, the “detection information” includes information indicating the position of the user 101. When “other information” related to the concentration state of the user 101 is input from the input unit 111, the “other information” is sent to the concentration state estimation unit 114.

[0037] The concentration state estimation unit 114 obtains and outputs "information indicating whether the user 101 is in a concentration state" or "information indicating the degree of concentration of the user 101" using the "input information" of the user 101 including at least one of the "detection information" and the "other information" and the "information for concentration state estimation" extracted from the storage unit 113. For example, when the "input information for concentration state estimation" is a table in which "input information" is associated with "information indicating whether the user 101 is in a concentration state" and "information indicating the degree of concentration", the concentration state estimation unit 114 obtains and outputs "information indicating whether the user 101 is in a concentration state" and "information indicating the degree of concentration" corresponding to the "input information" of the user 101. For example, when the "input information for concentration state estimation" is a threshold value of the "input information" for determining "whether the user is in a concentration state", the concentration state estimation unit 114 performs a threshold determination of the "input information" of the user 101, obtains and outputs "information indicating whether the user 101 is in a concentration state". For example, when the “information for estimating the concentration state” is an estimation model that outputs “information indicating whether or not the user is in a concentration state” or “information indicating the degree of concentration” for “input information”, the concentration state estimation unit 114 uses the estimation model to obtain and output “information indicating whether or not the user is in a concentration state” or “information indicating the degree of concentration” corresponding to the “input information”. When the “other information” includes information indicating the intention of the user 101, the concentration state estimation unit 114 may give priority to the intention of the user 101 and obtain and output “information indicating whether or not the user is in a concentration state”. For example, when the “other information” indicates an intention such as “want to concentrate” or “want to turn off notifications”, the concentration state estimation unit 114 may output “information indicating the user is in a concentration state” as “information indicating whether or not the user is in a concentration state”. For example, when the “other information” indicates an intention such as “can communicate” or “want to turn on notifications”, the concentration state estimation unit 114 may output “information indicating the user is not in a concentration state” as “information indicating whether or not the user is in a concentration state”. The information indicating the intention of the user 101 included in the "other information" is stored in the storage unit 113. The concentration state estimation unit 114 may obtain and output the "information indicating whether the user is in a concentration state" as described above based on the information indicating the intention stored in the storage unit 113 before the intention of the user 101 is updated. The "information indicating whether the user is in a concentration state" or the "information indicating the degree of concentration" is sent to the control unit 115.

[0038] The sound signal sensor 13 detects the surrounding sound signal AC2 (second sound signal), and transmits information indicating the sound signal AC2 to the environment estimation unit 116. The environment estimation unit 116 uses the input information indicating the sound signal AC2 to transmit "sound detection information" indicating the detection result of the surrounding sound signal to the control unit 115. The sound detection information is, for example, information indicating whether the user 102 in the surrounding area has spoken, information indicating the size of the surrounding sound, and the like.

[0039] The control unit 115 receives the “information indicating whether or not the user is in a concentrated state” or “information indicating the degree of concentration” sent from the concentration state estimation unit 114 and the “sound detection information” sent from the environment estimation unit 116 in real time. The control unit 115 uses the “information indicating whether or not the user is in a concentrated state” to determine whether the user 101 who is listening to the sound signal AC1 is in a concentrated state, or uses the “information indicating the degree of concentration” to determine whether or not the degree of concentration of the user 101 is above the reference TH1 (first reference). Here, when the user 101 is not in a concentrated state or when the degree of concentration of the user 101 is lower than the reference TH1 (first reference), the control unit 115 performs the following control processing CON1 (first control processing): based on the sound signal AC2 (a second sound signal different from the first sound signal) around the user 101 indicated by the “sound detection information”, the sound signal AC1 is changed so that the user 101 can easily hear the sound signal AC2. This processing is performed automatically. As a result, when the user 101 is not concentrating, it becomes easy to notice the call from the user 102, etc., and it becomes easy to communicate with others. On the other hand, when the user 101 is in a concentrated state or when the concentration level is greater than the reference TH1, the control process CON2 (second control process) is performed. The control process CON2 (second control process) is a process that does not perform the control process CON1 (first control process). As a result, when the user 101 is concentrating, it becomes easy to maintain the concentrated state. Specific examples of the control process CON1 (first control process) and the control process CON2 (second control process) are shown below.

[0040] A specific example of the control process CON1 (first control process):

[0041] The control process CON1 (first control process) includes, for example, a process of changing the acoustic signal AC1 (first acoustic signal) so that the user 101 can easily hear the acoustic signal AC2 (second acoustic signal) when the amplitude of the acoustic signal AC2 (second acoustic signal) is greater than the reference TH2 (second reference) or when the acoustic signal AC2 (second acoustic signal) is detected. An example of this process is a process of attenuating the amplitude of the acoustic signal AC1 (first acoustic signal). In addition, the acoustic signal AC2 (second acoustic signal) can be easily heard by the user 101 by changing the phase or waveform of the acoustic signal AC1 (first acoustic signal). As a result, the user 101 can easily notice the call from the user 102, etc. On the other hand, when the amplitude of the acoustic signal AC2 (second acoustic signal) is less than the reference TH2 (second reference) or when the acoustic signal AC2 (second acoustic signal) is not detected, the process of changing the acoustic signal AC1 (first acoustic signal) (the process of changing the first acoustic signal so that the user can easily hear the second acoustic signal) is not performed. This can prevent the acoustic signal AC1 from changing in accordance with the concentration state of the user 101 even though there is no call from the user 102 or the like.

[0042] A specific example of the control process CON2 (second control process):

[0043] In the control process CON2 (second control process), the following process is not performed, that is, the process of changing the acoustic signal AC1 so that the user 101 can easily hear the acoustic signal AC2. For example, in the control process CON2, the amplitude of the acoustic signal AC1 is not automatically attenuated or the phase or waveform of the acoustic signal AC1 is not changed. For example, the control process CON2 may be a control that does not perform anything. Thus, when the user 101 listens to the acoustic signal AC1 at a high volume in order to maintain a focused state, the user 101 can maintain a focused state even if there is a call from the surroundings or the surroundings become noisy.

[0044] Furthermore, the control process CON2 may include a process of changing the acoustic signal AC1 (first acoustic signal) so that the user 101 cannot easily hear the acoustic signal AC2 (second acoustic signal). For example, in order to make it difficult for the user 101 to hear the acoustic signal AC2, the magnitude of each frequency component of the acoustic signal AC1 may be changed, the phase of the acoustic signal AC1 may be changed, or the acoustic signal AC1 may be changed to shield the acoustic signal AC2. For example, an acoustic signal obtained by adding an acoustic signal with an opposite phase to the acoustic signal AC2 or an acoustic signal close to the opposite phase to the original acoustic signal AC1 may be set as a new acoustic signal AC1. Thus, even if there is a call from the surroundings or the surroundings become noisy, the user 101 can be more focused.

[0045] A specific example of the control process of the control unit 115 is:

[0046] use Figure 2 , a specific example of the control processing based on the control unit 115 is shown.

[0047] The control unit 115 receives the "information indicating whether or not the user is in a concentrated state" or "information indicating the degree of concentration" sent from the concentration state estimation unit 114 and the "sound detection information" sent from the environment estimation unit 116 (step S1). The control unit 115 uses the sound detection information to determine whether or not a call is present. For example, the control unit 115 determines that a call is present when the amplitude of the sound signal AC2 is greater than or equal to the reference TH2 or when the sound signal AC2 is detected, and otherwise determines that a call is not present (step S2). Here, if it is determined that there is no call, the process returns to step S1. On the other hand, if it is determined that there is a call, the control unit 115 uses the "information indicating whether or not the user is in a concentrated state" or "information indicating the degree of concentration" to determine whether or not the user 101 is in a concentrated state or the degree of concentration of the user 101 (step S3). Here, when the user 101 is not in a concentrated state or the concentration level of the user 101 is lower than the reference TH1 (first reference), the control unit 115 performs the control process CON1 (first control process) (step S4), and then returns the process to step S1. On the other hand, when the user 101 is in a concentrated state or the concentration level is higher than the reference TH1, the control unit 115 performs the control process CON2 (second control process) (step S5), and then returns the process to step S1.

[0048] <Features of this embodiment>

[0049] As described above, in this embodiment, the acoustic signal AC1 is controlled based on the concentration state and concentration degree of the user 101 who listens to the acoustic signal AC1 and the acoustic signal AC2 different from the acoustic signal AC1. As a result, the user 101 can easily communicate with others when not concentrating and can easily maintain the concentration state when concentrating.

[0050] [Second embodiment]

[0051] The second embodiment is a modified example of the first embodiment, and based on the concentration state and concentration degree of the user 101 who hears the acoustic signal AC1 and the acoustic signal AC2 different from the acoustic signal AC1, notification is also performed to the user 101 and other users 102. The following description will focus on the differences from the first embodiment, and the same reference numerals are used to simplify the description of matters that have already been described.

[0052] <Structure>

[0053] like Figure 1 As shown, the sound signal reproduction system 2 of the second embodiment includes a control device 21, a user sensor 12, a sound signal sensor 13, and a sound signal output device 14. The control device 21 includes an input unit 111, a reproduction unit 112, a storage unit 113, a concentration state estimation unit 114, a control unit 115, an environment estimation unit 116, a user notification unit 217, and a surrounding notification unit 218.

[0054] <Pretreatment>

[0055] Same as the first embodiment.

[0056] <Processing>

[0057] The difference from the first embodiment lies in the control process CON1 (first control process) and the control process CON2 (second control process). The control process CON1 of the second embodiment includes a process for prompting the user 101 with notification information N1 (first notification information) when the amplitude of the acoustic signal AC2 (second acoustic signal) is greater than the reference TH2 (second reference) or when the acoustic signal AC2 (second acoustic signal) is detected. In the control process CON1, the control unit 115 also instructs the user notification unit 217 to output the notification information N1, and the user notification unit 217 performs a process for prompting the user 101 with the notification information N1. This process is, for example, a process for outputting the notification information N1 from the acoustic signal output device 14, the control device 11, or other devices (such as a smartphone, etc.) to the user 101. The notification information N1 may be auditory information (e.g., notification sound, notification voice, etc.), visual information (e.g., LED lighting, image display, lighting change, notification message, etc.), tactile information (e.g., vibration, etc.), or a combination of at least some of them. By prompting the user 101 with the notification information N1, the user 101 can be aware of the presence of a call from another person and can communicate with the other person more smoothly.

[0058] In addition, the control process CON2 of the second embodiment includes a process for presenting notification information N2 (second notification information) to a person other than the user 101 (for example, the user 102). In the control process CON2, the control unit 115 further instructs the surrounding notification unit 218 to output the notification information N2, and the surrounding notification unit 218 performs a process for presenting the notification information N2 to a person other than the user 101. This process is, for example, a process for outputting the notification information N2 from the sound signal output device 14, the control device 11, or other devices (for example, a smartphone, etc.) to a person other than the user 101. The notification information N2 may be auditory information (for example, notification sound, notification voice, etc.), visual information (for example, LED light emission, image display, lighting change, notification message, etc.), tactile information (for example, vibration, etc.), or a combination of at least a part thereof. Thus, the user 102 and other persons can be informed that the user 101 is in a concentrated state, and the user 101 can maintain a concentrated state without being disturbed by others.

[0059] Alternatively, the control process CON1 may include the above-mentioned process for prompting the notification information N1, while the control process CON2 may not include the above-mentioned process for prompting the notification information N2. Alternatively, the control process CON1 may not include the above-mentioned process for prompting the notification information N1, while the control process CON2 may include the above-mentioned process for prompting the notification information N2.

[0060] <Features of this embodiment>

[0061] As described above, by presenting the notification information N1 to the user 101 when the user 101 is not concentrating, it is easier to communicate with others. In addition, by presenting the notification information N2 to people other than the user 101 when the user 101 is concentrating, it is easier to maintain the concentration of the user 101.

[0062] [Third Embodiment]

[0063] In the first and second embodiments, a situation in which the user 101 communicates with the surrounding users 102 is assumed. However, a situation in which the user 101 communicates with others via a communication device such as a smartphone is also conceivable. In the present embodiment, such a situation is assumed.

[0064] <Structure>

[0065] like Figure 3 As shown, the sound signal reproduction system 3 of the third embodiment includes a control device 31, a user sensor 12, a communication device 33, and a sound signal output device 14. The control device 31 includes an input unit 111, a reproduction unit 112, a storage unit 113, a concentration state estimation unit 114, a control unit 315, and a notification determination unit 316. The control device 31 may further include a user notification unit 217 and a communication notification unit 318.

[0066] <Pretreatment>

[0067] Same as the first embodiment.

[0068] <Processing>

[0069] The difference from the first and second embodiments is that, instead of the sound signal sensor 13, a communication device 33 such as a smartphone sends a notification such as an incoming call (a notification related to the second sound signal) to the determination unit 316, and the notification determination unit 316 sends "notification detection information" indicating whether the communication device 33 has a notification based on the input notification to the control unit 315.

[0070] As described above, the control unit 315 receives the “information indicating whether or not the user is in a concentrated state” or “information indicating the degree of concentration” sent from the concentration state estimation unit 114 and the “notification detection information” sent from the notification determination unit 316 in real time. The control unit 315 determines whether or not the user 101 who is listening to the acoustic signal AC1 is in a concentrated state using the “information indicating whether or not the user is in a concentrated state”, or determines whether or not the degree of concentration of the user 101 is greater than the reference TH1 (first reference) using the “information indicating the degree of concentration”. Here, when the user 101 is not in a concentrated state or when the degree of concentration of the user 101 is lower than the reference TH1 (first reference), the control unit 315 performs the control process CON1 (first control process) of changing the acoustic signal AC1 so that the user 101 can easily hear the acoustic signal AC2 (second acoustic signal) output from the communication device 33, based on the notification (notification related to the second acoustic signal) indicated by the “notification detection information”. This process is performed automatically. As a result, the user 101 can easily notice the notification from the communication device 33 when not concentrating, and can easily communicate with others via the communication device 33. On the other hand, when the user 101 is in a concentrated state or the concentration level is equal to or higher than the reference TH1, the control process CON2 (second control process) is performed without performing the control process CON1 (first control process). As a result, when the user 101 is concentrating, it becomes easy to maintain the concentrated state. Specific examples of the control process CON1 (first control process) and the control process CON2 (second control process) are shown below.

[0071] A specific example of the control process CON1 (first control process):

[0072] The control process CON1 (first control process) includes, for example, a process of changing the acoustic signal AC1 (first acoustic signal) so that the user 101 can easily hear the acoustic signal AC2 (second acoustic signal) output from the communication device 33 when there is a notification such as an incoming call (notification related to the second acoustic signal) in the communication device 33. An example of this process is a process of attenuating the amplitude of the acoustic signal AC1 (first acoustic signal). As a result, the user 101 can easily notice the notification in the communication device 33. On the other hand, when there is no notification such as an incoming call in the communication device 33 (notification related to the second acoustic signal), the following process is not performed, that is, the process of changing the acoustic signal AC1 (first acoustic signal) so that the user 101 can easily hear the acoustic signal AC2 (second acoustic signal). As a result, it is possible to prevent the acoustic signal AC1 from being sent and changing according to the concentration state of the user 101 even though there is no incoming call in the communication device 33.

[0073] In the control process CON1, the control unit 315 may further instruct the user notification unit 217 to output the notification information N1, and the user notification unit 217 may perform a process for presenting the notification information N1 to the user 101. The specific example is as described in the second embodiment.

[0074] A specific example of the control process CON2 (second control process):

[0075] In the control process CON2 (second control process), the following process is not performed, that is, the process of changing the acoustic signal AC1 so that the user 101 can easily hear the acoustic signal AC2. For example, in the control process CON2, the amplitude of the acoustic signal AC1 is not automatically attenuated or the phase or waveform of the acoustic signal AC1 is not changed. As a result, when the user 101 listens to the acoustic signal AC1 at a high volume in order to maintain a focused state, the user 101 can maintain a focused state even if there is an incoming call on the communication device 33.

[0076] In the control process CON2, the communication device 33 may also prompt the communication object with notification information N2 (second notification information). In this case, the control unit 315 also instructs the communication notification unit 318 to send the notification information N2 to the communication object, and the communication notification unit 318 sends the notification information N2 to the communication device 33 and instructs it to be sent to the communication object. The notification information N2 can be auditory information (for example, notification sound, notification voice, etc.), visual information (for example, notification message, etc.), tactile information (for example, vibration, etc.), or a combination of at least part of them. In this way, it is possible to convey to the communication object that the user 101 is in a concentrated state, and the user 101 can maintain a concentrated state without being disturbed by others.

[0077] The rest of the processing of the control unit 315 is the same as that of the control unit 115 .

[0078] <Features of this embodiment>

[0079] As described above, in this embodiment, the acoustic signal AC1 is controlled based on the concentration state and concentration degree of the user 101 who listens to the acoustic signal AC1 and the notification related to the acoustic signal AC2 which is different from the acoustic signal AC1. As a result, it becomes easier for the user 101 to communicate with others when not concentrating and easier to maintain the concentration state when concentrating.

[0080] [Hardware Structure]

[0081] The control devices 11, 21, and 31 in each embodiment are, for example, devices that are configured by executing a given program on a general-purpose or special-purpose computer having a processor (hardware / processor) such as a CPU (central processing unit), a memory such as a RAM (random-access memory) / ROM (read-only memory), etc. That is, the control devices 11, 21, and 31 in each embodiment have, for example, a processing circuit configured to implement each of the parts they have. The computer may have one processor and a memory, or may have multiple processors and memories. The program may be installed in the computer or recorded in a ROM, etc. in advance. In addition, instead of using an electronic circuit (circuitry) that implements a functional structure by reading a program like a CPU, an electronic circuit that implements a processing function alone may be used to constitute a part or all of the processing unit. In addition, the electronic circuit constituting one device may also include multiple CPUs.

[0082] Figure 4 1 is a block diagram illustrating the hardware configuration of the control devices 11, 21, and 31 in each embodiment. Figure 4As shown, the control devices 11, 21, and 31 of this example have a CPU (Central Processing Unit) 10a, an input unit 10b, an output unit 10c, a RAM (Random Access Memory) 10d, a ROM (Read Only Memory) 10e, an auxiliary storage device 10f, a communication unit 10h, and a bus 10g. The CPU 10a of this example has a control unit 10aa, a calculation unit 10ab, and a register 10ac, and performs various calculations according to various programs read into the register 10ac. In addition, the input unit 10b is an input terminal, keyboard, mouse, touch panel, etc. for inputting data. In addition, the output unit 10c is an output terminal, display, etc. for outputting data. The communication unit 10h is a LAN card, etc. controlled by the CPU 10a that has read a given program. In addition, the RAM 10d is an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), etc., and has a program area 10da for storing a given program and a data area 10db for storing various data. In addition, the auxiliary storage device 10f is, for example, a hard disk, an MO (Magneto-Optical disc), a semiconductor memory, etc., and has a program area 10fa for storing a given program and a data area 10fb for storing various data. In addition, the bus 10g connects the CPU 10a, the input unit 10b, the output unit 10c, the RAM 10d, the ROM 10e, the communication unit 10h, and the auxiliary storage device 10f so that information can be exchanged. The CPU 10a follows the read OS (Operating System) program and writes the program stored in the program area 10fa of the auxiliary storage device 10f into the program area 10da of the RAM 10d. Similarly, the CPU 10a writes various data stored in the data area 10fb of the auxiliary storage device 10f into the data area 10db of the RAM 10d. Then, the address on the RAM 10d where the program and data are written is stored in the register 10ac of the CPU 10a. The control unit 10aa of the CPU 10a sequentially reads these addresses stored in the register 10ac, reads the program and data from the area on the RAM 10d indicated by the read address, and causes the calculation unit 10ab to sequentially execute the calculation indicated by the program, and stores the calculation result in the register 10ac. With such a structure, the functional structure of the control device 11, 21, 31 is realized.

[0083] The above-mentioned program can be recorded in a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

[0084] The circulation of the program is carried out, for example, by selling, transferring, renting, etc. a removable recording medium such as a DVD, CD-ROM, etc. on which the program is recorded. Furthermore, it is also possible to store the program in the storage device of the server computer, and to forward the program from the server computer to other computers via a network, so as to circulate the program. As described above, a computer that executes such a program, for example, first temporarily stores the program recorded in the removable recording medium or the program forwarded from the server computer in its own storage device. Then, when executing the process, the computer reads the program stored in its own storage device and executes the process in accordance with the read program. In addition, as another execution method of the program, it is also possible to set the computer to directly read the program from the removable recording medium and execute the process in accordance with the program, and further, it is also possible to set the process in accordance with the received program one by one each time the program is forwarded from the server computer to the computer. In addition, it is also possible to set the structure of executing the above-mentioned process by not forwarding the program from the server computer to the computer but only realizing the processing function through the execution instruction and result acquisition, the so-called ASP (Application Service Provider: Application Service Provider) type service. In addition, the program in this embodiment includes information for processing by an electronic computer, that is, information following the program (data having properties that specify processing by the computer, etc., although not direct instructions to the computer).

[0085] In each embodiment, the present apparatus is configured by executing a given program on a computer, but at least a part of the processing contents may be realized on hardware.

[0086] [Other Modifications]

[0087] In addition, the present invention is not limited to the above-mentioned embodiments. The above-mentioned various processes can not only be performed in a time series according to the records, but also can be performed in parallel or individually according to the processing capacity or needs of the device for performing the processing. In addition, it is of course possible to appropriately change within the scope of the gist of the present invention.

[0088] Description of Reference Numerals

[0089] 1, 2, 3: sound signal reproduction system, 11, 21, 31: control device, 115, 315: control unit.

Claims

1. A control device comprising: A control unit performs a first control process in which the first sound signal is changed based on a second sound signal different from the first sound signal or a notification related to the second sound signal so that the user can easily hear the second sound signal when the user who hears the first sound signal is not in a concentrated state or when the concentration level of the user is lower than a first standard, and performs a second control process in which the first control process is not performed when the user is in a concentrated state or when the concentration level is higher than the first standard.

2. The control device according to claim 1, wherein: The first control process includes a process of changing the first sound signal so that the user can easily hear the second sound signal when the amplitude of the second sound signal is equal to or larger than a second reference or when the second sound signal is detected.

3. The control device according to claim 1, wherein: The first control process includes a process of attenuating the amplitude of the first acoustic signal when the amplitude of the second acoustic signal is equal to or larger than a second reference or when the second acoustic signal is detected.

4. The control device according to claim 1, wherein: The first control process includes a process for presenting first notification information to the user when the amplitude of the second acoustic signal is equal to or larger than a second reference or when the second acoustic signal is detected.

5. The control device according to claim 1, wherein: The second control process includes a process of changing the first sound signal so that the user is less likely to hear the second sound signal.

6. The control device according to claim 1, wherein: The second control process includes a process for presenting second notification information to a person other than the user.

7. A control method, which is a control method based on a control device, comprising: The first step is to perform a first control process in which, when a user who hears a first sound signal is not in a concentration state or when the concentration level of the user is lower than a first reference, the first control process is a control process in which the first sound signal is changed based on a second sound signal different from the first sound signal or a notification related to the second sound signal so that the user can easily hear the second sound signal; and In the second step, when the user is in a concentrated state or when the concentration level is equal to or higher than the first reference, a second control process is performed, wherein the first control process is not performed.

8. A program for causing a computer to function as the control device according to claim 1.

Images