Control device, control method, and program

Abstract

According to the present invention, when a user listening to a first acoustic signal is not in a state of concentration or when the concentration level of the user is lower than a first criterion, first control processing is performed in response to a second acoustic signal that is different from the first acoustic signal or a notification regarding the second acoustic signal, the first control processing changing the first acoustic signal to make it easier for the user to listen to the second acoustic signal, whereas when the user is in the state of concentration or when the concentration level is at or above the first criterion, second control processing is performed without performing the first control processing.

Description

Technical Field

[0001] The present invention relates to a technique for controlling the reproduction of acoustic signals.

Background Art

[0002] There are known acoustic signal output devices of a type that do not completely block the ear canal, such as open-ear type (open type) earphones and headphones. A user wearing such an acoustic signal output device can listen to a desired reproduced sound such as music while being able to hear surrounding sounds.

[0003] However, even when a user is using such an acoustic signal output device, if the volume of the reproduced sound is large, the user may not notice a call from a person around or a notification from a terminal device such as a smartphone, which may interfere with communication with others. On the other hand, the user may deliberately listen to the reproduced sound at a large volume so as not to interrupt the concentration state.

[0004] In contrast, Non-Patent Document 1 discloses a technique in which when a user listening to reproduced sound with headphones makes a sound, the reproduced sound is automatically paused or muted. Patent Document 1 also discloses a technique for estimating a user's behavior based on the detection results of sensors and controlling the maximum allowable volume of the reproduced sound based on the estimation results.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Non-Patent Documents

[0006]

Non-Patent Document 1

[0007] However, in the technology described in Non-Patent Document 1, the playback sound is not controlled unless the user speaks, and if the user does not notice calls, ringtones, or notification sounds, it may interfere with communication with others. Furthermore, in the technology described in Patent Document 1, even if the user deliberately listens to the playback sound at a high volume to avoid interrupting their concentration, the maximum allowable volume of the playback sound is still controlled.

[0008] This problem is common not only when users are listening to reproduced sound using an acoustic signal output device that does not block the ear canal, but also when a user listening to a first acoustic signal is in an environment where they can also hear a second acoustic signal that is different from the first acoustic signal.

[0009] In view of these points, the present invention provides a technology that, in an environment where a user listening to a first acoustic signal may also hear a second acoustic signal different from the first acoustic signal, facilitates communication with others when the user is not concentrating, and facilitates maintaining that state of concentration when the user is concentrating. [Means for solving the problem]

[0010] If a user listening to the first sound signal is not in a state of concentration or the user's level of concentration is lower than the first criterion, a first control process is performed to change the first sound signal in response to a second sound signal different from the first sound signal or a notification regarding the second sound signal, so that the user can more easily hear the second sound signal. If the user is in a state of concentration or the level of concentration is equal to or greater than the first criterion, a second control process is performed in which the first control process is not performed. [Effects of the Invention]

[0011] This makes it easier for a user listening to a first sound signal to communicate with others when they are not concentrating, and easier for them to maintain their concentration when they are concentrating, in an environment where they may also hear a second sound signal that is different from the first sound signal. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a diagram illustrating the configuration of an acoustic signal reproduction system according to an embodiment. [Figure 2] Figure 2 is a flowchart illustrating the control method of the embodiment. [Figure 3] Figure 3 is a diagram illustrating the configuration of an acoustic signal reproduction system according to an embodiment. [Figure 4] Figure 4 is a block diagram illustrating the hardware configuration of the control device according to the embodiment. [Modes for carrying out the invention]

[0013] Embodiments of the present invention will be described below with reference to the drawings. [First Embodiment] <Structure> As illustrated in Figure 1, the acoustic signal reproduction system 1 of the first embodiment includes a control device 11, a user sensor 12, an acoustic signal sensor 13, and an acoustic signal output device 14.

[0014] The control device 11 includes an input unit 111, a playback unit 112, a storage unit 113, a concentration state estimation unit 114, a control unit 115, and an environment estimation unit 116.

[0015] The user sensor 12 is a sensor that detects the state of the user 101. The user sensor 12 includes, for example, at least one of a biological signal sensor that detects the biological signal of the user 101, an acceleration information sensor that detects the posture, movement, orientation, etc. of the user 101, or a position sensor that detects the position of the user 101. Examples of the biological signal sensor include a sensor that detects the pulse or heart rate of the user 101, a sensor that detects brain waves, a sensor that detects eye movement, etc. Examples of the acceleration information sensor include an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, a 9-axis sensor, etc. Examples of the position sensor include a geomagnetic sensor, a camera, a capacitance sensor, an ultrasonic sensor, a potentiometer, etc.

[0016] The acoustic signal sensor 13 is a microphone, a volume sensor, etc. that detects the ambient acoustic signal AC2 (second acoustic signal).

[0017] The acoustic signal output device 14 is, for example, an earphone, a headset, a neck speaker, a bone conduction speaker, or other speakers that output the acoustic signal AC1 (first acoustic signal). The acoustic signal output device 14 may be of a type that does not completely block the external auditory canal of the user 101, or may be of a type that completely blocks the external auditory canal of the user 101.

[0018] <Preprocessing> In the preprocessing stage, the memory unit 113 stores "concentration state estimation information" for estimating the concentration state of the user 101 from the "input information". The "input information" may be, for example, "detection information" detected by the user sensor 12 or its function value, or "other information" relating to the "detection information" and the concentration state of the user 101 or their function values, or the "other information" or its function value. The "other information" may be, for example, information representing the content of the user 101's task, information representing the duration of the user 101's task, information representing the time the user 101 performed the task, or information representing the user 101's intentions (such as "I want to concentrate," "I can communicate," "I want to turn off notifications," or "I want to turn on notifications"). The "concentration state estimation information" may be, for example, information for obtaining "information indicating whether or not the user 101 is in a concentrated state" based on the "input information," or information for obtaining "information indicating the degree of concentration" of the user 101 based on the "input information." A higher degree of concentration indicates a more concentrated state, and a lower degree of concentration indicates a less concentrated state. "Information for estimating concentration state" may be, for example, a table that associates "input information" with "information indicating whether or not a concentration state is in place," or a table that associates "input information" with "information indicating the degree of concentration," or a threshold for "input information" used to determine whether or not a concentration state is in place. These tables and thresholds are predetermined based on, for example, past "detection information," past task logs, the duration of past tasks, the time when past tasks were performed, etc. Alternatively, "information for estimating concentration state" may be, for example, an estimation model that outputs "information indicating whether or not a concentration state is in place" for "input information," or an estimation model that outputs "information indicating the degree of concentration" for "input information." Examples of estimation models include deep learning-based models, hidden Markov models, and SVMs (Support Vector Machines). These models can be obtained, for example, through machine learning using a learning model.Examples of learning models include supervised learning data that associates "learning input information" (such as past detection information, past task logs, the duration of past tasks, the time when past tasks were performed, etc.) with labels representing "whether in a concentrated state" or "degree of concentration", etc. There is no limitation on the method for estimating the concentrated state, and known estimation methods such as those disclosed in JP-A-2014-158600 etc. may be used.

[0019] <Process> The playback unit 112 of the control device 11 (Fig. 1) outputs a playback signal representing the acoustic signal AC1 (first acoustic signal) that the user 101 listens to under the control of the control unit 115. The acoustic signal AC1 is, for example, music, voice, environmental sound, or other acoustic content. The playback signal is transmitted to the acoustic signal output device 14 by wire or wirelessly, and the acoustic signal output device 14 outputs the acoustic signal AC for based on the transmitted playback signal. The user 101 listens to the acoustic signal AC1 output from the acoustic signal output device 14.

[0020] The user sensor 12 detects the state of the user 101 and sends the detected "detection information" to the concentration state estimation unit 114. When the user sensor 12 includes a biological signal sensor, the "detection information" includes information representing the biological signal of the user 101. When the user sensor 12 includes an acceleration information sensor, the "detection information" includes information representing the posture, movement, orientation, etc. of the user 101, such as the acceleration and angular acceleration of the user 101. When the user sensor 12 includes a position sensor, the "detection information" includes information representing the position of the user 101. When "other information" regarding the concentration state of the user 101 is input from the input unit 111, the "other information" is sent to the concentration state estimation unit 114.

[0021] The concentration state estimation unit 114 uses the user's "input information" which includes at least one of "detection information" and "other information," and the "concentration state estimation information" extracted from the storage unit 113 to obtain and output "information indicating whether or not user 101 is in a concentrated state" or "information indicating the degree of concentration" of user 101. For example, if the "concentration state estimation information" is a table in which "input information" is associated with "information indicating whether or not user 101 is in a concentrated state" or "information indicating the degree of concentration," the concentration state estimation unit 114 obtains and outputs "information indicating whether or not user 101 is in a concentrated state" or "information indicating the degree of concentration" corresponding to user 101's "input information." For example, if the "concentration state estimation information" is a threshold for "input information" to determine "whether or not user 101 is in a concentrated state," the concentration state estimation unit 114 performs a threshold determination on user 101's "input information" and obtains and outputs "information indicating whether or not user 101 is in a concentrated state." For example, if the "information for estimating concentration state" is an estimation model that outputs "information indicating whether or not the user is in a state of concentration" or "information indicating the degree of concentration" for the "input information", the concentration state estimation unit 114 uses this estimation model to obtain and output "information indicating whether or not the user is in a state of concentration" or "information indicating the degree of concentration" corresponding to the "input information". If the "other information" includes information that expresses the user's intentions, the concentration state estimation unit 114 may prioritize the user's intentions and obtain and output "information indicating whether or not the user is in a state of concentration". For example, if the "other information" expresses intentions such as "I want to concentrate" or "I want to turn off notifications", the concentration state estimation unit 114 may output "information indicating that the user is in a state of concentration" as "information indicating whether or not the user is in a state of concentration". For example, if the "other information" expresses intentions such as "communication is possible" or "I want to turn on notifications", the concentration state estimation unit 114 may output "information indicating that the user is not in a state of concentration" as "information indicating whether or not the user is in a state of concentration". Information representing the user 101's intentions, included in "other information," is stored in the memory unit 113. The concentration state estimation unit 114 may, until the user 101's intentions are updated, obtain and output "information indicating whether or not the user is in a state of concentration" based on the information representing the intentions stored in the memory unit 113, as described above. The "information indicating whether or not the user is in a state of concentration" or "information indicating the degree of concentration" is sent to the control unit 115.

[0022] The acoustic signal sensor 13 detects the surrounding acoustic signal AC2 (second acoustic signal) and sends information representing the acoustic signal AC2 to the environment estimation unit 116. The environment estimation unit 116 uses the information representing the input acoustic signal AC2 to send "acoustic detection information" representing the detection result of the surrounding acoustic signal to the control unit 115. The acoustic detection information includes, for example, information indicating whether or not the user 102 has spoken in the surroundings, and information indicating the loudness of the surrounding sound.

[0023] The control unit 115 receives in real time "information indicating whether or not the user is in a state of concentration" or "information indicating the degree of concentration" from the concentration state estimation unit 114, and "acoustic detection information" from the environment estimation unit 116. The control unit 115 uses the "information indicating whether or not the user is in a state of concentration" to determine whether or not the user 101 listening to the acoustic signal AC1 is in a state of concentration, or uses the "information indicating the degree of concentration" to determine whether or not the user 101's degree of concentration is equal to or greater than the standard TH1 (first standard). If the user 101 is not in a state of concentration or the user 101's degree of concentration is lower than the standard TH1 (first standard), the control unit 115 performs a control process CON1 (first control process) to change the acoustic signal AC1 in accordance with the acoustic signal AC2 (second acoustic signal different from the first acoustic signal) in the user 101's surroundings, which is represented by the "acoustic detection information," so that the user 101 can more easily hear the acoustic signal AC2. This process is performed automatically. This makes it easier for user 101 to notice calls from user 102 and communicate with others when not concentrating. On the other hand, if user 101 is in a state of concentration or if their level of concentration is above the standard TH1, control process CON2 (second control process) is performed. Control process CON2 (second control process) is a process that does not perform control process CON1 (first control process). This makes it easier for user 101 to maintain their state of concentration when they are concentrating. Specific examples of control process CON1 (first control process) and control process CON2 (second control process) are shown below.

[0024] Specific example of control process CON1 (first control process): Control process CON1 (first control process) includes, for example, a process to change the acoustic signal AC1 (first acoustic signal) so that user 101 can more easily hear the acoustic signal AC2 (second acoustic signal) when the amplitude of the acoustic signal AC2 (second acoustic signal) is greater than or equal to the reference TH2 (second reference) or when the acoustic signal AC2 (second acoustic signal) is detected. An example of this process is a process to attenuate the amplitude of the acoustic signal AC1 (first acoustic signal). In addition, the phase or waveform of the acoustic signal AC1 (first acoustic signal) may be changed to make it easier for user 101 to hear the acoustic signal AC2 (second acoustic signal). This makes it easier for user 101 to notice calls from user 102, etc. On the other hand, if the amplitude of acoustic signal AC2 (second acoustic signal) is less than the reference TH2 (second reference) or if acoustic signal AC2 (second acoustic signal) is not detected, the process of changing acoustic signal AC1 (first acoustic signal) in this way (the process of changing the first acoustic signal to make it easier for the user to hear the second acoustic signal) is not executed. This prevents acoustic signal AC1 from changing in accordance with the concentration state of user 101 even if there is no call or other notification from user 102.

[0025] Specific example of control process CON2 (second control process): In control process CON2 (second control process), no processing is performed to change the acoustic signal AC1 so that user 101 can easily hear the acoustic signal AC2. For example, control process CON2 does not automatically attenuate the amplitude of the acoustic signal AC1 or change its phase or waveform. For example, control process CON2 may do nothing. This allows user 101 to maintain their concentration even if they are called out to or the surroundings are noisy while listening to the acoustic signal AC1 at a high volume to maintain their concentration.

[0026] Furthermore, the control process CON2 may include a process to modify the acoustic signal AC1 (first acoustic signal) so that user 101 has difficulty hearing the acoustic signal AC2 (second acoustic signal). For example, the magnitude of each frequency component of acoustic signal AC1 may be changed, the phase of acoustic signal AC1 may be changed, or acoustic signal AC1 may be modified in any other way to mask acoustic signal AC2 so that user 101 has difficulty hearing acoustic signal AC2. For example, an acoustic signal obtained by adding an acoustic signal with the opposite phase of acoustic signal AC2, or an acoustic signal approximating said opposite phase acoustic signal, to the original acoustic signal AC1 may be used as the new acoustic signal AC1. This makes it possible to maintain user 101's concentration even if there is a call from the surroundings or the surroundings are noisy.

[0027] Specific example of control processing by the control unit 115: Figure 2 illustrates a specific example of the control process performed by the control unit 115. The control unit 115 receives "information indicating whether or not the user is in a concentrated state" or "information indicating the degree of concentration" sent from the concentration state estimation unit 114, and "acoustic detection information" sent from the environment estimation unit 116 (step S1). The control unit 115 uses the acoustic detection information to determine whether or not a call was made. For example, the control unit 115 determines that a call was made if the amplitude of the acoustic signal AC2 is greater than or equal to the reference TH2, or if the acoustic signal AC2 is detected, and determines that there was no call otherwise (step S2). If it is determined that there was no call, the process returns to step S1. On the other hand, if it is determined that a call was made, the control unit 115 uses "information indicating whether or not the user is in a concentrated state" or "information indicating the degree of concentration" to determine whether or not the user 101 is in a concentrated state, or the degree of concentration of the user 101 (step S3). If user 101 is not in a concentrated state or the degree of concentration of user 101 is lower than the standard TH1 (first standard), the control unit 115 performs control process CON1 (first control process) (step S4), and then returns the process to step S1. On the other hand, if user 101 is in a concentrated state or the degree of concentration is equal to or greater than the standard TH1, the control unit 115 performs control process CON2 (second control process) (step S5), and then returns the process to step S1.

[0028] <Features of this embodiment> As described above, in this embodiment, the acoustic signal AC1 is controlled based on the concentration state and degree of concentration of the user 101 listening to the acoustic signal AC1, and an acoustic signal AC2 that is different from the acoustic signal AC1. As a result, the user 101 can more easily communicate with others when not concentrating, and can more easily maintain that state of concentration when concentrating.

[0029] [Second Embodiment] The second embodiment is a modification of the first embodiment, and further notifications are made to user 101 and other users 102 based on the concentration state and degree of concentration of user 101 listening to the acoustic signal AC1, and an acoustic signal AC2 that is different from acoustic signal AC1. In the following, the differences from the first embodiment will be explained in detail, and the explanation of matters already explained will be simplified using the same reference numbers.

[0030] <Structure> As illustrated in Figure 1, the acoustic signal reproduction system 2 of the second embodiment includes a control device 21, a user sensor 12, an acoustic signal sensor 13, and an acoustic signal output device 14. The control device 21 includes an input unit 111, a reproduction unit 112, a storage unit 113, a centralized state estimation unit 114, a control unit 115, an environment estimation unit 116, a user notification unit 217, and an ambient notification unit 218.

[0031] <Pre-processing> This is the same as the first embodiment.

[0032] <Processing> The difference from the first embodiment lies in the control process CON1 (first control process) and control process CON2 (second control process). The control process CON1 of the second embodiment includes a process for presenting notification information N1 (first notification information) to the user 101 when the amplitude of the acoustic signal AC2 (second acoustic signal) is greater than or equal to the reference TH2 (second reference) or when the acoustic signal AC2 (second acoustic signal) is detected. In this control process CON1, the control unit 115 further instructs the user notification unit 217 to output the notification information N1, and the user notification unit 217 performs a process for presenting this notification information N1 to the user 101. This process is, for example, a process for outputting notification information N1 to the user 101 from an acoustic signal output device 14, a control device 11, or other device (for example, a smartphone). The notification information N1 may be auditory (e.g., a notification sound or voice), visual (e.g., LED light, image display, lighting change, or notification message), tactile (e.g., vibration), or a combination of at least some of these. By presenting the notification information N1 to the user 101, the user 101 can become aware that someone has called out to them, and can communicate with that person more smoothly.

[0033] Furthermore, the control process CON2 of the second embodiment includes processing for presenting notification information N2 (second notification information) to persons other than user 101 (for example, user 102). In this control process CON2, the control unit 115 further instructs the ambient notification unit 218 to output notification information N2, and the ambient notification unit 218 processes to present this notification information N2 to persons other than user 101. This processing is, for example, the process of outputting notification information N2 to persons other than user 101 from an acoustic signal output device 14, a control device 11, or other devices (for example, a smartphone). The notification information N2 may be auditory (for example, a notification sound or notification voice), visual (for example, LED light emission, image display, lighting change, or notification message), tactile (for example, vibration), or a combination of at least some of these. This allows others, such as user 102, to know that user 101 is in a state of concentration, and user 101 can maintain their state of concentration without being disturbed by others.

[0034] Alternatively, control process CON1 may include processing for presenting the notification information N1 described above, while control process CON2 may not include processing for presenting the notification information N2 described above. Alternatively, control process CON1 may not include processing for presenting the notification information N1 described above, while control process CON2 may include processing for presenting the notification information N2 described above.

[0035] <Features of this embodiment> As described above, by presenting notification information N1 to user 101 when user 101 is not concentrating, it becomes easier for user 101 to communicate with others. Furthermore, by presenting notification information N2 to others when user 101 is concentrating, it becomes easier to maintain user 101's concentration.

[0036] [Third Embodiment] In the first and second embodiments, a situation was assumed in which user 101 communicates with users 102 in the vicinity. However, a situation in which user 101 communicates with others via a communication device such as a smartphone can also be assumed. This embodiment assumes such a situation.

[0037] <Structure> As illustrated in Figure 3, the acoustic signal reproduction system 3 of the third embodiment includes a control device 31, a user sensor 12, a communication device 33, and an acoustic signal output device 14. The control device 31 includes an input unit 111, a reproduction unit 112, a storage unit 113, a centralized state estimation unit 114, a control unit 315, and a notification determination unit 316. The control device 31 may further include a user notification unit 217 and a communication notification unit 318.

[0038] <Pre-processing> This is the same as the first embodiment.

[0039] <Processing> The difference from the first and second embodiments is that instead of the acoustic signal sensor 13, a communication device 33 such as a smartphone sends notifications such as incoming calls (notifications related to the second acoustic signal) to the notification determination unit 316, and the notification determination unit 316 sends "notification detection information" to the control unit 315 indicating whether or not a notification was received by the communication device 33 based on the input notification.

[0040] As described above, the control unit 315 receives in real time "information indicating whether or not the user is in a concentrated state" or "information indicating the degree of concentration" sent from the concentration state estimation unit 114, and "notification detection information" sent from the notification determination unit 316. The control unit 315 uses the "information indicating whether or not the user is in a concentrated state" to determine whether or not the user 101 listening to the acoustic signal AC1 is in a concentrated state, or uses the "information indicating the degree of concentration" to determine whether or not the user 101's degree of concentration is equal to or greater than the standard TH1 (first standard). If the user 101 is not in a concentrated state or the user 101's degree of concentration is lower than the standard TH1 (first standard), the control unit 315 performs a control process CON1 (first control process) to change the acoustic signal AC1 so that the user 101 can more easily hear the acoustic signal AC2 (second acoustic signal) output from the communication device 33, in response to the notification (notification regarding the second acoustic signal) indicated by the "notification detection information". This process is performed automatically. This makes it easier for user 101 to notice notifications from the communication device 33 when not concentrating, and to communicate with others via the communication device 33. On the other hand, if user 101 is in a concentrating state or the degree of concentration is equal to or greater than the standard TH1, control process CON2 (second control process) is performed instead of control process CON1 (first control process). This makes it easier for user 101 to maintain that concentrating state when they are concentrating. Specific examples of control process CON1 (first control process) and control process CON2 (second control process) are shown below.

[0041] Specific example of control process CON1 (first control process): Control process CON1 (first control process) includes, for example, a process to change the acoustic signal AC1 (first acoustic signal) so that user 101 can more easily hear the acoustic signal AC2 (second acoustic signal) output from communication device 33 when there is a notification such as an incoming call (notification related to the second acoustic signal) on communication device 33. An example of this process is a process to attenuate the amplitude of the acoustic signal AC1 (first acoustic signal). This makes it easier for user 101 to notice notifications on communication device 33. On the other hand, if there is no notification such as an incoming call (notification related to the second acoustic signal) on communication device 33, the process to change the acoustic signal AC1 (first acoustic signal) so that user 101 can more easily hear the acoustic signal AC2 (second acoustic signal) is not executed. This prevents the acoustic signal AC1 from changing according to user 101's concentration state even when there is no incoming call or other notification on communication device 33.

[0042] In this control process CON1, the control unit 315 may further instruct the user notification unit 217 to output notification information N1, and the user notification unit 217 may perform processing to present this notification information N1 to the user 101. A specific example of this is as described in the second embodiment.

[0043] Specific example of control process CON2 (second control process): In control process CON2 (second control process), no processing is performed to change the acoustic signal AC1 so that user 101 can easily hear the acoustic signal AC2. For example, control process CON2 does not automatically attenuate the amplitude of the acoustic signal AC1 or change its phase or waveform. As a result, even if there is an incoming call or other issue on the communication device 33 while user 101 is listening to the acoustic signal AC1 at a high volume to maintain their concentration, user 101 can maintain their concentration.

[0044] In this control process CON2, the communication device 33 may present notification information N2 (second notification information) to the communication partner. In this case, the control unit 315 may further instruct the communication notification unit 318 to send the notification information N2 to the communication partner, and the communication notification unit 318 may send this notification information N2 to the communication device 33 and instruct it to send it to the communication partner. The notification information N2 may be auditory (e.g., notification sound or notification voice), visual (e.g., notification message), tactile (e.g., vibration), or a combination of at least some of these. This allows the communication partner to be informed that the user 101 is in a state of concentration, and the user 101 can maintain their state of concentration without being disturbed by others.

[0045] The other processing of the control unit 315 is the same as that of the control unit 115.

[0046] <Features of this embodiment> As described above, in this embodiment, the acoustic signal AC1 is controlled based on the concentration state and degree of concentration of the user 101 listening to the acoustic signal AC1, and notifications regarding an acoustic signal AC2 that is different from acoustic signal AC1. As a result, the user 101 can more easily communicate with others when not concentrating, and can more easily maintain that state of concentration when concentrating.

[0047] [Hardware configuration] The control devices 11, 21, and 31 in each embodiment are devices configured by a general-purpose or dedicated computer, for example, equipped with a processor (hardware processor) such as a CPU (central processing unit) and memory such as RAM (random-access memory) and ROM (read-only memory), executing a predetermined program. That is, the control devices 11, 21, and 31 in each embodiment have, for example, processing circuits configured to implement the respective parts they each possess. This computer may have one processor and memory, or it may have multiple processors and memories. This program may be installed on the computer, or it may be pre-recorded in ROM, etc. Furthermore, some or all of the processing units may be configured using electronic circuits that realize processing functions independently, rather than electronic circuits that realize the functional configuration by loading a program, such as a CPU. Also, the electronic circuits that constitute one device may include multiple CPUs.

[0048] Figure 4 is a block diagram illustrating the hardware configuration of the control devices 11, 21, and 31 in each embodiment. As illustrated in Figure 4, the control devices 11, 21, and 31 in this example include a CPU (Central Processing Unit) 10a, an input unit 10b, an output unit 10c, a RAM (Random Access Memory) 10d, a ROM (Read Only Memory) 10e, an auxiliary storage device 10f, a communication unit 10h, and a bus 10g. The CPU 10a in this example includes a control unit 10aa, an arithmetic unit 10ab, and a register 10ac, and performs various arithmetic processing according to various programs loaded into the register 10ac. The input unit 10b is an input terminal, keyboard, mouse, touch panel, etc., to which data is input. The output unit 10c is an output terminal, display, etc., to which data is output. The communication unit 10h is a LAN card, etc., controlled by the CPU 10a which has loaded a predetermined program. Furthermore, RAM 10d is an SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), etc., and has a program area 10da where a predetermined program is stored and a data area 10db where various data is stored. Furthermore, auxiliary storage device 10f is, for example, a hard disk, MO (Magneto-Optical disc), semiconductor memory, etc., and has a program area 10fa where a predetermined program is stored and a data area 10fb where various data is stored. Furthermore, bus 10g connects CPU 10a, input unit 10b, output unit 10c, RAM 10d, ROM 10e, communication unit 10h, and auxiliary storage device 10f so that information can be exchanged. CPU 10a writes the program stored in the program area 10fa of auxiliary storage device 10f to the program area 10da of RAM 10d according to the loaded OS (Operating System) program. Similarly, CPU 10a writes various data stored in the data area 10fb of auxiliary storage device 10f to the data area 10db of RAM 10d. Then, the address on RAM10d where this program and data are written is stored in register 10ac of CPU10a.The control unit 10aa of the CPU 10a sequentially reads these addresses stored in register 10ac, reads programs and data from the area on RAM 10d indicated by the read addresses, sequentially has the arithmetic unit 10ab execute the calculations indicated by the programs, and stores the calculation results in register 10ac. This configuration realizes the functional configuration of the control devices 11, 21, and 31.

[0049] The above-mentioned program can be recorded on a computer-readable recording medium. Examples of computer-readable recording media are non-transitory recording media. Examples of such recording media include magnetic recording devices, optical discs, magneto-optical recording media, and semiconductor memory.

[0050] The distribution of this program can be carried out, for example, by selling, transferring, or lending portable recording media such as DVDs or CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing it in the storage device of a server computer and transferring it from the server computer to other computers via a network. As described above, a computer executing such a program may, for example, first store the program recorded on the portable recording media or the program transferred from the server computer in its own storage device. Then, when processing is to be executed, this computer reads the program stored in its own storage device and executes the processing according to the program it reads. Alternatively, as another form of execution of this program, the computer may directly read the program from the portable recording media and execute the processing according to that program, or it may sequentially execute the processing according to the program received each time a program is transferred to this computer from the server computer. Furthermore, the above processing may be executed by a so-called ASP (Application Service Provider) type service, which does not transfer the program from the server computer to this computer, but realizes the processing function only by issuing execution instructions and obtaining results. Furthermore, the term "program" in this form includes information used for processing by an electronic computer that is equivalent to a program (data, etc., that is not a direct instruction to the computer but has the property of defining the computer's processing).

[0051] In each embodiment, the device is configured by executing a predetermined program on a computer; however, at least a part of these processes may be implemented in hardware.

[0052] [Other variations] It should be noted that the present invention is not limited to the embodiments described above. The various processes described above may be executed not only in chronological order as described, but also in parallel or individually as needed, depending on the processing capacity of the device performing the processes. Needless to say, other modifications can be made as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0053] 1,2,3 Acoustic signal reproduction system 11,21,31 Control device 115,315 Control Unit

Claims

1. The control unit has a control unit that, when a user listening to a first sound signal is not in a focused state or the user's level of focus is lower than a first criterion, performs a first control process to change at least one of the phase or waveform of the first sound signal in response to a second sound signal different from the first sound signal or a notification regarding the second sound signal, so that the user can easily hear the second sound signal; and when the user is in a focused state or the level of focus is equal to or greater than the first criterion, performs a second control process that does not perform the first control process. The control device is such that the first acoustic signal is output from an acoustic signal output device that does not completely block the user's ear canal and is heard by the user.

2. A control device according to claim 1, The control device includes a process for changing the first acoustic signal so that the user can easily hear the second acoustic signal when the amplitude of the second acoustic signal is greater than or equal to a second standard or when the second acoustic signal is detected.

3. A control device according to claim 1, The control device includes a process for attenuating the amplitude of the first acoustic signal when the amplitude of the second acoustic signal is greater than or equal to a second reference or when the second acoustic signal is detected.

4. A control device according to claim 1, The control device includes a process for presenting first notification information to the user when the amplitude of the second acoustic signal is greater than or equal to a second criterion or when the second acoustic signal is detected.

5. A control device according to claim 1, The control device includes a process for changing the first acoustic signal so that the user has difficulty hearing the second acoustic signal.

6. A control device according to claim 1, The control device includes a process for presenting the second notification information to a person other than the user.

7. A control method using a control device, A first step is to perform a first control process in which, if a user listening to the first acoustic signal is not in a focused state or the user's level of focus is lower than a first criterion, the first control process is performed in response to a second acoustic signal different from the first acoustic signal or a notification regarding the second acoustic signal, to change at least one of the phase or waveform of the first acoustic signal so that the user can easily hear the second acoustic signal. A second step in which a second control process is performed in which the first control process is not performed if the user is in a concentrated state or the degree of concentration is equal to or greater than the first criterion, It has, A control method wherein the first acoustic signal is a signal output from an acoustic signal output device that does not completely block the user's ear canal and is heard by the user.

8. A program for causing a computer to function as a control device according to claim 1.

Images