User equipment, shared equipment, methods using them, and programs

Abstract

According to the present invention, an individual acoustic signal specialized for a specific user, who is any one of a plurality of users, is presented to the specific user from an acoustic signal output device for the specific user at a timing synchronized with a common acoustic signal presented to the plurality of users from a common sound source.

Description

[Technical Field]

[0001] This invention relates to a technology for allowing multiple users to listen to an acoustic signal. [Background technology]

[0002] Acoustic signal output devices are known that allow individual reproduced sounds to be heard while ambient sounds can still be heard (see, for example, Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] “WHAT ARE OPEN-EAR HEADPHONES?”, [online], Bose Corporation, [Retrieved September 13, 2021], Internet<https: / / www.bose.com / en_us / better_with_bose / open-ear-headphones.html> [Overview of the project] [Problems that the invention aims to solve]

[0004] However, the advantage of an acoustic signal output device that allows individual reproduced sounds to be heard while ambient sounds are still audible is not being fully utilized.

[0005] In view of these points, the present invention provides a diverse range of services that take advantage of the benefits of an acoustic signal output device that allows users to hear individual reproduced sounds while still being able to hear ambient sounds. [Means for solving the problem]

[0006] At a timing synchronized with a common sound signal presented to multiple users from a common sound source, an individual sound signal tailored to a specific user (one of those multiple users) is presented to that specific user from an audio signal output device for that specific user.

Advantages of the Invention

[0007] As a result, it is possible to provide a diverse service that makes use of the advantages of an acoustic signal output device capable of listening to individual reproduced sounds while being able to listen to surrounding sounds.

Brief Description of the Drawings

[0008] [Figure 1] FIG. 1 is a diagram for exemplifying the configuration of a reproduction system according to an embodiment. [Figure 2] FIG. 2 is a diagram for exemplifying the configuration of a user device and a common device according to an embodiment. [Figure 3] FIG. 3 is a transparent perspective view for exemplifying the configuration of an acoustic signal output device that does not completely seal the external auditory canal. [Figure 4] FIG. 4A is a transparent plan view exemplifying the configuration of an acoustic signal output device that does not completely seal the external auditory canal. FIG. 4B is a transparent front view exemplifying the configuration of an acoustic signal output device that does not completely seal the external auditory canal. FIG. 4C is a bottom view exemplifying the configuration of an acoustic signal output device that does not completely seal the external auditory canal. [Figure 5] FIG. 5A is an end view of 4BA-4BA in FIG. 4B. FIG. 5B is an end view of 4A-4A in FIG. 4A. FIG. 5C is an end view of 4BC-4BC in FIG. 2B. [Figure 6] FIG. 6 is a block diagram for exemplifying the hardware configuration of a user device and a common device according to an embodiment.

Modes for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. [First Embodiment] <Overall Configuration> As illustrated in FIG. 1, the playback system 1 of the first embodiment includes M user devices 11-1, …, 11-M, M sets of acoustic signal output devices 10-1, …, 10-M, N common devices 13-1, …, 13-N, and N acoustic signal output devices 14-1, …, 14-N. Here, M is an integer of 2 or more, and m = 1, …, M. N is an integer of 1 or more, and n = 1, …, N. M users 101-1, …, 101-M use the playback system 1, and each user 101-m uses the user device 11-m and the acoustic signal output device 10-m. Note that the positions and orientations of the common device 13-n and the acoustic signal output device 14-n may be fixed or variable. The user 101-m wears the acoustic signal output device 10-m and can move together with the acoustic signal output device 10-m. The user device 11-m may move together with the user 101-m and the acoustic signal output device 10-m, or may be arranged at a position separated from the user 101-m and the acoustic signal output device 10-m. The user device 11-m is configured to be communicable with the acoustic signal output device 10-m and the acoustic signal output device 10-n by wire or wirelessly, and the acoustic signal output device 10-n is configured to be communicable with the acoustic signal output device 14-n by wire or wirelessly.

[0010] <Acoustic signal output device 10-m> The acoustic signal output device 10-m is an acoustic signal output device for the user 101-m (an acoustic signal output device for a specific user). In the present embodiment, an example of the acoustic signal output device 10-m that is worn on the user 101-m without completely sealing the external auditory canal and emits an acoustic signal (individual acoustic signal) specialized for each user 101-m (specific user) to the external auditory canal of the user 101-m is illustrated. Examples of such an acoustic signal output device 10-m include open-ear type earphones, headphones, audio sunglasses, head-mounted displays, neck speakers, bone conduction speakers, and other speakers. <User device 11-m> As illustrated in FIG. 2, the user device 11-m of the first embodiment includes an individual information providing unit 111-m, a transmitting unit 112-m, a receiving unit 113-m, an input unit 114-m, and an individual playback unit 115-m.

[0011] <Common device 13-n> As illustrated in Figure 2, the common device 13-n of the first embodiment includes storage units 131-n, 133-n, a common playback unit 132-n, a receiving unit 134-n, an individual sound selection unit 135-n, and a transmission unit 136-n (output unit).

[0012] <Acoustic signal output device 14-n> The acoustic signal output device 14-n (common sound source) is a device that allows multiple users (for example, M users 101-1, ..., 101-M) to hear a common acoustic signal (common acoustic signal). The acoustic signal output device 14-n can be anything that emits a common acoustic signal around user 101-m. An example of the acoustic signal output device 14-n is a speaker.

[0013] <Pre-processing> As a preprocessing step, the memory unit 131-n of the common device 13-n (Figure 2) stores a common sound DB (database) representing common (identical) acoustic signals (common acoustic signals) for multiple users (for example, M users 101-1, ..., 101-M). Examples of common acoustic signals include sounds such as music, voices, sound effects, and ambient sounds. In addition, the memory unit 133-n stores an individual sound DB representing acoustic signals (individual acoustic signals) specific to each user 101-m (specific user). Examples of individual acoustic signals include sounds such as music, voices, sound effects, and ambient sounds. Individual acoustic signals are signals with content specific to each user 101-m (specific user), and are, for example, signals corresponding to at least one of each user 101-m's (specific user's) attributes, preferences, actions, posture, orientation, position, or situation. User 101-m's attributes include, for example, age, gender, occupation, nationality, native language, learned languages, learned language level, place of residence, family structure, income, educational background, work history, and perceptual / cognitive characteristics. User 101-m's preferences include, for example, musical preferences, vocal preferences, content preferences, tempo preferences, voice preferences, ambient sound preferences, and so on. User 101-m's actions include, for example, walking, running, turning, stopping, sitting, standing, speaking, and silence. User 101-m's posture and orientation include, for example, facing forward, facing backward, facing right, facing left, facing upward, facing downward, looking down, leaning back, orientation with an elevation angle of θ from the reference position, orientation with an azimuth angle of σ from the reference position, and so on. The location of user 101-m is, for example, a location in a geographic coordinate system, a location relative to a reference location, or a location relative to other user devices 11-m' (where m'≠m, m'∈{1,…,M}). The reference location may be, for example, a fixed specific location, a moving specific location, the location of any common device 13-n, or the location of any other user device 11-m' (where m'≠m, m'∈{1,…,M}). The status of user 101-m may be, for example, participating, not participating, logged in, logged out, playing, not playing, learning, not learning, focused, distracted, tired, awake, etc. Individual acoustic signals are associated with, for example, registered individual information representing the corresponding user 101-m, its attributes, preferences, actions, posture, orientation, location, or status.Note that the individual sound database may be set only during pre-processing, or it may be updated during subsequent update processing.

[0014] <Processing> The common playback unit 132-n of the common device 13-n (Figure 2) extracts a common acoustic signal from the common sound DB stored in the memory unit 131-n and outputs an output signal (information for presenting the common acoustic signal from the common sound source to multiple users) for presenting the common acoustic signal (step S132-n). This output signal is an electrical signal and is supplied to the acoustic signal output device 14-n by wire or wireless. The acoustic signal output device 14-n (common sound source) presents (outputs) the common acoustic signal to multiple users according to the supplied output signal. This common acoustic signal is emitted around the user device 11-m. Users 101-m can hear the common acoustic signal presented from the acoustic signal output device 14-n, but the volume and sound quality of the common acoustic signal that can be heard may differ depending on the location and environment of users 101-m. Furthermore, depending on the location and environment of user 101-m, user 101-m may not be able to hear any of the common acoustic signals presented by any of the acoustic signal output devices 14-n, may be able to hear only the common acoustic signal presented by one of the acoustic signal output devices 14-n, or may be able to hear the common acoustic signals presented by multiple acoustic signal output devices 14-n1, 14-n2 (where n1 ≠ n2, n1, n2 ∈ {1, ..., N}) (step S14-n).

[0015] The individual information provision unit 111-m of the user device 11-m (Figure 2) obtains and outputs individual information specific to user 101-m. The individual information may be pre-set, input in real time, or acquired in real time. Examples of individual information include at least one of user 101-m's attributes, preferences, actions, posture, orientation, location, or situation. Specific examples of attributes, preferences, actions, posture, orientation, location, or situation are as described above. For example, the individual information provision unit 111-m can acquire user 101-m's actions, posture, orientation, etc. using an acceleration information sensor, camera, and microphone, acquire its position using a position sensor, detect user 101-m's situation using a computing device, biosignal sensor, camera, etc., and detect user 101-m's attributes, preferences, etc. using a computing device that stores personal information (step S111-m). The individual information of user 101-m output from individual information provision unit 111-m is sent to transmission unit 112-m, and from transmission unit 112-m it is transmitted to common device 13-n (step S112-m).

[0016] The receiving unit 134-n of the common device 13-n receives individual information of user 101-m transmitted from user device 11-m and sends it to the individual sound selection unit 135-n (step S134-n). The individual sound selection unit 135-n uses the received individual information to search the individual sound DB in the storage unit 133-n and extracts an individual sound signal associated with the registered individual information corresponding to this individual information. The individual sound selection unit 135-n works in cooperation with the common playback unit 132-n to generate individual playback control information for presenting the individual sound signal extracted from the individual sound DB from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. The individual sound selection unit 135-n sends the individual playback control information to the transmitting unit 136-n (step S135-n).

[0017] The transmitting unit 136-n transmits individual playback control information to the user device 11-m. That is, the transmitting unit 136-n (output unit) outputs information for presenting an individual acoustic signal, which is specific to one of the multiple users, to a particular user from an acoustic signal output device for that specific user, at a timing synchronized with the common acoustic signal presented to multiple users from a common sound source (step S136-n).

[0018] Individual playback control information is received by the receiving unit 113-m of the user device 11-m and sent to the individual playback unit 115-m (step S113-m). Based on the individual playback control information, the individual playback unit 115-m outputs an individual playback signal to present the individual sound signal extracted by the individual sound selection unit 135-n to the user 101-m via the sound signal output device 10-m, at a timing synchronized with the common sound signal output from the sound signal output device 14-n. In other words, the individual playback unit 115-m outputs an individual playback signal to present an individual sound signal, which is specialized for a specific user among multiple users, to that specific user via the sound signal output device for that specific user, at a timing synchronized with the common sound signal presented to multiple users from a common sound source. Furthermore, the individual playback signal may be corrected or adjusted based on information input in advance from the input unit 114-m or information input in real time (step S115-m).

[0019] The individual playback signal is input to the acoustic signal output device 10-m. Based on the individual playback signal, the acoustic signal output device 10-m outputs the individual sound signal extracted by the individual sound selection unit 135-n at a timing synchronized with the common sound signal output from the acoustic signal output device 14-n. As a result, user 101-m hears the individual playback signal emitted from the acoustic signal output device 14-n, along with the common sound signal emitted from the acoustic signal output device 14-n, at a timing synchronized with the common sound signal. In particular, the acoustic signal output device 10-m in this embodiment is worn without completely sealing the ear canal of user 101-m, and emits the individual sound signal into the ear canal of user 101-m at a timing synchronized with the common sound signal. Therefore, even when user 101-m is wearing the acoustic signal output device 10-m, they can hear the common sound signal emitted around them and hear the common sound signal and the individual sound signal in a synchronized state (step S10-m).

[0020] <Features of this embodiment> User 101-m can hear a common acoustic signal presented to multiple users and an individual acoustic signal tailored to each user 101-m, in a synchronized timing. This allows for the provision of diverse and optimized acoustic content that reflects each user 101-m's attributes, preferences, actions, posture, orientation, location, or situation.

[0021] [Modification 1 of the First Embodiment] In the first embodiment, the storage unit 133-n of the common device 13-n stores individual sound DBs representing individual sound signals specific to each user 101-m. However, individual sound signals specific to each user 101-m may be stored in each user device 11-m. In this case, the storage unit 133-n of the common device 13-n may be omitted. In this case, instead of step S135-n, the individual sound selection unit 135-n of the common device 13-n works in cooperation with the common playback unit 132-n to generate individual playback control information for presenting the individual sound signals stored in each user device 11-m from the sound signal output device 10-m at a timing synchronized with the common sound signal. This individual playback control information is sent to the transmission unit 136-n, and the transmission unit 136-n transmits the individual playback control information to the user device 11-m. Individual playback control information is received by the receiving unit 113-m of the user device 11-m and sent to the individual playback unit 115-m (step S113-m). Furthermore, the individual acoustic signals stored in the user device 11-m are also sent to the individual playback unit 115-m. Based on the individual playback control information and the individual acoustic signals, the individual playback unit 115-m outputs an individual playback signal to present these individual acoustic signals to the user 101-m via the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal output from the acoustic signal output device 14-n. Individual playback control information is sent to the individual playback unit 115-m. The subsequent steps are the same as steps S115-m and S10-m of the first embodiment.

[0022] [Modification 2 of the First Embodiment] Furthermore, if each user device 11-m stores individual acoustic signals specific to each user 101-m, an individual sound selection unit may be provided in the user device 11-m. In this case, the individual sound selection unit of the user device 11-m selects an individual acoustic signal from the individual acoustic signals stored in the user device 11-m that is suitable for the individual information (e.g., movement, posture, orientation, position, or situation) obtained by the individual information provision unit 111-m, and sends it to the individual playback unit 115-m. Based on the individual playback control information and individual acoustic signals, the individual playback unit 115-m outputs an individual playback signal for presenting this individual acoustic signal to the user 101-m via the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal output from the acoustic signal output device 14-n. The subsequent steps are the same as step S10-m of the first embodiment. In such a configuration, the individual sound selection unit 135-n may be omitted from the common device 13-n.

[0023] [Modification 3 of the First Embodiment] Alternatively, ambient sounds of user 101-m may be captured by an acoustic signal sensor such as a microphone, and this ambient sound information may be input to the individual playback unit 115-m. The individual playback unit 115-m may then use this ambient sound information to optimize the playback timing of the individual acoustic signals.

[0024] [Second Embodiment] Along with a common acoustic signal presented to multiple users, individual acoustic signals may be presented to each user 101-m at timings specific to each user 101-m, or individual acoustic signals that have undergone acoustic signal processing specific to each user 101-m may be presented to each user 101-m. Below, the differences from the first embodiment will be explained in detail, and the explanation of matters already described will be simplified using the same reference numbers.

[0025] <Overall Structure> As illustrated in Figure 1, the playback system 2 of the second embodiment has M user devices 21-1, ..., 21-M, M sets of acoustic signal output devices 10-1, ..., 10-M, N common devices 23-1, ..., 23-N, and N acoustic signal output devices 14-1, ..., 14-N. M users 101-1, ..., 101-M use the playback system 2, and each user 101-m uses user device 21-m and acoustic signal output device 10-m. The position and orientation of the common device 23-n and acoustic signal output device 14-n may be fixed or variable. User 101-m wears an acoustic signal output device 10-m and is movable together with the acoustic signal output device 10-m. The user device 21-m may be movable together with the user 101-m and the acoustic signal output device 10-m, or it may be located at a location separate from the user 101-m and the acoustic signal output device 10-m.

[0026] <User device 21-m> As illustrated in Figure 2, the user device 21-m of the second embodiment includes an individual information provision unit 111-m, a transmission unit 112-m, a reception unit 213-m, an input unit 114-m, an individual playback unit 115-m, and an acoustic signal processing unit 216-m.

[0027] <Common device 23-n> As illustrated in Figure 2, the common device 23-n of the second embodiment includes storage units 131-n, 133-n, a common playback unit 132-n, a receiving unit 234-n, an individual sound selection unit 135-n, a transmission unit 236-n (output unit), and an individual control determination unit 237-n.

[0028] <Pre-processing> This is the same as the first embodiment.

[0029] <Processing> Instead of the common device 13-n, the common device 23-n performs the processing in step S132-n, and the acoustic signal output device 14-n performs the processing in step S14-n. Instead of the user device 11-m, the user device 21-m performs the processing in steps S111-m and S112-m.

[0030] The receiving unit 234-n of the common device 23-n receives individual information of user 101-m transmitted from user device 21-m and sends it to the individual sound selection unit 135-n and the individual control determination unit 237-n (step S134-n). The individual sound selection unit 135-n searches the individual sound DB in the storage unit 133-n using the received individual information and extracts an individual sound signal associated with the registered individual information corresponding to this individual information. The individual sound selection unit 135-n works in cooperation with the common playback unit 132-n to generate individual playback control information for presenting the individual sound signal extracted from the individual sound DB from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. The individual sound selection unit 135-n sends the individual playback control information to the transmitting unit 136-n (step S135-n).

[0031] Furthermore, the individual control determination unit 237-n uses the received individual information to obtain individual control information for controlling signal processing specific to the user device 21-m (specific user). An example of signal processing specific to the user device 21-m is the process of playing an individual acoustic signal in synchronization with a common acoustic signal at a timing specific to the user device 21-m (specific user). For example, the optimal timing for playing an individual acoustic signal in relation to a common acoustic signal may differ depending on the user 101-m's attributes (e.g., age, nationality, native language, learned languages, learned language level, perceptual / cognitive characteristics, etc.), preferences (e.g., musical preferences, tempo preferences, etc.), actions (e.g., walking, running, stopping, etc.), posture and orientation, position (e.g., relative position from the acoustic signal output device 14-n, etc.), and situation (e.g., focused state, distracted state, fatigued state, awake state, etc.). In such cases, the individual control determination unit 237-n may, according to the individual information received, determine the optimal playback timing of the individual acoustic signal relative to the common acoustic signal, and obtain individual control information to play the individual acoustic signal in synchronization with the common acoustic signal at a timing specific to the user device 21-m (specific user). Another example of signal processing specific to the user device 21-m is acoustic signal processing specific to the user device 21-m (specific user). For example, the optimal acoustic signal processing for the individual acoustic signal may differ depending on the user 101-m's attributes (e.g., age, nationality, native language, learned languages, learned language level, perceptual / cognitive characteristics, etc.), preferences (e.g., musical preferences, tempo preferences, etc.), actions (e.g., walking, running, stopping, etc.), posture and orientation, position (e.g., relative position from the acoustic signal output device 14-n, etc.), and situation (e.g., focused state, distracted state, fatigued state, awake state, etc.). For example, if the acoustic signal processing involves convolving a head-related transfer function (HRTF) or head-related impulse response (HRIR) into individual acoustic signals, the HRTF or head-related impulse response that reproduces the appropriate sense of presence, distance, and direction may differ depending on the user's (101-m) posture, orientation, and position. Furthermore, if the acoustic signal processing involves panning or volume adjustment of individual acoustic signals, the sound localization and volume that reproduce the appropriate sense of presence, distance, and direction may differ depending on the user's (101-m) posture, orientation, and position.For example, if the acoustic signal processing involves applying a low-pass filter, high-pass filter, band-pass filter, etc., to individual acoustic signals, the optimal passband and attenuation band may differ depending on the user 101-m's attributes such as perceptual and cognitive characteristics, preferences such as musical tastes, and states such as concentration, distraction, fatigue, and alertness. In such cases, the individual control determination unit 237-n may obtain individual control information for performing acoustic signal processing specific to a particular user, according to the individual information it has received. The individual control determination unit 237-n sends the individual control information described above to the transmission unit 136-n (step S237-n).

[0032] The transmitting unit 236-n transmits the individual playback control information and individual control information described above to the user device 21-m. That is, the transmitting unit 236-n (output unit) outputs information for presenting an individual acoustic signal, which is specific to one of the multiple users, to a particular user from an acoustic signal output device for that specific user, at a timing synchronized with the common acoustic signal presented to multiple users from a common sound source (step S236-n).

[0033] Individual playback control information and individual control information are received by the receiving unit 213-m of the user device 21-m and sent to the acoustic signal processing unit 216-m (step S213-m).

[0034] The acoustic signal processing unit 216-m processes the individual acoustic signals represented by the individual playback control information based on the individual control information, and generates and outputs new individual playback control information for presentation from the acoustic signal output device 10-m at a timing synchronized with the aforementioned common acoustic signal. For example, the acoustic signal processing unit 216-m may perform processing to reproduce the individual acoustic signals in synchronization with the common acoustic signal at a timing specific to the user device 21-m, and generate and output new individual playback control information obtained therefrom for reproducing the individual acoustic signals in synchronization with the common acoustic signal at a timing specific to the user device 21-m. For example, the acoustic signal processing unit 216-m may apply acoustic signal processing specific to the user device 21-m to the individual acoustic signals, and generate and output new individual playback control information for presentation from the acoustic signal output device 10-m at a timing synchronized with the aforementioned common acoustic signal. For example, the acoustic signal processing unit 216-m may apply acoustic signal processing specific to the user device 21-m to the individual acoustic signals, and generate and output new individual playback control information for presentation from the acoustic signal output device 10-m at a timing specific to the user device 21-m and synchronized with the aforementioned common acoustic signal. Furthermore, the new individual playback control information may be corrected or adjusted based on information input in advance from the input unit 114-m or information input in real time. The new individual playback control information is sent to the individual playback unit 115-m (step S216-m).

[0035] The individual playback unit 115-m outputs an individual playback signal to present the individual audio signal to the user 101-m via the audio signal output device 10-m, at a timing synchronized with the common audio signal output from the audio signal output device 14-n, based on new individual playback control information. The individual playback signal is a signal with content specific to a particular user, based on new individual playback control information. For example, the individual playback signal in this embodiment may include a signal that is played back in synchronization with the common audio signal at a timing specific to the user device 21-m (specific user), or it may include a signal that has undergone audio signal processing specific to the user device 21-m (specific user). Furthermore, the individual playback signal may be corrected or adjusted based on information input in advance from the input unit 114-m or information input in real time (step S115-m).

[0036] The individual playback signal is input to the sound signal output device 10-m. Based on this individual playback signal, the sound signal output device 10-m presents the individual sound signal to the user 101-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n. In this embodiment, for example, the individual sound signal may be played back at a timing specific to the user device 21-m in synchronization with the common sound signal, or an individual sound signal that has undergone sound signal processing specific to the user device 21-m may be played back at a timing synchronized with the common sound signal, or an individual sound signal that has undergone sound signal processing specific to the user device 21-m may be played back at a timing specific to the user device 21-m in synchronization with the common sound signal (step S10-m).

[0037] <Features of this embodiment> Users 101-m can hear a common acoustic signal presented to multiple users and individual acoustic signals tailored to each user 101-m in a synchronized timing. This allows for the provision of diverse and optimized acoustic content that reflects each user 101-m's attributes, preferences, actions, posture, orientation, position, or situation. Furthermore, in this embodiment, timing and acoustic signal processing tailored to each user 101-m can be performed, providing each user 101-m with acoustic content that is even more optimized in terms of presence, distance, and direction.

[0038] [Modification 1 of the second embodiment] In the second embodiment, the storage unit 133-n of the common device 23-n stores individual sound DBs representing individual sound signals specific to each user 101-m. However, individual sound signals specific to each user 101-m may be stored in each user device 21-m. In this case, the storage unit 133-n of the common device 23-n may be omitted. In this case, instead of step S135-n, the individual sound selection unit 135-n of the common device 23-n works in cooperation with the common playback unit 132-n to generate individual playback control information for presenting the individual sound signals stored in each user device 21-m from the sound signal output device 10-m at a timing synchronized with the common sound signal. This individual playback control information is sent to the transmission unit 136-n, which transmits the individual playback control information to the user device 21-m. The individual playback control information is received by the receiving unit 113-m of the user device 21-m and sent to the sound signal processing unit 216-m. Furthermore, individual acoustic signals stored in the user device 21-m are also sent to the acoustic signal processing unit 216-m. The acoustic signal processing unit 216-m processes these individual acoustic signals based on individual control information, and generates and outputs new individual playback control information for presentation from the acoustic signal output device 10-m at a timing synchronized with the aforementioned common acoustic signal. The new individual playback control information is sent to the individual playback unit 115-m. The subsequent steps are the same as steps S115-m and S10-m of the second embodiment.

[0039] [Modification 2 of the second embodiment] Furthermore, if each user device 21-m stores individual acoustic signals specific to each user 101-m, an individual sound selection unit may be provided in the user device 21-m. In this case, the individual sound selection unit of the user device 21-m selects an individual acoustic signal from the individual acoustic signals stored in the user device 21-m that is suitable for the individual information obtained by the individual information provision unit 111-m (for example, operation, posture, orientation, position, or situation), and sends the selected individual acoustic signal to the acoustic signal processing unit 216-m. The acoustic signal processing unit 216-m processes this individual acoustic signal based on the individual control information, and generates and outputs new individual playback control information for presentation from the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal after signal processing. In such a configuration, the individual sound selection unit 135-n may be omitted from the common device 23-n.

[0040] [Modification 3 of the second embodiment] Alternatively, ambient sounds of user 101-m may be captured by an acoustic signal sensor such as a microphone, and this ambient sound information may be input to the acoustic signal processing unit 216-m. The acoustic signal processing unit 216-m may then use this ambient sound information to optimize the playback timing of individual acoustic signals.

[0041] [Modification 4 of the second embodiment] In the second embodiment, the common device 23-n is provided with an individual control determination unit 237-n. However, the function of the individual control determination unit 237-n may be included in the acoustic signal processing unit 216-m of the user device 21-m. The acoustic signal processing unit 216-m processes individual acoustic signals based on individual information (e.g., operation, posture, orientation, position, or situation) obtained by the individual information provision unit 111-m, and generates and outputs new individual playback control information to be presented from the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal after signal processing. The rest is as described in the second embodiment.

[0042] [Modification 5 of the second embodiment] In the second embodiment, the individual acoustic signal was a signal with content specific to user device 21-m (specific user). However, an individual acoustic signal common to all users 101-1, ..., 101-M may be played back in synchronization with the common acoustic signal at a timing specific to each user device 21-m (specific user). Alternatively, the individual acoustic signal common to all users 101-1, ..., 101-M may be subjected to acoustic signal processing specific to each user device 21-m (specific user), and the resulting new individual acoustic signal may be played back in synchronization with the common acoustic signal. Alternatively, the individual acoustic signal common to all users 101-1, ..., 101-M may be subjected to acoustic signal processing specific to each user device 21-m (specific user), and the resulting new individual acoustic signal may be played back in synchronization with the common acoustic signal at a timing specific to each user device 21-m (specific user). In such a case, instead of step S135-n in the second embodiment, the individual sound selection unit 135-n generates individual playback control information for presenting an individual acoustic signal common to all users 101-1, ..., 101-M from the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal, and sends it to the transmission unit 136-n.

[0043] [An example of an acoustic signal output device 10-m] An example of the acoustic signal output device 10-m of each embodiment described above is shown. The acoustic signal output device 10-m in this example has a function to suppress sound leakage to the outside and is particularly suitable for applications that reproduce acoustic signals specific to each user device 21-m only to the user device 21-m, as described in each embodiment and its modified form.

[0044] Figures 3, 4A-4C, and 5A-5C show an example of this acoustic signal output device 10-m. For simplicity, below, the individual acoustic signal output devices 10-m will not be distinguished and will be referred to simply as acoustic signal output device 10. Similarly, user 101-m, user device 11-m, and individual playback unit 115-m will be referred to as user 101, user device 11, and individual playback unit 115.

[0045] As illustrated in Figures 3, 4A-4C, and 5A-5C, the audio signal output device 10 in this example includes a driver unit 1011 that converts individual playback signals output from the individual playback unit 115 of the user device 11 into audio signals and outputs them, and a housing 1012 that houses the driver unit 1011 inside.

[0046] <Driver Unit 1011> The driver unit (speaker driver unit) 1011 is a device (a device with speaker functionality) that emits an acoustic signal AC1 (first acoustic signal) based on an input individual playback signal to one side (direction D1), and emits an acoustic signal AC2 (second acoustic signal), which is the opposite phase signal (phase inversion signal) of the acoustic signal AC1 or an approximate signal of the opposite phase signal, to the other side (direction D2). That is, the acoustic signal emitted from the driver unit 1011 to one side (direction D1) will be called the acoustic signal AC1 (first acoustic signal), and the acoustic signal emitted from the driver unit 1011 to the other side (direction D2) will be called the acoustic signal AC2 (second acoustic signal). For example, the driver unit 1011 includes a diaphragm 10113 that emits the acoustic signal AC1 from one surface 10113a to the direction D1 by vibration, and emits the acoustic signal AC2 from the other surface 10113b to the direction D2 by this vibration (Figure 4B). In this example, the driver unit 1011 vibrates its diaphragm 10113 based on the input individual playback signal, thereby emitting the acoustic signal AC1 from one side 10111 toward the D1 direction, and emitting the acoustic signal AC2, which is the inverse phase signal of the acoustic signal AC1 or an approximate signal of the inverse phase signal, toward the other side. surfaceThe signal is emitted from 10112 toward the D2 direction. In other words, the acoustic signal AC2 is emitted secondarily along with the emission of the acoustic signal AC1. Note that the D2 direction (the other side) is, for example, the opposite direction of the D1 direction (one side), but the D2 direction does not need to be exactly the opposite direction of the D1 direction; it is sufficient that the D2 direction is different from the D1 direction. The relationship between one side (D1 direction) and the other side (D2 direction) depends on the type and shape of the driver unit 1011. Also, depending on the type and shape of the driver unit 1011, the acoustic signal AC2 may be exactly the inverse phase signal of the acoustic signal AC1, or it may be an approximate signal of the inverse phase signal of the acoustic signal AC1. For example, the approximate signal of the inverse phase signal of the acoustic signal AC1 may be (1) a signal obtained by shifting the phase of the inverse phase signal of the acoustic signal AC1, (2) a signal obtained by changing (amplifying or attenuating) the amplitude of the inverse phase signal of the acoustic signal AC1, or (3) a signal obtained by shifting the phase of the inverse phase signal of the acoustic signal AC1 and further changing its amplitude. The phase difference between the inverse phase signal of the acoustic signal AC1 and its approximate signal is preferably less than or equal to δ1% of one period of the inverse phase signal of the acoustic signal AC1. Examples of δ1% include 1%, 3%, 5%, 10%, 20%, etc. Furthermore, the difference between the amplitude of the inverse phase signal of the acoustic signal AC1 and the amplitude of its approximate signal is preferably less than or equal to δ2% of the amplitude of the inverse phase signal of the acoustic signal AC1. Examples of δ2% include 1%, 3%, 5%, 10%, 20%, etc. Examples of the driver unit 1011 type include dynamic type, balanced armature type, hybrid type of dynamic and balanced armature type, and condenser type. Furthermore, there are no limitations on the shape of the driver unit 1011 or the diaphragm 10113. In this example, for the sake of simplicity, the driver unit 1011 is shown as having a substantially cylindrical shape with faces at both ends, and the diaphragm 10113 is shown as having a substantially disc shape, but this does not limit the present invention. For example, the driver unit 1011 may have a rectangular parallelepiped shape, or the diaphragm 10113 may have a dome shape.

[0047] <Enclosure 1012> The housing 1012 is a hollow member with an outer wall, and houses the driver unit 1011 inside. For example, the driver unit 1011 is fixed to the end of the housing 1012 on the D1 direction side. However, this does not limit the present invention. There are no limitations on the shape of the housing 1012, but it is desirable that the shape of the housing 1012 be rotationally symmetric (line symmetric) or substantially rotationally symmetric about an axis A1 extending along the D1 direction. This makes it easier to provide sound holes 10123a (details described later) in such a way that the variation in the direction of sound energy emitted from the housing 1012 is reduced. As a result, it becomes easier to reduce sound leakage uniformly in each direction. For example, the housing 1012 has a first end face which is a wall portion 10121 located on one side (D1 direction side) of the driver unit 1011, a second end face which is a wall portion 10122 located on the other side (D2 direction side) of the driver unit 1011, and a side surface which is a wall portion 10123 that surrounds the space between the first and second end faces, centered on the axis A1 passing through the first and second end faces (Figures 4B and 5B). In this example, for the sake of simplicity, an example is shown in which the housing 1012 has a substantially cylindrical shape with both end faces. For example, the distance between wall portions 10121 and 10122 is 10 mm, and wall portions 10121 and 10122 are circular with a radius of 10 mm. However, these are just examples and do not limit the present invention. For example, the housing 1012 may have a substantially dome shape with walls at its ends, or it may be a hollow substantially cubic shape, or it may be any other three-dimensional shape. Furthermore, there are no limitations on the materials that make up the housing 1012. The housing 1012 may be made of a rigid material such as synthetic resin or metal, or it may be made of an elastic material such as rubber.

[0048] <Sound hole 10121a, 10123a> The wall of the housing 1012 is provided with a sound hole 10121a (first sound hole) for letting out the acoustic signal AC1 (first acoustic signal) emitted from the driver unit 1011 to the outside, and a sound hole 10123a (second sound hole) for letting out the acoustic signal AC2 (second acoustic signal) emitted from the driver unit 1011 to the outside. The sound holes 10121a and 10123a are, for example, through holes that penetrate the wall of the housing 1012, but this is not a limitation of the present invention. The sound holes 10121a and 10123a do not have to be through holes, as long as the acoustic signals AC1 and AC2 can be let out to the outside, respectively.

[0049] The acoustic signal AC1 emitted from sound hole 10121a reaches the ear canal of user 101 and is heard by user 101. On the other hand, an acoustic signal AC2, which is the inverse phase signal of acoustic signal AC1 or an approximate signal of the inverse phase signal, is emitted from sound hole 10123a. A portion of this acoustic signal AC2 cancels out a portion of the acoustic signal AC1 emitted from sound hole 10121a (sound leakage component). In other words, the attenuation rate η of the acoustic signal AC1 (first acoustic signal) at position P2 (second position) relative to position P1 (first position) is determined by the emission of acoustic signal AC1 (first acoustic signal) from sound hole 10121a (first sound hole) and acoustic signal AC2 (second acoustic signal) from sound hole 10123a (second sound hole). 11 a predetermined value η th The following can be determined, and the attenuation η of the acoustic signal AC1 (first acoustic signal) at position P2 (second point) relative to position P1 (first point) 12 A predetermined value ω th The above can be achieved. Here, position P1 (first point) is a predetermined point to which the acoustic signal AC1 (first acoustic signal) emitted from the sound hole 10121a (first sound hole) reaches. On the other hand, position P2 (second point) is a predetermined point that is further from the acoustic signal output device 10 than position P1 (first point). The predetermined value η th This is the attenuation rate η of an arbitrary or specific acoustic signal (sound) due to air propagation at position P2 (second point) relative to position P1 (first point). 21 It is a value smaller than (lower than) ω. this the attenuation amount η due to air propagation of an arbitrary or specific acoustic signal (sound) at position P2 (second location) with respect to position P1 (first location). 22 is a value larger than that. That is, the acoustic signal output device 10 in this example has an attenuation rate η 11 is smaller than the attenuation rate η 21 is designed to be equal to or less than a predetermined value η th or is designed such that the attenuation amount η 12 is equal to or greater than a predetermined value ω 22 that is larger than the attenuation amount η th The acoustic signal AC1 is propagated through the air from position P1 to position P2 and attenuates due to this air propagation and the acoustic signal AC2. The attenuation rate η 11 is the ratio (AMP2(AC1) / AMP1(AC1)) of the magnitude AMP2(AC1) of the acoustic signal AC1 at position P2, which has attenuated due to air propagation and the acoustic signal AC2, to the magnitude AMP1(AC1) of the acoustic signal AC1 at position P1. Also, the attenuation amount η 12 is the difference (|AMP1(AC1) - AMP2(AC1)|) between the magnitude AMP1(AC1) and the magnitude AMP2(AC1). On the other hand, when the acoustic signal AC2 is not assumed, an arbitrary or specific acoustic signal AC ar propagated through the air from position P1 to position P2 attenuates due to air propagation without being caused by the acoustic signal AC2. The attenuation rate η 21 is the ratio (AMP2(AC ar ) / AMP1(AC ar )) of the magnitude AMP2(AC ar ) of the acoustic signal AC at position P2, which has attenuated due to air propagation (attenuated without being caused by the acoustic signal AC2), to the magnitude AMP1(AC ar ) of the acoustic signal AC at position P1. Also, the attenuation amount η ar is the difference (|AMP1(AC ar ) - AMP2(AC<000002> 22 )) between the magnitude AMP1(AC ar ) and the magnitude AMP2(AC ar ). ar ). ar)|). Examples of the magnitude of an acoustic signal include the sound pressure or energy of the acoustic signal. Furthermore, "sound leakage component" refers to a component of the acoustic signal AC1 emitted from the sound port 10121a that is likely to reach areas other than the user 101 wearing the acoustic signal output device 10 (for example, a person other than the user 101 wearing the acoustic signal output device 10). For example, "sound leakage component" refers to a component of the acoustic signal AC1 that propagates in directions other than the D1 direction. For example, the direct wave of the acoustic signal AC1 is mainly emitted from the sound port 10121a, and the direct wave of the second acoustic signal is mainly emitted from the second sound port. A portion of the direct wave of the acoustic signal AC1 emitted from the sound port 10121a (sound leakage component) is canceled out by interference with at least a portion of the direct wave of the acoustic signal AC2 emitted from the sound port 10123a. However, this does not limit the present invention, and this cancellation can occur with waves other than direct waves. In other words, the sound leakage component, which is at least one of the direct and reflected waves of the acoustic signal AC1 emitted from sound hole 10121a, may be canceled out by at least one of the direct and reflected waves of the acoustic signal AC2 emitted from sound hole 10123a. This suppresses sound leakage.

[0050] [Hardware configuration of user equipment and shared equipment] In each embodiment, the user devices 11-m, 21-m and the common devices 13-n, 23-n are devices configured by a general-purpose or dedicated computer, for example, equipped with a processor (hardware processor) such as a CPU (central processing unit) and memory such as RAM (random-access memory) and ROM (read-only memory), executing a predetermined program. That is, in each embodiment, the user devices 11-m, 21-m and the common devices 13-n, 23-n each have, for example, processing circuits configured to implement the respective parts they each possess. This computer may have one processor and memory, or it may have multiple processors and memories. This program may be installed on the computer, or it may be pre-recorded in ROM, etc. Furthermore, some or all of the processing units may be configured using electronic circuits that realize processing functions independently, rather than electronic circuits that realize the functional configuration by loading a program, such as a CPU. Also, the electronic circuits that constitute one device may include multiple CPUs.

[0051] Figure 6 is a block diagram illustrating the hardware configuration of user devices 11-m, 21-m and common devices 13-n, 23-n in each embodiment. As illustrated in Figure 6, the user devices 11-m, 21-m and common devices 13-n, 23-n in this example have a CPU (Central Processing Unit) 10a, an input unit 10b, an output unit 10c, a RAM (Random Access Memory) 10d, a ROM (Read Only Memory) 10e, an auxiliary storage device 10f, a communication unit 10h, and a bus 10g. The CPU 10a in this example has a control unit 10aa, an arithmetic unit 10ab, and a register 10ac, and performs various arithmetic processing according to various programs loaded into the register 10ac. The input unit 10b is an input terminal, keyboard, mouse, touch panel, etc., to which data is input. The output unit 10c is an output terminal, display, etc., to which data is output. The communication unit 10h is a LAN card, etc., controlled by the CPU 10a which has loaded a predetermined program. Furthermore, RAM 10d is an SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), etc., and has a program area 10da where a predetermined program is stored and a data area 10db where various data is stored. Furthermore, auxiliary storage device 10f is, for example, a hard disk, MO (Magneto-Optical disc), semiconductor memory, etc., and has a program area 10fa where a predetermined program is stored and a data area 10fb where various data is stored. Furthermore, bus 10g connects CPU 10a, input unit 10b, output unit 10c, RAM 10d, ROM 10e, communication unit 10h, and auxiliary storage device 10f so that information can be exchanged. CPU 10a writes the program stored in the program area 10fa of auxiliary storage device 10f to the program area 10da of RAM 10d according to the loaded OS (Operating System) program. Similarly, CPU 10a writes various data stored in the data area 10fb of auxiliary storage device 10f to the data area 10db of RAM 10d.The addresses on RAM 10d where the program and data are written are then stored in register 10ac of CPU 10a. The control unit 10aa of CPU 10a sequentially reads these addresses stored in register 10ac, reads the program and data from the area on RAM 10d indicated by the read addresses, sequentially executes the calculations indicated by the program in the calculation unit 10ab, and stores the calculation results in register 10ac. This configuration realizes the functional configurations of user devices 11-m, 21-m and common devices 13-n, 23-n.

[0052] The above-mentioned program can be recorded on a computer-readable recording medium. Examples of computer-readable recording media are non-transitory recording media. Examples of such recording media include magnetic recording devices, optical discs, magneto-optical recording media, and semiconductor memory.

[0053] The distribution of this program can be carried out, for example, by selling, transferring, or lending portable recording media such as DVDs or CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing it in the storage device of a server computer and transferring it from the server computer to other computers via a network. As described above, a computer executing such a program may, for example, first store the program recorded on the portable recording media or the program transferred from the server computer in its own storage device. Then, when processing is to be executed, this computer reads the program stored in its own storage device and executes the processing according to the program it reads. Alternatively, as another form of execution of this program, the computer may directly read the program from the portable recording media and execute the processing according to that program, or it may sequentially execute the processing according to the program received each time a program is transferred to this computer from the server computer. Furthermore, the above processing may be executed by a so-called ASP (Application Service Provider) type service, which does not transfer the program from the server computer to this computer, but realizes the processing function only by issuing execution instructions and obtaining results. Furthermore, the term "program" in this form includes information used for processing by an electronic computer that is equivalent to a program (data, etc., that is not a direct instruction to the computer but has the property of defining the computer's processing).

[0054] In each embodiment, the device is configured by executing a predetermined program on a computer; however, at least a part of these processes may be implemented in hardware.

[0055] [Other variations] It should be noted that the present invention is not limited to the embodiments described above. For example, in each of the embodiments and modifications described above, an acoustic signal output device 10-m was provided as an example, which is attached to the user 101-m without completely sealing the ear canal, and emits an acoustic signal specific to each user 101-m into the ear canal of the user 101-m. Such an acoustic signal output device 10-m that does not completely seal the ear canal is suitable for applications in which a common acoustic signal presented to multiple users and an individual acoustic signal specific to each user 101-m are to be heard at a synchronized timing. However, instead of the acoustic signal output device 10-m that does not completely seal the ear canal, an acoustic signal output device that can take in the common acoustic signal emitted to the outside and present it to the user 101-m together with the individual acoustic signal may be used.

[0056] Furthermore, in the embodiments and modifications described above, the common acoustic signal was reproduced from the acoustic signal output device 14-n. However, the common acoustic signal may also be ambient sounds such as environmental sounds, natural sounds, live sounds, or speech sounds. In such cases, the ambient sounds may be picked up by an acoustic signal sensor such as a microphone and sent to the common devices 13-n and 23-n. The individual sound selection unit 135-n of the common devices 13-n and 23-n may then generate individual playback control information to present individual acoustic signals from the acoustic signal output device 10-m at a timing synchronized with the common acoustic signal, which is the ambient sound.

[0057] Furthermore, individual acoustic signals may be signals corresponding to the relationship between user 101-m (a specific user) and users 101-m' other than user 101-m (where m'∈{1,…,M}, m'≠m) included in users 101-1,…,101-M (multiple users). For example, the individual acoustic signal presented to user 101-m may differ depending on the distance between user 101-m and other users 101-m', or the individual acoustic signal presented to user 101-m may differ depending on the number of other users 101-m' present in the unit area where user 101-m exists. Alternatively, if user 101-m and other users 101-m' present within a predetermined distance from user 101-m have a pre-registered relationship (for example, being acquaintances), a different individual acoustic signal may be presented to user 101-m than in other cases. The relationship between such user 101-m and other users 101-m' may be acquired in real time by the individual information provision unit 111-m, may be pre-configured in the individual information provision unit 111-m, or may be input into the individual information provision unit 111-m in real time.

[0058] Furthermore, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually as needed, depending on the processing capacity of the device performing the processes. It goes without saying that other modifications can be made as appropriate without departing from the spirit of the present invention. [Industrial applicability]

[0059] This invention can be used, for example, for audio commentary and music playback for artworks in museums, audio and music playback in movies, video games, horror attractions in amusement parks, and virtual spaces, for adding sound to enhance the sense of realism at concerts and live performances, and for playing simultaneous interpretation audio in business, movies, and tourism.

[0060] For example, in the case of use in museums or movies, we can imagine a situation where the original audio commentary or commentary in the local language by a commentator is played as a common audio signal. In such a case, if the user does not know the language of the audio played as the common audio signal, they will not be able to understand the content. Here, it is conceivable to play dubbed audio individually for each user as an individual audio signal, according to the user's nationality, language used, and language level. For example, the following uses are conceivable. Venue: English audio commentary is playing as a common audio signal. Person A: Since Person A does not understand English at all, all audio commentaries will be played back as individual audio signals for Person A, using dubbed audio in Person A's native language. Person B: Since Person B can understand simple English, only the parts that Person B finds difficult to understand will have Person A's native language dubbed audio played as Person A's individual audio signal. In such examples, attributes such as native language, acquired language, and acquired language level are included in the individual information. Furthermore, the type and processing of individual audio signals, such as voice and sound effects, may differ depending on the user's current location. In addition, music tailored to the user's preferences may be played as an individual audio signal.

[0061] In the case of use at concerts and live performances, the live performance at the venue may be heard by users as a common sound signal, and optimized playback sounds may be played as individual sound signals for each user. In this example, all users can hear the live performance at the venue. However, for example, the live performance does not include vocals. In this case, different vocal sounds may be played as individual sound signals according to the user's pre-set preferences. Alternatively, the same vocal sound may be played for all users as an individual sound signal, but the sound signal processing unit may convolve the head-related transfer function and head-related impulse response according to each user's current position, so that all users feel as if the vocal sound is coming from the direction of the live performance. Alternatively, the same vocal sound may be played for all users as an individual sound signal, but the vocal sound may be played only when each user is in a specific section. Such settings may be changeable in real time. [Explanation of Symbols]

[0062] 1,2 Playback System 10-m,14-m acoustic signal output device 11-m,21-m User equipment 13-n,23-n common equipment 101-m User

Claims

1. An individual playback unit outputs an individual playback signal from an audio signal output device for a specific user to present to that specific user, which is one of the multiple users, an individual audio signal tailored to the preferences or situation of that specific user, at a timing synchronized with a common audio signal presented to multiple users from a common sound source. It has, The aforementioned preference is one of the following: the specific user's musical preference, tempo preference, vocal preference, content preference, or ambient sound preference. The user device is such that the aforementioned situation is one of the following states of concentration, distraction, fatigue, or alertness of the specific user.

2. An individual playback unit outputs an individual playback signal from an audio signal output device for a specific user to present to that specific user, which is one of the multiple users, at a timing synchronized with a common sound signal presented to multiple users from a common sound source. It has, The user device is such that the aforementioned situation is one of the following states of concentration, distraction, fatigue, or alertness of the specific user.

3. An individual playback unit outputs an individual playback signal from an audio signal output device for a specific user to present to that specific user, which is one of the multiple users, an individual audio signal tailored to the preferences or situation of that specific user, at a timing synchronized with a common audio signal presented to multiple users from a common sound source. It has, The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness. A user device that changes the timing of emitting the individual acoustic signals according to the aforementioned preference or circumstances.

4. An individual playback unit outputs an individual playback signal from an audio signal output device for a specific user to present to that specific user, which is one of the multiple users, an individual audio signal tailored to the preferences or situation of that specific user, at a timing synchronized with a common audio signal presented to multiple users from a common sound source. It has, The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness. A user device that changes the bandpass filter used to obtain the individual acoustic signals according to the aforementioned preference or circumstances.

5. A common playback unit that outputs information for presenting a common audio signal to multiple users from a common sound source, An output unit that outputs information to present to a specific user, which is one of the multiple users, an individual acoustic signal tailored to the preferences or circumstances of that specific user, at a timing synchronized with the common acoustic signal, from the acoustic signal output device for that specific user. It has, The aforementioned preference is one of the following: the specific user's musical preference, tempo preference, vocal preference, content preference, or ambient sound preference. The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness, in a common device.

6. A common playback unit that outputs information for presenting a common audio signal to multiple users from a common sound source, An output unit that outputs information to present to a specific user, which is one of the multiple users, an individual acoustic signal specific to the situation of that specific user, at a timing synchronized with the common acoustic signal, from the acoustic signal output device for the specific user. It has, The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness, in a common device.

7. A common playback unit that outputs information for presenting a common audio signal to multiple users from a common sound source, An output unit that outputs information to present to a specific user, which is one of the multiple users, an individual acoustic signal tailored to the preferences or circumstances of that specific user, at a timing synchronized with the common acoustic signal, from the acoustic signal output device for that specific user. It has, The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness. A common device that changes the timing of emitting the individual acoustic signals according to the aforementioned preference or circumstances.

8. A common playback unit that outputs information for presenting a common audio signal to multiple users from a common sound source, An output unit that outputs information to present to a specific user, which is one of the multiple users, an individual acoustic signal tailored to the preferences or circumstances of that specific user, at a timing synchronized with the common acoustic signal, from the acoustic signal output device for that specific user. It has, The aforementioned situation is one of the following states of the specific user: a state of concentration, a state of distraction, a state of fatigue, or a state of alertness. A common device for changing the bandpass filter used to obtain the individual acoustic signals according to the aforementioned preference or circumstances.

9. A method using user-provided equipment, Individual playback step: At a timing synchronized with a common sound signal presented to multiple users from a common sound source, an individual playback signal is output from the sound signal output device for the specific user to present an individual sound signal tailored to the preferences or circumstances of a specific user, which is one of the multiple users. It has, The aforementioned preference is one of the following: the specific user's musical preference, tempo preference, vocal preference, content preference, or ambient sound preference. The method wherein the aforementioned situation is one of the following states of concentration, distraction, fatigue, or alertness of the specific user.

10. A program for causing a computer to function as a user device according to any of claims 1 to 4 or as a common device according to any of claims 5 to 8.

Images