User device, common device, method based on same, and program

Abstract

At a timing synchronized with a common sound signal presented from a common sound source to a plurality of users, an individual sound signal dedicated to a specific user, which is any one of the plurality of users, is presented to the specific user from a sound signal output device for the specific user.

Description

Technical Field

[0001] The present invention relates to a technique for allowing a plurality of users to listen to an acoustic signal. Background Art

[0002] There is known an acoustic signal output device that enables listening to each reproduced sound while enabling listening to surrounding sounds (for example, refer to Non-Patent Document 1).

[0003] Prior art literature

[0004] Non-patent literature

[0005] Non-Patent Literature 1: “WHAT ARE OPEN-EAR HEADPHONES?”, [online], Bose Corporation, [retrieved on September 13, 2021], Internet<https: / / www.bose.com / en_us / better_with_bose / open-ear-headphones.html> Summary of the invention

[0006] Problems to be solved by the invention

[0007] However, it can be said that the advantage of the acoustic signal output device that enables listening to each reproduced sound while enabling listening to surrounding sounds has not been fully utilized.

[0008] In view of such circumstances, the present invention provides a diversified service that takes advantage of an acoustic signal output device that allows listening to each reproduced sound while being able to listen to surrounding sounds.

[0009] Means for solving problems

[0010] At a timing synchronized with a common sound signal presented to a plurality of users from a common sound source, an individual sound signal dedicated to a specific user, who is any one of the plurality of users, is presented to the specific user from the sound signal output device for the specific user.

[0011] Effects of the Invention

[0012] This makes it possible to provide a diverse service that takes advantage of the sound signal output device that allows listening to each reproduced sound while being able to listen to surrounding sounds. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a diagram for illustrating the structure of a reproduction system according to an embodiment.

[0014] Figure 2 It is a diagram for illustrating the configuration of a user device and a public device according to an embodiment.

[0015] Figure 3 This is a perspective stereoscopic diagram for illustrating the structure of an acoustic signal output device that does not completely seal the external auditory canal.

[0016] Figure 4A This is a perspective top view illustrating the structure of an acoustic signal output device that does not completely seal the external auditory canal. Figure 4B This is a perspective front view illustrating the structure of an acoustic signal output device that does not completely seal the external auditory canal. Figure 4C This is a bottom view illustrating the structure of an acoustic signal output device that does not completely seal the external auditory canal.

[0017] Figure 5A yes Figure 4B 4BA-4BA end view. Figure 5B yes Figure 4A 4A-4A end view. Figure 5C yes Figure 2 B's 4BC-4BC end view.

[0018] Figure 6 This is a block diagram for illustrating the hardware configuration of a user device and a public device according to an embodiment. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0020] [First embodiment]

[0021] <Overall Structure>

[0022] like Figure 1As illustrated, the reproduction system 1 of the first embodiment includes M user devices 11-1, ..., 11-M, M sets of sound signal output devices 10-1, ..., 10-M, N public devices 13-1, ..., 13-N, and N sound signal output devices 14-1, ..., 14-N. Here, M is an integer greater than or equal to 2, m=1, ..., M. N is an integer greater than or equal to 1, n=1, ..., N. M users 101-1, ..., 101-M use the reproduction system 1, and each user 101-m uses the user device 11-m and the sound signal output device 10-m. In addition, the position and orientation of the public device 13-n and the sound signal output device 14-n may be fixed or variable. The user 101-m can wear the sound signal output device 10-m and move together with the sound signal output device 10-m. The user device 11-m may be movable together with the user 101-m and the sound signal output device 10-m, or may be arranged at a location away from the user 101-m and the sound signal output device 10-m. The user device 11-m is configured to communicate with the sound signal output device 10-m and the sound signal output device 10-n by wire or wireless, and the sound signal output device 10-n is configured to communicate with the sound signal output device 14-n by wire or wireless.

[0023] <Audio signal output device 10-m>

[0024] The sound signal output device 10-m is a sound signal output device for the user 101-m (a sound signal output device for a specific user). In the present embodiment, the following sound signal output device 10-m is exemplified: the sound signal output device 10-m is worn by the user 101-m without completely sealing the external auditory canal, and emits a sound signal (individual sound signal) dedicated to each user 101-m (specific user) to the external auditory canal of the user 101-m. Examples of such sound signal output devices 10-m are open-ear earphones, headphones, audio sunglasses, head mount displays, neck speakers, bone conduction speakers, other speakers, and the like.

[0025] <User Device 11-m>

[0026] like Figure 2 As illustrated, the user device 11 - m of the first embodiment includes an individual information providing unit 111 - m , a transmitting unit 112 - m , a receiving unit 113 - m , an input unit 114 - m , and an individual reproducing unit 115 - m .

[0027] <Public Device 13-n>

[0028] like Figure 2 As illustrated, the common device 13 - n of the first embodiment includes storage units 131 - n and 133 - n , a common reproduction unit 132 - n , a reception unit 134 - n , an individual sound selection unit 135 - n , and a transmission unit 136 - n (output unit).

[0029] <Audio Signal Output Device 14-n>

[0030] The sound signal output device 14-n (public sound source) is a device that allows multiple users (e.g., M users 101-1, ..., 101-M) to listen to a common sound signal (public sound signal). The sound signal output device 14-n can be any device as long as it emits a public sound signal around the user 101-m. An example of the sound signal output device 14-n is a speaker.

[0031] <Preprocessing>

[0032] As pre-processing, the public device 13-n ( Figure 2) stores a common sound DB (database) representing sound signals (common sound signals) that are common (same) to multiple users (e.g., M users 101-1, ..., 101-M). Examples of common sound signals are sounds such as music, voice, sound effects, and ambient sounds. In addition, in the storage unit 133-n, a separate sound DB representing sound signals (separate sound signals) that are dedicated to each user 101-m (specific user) is stored. Examples of separate sound signals are sounds such as music, voice, sound effects, and ambient sounds. Separate sound signals are signals of content that are dedicated to each user 101-m (specific user), such as signals corresponding to at least any one of the attributes, preferences, actions, postures, orientations, positions, or conditions of each user 101-m (specific user). The attributes of user 101-m are, for example, age, gender, occupation, nationality, native language, second language, second language proficiency, place of residence, family composition, income, education, work experience, perception and cognitive characteristics, etc. The preferences of the user 101-m include, for example, preferences for music, preferences for vocals, preferences for content, preferences for tempo, preferences for voices, preferences for ambient sounds, preferences for ambient sounds, etc. The actions of the user 101-m include, for example, walking, running, turning, stopping, sitting, standing up, talking, being silent, etc. The posture and orientation of the user 101-m include, for example, forward, backward, right, left, upward, downward, bowing the head, holding the chest high, orientation with an elevation angle of θ from a reference position, orientation with an azimuth angle of σ from a reference position, etc. The position of the user 101-m includes, for example, the position of the geographic coordinate system, the relative position relative to the reference position, the relative position relative to other user devices 11-m' (where m'≠m, m'∈{1,...,M}), etc. In addition, the reference position may be, for example, a fixed specific position, a moving specific position, the position of any public device 13-n, or the position of any other user device 11-m' (where m'≠m, m'∈{1,...,M}). The status of the user 101-m may be, for example, participating, not participating, logging in, logging out, playing a game, not playing a game, learning, not learning, concentrating, distracted, tired, awake, etc. The individual sound signal is associated with, for example, registered individual information indicating the corresponding user 101-m, its attributes, preferences, actions, postures, directions, positions or conditions. In addition, the individual sound DB may be set only in preprocessing, or updated through subsequent update processing.

[0033] <Processing>

[0034] Public device 13-n( Figure 2) extracts a public sound signal from the public sound DB stored in the storage unit 131-n, and outputs an output signal for prompting the public sound signal (information for prompting the public sound signal from the public sound source to multiple users) (step S132-n). The output signal is an electrical signal, and is supplied to the sound signal output device 14-n by wire or wirelessly. The sound signal output device 14-n (public sound source) prompts (outputs) the public sound signal to multiple users according to the supplied output signal. The public sound signal is emitted to the surroundings of the user device 11-m. The user 101-m can listen to the public sound signal prompted by the sound signal output device 14-n, but there is a situation where the volume and sound quality of the public sound signal that can be listened to are different depending on the position and environment of the user 101-m. In addition, depending on the position and environment of the user 101-m, there may be a situation where the user 101-m cannot listen to the public sound signal prompted by any sound signal output device 14-n, there may be a situation where the user 101-m can only listen to the public sound signal prompted by one of the sound signal output devices 14-n, and there may also be a situation where the user 101-m can listen to the public sound signal prompted by multiple sound signal output devices 14-n1, 14-n2 (where n1≠n2, n1, n2∈{1,...,N}) (step S14-n).

[0035] User device 11-m( Figure 2 ) obtains and outputs the individual information dedicated to the user 101-m. The individual information may be preset, input in real time, or acquired in real time. Examples of individual information include at least one of the attributes, preferences, actions, postures, orientations, positions, or conditions of the user 101-m. Specific examples of the attributes, preferences, actions, postures, orientations, positions, or conditions are as described above. For example, the individual information providing unit 111-m can obtain the actions, postures, orientations, etc. of the user 101-m through an acceleration information sensor, a camera, or a microphone, can obtain the position through a position sensor, can detect the condition of the user 101-m through a computing device, a biosignal sensor, a camera, etc., and can detect the attributes, preferences, etc. of the user 101-m through a computing device that stores personal information (step S111-m). The individual information of the user 101-m output from the individual information providing unit 111-m is sent to the sending unit 112-m, and is sent from the sending unit 112-m to the public device 13-n (step S112-m).

[0036] The receiving unit 134-n of the public device 13-n receives the individual information of the user 101-m transmitted from the user device 11-m, and transmits it to the individual sound selecting unit 135-n (step S134-n). The individual sound selecting unit 135-n uses the received individual information to search the individual sound DB of the storage unit 133-n, and extracts the individual sound signal corresponding to the registered individual information corresponding to the individual information. The individual sound selecting unit 135-n cooperates with the public reproduction unit 132-n to generate individual reproduction control information, which is used to prompt the individual sound signal extracted from the individual sound DB from the sound signal output device 10-m at a timing synchronized with the aforementioned public sound signal. The individual sound selecting unit 135-n transmits the individual reproduction control information to the transmitting unit 136-n (step S135-n).

[0037] The sending unit 136-n sends the individual reproduction control information to the user device 11-m. That is, the sending unit 136-n (output unit) outputs information for presenting an individual sound signal dedicated to a specific user, who is any one of the multiple users, from a sound signal output device for the specific user to the specific user at a timing synchronized with a common sound signal presented to the multiple users from a common sound source (step S136-n).

[0038] The individual reproduction control information is received by the receiving unit 113-m of the user device 11-m and is transmitted to the individual reproduction unit 115-m (step S113-m). Based on the individual reproduction control information, the individual reproduction unit 115-m outputs an individual reproduction signal for presenting the individual sound signal extracted by the individual sound selection unit 135-n to the user 101-m through the sound signal output device 10-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n. That is, the individual reproduction unit 115-m outputs an individual reproduction signal for presenting the individual sound signal dedicated to a specific user, who is any one of the multiple users, from the sound signal output device for the specific user at a timing synchronized with the common sound signal presented to the multiple users from the common sound source. Furthermore, the individual reproduction signal may be modified and adjusted based on information input in advance from the input unit 114-m or information input in real time (step S115-m).

[0039] The individual reproduction signal is input to the sound signal output device 10-m. Based on the individual reproduction signal, the sound signal output device 10-m outputs the individual sound signal extracted by the individual sound selection unit 135-n at a timing synchronized with the common sound signal output from the sound signal output device 14-n. As a result, the user 101-m listens to the common sound signal emitted from the sound signal output device 14-n, and listens to the individual reproduction signal emitted from the sound signal output device 14-n at a timing synchronized with the common sound signal. In particular, the sound signal output device 10-m of the present embodiment is worn so as not to completely seal the external auditory canal of the user 101-m, and emits the individual sound signal to the external auditory canal of the user 101-m at a timing synchronized with the common sound signal. Therefore, even when the user 101-m is wearing the sound signal output device 10-m, it is possible to listen to the common sound signal emitted to the surroundings, and can listen in a state where the common sound signal and the individual sound signal are synchronized (step S10-m).

[0040] <Features of this embodiment>

[0041] The user 101-m can listen to the common sound signal presented to multiple users and the individual sound signal dedicated to each user 101-m at a synchronized timing, thereby providing diverse sound content and optimized sound content reflecting the attributes, preferences, actions, postures, directions, positions, or conditions of each user 101-m.

[0042] [Modification 1 of the first embodiment]

[0043] In the first embodiment, a separate sound DB representing a separate sound signal dedicated to each user 101-m is stored in advance in the storage unit 133-n of the public device 13-n. However, separate sound signals dedicated to each user 101-m may be stored in each user device 11-m. In this case, the storage unit 133-n of the public device 13-n may be omitted. In this case, instead of step S135-n, the separate sound selection unit 135-n of the public device 13-n cooperates with the common reproduction unit 132-n to generate separate reproduction control information for presenting the separate sound signal stored in each user device 11-m from the sound signal output device 10-m at a timing synchronized with the common sound signal. The separate reproduction control information is sent to the sending unit 136-n, and the sending unit 136-n sends the separate reproduction control information to the user device 11-m. The individual reproduction control information is received by the receiving unit 113-m of the user device 11-m and is sent to the individual reproduction unit 115-m (step S113-m). Furthermore, the individual sound signal stored in the user device 11-m is also sent to the individual reproduction unit 115-m. Based on the individual reproduction control information and the individual sound signal, the individual reproduction unit 115-m outputs an individual reproduction signal for prompting the individual sound signal to the user 101-m through the sound signal output device 10-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n. The individual reproduction control information is sent to the individual reproduction unit 115-m. The subsequent steps are the same as steps S115-m and S10-m of the first embodiment.

[0044] [Modification 2 of the first embodiment]

[0045] In addition, in the case where each user device 11-m stores an individual sound signal dedicated to each user 101-m, an individual sound selection unit may be provided in the user device 11-m. In this case, the individual sound selection unit of the user device 11-m selects an individual sound signal suitable for the individual information (such as action, posture, direction, position or situation) obtained by the individual information providing unit 111-m from the individual sound signals stored in the user device 11-m, and sends it to the individual reproduction unit 115-m. The individual reproduction unit 115-m outputs an individual reproduction signal for presenting the individual sound signal to the user 101-m through the sound signal output device 10-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n based on the individual reproduction control information and the individual sound signal. The subsequent steps are the same as step S10-m of the first embodiment. In the case of such a structure, the individual sound selection unit 135-n may be omitted from the common device 13-n.

[0046] [Variation 3 of the first embodiment]

[0047] Alternatively, the surrounding sounds of the user 101 - m may be picked up by an acoustic signal sensor such as a microphone, and the information of the surrounding sounds may be input to the individual reproduction unit 115 - m , which may use the information of the surrounding sounds to optimize the reproduction timing of the individual acoustic signals.

[0048] It is also possible that, together with the common sound signal presented to a plurality of users, an individual sound signal is presented to the user 101-m at a timing specific to each user 101-m, or an individual sound signal to which sound signal processing specific to each user 101-m is applied is presented to the user 101-m. In the following, the description will be centered on the differences from the first embodiment, and the same reference numerals are used for matters that have already been described to simplify the description.

[0049] <Overall Structure>

[0050] like Figure 1 As illustrated, the reproduction system 2 of the second embodiment includes M user devices 21-1, ..., 21-M, M sets of sound signal output devices 10-1, ..., 10-M, N public devices 23-1, ..., 23-N, and N sound signal output devices 14-1, ..., 14-N. M users 101-1, ..., 101-M use the reproduction system 2, and each user 101-m uses the user device 21-m and the sound signal output device 10-m. In addition, the position and orientation of the public device 23-n and the sound signal output device 14-n may be fixed or variable. The user 101-m can wear the sound signal output device 10-m and move with the sound signal output device 10-m. The user device 21-m may be able to move with the user 101-m and the sound signal output device 10-m, or may be arranged at a position away from the user 101-m and the sound signal output device 10-m.

[0051] <User Device 21-m>

[0052] like Figure 2 As illustrated, the user device 21 - m of the second embodiment includes an individual information providing unit 111 - m , a transmitting unit 112 - m , a receiving unit 213 - m , an input unit 114 - m , an individual reproducing unit 115 - m , and an audio signal processing unit 216 - m .

[0053] <Public Device 23-n>

[0054] like Figure 2As illustrated, the common device 23-n of the second embodiment includes storage units 131-n, 133-n, a common reproduction unit 132-n, a reception unit 234-n, an individual sound selection unit 135-n, a transmission unit 236-n (output unit), and an individual control determination unit 237-n.

[0055] <Preprocessing>

[0056] Same as the first embodiment.

[0057] <Processing>

[0058] The public device 23-n executes the process of step S132-n instead of the public device 13-n, and the sound signal output device 14-n executes the process of step S14-n. The user device 21-m executes the processes of steps S111-m and S112-m instead of the user device 11-m.

[0059] The receiving unit 234-n of the public device 23-n receives the individual information of the user 101-m transmitted from the user device 21-m, and transmits it to the individual sound selection unit 135-n and the individual control determination unit 237-n (step S134-n). The individual sound selection unit 135-n uses the received individual information to search the individual sound DB of the storage unit 133-n, and extracts the individual sound signal corresponding to the registered individual information corresponding to the individual information. The individual sound selection unit 135-n cooperates with the public reproduction unit 132-n to generate individual reproduction control information, which is used to prompt the individual sound signal extracted from the individual sound DB from the sound signal output device 10-m at a timing synchronized with the aforementioned public sound signal. The individual sound selection unit 135-n transmits the individual reproduction control information to the transmission unit 136-n (step S135-n).

[0060] Furthermore, the individual control determination unit 237-n uses the received individual information to obtain individual control information for controlling signal processing dedicated to the user device 21-m (specific user). An example of signal processing dedicated to the user device 21-m is processing for causing an individual sound signal to be reproduced synchronously with a common sound signal at a timing dedicated to the user device 21-m (specific user). For example, depending on the attributes of the user 101-m (e.g., age, nationality, native language, second language, second language level, perception and cognitive characteristics, etc.), preferences (e.g., music preferences, speed preferences, etc.), actions (e.g., walking, running, stopping, etc.), posture, direction, position (e.g., relative position from the sound signal output device 14-n, etc.), and conditions (e.g., concentrated state, scattered state, fatigue state, awake state, etc.), there is a case where the optimal reproduction timing of the individual sound signal relative to the common sound signal is different. In such a case, the individual control determination unit 237-n may determine the optimal reproduction timing of the individual sound signal relative to the common sound signal according to the received individual information, thereby obtaining individual control information for causing the individual sound signal to be reproduced synchronously with the common sound signal at a timing specific to the user device 21-m (specific user). Another example of signal processing specific to the user device 21-m is sound signal processing specific to the user device 21-m (specific user). For example, there is a case where the optimal sound signal processing for the individual sound signal is different depending on the attributes of the user 101-m (e.g., age, nationality, native language, second language, second language level, perception and cognitive characteristics, etc.), preferences (e.g., music preferences, speed preferences, etc.), actions (e.g., walking, running, stopping, etc.), posture, direction, position (e.g., relative position from the sound signal output device 14-n, etc.), and status (e.g., concentrated state, distracted state, fatigue state, awake state, etc.). For example, in the case where the sound signal processing is a process of convolving a head transfer function (HRTF (Head Related Transfer Function)) and a head impulse response (HRIR (Head Related Impulse Response)) with a separate sound signal, there may be a case where the head transfer function and the head impulse response that reproduce the appropriate sense of presence, distance, direction, etc. may be different depending on the posture, orientation, and position of the user 101-m. In addition, in the case where the sound signal processing is a sound image (panning) and volume adjustment for a separate sound signal, there may be a case where the sound image positioning and volume that can reproduce the appropriate sense of presence, distance, direction, etc. may be different depending on the posture, orientation, and position of the user 101-m.For example, in the case where the sound signal processing is a process in which a low-pass filter, a high-pass filter, a band-pass filter, etc. are applied to a single sound signal, there is a case where the optimal passband and attenuation band are different depending on the user 101-m's attributes such as perception and cognitive characteristics, preferences such as music preferences, and states such as concentration, distraction, fatigue, and wakefulness. In such a case, the individual control decision unit 237-n can also obtain individual control information for performing sound signal processing dedicated to a specific user according to the received individual information. The individual control decision unit 237-n sends the above-mentioned individual control information to the sending unit 136-n (step S237-n).

[0061] The sending unit 236-n sends the above-mentioned individual reproduction control information and individual control information to the user device 21-m. That is, the sending unit 236-n (output unit) outputs information for prompting a specific user, who is any one of the multiple users, with an individual sound signal dedicated to the specific user from the sound signal output device for the specific user at a timing synchronized with the common sound signal prompted to the multiple users from the common sound source (step S236-n).

[0062] The individual reproduction control information and the individual control information are received by the receiving unit 213 - m of the user device 21 - m and transmitted to the audio signal processing unit 216 - m (step S213 - m ).

[0063] The sound signal processing unit 216-m performs signal processing on the individual sound signal represented by the individual reproduction control information based on the individual control information, generates and outputs new individual reproduction control information, and the new individual reproduction control information is used to present the individual sound signal after the signal processing from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. For example, the sound signal processing unit 216-m may also perform processing for making the individual sound signal be reproduced synchronously with the common sound signal at a timing dedicated to the user device 21-m, and generate and output new individual reproduction control information for making the individual sound signal be reproduced synchronously with the common sound signal at the timing dedicated to the user device 21-m obtained thereby. For example, the sound signal processing unit 216-m may also perform sound signal processing dedicated to the user device 21-m on the individual sound signal, and generate and output new individual reproduction control information for presenting the individual sound signal obtained thereby from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. For example, the sound signal processing unit 216-m may also perform sound signal processing dedicated to the user device 21-m on the individual sound signal, generate and output new individual reproduction control information for prompting the individual sound signal obtained thereby from the sound signal output device 10-m at a timing dedicated to the user device 21-m and synchronized with the aforementioned common sound signal. Furthermore, the new individual reproduction control information may be modified and adjusted based on information pre-input from the input unit 114-m or information input in real time. The new individual reproduction control information is sent to the individual reproduction unit 115-m (step S216-m).

[0064] The individual reproduction unit 115-m outputs an individual reproduction signal based on the new individual reproduction control information, and the individual reproduction signal is used to prompt the individual sound signal to the user 101-m through the sound signal output device 10-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n. The individual reproduction signal is a signal of content dedicated to a specific user based on the new individual reproduction control information. For example, the individual reproduction signal of this embodiment may include a signal that is reproduced in synchronization with the common sound signal at a timing dedicated to the user device 21-m (specific user), and may also include a signal to which sound signal processing dedicated to the user device 21-m (specific user) is applied. Furthermore, the individual reproduction signal may also be modified and adjusted based on information pre-input from the input unit 114-m or information input in real time (step S115-m).

[0065] The individual reproduction signal is input to the sound signal output device 10-m. Based on the individual reproduction signal, the sound signal output device 10-m presents the individual sound signal to the user 101-m through the sound signal output device 10-m at a timing synchronized with the common sound signal output from the sound signal output device 14-n. In the present embodiment, for example, the individual sound signal is reproduced synchronously with the common sound signal at a timing dedicated to the user device 21-m, or the individual sound signal after applying the sound signal processing dedicated to the user device 21-m is reproduced at a timing synchronized with the common sound signal, or the individual sound signal after applying the sound signal processing dedicated to the user device 21-m is reproduced synchronously with the common sound signal at a timing dedicated to the user device 21-m (step S10-m).

[0066] <Features of this embodiment>

[0067] The user 101-m can listen to the common sound signal presented to multiple users and the individual sound signal dedicated to each user 101-m at a synchronized timing. As a result, it is possible to provide a variety of sound content and optimized sound content that reflects the attributes, preferences, actions, postures, directions, positions, or conditions of each user 101-m. Furthermore, in this embodiment, it is also possible to perform timing and sound signal processing dedicated to each user 101-m, and to provide each user 101-m with sound content that further optimizes the sense of presence, distance, and direction.

[0068] [Modification 1 of the Second Embodiment]

[0069] In the second embodiment, the individual sound DB representing the individual sound signal dedicated to each user 101-m is stored in advance in the storage unit 133-n of the public device 23-n. However, the individual sound signal dedicated to each user 101-m may be stored in each user device 21-m. In this case, the storage unit 133-n of the public device 23-n may be omitted. In this case, instead of step S135-n, the individual sound selection unit 135-n of the public device 23-n cooperates with the common reproduction unit 132-n to generate individual reproduction control information for presenting the individual sound signal stored in each user device 21-m from the sound signal output device 10-m at a timing synchronized with the common sound signal. The individual reproduction control information is sent to the sending unit 136-n, and the sending unit 136-n sends the individual reproduction control information to the user device 21-m. The individual reproduction control information is received by the receiving unit 113-m of the user device 21-m and sent to the sound signal processing unit 216-m. Furthermore, the individual sound signal stored in the user device 21-m is also sent to the sound signal processing unit 216-m. The sound signal processing unit 216-m processes the individual sound signal based on the individual control information, generates and outputs new individual reproduction control information for prompting the individual sound signal after the signal processing from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. The new individual reproduction control information is sent to the individual reproduction unit 115-m. The subsequent steps are the same as steps S115-m and S10-m of the second embodiment.

[0070] [Variation 2 of the Second Embodiment]

[0071] In addition, in the case where each user device 21-m stores an individual sound signal dedicated to each user 101-m, an individual sound selection unit may be provided in the user device 21-m. In this case, the individual sound selection unit of the user device 21-m selects an individual sound signal suitable for the individual information (such as action, posture, direction, position or condition, etc.) obtained by the individual information providing unit 111-m from the individual sound signals stored in the user device 21-m, and sends the selected individual sound signal to the sound signal processing unit 216-m. The sound signal processing unit 216-m performs signal processing on the individual sound signal based on the individual control information, and generates and outputs new individual reproduction control information for presenting the individual sound signal after the signal processing from the sound signal output device 10-m at a timing synchronized with the aforementioned common sound signal. In the case of such a structure, the individual sound selection unit 135-n may be omitted from the common device 23-n.

[0072] [Variation 3 of the Second Embodiment]

[0073] Alternatively, the surrounding sounds of the user 101 - m may be picked up by an acoustic signal sensor such as a microphone, and the information on the surrounding sounds may be input to the acoustic signal processing unit 216 - m , which may use the information on the surrounding sounds to optimize the reproduction timing of the individual acoustic signals.

[0074] [Variation 4 of the Second Embodiment]

[0075] In the second embodiment, an individual control determination unit 237-n is provided in the public device 23-n. However, the function of the individual control determination unit 237-n may also be included in the sound signal processing unit 216-m of the user device 21-m. The sound signal processing unit 216-m processes the individual sound signal based on the individual information (such as action, posture, direction, position or condition, etc.) obtained by the individual information providing unit 111-m, and generates and outputs new individual reproduction control information for prompting the individual sound signal after the signal processing from the sound signal output device 10-m at a timing synchronized with the aforementioned public sound signal. The rest is as described in the second embodiment.

[0076] [Variation 5 of the Second Embodiment]

[0077] In the second embodiment, the individual sound signal is a signal of content dedicated to the user device 21-m (specific user). However, it is also possible that the individual sound signal common to all users 101-1, ..., 101-M is reproduced in synchronization with the common sound signal at a timing dedicated to each user device 21-m (specific user). Alternatively, it is also possible that sound signal processing dedicated to each user device 21-m (specific user) is performed on the individual sound signal common to all users 101-1, ..., 101-M, and the new individual sound signal obtained is reproduced at a timing synchronized with the common sound signal. Alternatively, it is also possible that sound signal processing dedicated to each user device 21-m (specific user) is performed on the individual sound signal common to all users 101-1, ..., 101-M, and the new individual sound signal obtained is reproduced at a timing dedicated to each user device 21-m (specific user) and the common sound signal is reproduced. In such a case, step S135-n of the second embodiment is changed, and the individual sound selection unit 135-n generates individual reproduction control information for prompting an individual sound signal common to all users 101-1, ..., 101-M from the sound signal output device 10-m at a timing synchronized with the common sound signal, and sends it to the sending unit 136-n.

[0078] [An example of the acoustic signal output device 10-m]

[0079] An example of the sound signal output device 10-m of each of the above-mentioned embodiments is shown. The sound signal output device 10-m of this example has a function of suppressing sound leakage to the outside, and as described in each of the embodiments and their variations, is particularly suitable for the purpose of reproducing a sound signal dedicated to each user device 21-m only in the user device 21-m.

[0080] Figure 3 , Figure 4A-4C as well as Figure 5A-Figure 5C An example of the sound signal output device 10-m is shown in FIG. 1. In the following, for simplicity, each of the sound signal output devices 10-m is not distinguished and is expressed as the sound signal output device 10. Similarly, the user 101-m, the user device 11-m, and the separate reproduction unit 115-m are also expressed as the user 101, the user device 11, and the separate reproduction unit 115.

[0081] like Figure 3 , Figure 4A-4C as well as Figure 5A-Figure 5C As illustrated, the sound signal output device 10 of this example includes: a driver unit 1011 that converts the individual reproduction signal output from the individual reproduction unit 115 of the user device 11 into an audio signal and outputs it; and a housing 1012 that accommodates the driver unit 1011 therein.

[0082] <Drive unit 1011>

[0083] The driving unit (speaker driving unit) 1011 is a device (a device having a speaker function) that emits (plays sound) an acoustic signal AC1 (first acoustic signal) based on an inputted independent reproduction signal to one side (D1 direction side), and emits an acoustic signal AC2 (second acoustic signal) which is an inverted signal (phase inversion signal) of the acoustic signal AC1 or an approximate signal of the inverted signal to the other side (D2 direction side). That is, the acoustic signal emitted from the driving unit 1011 to one side (D1 direction side) is referred to as the acoustic signal AC1 (first acoustic signal), and the acoustic signal emitted from the driving unit 1011 to the other side (D2 direction side) is referred to as the acoustic signal AC2 (second acoustic signal). For example, the driving unit 1011 includes a vibration plate 10113 that emits an acoustic signal AC1 from one surface 10113a to the D1 direction side by vibration, and emits an acoustic signal AC2 from the other surface 10113b to the D2 direction side by the vibration. Figure 4B). The driving unit 1011 of this example vibrates based on the input independent reproduction signal through the vibration plate 10113, and releases the sound signal AC1 from the surface 10111 on one side to the D1 direction side, and releases the sound signal AC2 which is the inverted signal of the sound signal AC1 or an approximate signal of the inverted signal from the side 10112 on the other side to the D2 direction side. That is, the sound signal AC2 is an sound signal that is incidentally released along with the release of the sound signal AC1. In addition, the D2 direction (the other side) is, for example, the opposite direction of the D1 direction (one side), but the D2 direction does not need to be strictly the opposite direction of the D1 direction, and the D2 direction only needs to be different from the D1 direction. The relationship between one side (D1 direction) and the other side (D2 direction) depends on the type and shape of the driving unit 1011. In addition, depending on the type and shape of the driving unit 1011, there is a case where the sound signal AC2 is strictly the inverted signal of the sound signal AC1, and there is also a case where the sound signal AC2 is an approximate signal of the inverted signal of the sound signal AC1. For example, the approximate signal of the inverted signal of the acoustic signal AC1 may be (1) a signal obtained by shifting the phase of the inverted signal of the acoustic signal AC1, (2) a signal obtained by changing (amplifying or attenuating) the amplitude of the inverted signal of the acoustic signal AC1, or (3) a signal obtained by shifting the phase of the inverted signal of the acoustic signal AC1 and further changing the amplitude. The phase difference between the inverted signal of the acoustic signal AC1 and its approximate signal is preferably less than δ1% of one cycle of the inverted signal of the acoustic signal AC1. Examples of δ1% are 1%, 3%, 5%, 10%, 20%, etc. In addition, the difference between the amplitude of the inverted signal of the acoustic signal AC1 and the amplitude of its approximate signal is preferably less than δ2% of the amplitude of the inverted signal of the acoustic signal AC1. Examples of δ2% are 1%, 3%, 5%, 10%, 20%, etc. In addition, as the mode of the driving unit 1011, a dynamic type, a balanced armature type, a hybrid type of a dynamic type and a balanced armature type, a capacitor type, etc. can be exemplified. In addition, the shapes of the driving unit 1011 and the vibration plate 10113 are not limited. In this example, for the sake of simplicity of explanation, an example is shown in which the outer shape of the driving unit 1011 is a roughly cylindrical shape with two end faces, and the vibration plate 10113 is a roughly disc-shaped example, but this does not limit the present invention. For example, the outer shape of the driving unit 1011 can also be a rectangular parallelepiped shape, etc., and the vibration plate 10113 can also be a dome shape, etc.

[0084] <Frame 1012>

[0085] The frame 1012 is a hollow member having a wall portion on the outside, and accommodates the drive unit 1011 inside. For example, the drive unit 1011 is fixed to the end portion on the D1 direction side inside the frame 1012. However, this does not limit the present invention. The shape of the frame 1012 is also not limited, but for example, the shape of the frame 1012 is preferably rotationally symmetrical (line symmetrical) or approximately rotationally symmetrical with the axis A1 extending along the D1 direction as the center. Thus, it is easy to set the sound hole 10123a (details will be described later) so that the deviation of the energy of the sound emitted from the frame 1012 in each direction becomes smaller. As a result, it is easy to reduce sound leakage evenly in all directions. For example, the frame 1012 has: a wall portion 10121, i.e., a first end face, disposed on one side (the D1 direction side) of the driving unit 1011; a wall portion 10122, i.e., a second end face, disposed on the other side (the D2 direction side) of the driving unit 1011; and a wall portion 10123, i.e., a side face, surrounding a space sandwiched between the first end face and the second end face with the axis A1 passing through the first end face and the second end face as the center. Figure 4B , Figure 5B ). In the present embodiment, for the sake of simplicity of explanation, an example is shown in which the frame 1012 is a roughly cylindrical shape with two end faces. For example, the interval between the wall portion 10121 and the wall portion 10122 is 10 mm, and the wall portions 10121 and 10122 are circular with a radius of 10 mm. However, these are examples and do not limit the present invention. For example, the frame 1012 can be a roughly dome-shaped shape with a wall portion at the end, or a hollow roughly cubic shape, or other three-dimensional shapes. In addition, the material constituting the frame 1012 is not limited. The frame 1012 can be composed of a rigid body such as a synthetic resin or metal, or it can be composed of an elastomer such as rubber.

[0086] <Sound holes 10121a, 10123a>

[0087] The wall of the frame 1012 is provided with: a sound hole 10121a (first sound hole) for outputting the sound signal AC1 (first sound signal) emitted from the driving unit 1011 to the outside; and a sound hole 10123a (second sound hole) for outputting the sound signal AC2 (second sound signal) emitted from the driving unit 1011 to the outside. The sound holes 10121a and 10123a are, for example, through holes that penetrate the wall of the frame 1012, but this does not limit the present invention. As long as the sound signal AC1 and the sound signal AC2 can be respectively output to the outside, the sound holes 10121a and 10123a may not be through holes.

[0088] The acoustic signal AC1 emitted from the sound hole 10121a reaches the external auditory canal of the user 101 and is heard by the user 101. On the other hand, an acoustic signal AC2 which is an inverted signal of the acoustic signal AC1 or an approximate signal of the inverted signal is emitted from the sound hole 10123a. A portion of the acoustic signal AC2 cancels a portion (leakage component) of the acoustic signal AC1 emitted from the sound hole 10121a. That is, by emitting the acoustic signal AC1 (first acoustic signal) from the sound hole 10121a (first sound hole) and emitting the acoustic signal AC2 (second acoustic signal) from the sound hole 10123a (second sound hole), the attenuation rate η of the acoustic signal AC1 (first acoustic signal) at the position P2 (second location) based on the position P1 (first location) can be reduced to 11 becomes a predetermined value η th Next, the attenuation amount η of the acoustic signal AC1 (first acoustic signal) at the position P2 (second position) based on the position P1 (first position) can be set to 12 is a predetermined value ω th Here, the position P1 (first position) is a predetermined position where the sound signal AC1 (first sound signal) emitted from the sound hole 10121a (first sound hole) reaches. On the other hand, the position P2 (second position) is a predetermined position farther from the sound signal output device 10 than the position P1 (first position). The predetermined value η th is the attenuation rate η of an arbitrary or specific acoustic signal (sound) caused by air propagation at position P2 (second position) relative to position P1 (first position) 21 In addition, the predetermined value ω th is the attenuation η of an arbitrary or specific acoustic signal (sound) caused by air propagation at position P2 (second position) relative to position P1 (first position) as a reference. 22 That is, the acoustic signal output device 10 in this example is designed so that the attenuation rate η 11 becomes less than the attenuation rate η 21 The predetermined value η th Below, or designed to be attenuation η 12 becomes greater than the attenuation η 22 The predetermined value ω th In addition, the acoustic signal AC1 is propagated through the air from position P1 to position P2, and is attenuated by the air propagation and the acoustic signal AC2. Attenuation rate η 11 The attenuation amount η is the ratio of the magnitude AMP2(AC1) of the acoustic signal AC1 at position P2, which is attenuated by air propagation and the acoustic signal AC2, to the magnitude AMP1(AC1) of the acoustic signal AC1 at position P1 (AMP2(AC1) / AMP1(AC1)).12 is the difference between the magnitude AMP1(AC1) and the magnitude AMP2(AC1) (|AMP1(AC1)-AMP2(AC1)|). On the other hand, without considering the acoustic signal AC2, any or specific acoustic signal AC transmitted through the air from position P1 to position P2 ar The attenuation is not due to the acoustic signal AC2 but due to air propagation. Attenuation rate η 21 is the acoustic signal AC at position P2 which is attenuated by air propagation (not attenuated by the acoustic signal AC2) ar Size of AMP2(AC ar ) relative to the acoustic signal AC at position P1 ar Size of AMP1(AC ar ) ratio (AMP2(AC ar ) / AMP1(AC ar )). In addition, the attenuation η 22 Is the size of AMP1 (AC ar ) and size AMP2(AC ar ) between (|AMP1(AC ar )-AMP2(AC ar )|). In addition, examples of the magnitude of an acoustic signal include the sound pressure of the acoustic signal or the energy of the acoustic signal. In addition, a "leakage component" refers to, for example, a component of the acoustic signal AC1 emitted from the sound hole 10121a that is likely to reach an area other than the user 101 wearing the acoustic signal output device 10 (for example, a person other than the user 101 wearing the acoustic signal output device 10). For example, a "leakage component" refers to a component of the acoustic signal AC1 that propagates in a direction other than the direction D1. For example, the direct wave (direct wave) of the acoustic signal AC1 is mainly emitted from the sound hole 10121a, and the direct wave of the second acoustic signal is mainly emitted from the second sound hole. A portion of the direct wave (leakage component) of the acoustic signal AC1 emitted from the sound hole 10121a is canceled out by interfering with at least a portion of the direct wave of the acoustic signal AC2 emitted from the sound hole 10123a. However, this does not limit the present invention, and the cancellation may also occur in areas other than the direct wave. That is, a leakage sound component which is at least one of the direct wave and the reflected wave of the acoustic signal AC1 emitted from the sound hole 10121a is sometimes cancelled by at least one of the direct wave and the reflected wave of the acoustic signal AC2 emitted from the sound hole 10123a.

[0089] [Hardware Structure of User Device and Public Device]

[0090] The user devices 11-m, 21-m and the public devices 13-n, 23-n in each embodiment are devices configured by executing a predetermined program on a general-purpose or dedicated computer having a processor (hardware processor) such as a CPU (central processing unit), a memory such as a RAM (random access memory), and a ROM (read-only memory). That is, the user devices 11-m, 21-m and the public devices 13-n, 23-n in each embodiment have, for example, a processing circuit configured to realize each of the components. The computer may have one processor and a memory, or may have multiple processors and memories. The program may be installed in the computer or recorded in a ROM in advance. In addition, instead of an electronic circuit (circuitry) that realizes a functional structure by reading a program like a CPU, a circuit that realizes a processing function independently may be used to constitute a part or all of the processing unit. In addition, the electronic circuit constituting one device may include multiple CPUs.

[0091] Figure 6 1 is a block diagram illustrating the hardware configuration of the user devices 11-m, 21-m and the public devices 13-n, 23-n in each embodiment. Figure 6As shown in the example, the user devices 11-m, 21-m and the public devices 13-n, 23-n of this example include a CPU (Central Processing Unit) 10a, an input unit 10b, an output unit 10c, a RAM (Random Access Memory) 10d, a ROM (Read Only Memory) 10e, an auxiliary storage device 10f, a communication unit 10h, and a bus 10g. The CPU 10a of this example includes a control unit 10aa, a calculation unit 10ab, and a register 10ac, and performs various calculation processes according to various programs read into the register 10ac. In addition, the input unit 10b is an input terminal, a keyboard, a mouse, a touch panel, etc. to which data is input. In addition, the output unit 10c is an output terminal, a display, etc. to which data is output. The communication unit 10h is a LAN card, etc. controlled by the CPU 10a that has read a predetermined program. The RAM 10d is an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), etc., and has a program area 10da for storing a predetermined program and a data area 10db for storing various data. The auxiliary storage device 10f is a hard disk, an MO (Magneto-Optical Disc), a semiconductor memory, etc., and has a program area 10fa for storing a predetermined program and a data area 10fb for storing various data. The bus 10g connects the CPU 10a, the input unit 10b, the output unit 10c, the RAM 10d, the ROM 10e, the communication unit 10h, and the auxiliary storage device 10f in a manner that allows information to be exchanged. The CPU 10a writes the program stored in the program area 10fa of the auxiliary storage device 10f into the program area 10da of the RAM 10d according to the read OS (Operating System) program. Similarly, the CPU 10a writes various data stored in the data area 10fb of the auxiliary storage device 10f into the data area 10db of the RAM 10d. And the addresses on the RAM 10d where the programs and data are written are stored in the register 10ac of the CPU 10a. The control unit 10aa of the CPU 10a sequentially reads these addresses stored in the register 10ac, reads the programs and data from the areas on the RAM 10d indicated by the read addresses, and causes the calculation unit 10ab to sequentially execute the calculations indicated by the programs, and stores the calculation results in the register 10ac. With such a structure, the functional structure of the user devices 11-m, 21-m and the public devices 13-n, 23-n is realized.

[0092] The above-mentioned program can be recorded in a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

[0093] The circulation of the program is carried out, for example, by selling, transferring, lending, etc. a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, it can also be set as a structure in which the program is stored in a storage device of a server computer and the program is forwarded from the server computer to other computers via a network so that the program is circulated. As described above, a computer that executes such a program, for example, first temporarily stores a program recorded in a portable recording medium or a program forwarded from a server computer in its own storage device. Then, when executing the process, the computer reads the program stored in its own storage device and executes the process according to the read program. In addition, as another execution method of the program, it can also be set that the computer directly reads the program from the portable recording medium and executes the process according to the program. Further, it can also be set that whenever a program is forwarded from a server computer to the computer, the process according to the received program is executed in sequence. In addition, it can also be set as such a structure, that is, without forwarding the program from the server computer to the computer, the above-mentioned process is performed by realizing the processing function only according to its execution instruction and result acquisition, that is, the so-called ASP (Application Service Provider) type service. In addition, the program in the present embodiment is assumed to include information equivalent to the program (data that is not a direct instruction to the computer but has a nature of defining the processing of the computer, etc.) used for processing by an electronic computer.

[0094] In each embodiment, the present device is configured by executing a predetermined program on a computer, but at least a part of the processing contents may be realized by hardware.

[0095] [Other Modifications]

[0096] In addition, the present invention is not limited to the above-mentioned embodiments. For example, in each of the above-mentioned embodiments and modifications, an audio signal output device 10-m is illustrated which is worn by the user 101-m without completely sealing the external auditory canal and releases an audio signal dedicated to each user 101-m to the external auditory canal of the user 101-m. Such an audio signal output device 10-m that does not completely seal the external auditory canal is suitable for the purpose of listening to a common audio signal that is prompted to multiple users and an individual audio signal that is dedicated to each user 101-m at a synchronized timing. However, instead of the audio signal output device 10-m that does not completely seal the auditory canal, an audio signal output device that can take in the common audio signal that is released to the outside and prompt it to the user 101-m together with the individual audio signal can also be used.

[0097] In addition, in each of the above-mentioned embodiments and variations, the public sound signal is reproduced from the sound signal output device 14-n. However, the public sound signal may also be ambient sound such as environmental sound, natural sound, live sound, speech sound, etc. In such a case, the ambient sound may be picked up by an acoustic signal sensor such as a microphone and sent to the public device 13-n, 23-n, and the individual sound selection unit 135-n of the public device 13-n, 23-n generates individual reproduction control information for prompting the individual sound signal from the sound signal output device 10-m at a timing synchronized with the public sound signal as the ambient sound.

[0098] In addition, the individual sound signal may be a signal corresponding to the relationship between the user 101-m (specific user) and a user 101-m' (where m'∈{1, ..., M}, m'≠m) other than the user 101-m included in the users 101-1, ..., 101-M (multiple users). For example, the individual sound signal presented to the user 101-m may be different depending on the distance between the user 101-m and the other users 101-m', or the individual sound signal presented to the user 101-m may be different depending on the number of other users 101-m' present in the unit area where the user 101-m is located. Alternatively, in the case where the other users 101-m' present within a predetermined distance from the user 101-m are in a pre-registered relationship with the user 101-m (e.g., acquaintances), the individual sound signal different from other cases may be presented to the user 101-m. Such a relationship between the user 101 - m and other users 101 - m ′ may be acquired in real time by the individual information providing unit 111 - m, may be set in advance in the individual information providing unit 111 - m, or may be input into the individual information providing unit 111 - m in real time.

[0099] Furthermore, the various processes described above may be executed not only in time series as described, but also in parallel or individually according to the processing capability of the device executing the processes or as needed. In addition, it is obvious that appropriate changes can be made within the scope of the gist of the present invention.

[0100] Industrial Applicability

[0101] The present invention can be used, for example, for voice commentary of works in art galleries, music reproduction, voice and music reproduction in movies, video games, horror rides in amusement parks and virtual spaces, the addition of sounds to increase the sense of presence in concerts and live broadcasts, and reproduction of simultaneous interpretation voice in business, movies, sightseeing, etc.

[0102] For example, the following situation is envisioned: when used in an art gallery or a movie, the original commentary voice or the explanation voice in the local language of the commentator is reproduced as a public sound signal. In such a case, if the user has not learned the language of the voice reproduced in the public sound signal, it is impossible to understand its content. Here, it is possible to consider reproducing a replacement voice corresponding to the user's nationality, language used, and language level as a separate sound signal for each user. For example, the following use can be considered.

[0103] Venue: English audio commentary is being played as a public sound signal.

[0104] A: A does not understand English at all, so for all the audio narrations, a replacement voice in A's native language is reproduced as A's individual sound signal.

[0105] B: B can understand simple English, so only for the parts that B has difficulty understanding, a replacement voice in A's native language is reproduced as A's individual sound signal.

[0106] In such an example, attributes such as native language, second language, second language level, etc. are included in the separate information.

[0107] In addition, the types of voice and sound effects and signal processing as the individual sound signals may be different according to the current position information of the user. Furthermore, music that matches the user's preferences may be reproduced as the individual sound signals.

[0108] In the case of concerts, live broadcasts, etc., the live performance in the live broadcast venue can also be listened to by users as a public sound signal, and the optimized reproduced sound is reproduced for each user as a separate sound signal. In this example, all users can hear the live performance at the venue. However, for example, the live performance does not include the voice of the lead singer. In this case, different lead singers can also be reproduced as separate sound signals according to the preferences of the pre-set users. Alternatively, the same lead singer is reproduced as a separate sound signal to all users, but by convolving and reproducing the head transfer function and head impulse response corresponding to the current position of each user in the sound signal processing unit, all users can feel as if they have heard the lead singer from the direction of the live performance. Alternatively, the same lead singer is reproduced as a separate sound signal to all users, but it can be set to reproduce the lead singer only when each user is in a specific interval. Such settings can also be changed in real time.

[0109] Description of Reference Numerals

[0110] 1, 2 reproduction system; 10-m, 14-m sound signal output device; 11-m, 21-m user device; 13-n, 23-n public device; 101-m user.

Claims

1. A user device, comprising: The individual reproduction unit outputs an individual reproduction signal for presenting an individual sound signal dedicated to a specific user who is any one of the multiple users to the specific user from a sound signal output device for the specific user at a timing synchronized with a common sound signal presented to the multiple users from a common sound source.

2. The user device according to claim 1, wherein: The public sound source emits the public sound signal to the surroundings of the specific user, The sound signal output device is worn by the specific user without completely sealing the external auditory canal of the specific user, and emits the individual sound signal to the external auditory canal of the specific user.

3. The user device according to claim 1, wherein: The individual sound signal is a signal corresponding to at least any one of an attribute, a preference, an action, a posture, a direction, a situation of the specific user, or a relationship between the specific user and a user other than the specific user included in the plurality of users.

4. The user device according to claim 1, wherein: The individual sound signal includes at least one of a signal of content dedicated to the specific user, a signal reproduced in synchronization with the common sound signal at a timing dedicated to the specific user, or a signal subjected to sound signal processing dedicated to the specific user.

5. A public device having: a common reproduction unit that outputs information for presenting a common sound signal from a common sound source to a plurality of users; and The output unit outputs information for presenting an individual sound signal dedicated to a specific user, who is any one of the plurality of users, from the sound signal output device for the specific user to the specific user at a timing synchronized with the common sound signal.

6. A method based on a user device, comprising: The individual reproduction step outputs an individual reproduction signal, which is used to present an individual sound signal dedicated to a specific user who is any one of the multiple users from a sound signal output device for the specific user to the specific user at a timing synchronized with a common sound signal presented to the multiple users from a common sound source.

7. A method based on a public device, comprising: a public reproduction step of outputting information for presenting a public sound signal from a public sound source to a plurality of users; and The output step outputs information for presenting an individual sound signal dedicated to a specific user, who is any one of the plurality of users, from the sound signal output device for the specific user to the specific user at a timing synchronized with the common sound signal.

8. A program for causing a computer to function as the user device of claim 1 or the public device of claim 4.

Images