Virtual space communication system, communication control device, and communication control method

Abstract

In a system that enables users using user terminals to communicate with each other by voice through a virtual space provided to a plurality of user terminals connected via a communication network, a mode setting unit 11a is provided that sets a secret conversation mode in which only the first and second users can have a conversation when a first user among the users participating in the virtual space speaks to a second user in a predetermined voice having a predetermined frequency characteristic and the second user responds in the same predetermined voice, so that when a user among the plurality of users participating in the virtual space wants to have a secret conversation only with a specific user, the user can have secret voice communication in a state similar to a secret conversation between only two specific people in real space.

Description

[Technical Field]

[0001] The present invention relates to a virtual space communication system, a communication control device, and a communication control method, and is particularly suitable for use in a system that enables users using user terminals to communicate with each other via voice through a virtual space provided to multiple user terminals connected via a communication network. [Background technology]

[0002] Conventionally, systems that enable users to communicate with each other by voice in a virtual computer space have been known (see, for example, Patent Documents 1 to 4). Patent Documents 1 to 4 disclose that a user gives instructions to an avatar displayed in the virtual space and carries out a voice conversation while moving within the virtual space. Of these, Patent Documents 1 and 2 disclose giving voice instructions to the virtual space. Patent Document 3 discloses enabling a conversation when certain conditions are met in the virtual space. Patent Document 4 discloses simulating the propagation of voice communication spoken by users within a virtual collaboration space.

[0003] In the technology described in Patent Document 1, each user can interact in a virtual space through their own corresponding avatar. Using client software installed on a client terminal, users can instruct the avatar's behavior and speech using input devices such as a keyboard switch, pointing device, tablet, or microphone. When a host user starts a voice chat, a predetermined range centered on the host user is set as the audible range. The audible range moves in accordance with the movement of the host user's avatar. Users who enter the audible range are connected to the voice chat channel used by the host user and can engage in voice chat. When a user leaves the audible range, the user is disconnected from the voice chat channel.

[0004] In the technology described in Patent Document 2, each user uses a VR HMD system to communicate via voice through an avatar in a virtual space. When a user wearing an HMD moves their eyes or speaks, the display mode of the avatar object corresponding to the user changes in the virtual space presented by another HMD that is capable of communicating with the HMD, and sound is output from a speaker. Because the timing of the change in display mode and the timing of the sound output are synchronized, communication partners can communicate seamlessly using voice and avatar objects in communication via the virtual space. Users can give voice instructions to the virtual space by speaking into a microphone equipped in the HMD.

[0005] The space sharing support system described in Patent Document 3 includes a space display unit that displays a virtual space, an avatar display unit that displays a user's avatar in the virtual space, a movement instruction receiving unit that receives a movement instruction from the user to the avatar, and a conversation control unit that controls voice conversation between users through the avatar. The avatar display unit moves the avatar within the virtual space in accordance with the movement instruction. The conversation control unit determines that an interaction condition is met when a first avatar and a second avatar approach each other in the virtual space, and sets the first avatar and second avatar to be able to have conversation with the user corresponding to each avatar.

[0006] In addition, the conversation control unit determines that the interaction condition is met when the first avatar enters the personal space of the second avatar. Note that, taking into consideration that another user's avatar may simply pass through one's personal space by chance, it is also disclosed that the conversation control unit may switch to the interaction mode when communication such as a conversation occurs at the user's command or when another user's avatar is present in one's personal space for a predetermined period of time or more.

[0007] Furthermore, the conversation control unit determines that the interaction condition is met when the first avatar and the second avatar are simultaneously present in an area created in the virtual space (for example, a conference room or a reception room) or when the first avatar and the second avatar face each other.

[0008] In the system described in Patent Document 4, the position of the avatar and the voice transmission position within the virtual collaboration space are controlled independently, and when a voice transmission position is not specified separately from the position of the first user's avatar, voice communication related to the first user's speech is transmitted to the second and third users. On the other hand, when an instruction is given to place the first user's voice transmission location near the second user's avatar, voice communication from the first user to the second user is executed as a virtual whisper, and the first user's voice communication is not transmitted to the third user. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-199198 [Patent Document 2] Japanese Patent Application Publication No. 2018-185786 [Patent Document 3] Japanese Patent Publication No. 2022-071314 [Patent Document 4] US Patent Application Publication No. 2023 / 0032545 Summary of the Invention [Problem to be solved by the invention]

[0010] In the systems described in Patent Documents 1 to 4, the conditions for conversation are set and the volume is adjusted based on the relative positions of the avatars of each user in the virtual space, enabling voice communication in a state close to that of the real space. However, in actual conversations in the real space, the conditions for conversation, volume, etc. are not determined solely by the relative positions of the users.

[0011] SUMMARY OF THE INVENTION It is therefore an object of the present invention to enable users to communicate with each other by voice in a virtual space in a state that is closer to the real space. [Means for solving the problem]

[0012] In order to solve the above-mentioned problems, the present invention provides a system that allows users using user terminals to communicate with each other via voice through a virtual space provided to multiple user terminals connected via a communication network, and when a first user participating in the virtual space speaks to a second user using a predetermined voice with a predetermined frequency characteristic and the second user responds using the predetermined voice, a secret conversation mode is set in which only the first user and the second user can converse. [Effects of the Invention]

[0013] According to the present invention configured as described above, in a virtual space that allows users to communicate with each other via voice, if a user wishes to have a secret conversation only with a specific user, the user can carry out voice communication in a manner similar to a secret conversation that takes place only between two specific people in real space. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of a virtual space communication system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of a server device according to the present embodiment. [Figure 3] 10 is a flowchart illustrating an example of the operation of a mode setting unit according to the present embodiment. [Figure 4] 10 is a flowchart illustrating an example of the operation of the audio control unit according to the present embodiment. [Figure 5] 10 is a flowchart illustrating an example of the operation of an operation control unit according to the present embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of a user interface displayed on a display of a user terminal. DETAILED DESCRIPTION OF THE INVENTION

[0015] An embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a diagram showing an example of the overall configuration of a virtual space communication system according to this embodiment. As shown in Fig. 1, the virtual space communication system of this embodiment is configured to include a server device 10 and a plurality of user terminals 20. The server device 10 and the user terminals 20 are connected via a communication network 30 such as the Internet and a mobile phone network.

[0016] The user terminal 20 is configured as, for example, a smartphone, a tablet, a personal computer, or the like. The user terminal 20 has a built-in audio input device such as a microphone, or is configured to be connectable by wire or wirelessly. The user terminal 20 also has a built-in audio output device such as a speaker, or is configured to be connectable by wire or wirelessly. A headset equipped with a microphone and a speaker may be connected to the user terminal 20.

[0017] The server device 10 corresponds to a communication control device, and provides a virtual space to a plurality of user terminals 20 connected via a communication network 30, enabling users of the user terminals 20 to communicate with each other by voice through the virtual space. That is, the server device 10 receives a speaker's voice input from a voice input device of one user terminal 20 via the communication network 30, and transmits the received speaker's voice to another user terminal 20 via the communication network 30 and outputs it from a voice output device.

[0018] The virtual space is a space in which a virtual user corresponding to a user can move freely. A user using a user terminal 20 moves his / her virtual user within the virtual space and communicates by voice with users corresponding to other virtual users he / she meets at the destination of the user's movement. A dedicated application program (hereinafter referred to as a conversation app) is installed in the user terminal 20 for processing the actions and voice communication of such virtual users within the virtual space. The "virtual user corresponding to a user" refers to a virtual user set in the conversation app installed in the user terminal 20 by the user.

[0019] The conversation app transmits the virtual user's action instructions input by the user to the server device 10. The server device 10 controls the virtual user's actions in the virtual space in accordance with the action instructions received from the user terminal 20. The conversation app also transmits the speaker's voice input from the voice input device of the user terminal 20 to the server device 10. The server device 10 transmits the speaker's voice received from one user terminal 20 to another user terminal 20, causing the speaker's voice to be output from the voice output device.

[0020] In this embodiment, the virtual space provided by the server device 10 to the user terminal 20 is, for example, a non-display virtual space in which there is only audio and no images displayed on the screen of the user terminal 20. Although there are no images of the space or virtual users displayed on the user terminal 20, the virtual space itself exists, and the server device 10 manages the location information of the virtual space and the location information of the virtual users within the virtual space. For example, when a user issues an instruction to move the virtual user, the server device 10 updates the stored location information of the virtual user in accordance with the movement instruction.

[0021] The user understands the virtual user's position and surroundings in the virtual space by relying on the audio output from the audio output device. The user also moves the virtual user within the virtual space by giving audio instructions from the audio input device, and has audio conversations with users corresponding to other virtual users encountered at the destination location using the audio input and output devices.

[0022] The user terminal 20 is equipped with an image display device such as a display, or is configured to be connectable via wired or wireless connection. However, when communication is being carried out via voice through a virtual user in the virtual space, the screen of the virtual space is not displayed on the display.

[0023] Fig. 2 is a block diagram showing an example of the functional configuration of server device 10 according to this embodiment. As shown in Fig. 2, server device 10 of this embodiment includes, as its functional configuration, a communication control unit 11, an operation control unit 12, and a user information registration unit 13. More specifically, communication control unit 11 includes, as its functional configuration, a mode setting unit 11a and a voice control unit 11b. Server device 10 also includes, as storage media, a user information storage unit 14 and a spatial information storage unit 15.

[0024] The functional blocks 11 to 13 execute the following processes through the cooperation of hardware and software. For example, the processes of the functional blocks 11 to 13 are executed by the operation of a program stored in a storage medium such as RAM, ROM, a hard disk, or a semiconductor memory under the control of a microcomputer including a CPU, RAM, ROM, etc. In addition to the microcomputer, a DSP (Digital Signal Processor) etc. may also be included.

[0025] The user information registration unit 13 registers user information about users who use the conversation app. That is, the user information registration unit 13 receives user information transmitted from the user terminal 20 and stores the user information in the user information storage unit 14. For example, when the user installs the conversation app in the user terminal 20, the user operates the user terminal 20 to input user information, and transmits this to the server device 10 as a registration request. In response to this registration request, the server device 10 stores the user information received from the user terminal 20 in the user information storage unit 14.

[0026] The user information registered in the user information storage unit 14 includes, for example, the user's name, a nickname used as the name of a virtual user, a user ID, a login password, etc. The name and / or nickname is used as user identification information when users communicate with each other via voice. For this reason, it is preferable to register a nickname as a unique name for each individual user. For this reason, when a request to register a new nickname is received from the user terminal 20, the user information registration unit 13 determines whether the nickname is the same as one already registered in the user information storage unit 14, and if so, responds to the user terminal 20 with a message prompting the user to set a different nickname.

[0027] The user information storage unit 14 also stores information about the virtual user corresponding to the user. For example, the user information storage unit 14 receives set mode information indicating a mode set for the virtual user by the mode setting unit 11a from the mode setting unit 11a, and stores the information in association with the user ID. The user information storage unit 14 also stores information about the location and direction of the virtual user moving in the virtual space under the control of the action control unit 12 in association with the user ID.

[0028] The communication control unit 11 controls voice communication between users participating in the virtual space. A user participating in the virtual space is a user who has launched a conversation app and logged in to the server device 10. The communication control unit 11 controls the mode to be set for the virtual user by the mode setting unit 11a, and controls the dialogue voice communicated between the user terminals 20 by the voice control unit 11b according to the set mode. Details of these processes will be described later.

[0029] The movement control unit 12 controls the movement of a virtual user corresponding to a user participating in the virtual space in response to a movement instruction from the user transmitted from the user terminal 20. As described above, the movement instruction of the virtual user is given by the user's voice. That is, the movement control unit 12 controls the movement of the virtual user in the virtual space in response to a voice instruction input from a voice input device used by the user.

[0030] The actions of the virtual user include the movement of the virtual user within the virtual space. The action instructions include, for example, instructions to move forward, backward, turn, etc. The action instructions also include instructions to enter and exit a conversation space provided within the virtual space. One or more conversation spaces are provided within the virtual space. The space information storage unit 15 pre-stores position information indicating the overall position of the virtual space and position information indicating the location of the conversation space within the virtual space.

[0031] For example, when a user instructs the virtual user to move forward, the movement control unit 12 controls the virtual user to move forward a predetermined distance. The user may also instruct the distance to move forward. For example, when the user utters "move forward," the uttered voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The movement control unit 12 interprets the uttered voice regarding this movement instruction through voice recognition processing and controls the virtual user to move forward a predetermined distance. In other words, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating a position where the virtual user has moved forward a predetermined distance in the direction indicated by the traveling direction information.

[0032] Furthermore, when a user instructs the virtual user to turn right, the movement control unit 12 controls the virtual user to turn a predetermined angle to the right. The user may also instruct the angle of the turn. For example, when the user utters "turn right," the uttered voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The movement control unit 12 interprets the uttered voice regarding this movement instruction through speech recognition processing and controls the virtual user to turn a predetermined angle to the right. In other words, the virtual user's traveling direction information stored in the user information storage unit 14 is updated to information indicating a direction displaced by a predetermined angle to the right.

[0033] Furthermore, when a user instructs the virtual user to enter the conversation space, the action control unit 12 controls the virtual user to enter the conversation space. For example, when the user utters "enter," the uttered voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The action control unit 12 interprets the uttered voice relating to this action instruction through speech recognition processing and controls the virtual user to enter the conversation space. That is, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating the virtual user's location within the conversation space. Note that such entry processing may be enabled only when the virtual user is located within a predetermined distance from the conversation space.

[0034] Furthermore, when a user instructs the virtual user to leave the conversation space, the action control unit 12 controls the virtual user to leave the conversation space. For example, when the user utters "leave," the uttered voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The action control unit 12 interprets the uttered voice relating to this action instruction through speech recognition processing and controls the virtual user to leave the conversation space. That is, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating a location outside the conversation space (e.g., the location where the virtual user was located before entering the conversation space). Note that such an exit process may be enabled only when the virtual user is within the conversation space.

[0035] When a user logs in to the server device 10 from a conversation app for the first time, the virtual user of that user is set to be located at a predetermined start position in the virtual space. That is, the location information of the virtual user stored in the user information storage unit 14 is initially set to the predetermined start position. On the other hand, when the user logs in for the second time or later, the virtual user of that user is set to the location where the user was located at the time of previous logout. That is, information indicating the location where the virtual user was located at the time of logout is saved in the user information storage unit 14 and is used as the location information of the virtual user at the next log-in.

[0036] The mode setting unit 11a of the communication control unit 11 sets the mode according to the user's speech or the actions of the virtual user instructed by the user. The audio control unit 11b controls the audio transmitted to and received from the user terminal 20 according to the mode set by the mode setting unit 11a. The audio control includes volume control and sound image localization processing.

[0037] The mode setting unit 11a sets three modes: roaming mode, normal conversation mode, and secret conversation mode. The roaming mode is a mode that is set when the virtual user is outside the conversation space. The normal conversation mode is a normal mode that is set when the virtual user is inside the conversation space. The secret conversation mode is a mode that is set when the virtual user is inside the conversation space and the user's speech voice reaches a predetermined state.

[0038] When a virtual user enters a conversation space provided within the virtual space, the mode setting unit 11a sets a normal conversation mode for the virtual user, enabling conversation between multiple users corresponding to the multiple virtual users in the conversation space. Whether the virtual user has entered the conversation space can be determined by comparing the virtual user's location information stored in the user information storage unit 14 with the location information for the conversation space stored in the space information storage unit 15. When the mode setting unit 11a detects that the virtual user has entered the conversation space, it stores set mode information indicating that the normal conversation mode has been set for the virtual user in the user information storage unit 14 in association with the user ID.

[0039] The audio control unit 11b controls the speech of a user corresponding to one virtual user who is in the conversation space and has normal conversation mode set (speech transmitted from the user terminal 20 of that user) to be output from an audio output device used by a user corresponding to one or more other virtual users who are in the same conversation space.

[0040] That is, the voice control unit 11b identifies multiple virtual users present in one conversation space by referring to the virtual user location information stored in the user information storage unit 14. Then, when voice control unit 11b receives a user's utterance from a user terminal 20 corresponding to one virtual user present in the conversation space and set to normal conversation mode, it controls the voice control unit 11b to transmit the utterance to user terminals 20 corresponding to one or more other virtual users present in the same conversation space and output the voice from the voice output device.

[0041] Here, the one or more other virtual users to which the speaker voice is output may include both virtual users for which the normal conversation mode is set and virtual users for which the secret conversation mode is set. Alternatively, as will be described in detail later, the one or more other virtual users may be only virtual users for which the normal conversation mode is set, excluding virtual users for which the secret conversation mode is set. Furthermore, the user terminal 20 to which the speech voice is output may be a user terminal other than the user terminal 20 that transmitted the speech voice, or may include the user terminal 20 that transmitted the speech voice.

[0042] By performing the above-described processing by the mode setting unit 11a and the voice control unit 11b, when multiple virtual users exist in a conversation space, multiple users corresponding to the multiple virtual users can engage in voice communication in a state similar to a conversation in real space.

[0043] Furthermore, when a first user among multiple users corresponding to multiple virtual users in the conversation space speaks to a second user in a predetermined voice having predetermined frequency characteristics and the second user responds in a predetermined voice, the mode setting unit 11a sets the virtual users corresponding to the first and second users to a secret conversation mode in which only the first and second users can converse with each other. The mode setting unit 11a stores set mode information indicating that the secret conversation mode has been set for the two virtual users in the user information storage unit 14 in association with the user IDs.

[0044] The predetermined voice can be, for example, a voice having frequency characteristics in which low-frequency band components lower than a predetermined frequency are equal to or less than a predetermined value. Here, the mode setting unit 11a may analyze the frequency amplitude characteristics of the voice uttered by the user, separate the voice uttered into low-frequency band components and mid- to high-frequency band components, and recognize the voice uttered as the predetermined voice when the amount of energy specified by the amplitude of the low-frequency band components is equal to or less than a predetermined value.

[0045] The frequency amplitude characteristics can be analyzed using, for example, FFT (Fast Fourier Transformation). The amount of energy specified by the amplitude of the low-frequency band component can be, for example, the maximum amplitude value in the low-frequency band. Alternatively, it can be the total amount of amplitude values ​​in the low-frequency band.

[0046] The above frequency characteristics are characteristic of a whisper used for secret conversation. That is, the frequency characteristics of a whisper have a feature of having fewer low-frequency band components than the frequency characteristics of normal speech. When the mode setting unit 11a detects that the first and second users are exchanging utterances using a predetermined voice having such frequency characteristics characteristic of a whisper, the mode setting unit 11a sets a secret conversation mode between the first and second users.

[0047] Here, the predetermined frequency used as the boundary between the low frequency band and the medium-high frequency band can be, for example, the lower of two boundary frequencies that result when the entire frequency band of the user's speech is divided into thirds. That is, the lowest frequency band of the three divided frequency bands may be the low frequency band, and the remaining frequency bands may be the medium-high frequency bands. Note that equal division is not essential, and division into thirds that is close to equal division is not prohibited.

[0048] As another example, the upper limit frequency of a frequency band called the major formant (for example, a frequency band including the first to third formants) or a frequency different therefrom may be set as the predetermined frequency. That is, the frequency band including the major formant may be set as the low frequency band, and the frequency band not including the major formant may be set as the mid-high frequency band.

[0049] As yet another example, the speech sounds produced by whispering and the speech sounds produced by normal speech, not whispering, of multiple sample users may be frequency analyzed, and the frequency characteristics of the whispering sounds and the frequency characteristics of the normal speech sounds may be compared to identify the boundary frequency at which a significant difference in the amount of energy is observed in the low frequency range as the predetermined frequency.

[0050] In addition, speech data of multiple sample users may be used as learning data, and frequency characteristics in which low-frequency band components lower than a predetermined frequency are below a predetermined value may be learned by machine learning, and the mode setting unit 11a may input the user's speech into the learned model to determine whether the speech is made by the predetermined voice.

[0051] The predetermined value used to determine whether the low-frequency band components are equal to or less than a predetermined value may be variable depending on the attributes of the user. For example, the user information registered by the user information registration unit 13 in the user information storage unit 14 may further include attribute information such as the user's gender and age. The mode setting unit 11a may then set a variable predetermined value depending on the attribute information of the user who has spoken, and then determine whether the low-frequency band components are equal to or less than the predetermined value.

[0052] Furthermore, the mode setting unit 11a may set a secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak in a predetermined voice for a predetermined time or more, and that the second user has responded by continuing to speak in a predetermined voice to the first user for a predetermined time or more. Furthermore, the mode setting unit 11a may set a secret conversation mode between the first user and the second user when it further detects that the maximum volume of the speech that continues for a predetermined time or more is equal to or lower than a predetermined volume.

[0053] The mode setting unit 11a may also be configured to set the secret conversation mode when the first user utters the identification information (e.g., nickname) of the second user in a predetermined voice and the second user responds in the predetermined voice. In this case, the content of the second user's response does not matter as long as it is in the predetermined voice. Alternatively, the secret conversation mode may be set only when the second user also utters the identification information of the first user in the predetermined voice.

[0054] That is, the mode setting unit 11a monitors the frequency characteristics of the speech transmitted from the user terminal 20 of the user corresponding to the virtual user present in the conversation space, and when the mode setting unit 11a detects speech in a predetermined voice, it interprets the speech through speech recognition processing.Then, it determines whether the content of the interpreted speech matches any of the nicknames of the virtual users in the conversation space stored in the user information storage unit 14. Here, if it is determined that the content does not match any nickname, the mode setting unit 11a does not set the secret conversation mode.

[0055] On the other hand, if it is determined that the nickname matches any one of the nicknames, the mode setting unit 11a identifies the user of the user terminal 20 that is the sender of the spoken voice as the first user. Furthermore, the mode setting unit 11a monitors the frequency characteristics of the spoken voice transmitted within a predetermined time from the user terminal 20 of the user corresponding to the virtual user with the matching nickname, and if the mode setting unit 11a detects a spoken voice in a predetermined voice, the mode setting unit 11a identifies the user who responded by speaking as the second user and sets the secret conversation mode for the first user and the virtual users corresponding to the second user.

[0056] In addition, when the secret conversation mode is set only when the second user also utters the identification information of the first user, the mode setting unit 11a interprets, by voice recognition processing, a speech in a predetermined voice transmitted within a predetermined time from the user terminal 20 of a user whose nickname matches the nickname uttered by the first user.The mode setting unit 11a then determines whether the content of the interpreted speech matches the nickname of the first user stored in the user information storage unit 14, and sets the secret conversation mode if it is determined that they match.

[0057] When the secret conversation mode is set, the audio control unit 11b controls the audio output device so that the first user's speech is output only from the audio output device used by the second user, while the second user's speech is output only from the audio output device used by the first user.

[0058] That is, when the voice control unit 11b receives an utterance from the user terminal 20 of the first user in which the secret conversation mode is set, it controls so that the utterance is transmitted only to the user terminal 20 of the second user in which the secret conversation mode is also set and output from the voice output device.Furthermore, when the voice control unit 11b receives an utterance from the user terminal 20 of the second user, it controls so that the utterance is transmitted only to the user terminal 20 of the first user and output from the voice output device.

[0059] The mode setting unit 11a monitors whether at least one of the first user and the second user has spoken in a voice other than the predetermined voice while the secret conversation mode is set. If it detects that at least one of the users has spoken in a voice other than the predetermined voice, it cancels the setting of the secret conversation mode. In other words, it returns the mode setting for the virtual users corresponding to the first user and the second user to the normal conversation mode.

[0060] By performing the above-described processing by the mode setting unit 11a and the audio control unit 11b, when multiple users are conversing in a conversation space, a secret conversation can be conducted in whispers between only a first user and a second user among them, thereby enabling audio communication in a state similar to a secret conversation between only two specific people in real space.

[0061] Note that even when the first and second users are set to the secret conversation mode, other users in the same conversation space can have a normal (non-secret) conversation in the normal conversation mode. Here, the audio control unit 11b may be configured not to transmit the speech of other users in the same conversation space to the user terminals 20 of the first and second users. In this way, the whispered speech of the other user output to the audio output devices of the first and second users who are having a secret conversation can be prevented from being difficult to hear due to the normally spoken speech of the other user output to the audio output device.

[0062] Similarly, when transmitting the spoken voice of a nickname (spoken voice in a predetermined voice) transmitted from the user terminal 20 of the first user to the user terminal 20 of the other user corresponding to the nickname (i.e., a candidate user who can become the second user), the spoken voices of other users in the same conversation space may not be transmitted to the user terminal 20 of the candidate user. In this way, the candidate user can avoid missing the whispered spoken voice of the nickname output to the candidate user's voice output device because it becomes difficult to hear due to the normal spoken voice of the other users output to the voice output device.

[0063] Furthermore, when a virtual user is outside the conversation space, the mode setting unit 11a sets the roaming mode for that virtual user, and stores set mode information indicating that the roaming mode has been set in association with the user ID in the user information storage unit 14. In this case, the user for whom the roaming mode has been set may say anything, but the voice control unit 11b does not transmit the user's utterance to other users' user terminals 20. Meanwhile, the voice control unit 11b controls the voice of the conversation in the conversation space to be output from the voice output device used by the user corresponding to the virtual user for whom the roaming mode has been set, at a volume lower than the volume output when the virtual user is within the conversation space.

[0064] For example, the voice control unit 11b transmits the voice uttered from the user terminal 20 of one user who is in the conversation space and has the normal conversation mode set to the user terminals 20 of other users who are in the same conversation space (either only users who have the normal conversation mode set, or users who have the secret conversation mode set in addition to the normal conversation mode) without lowering the volume.On the other hand, the voice control unit 11b transmits the voice uttered from the user terminal 20 of one user who is in the conversation space and has the normal conversation mode set to the user terminals 20 of other users who are outside the conversation space and have the roaming mode set, with the volume lowered.

[0065] In this case, audio control unit 11b may perform sound image localization of the audio output to the audio output device according to the positional relationship between the virtual user outside the conversation space and the conversation space. In other words, audio control unit 11b controls the audio output to the audio output device according to the direction from the virtual user outside the conversation space toward the conversation space so that the audio is heard from a certain direction in the conversation space.

[0066] Furthermore, the audio control unit 11b controls the volume of the audio output to the audio output device depending on the distance between the virtual user outside the conversation space and the conversation space, so that the longer the distance, the lower the volume, and the shorter the distance, the higher the volume. However, even if a virtual user is close to the conversation space and the loudest volume is set, the volume is still lower than the volume output to the audio output device of a user who is in the conversation space and has normal conversation mode set. Furthermore, if a virtual user is located more than a certain distance away from the conversation space, the volume output to the audio output device of the user corresponding to that virtual user is set to zero (the spoken audio is not sent to the user terminal 20 of that user).

[0067] By performing such sound image localization processing by the audio control unit 11b, even if the virtual space provided to the user terminal 20 is a non-display virtual space with only audio, the user can navigate within the virtual space while grasping the direction and distance of the conversation space by relying on the sound image localized audio output from the audio output device, and can enter any conversation space and have a conversation. In this embodiment, all instructions to the virtual users and conversations between users can be given by audio, so even a visually impaired person can use a conversation app to enjoy audio communication in the virtual space.

[0068] Fig. 3 is a flowchart showing an example of the operation of the mode setting unit 11a according to this embodiment. Fig. 3 shows an example of the process of setting a mode for one virtual user, and the process of the flowchart shown in Fig. 3 is executed for all logged-in virtual users. Fig. 3 shows an example of the operation executed at the first login.

[0069] Mode setting unit 11a sets the wandering mode as the initial mode (step A1). Then, mode setting unit 11a determines whether the virtual user has entered the conversation space (step A2). For example, when the user utters "enter," operation control unit 12 executes a process to place the virtual user in the conversation space, and the virtual user's location information is updated to information indicating that the virtual user is in the conversation space. When mode setting unit 11a confirms this, it determines that the virtual user has entered the conversation space.

[0070] If mode setting unit 11a determines that the virtual user has not entered the conversation space, the process returns to step A1. On the other hand, if mode setting unit 11a determines that the virtual user has entered the conversation space, it sets the virtual user to the normal conversation mode (step A3). Thereafter, mode setting unit 11a monitors the frequency characteristics of the speech transmitted from user terminal 20 of the user corresponding to the virtual user for whom normal conversation mode has been set, and determines whether the speech is a predetermined voice (step A4).

[0071] Here, when the transmission of a speech voice in a predetermined voice is detected, the mode setting unit 11a interprets the speech voice by a voice recognition process and determines whether or not the content of the speech voice matches any of the nicknames of the virtual users in the conversation space stored in the user information storage unit 14 (step A5). Here, if the mode setting unit 11a determines that the content of the speech voice does not match any of the nicknames, the process proceeds to step A12.

[0072] On the other hand, if it is determined that the nickname matches any one of the nicknames, the mode setting unit 11a identifies the user of the user terminal 20 that is the sender of the uttered voice as the first user. Furthermore, the mode setting unit 11a monitors the frequency characteristics of the uttered voice transmitted within a predetermined time from the user terminal 20 of the virtual user with the matching nickname, and determines whether there has been a response by the uttered voice in the predetermined voice (step A6).

[0073] If a speech voice in the predetermined voice has not been received, the process proceeds to step A12. On the other hand, if a speech voice in the predetermined voice has been received, the mode setting unit 11a identifies the user of the user terminal 20 that is the sender of the speech voice as the second user, and sets the secret conversation mode for the first user and the virtual users corresponding to the second user (step A7).

[0074] Thereafter, the mode setting unit 11a monitors the frequency characteristics of the speech transmitted from the user terminals 20 of the first and second users for which the secret conversation mode has been set, and determines whether speech other than the predetermined voice has been received from at least one of the user terminals 20 (step A8). If speech other than the predetermined voice has not been received, the process returns to step A7, and the setting of the secret conversation mode continues. On the other hand, if the mode setting unit 11a determines that speech other than the predetermined voice has been received from at least one of the user terminals 20, the process returns to step A3, and the normal conversation mode is set.

[0075] If no speech in the specified voice is detected in step A4 above, the mode setting unit 11a monitors the frequency characteristics of speech transmitted from the user terminal 20 of another user for which normal conversation mode is set to the user terminal 20 of the user corresponding to the virtual user for which normal conversation mode was set in step A3, and determines whether speech in the specified voice has been received (step A9).

[0076] If a speech voice in the predetermined voice has not been received, the process proceeds to step A12. On the other hand, if a speech voice in the predetermined voice has been received, the mode setting unit 11a interprets the speech voice through a voice recognition process and determines whether the content of the speech voice matches the nickname of the user (the virtual user for whom the normal conversation mode was set in step A3) stored in the user information storage unit 14 (step A10). If the mode setting unit 11a determines that the content of the speech voice does not match the user's nickname, the process proceeds to step A12.

[0077] On the other hand, if it is determined that the nickname matches the user's own nickname, the mode setting unit 11a monitors the frequency characteristics of the voice uttered from the user's own user terminal 20 within a predetermined time, and determines whether the user responded with a voice uttered in a predetermined voice (step A11).

[0078] If a speech voice in the predetermined voice has not been received, the process proceeds to step A12. On the other hand, if a speech voice in the predetermined voice has been received, the process proceeds to step A7. In this case, the mode setting unit 11a identifies the user who responded as the second user and sets the secret conversation mode for the virtual users corresponding to the first user and the second user.

[0079] In step A12, mode setting unit 11a determines whether the virtual user has left the conversation space. For example, when the user utters "exit," operation control unit 12 executes a process to move the virtual user out of the conversation space, and the virtual user's location information is updated to information indicating that the virtual user is outside the conversation space. If mode setting unit 11a confirms this, it determines that the virtual user has left the conversation space.

[0080] If the mode setting unit 11a determines that the virtual user has not left the conversation space, the process returns to step A3, where the normal conversation mode continues to be set. On the other hand, if the mode setting unit 11a determines that the virtual user has left the conversation space, the process returns to step A1, where the wandering mode is set.

[0081] As shown in Figure 3, the initial setting is the wandering mode when you log in for the first time, but when you log in next time or later, the process starts by setting the mode corresponding to the location where the virtual user was when you last logged out (step A3 or step A7).

[0082] Fig. 4 is a flowchart showing an example of the operation of the voice control unit 11b according to this embodiment. Fig. 4 shows an example of the operation when processing one speaker's voice transmitted from one user terminal 20, and the process of the flowchart shown in Fig. 4 is executed every time a speaker's voice transmitted from a logged-in user terminal 20 is received.

[0083] The voice control unit 11b determines whether or not a speaker's voice has been received from the user terminal 20 (step B1). The voice control unit 11b continues the determination in step B1 until one speaker's voice is received. When the server device 10 receives one speaker's voice, the voice control unit 11b determines the mode currently set for the virtual user corresponding to the user of the user terminal 20 who transmitted the speaker's voice (step B2).

[0084] If it is determined that the mode set for the virtual user is the wandering mode, the process returns to step B1. That is, the voice control unit 11b does not transmit the voice of the speaker to other user terminals 20, and waits for reception of the voice of the next speaker.

[0085] If it is determined that the mode set for the virtual user is the normal conversation mode, the voice control unit 11b refers to the virtual user's location information stored in the user information storage unit 14, identifies one or more other virtual users who are in the same conversation space as the speaking virtual user, and controls the transmission of spoken voice to one or more user terminals 20 corresponding to the one or more other virtual users, and outputs the voice from the voice output device (step B3).

[0086] Furthermore, voice control unit 11b refers to the virtual user location information stored in user information storage unit 14, and identifies one or more virtual users who are outside the conversation space but are located within a certain distance from the conversation space where the speaking virtual user is located. Then, voice control unit 11b controls one or more user terminals 20 corresponding to the identified one or more virtual users to transmit speech voices that have been subjected to sound image localization according to the positional relationship between each virtual user and the conversation space, and output the speech voices from the voice output devices (step B4). Then, the process returns to step B1.

[0087] If it is determined that the mode set for the virtual user is the secret conversation mode, the voice control unit 11b refers to the setting information for the secret conversation mode stored in the user information storage unit 14, identifies the other virtual user for whom the secret conversation mode is set, and controls so that the spoken voice is transmitted only to the user terminal 20 corresponding to the identified other virtual user and output from the voice output device (step B5). Then, the process returns to step B1.

[0088] Fig. 5 is a flowchart showing an example of the operation of the operation control unit 12 according to this embodiment. Fig. 5 shows an example of a process for controlling the operation of one virtual user, and the process of the flowchart shown in Fig. 5 is executed for all logged-in virtual users.

[0089] The action control unit 12 determines whether or not an action instruction has been received from the user terminal 20 (step C1). The action control unit 12 continues the determination in step C1 until an action instruction is received. When the server device 10 receives an action instruction, the action control unit 12 controls the action of the virtual user in the virtual space in accordance with the action instruction (step C2). Thereafter, the process returns to step C1.

[0090] As described above in detail, in the virtual space communication system of this embodiment, the server device 10 provides a virtual space to a plurality of user terminals 20 connected via a communication network 30, and enables users using the user terminals 20 to communicate with each other by voice through the virtual space. In particular, in this embodiment, when a first user speaks to a second user using a predetermined voice having a predetermined frequency characteristic and the second user responds using the predetermined voice, a secret conversation mode is set in which only the first and second users can converse. When the secret conversation mode is set, the speech of the first user is output only from the voice output device used by the second user, and the speech of the second user is output only from the voice output device used by the first user.

[0091] According to the virtual space communication system of this embodiment configured as described above, in a virtual space that allows users to communicate with each other via voice, if a user wants to have a secret conversation only with a specific user, the user can carry out voice communication in a manner similar to a secret conversation that takes place only between two specific people in real space.

[0092] In the above embodiment, the virtual space provided to the user terminal 20 is a non-visual space that uses only audio, and instructions to operate the non-visual user are given only by audio. However, the present invention is not limited to this. For example, the user interface for issuing instructions to operate may be displayed on a screen.

[0093] Fig. 6 is a diagram showing an example of a user interface displayed on the display of user terminal 20. As shown in Fig. 6, the virtual space and virtual users are not displayed, and only operation buttons for instructing the virtual users to move forward, backward, turn, enter, and leave the room are displayed. In this case, the user can instruct the virtual users to move by voice or using the user interface displayed on the screen.

[0094] As another example, if the user terminal 20 is a smartphone, tablet, or the like with a built-in acceleration sensor or the like, the virtual user may be instructed to move in accordance with the movement of the user terminal 20 detected by the acceleration sensor. For example, when the user terminal 20 is swung forward, backward, left, or right, the virtual user may be instructed to move forward, backward, turn left, or turn right, respectively, and when the user terminal 20 is rotated right, the virtual user may be instructed to enter the room, and when the user terminal 20 is rotated left, the virtual user may be instructed to leave the room.

[0095] Furthermore, instead of a non-displayed virtual space, a display virtual space may be used in which a virtual space and a virtual user are displayed on a screen. Even in this case, if instructions to the virtual user are given using voice or an acceleration sensor, the user can communicate by voice without looking at the displayed virtual space. Needless to say, if the user wishes, communication by voice can be carried out while looking at the displayed virtual space.

[0096] In the above embodiment, a smartphone, a tablet, and a personal computer are given as examples of the user terminal 20, but the present invention is not limited to these. For example, the user terminal 20 may be a wearable terminal such as a goggle-type terminal, an eyeglass-type terminal, or a wristwatch-type terminal. In addition, when a virtual space is used as the display virtual space, a head-mounted display capable of displaying VR (virtual reality) images may be used as the user terminal 20.

[0097] Furthermore, in the above embodiment, when a wandering mode is set for a virtual user, an example was described in which the audio of a conversation taking place in a conversation space within a certain distance from the virtual user's position is localized as a sound image and supplied to the user terminal 20 of the user corresponding to that virtual user, but instead of or in addition to this, an audio other than speech audio may be supplied and output from the audio output device.

[0098] For example, a specific sound to notify the user of the existence of a conversation space may be localized and supplied to the user terminal 20 in the navigation mode. In this case, a special sound may be supplied to a conversation space where active conversation is taking place. The definition of active conversation may be set arbitrarily. For example, it is possible to determine that active conversation is taking place when either or both of the number of virtual users present in the conversation space is equal to or greater than a threshold, or the number of utterances per predetermined time is equal to or greater than a threshold, are satisfied.

[0099] Furthermore, in the above embodiment, an example was described in which there are three modes: roaming mode, normal conversation mode, and secret conversation mode; however, the present invention is not limited to this. For example, there may be only two modes: normal conversation mode and secret conversation mode. For example, the virtual space itself may be a single conversation space, and a logged-in virtual user may always exist within a single conversation space (= virtual space), where the normal conversation mode and secret conversation mode may be switched as appropriate. Alternatively, multiple conversation spaces may exist within the virtual space, and an instruction to jump from one conversation space to another conversation space may be given to the virtual user.

[0100] The functions and processes described above can be applied in appropriate combinations. Examples of configurations that can be applied to this embodiment are summarized below.

[0101] [Configuration 1] A system that enables users of a plurality of user terminals connected via a communication network to communicate with each other by voice through a virtual space provided to the user terminals, comprising: a communication control unit that controls voice communication between users participating in the virtual space; The communication control unit sets a secret conversation mode in which only the first user and the second user can have a conversation when a first user speaks to a second user in a predetermined voice having a predetermined frequency characteristic and the second user responds in the predetermined voice. A virtual space communication system characterized by:

[0102] [Configuration 2] 2. The virtual space communication system according to configuration 1, wherein the predetermined sound is a sound having frequency characteristics in which low-frequency band components lower than a predetermined frequency are equal to or less than a predetermined value.

[0103] [Configuration 3] The virtual space communication system according to configuration 2, wherein the communication control unit analyzes the frequency amplitude characteristics of the speech uttered by the user, separates the speech uttered into the low-frequency band components and mid-to-high-frequency band components higher than the predetermined frequency, and recognizes the speech uttered as the predetermined voice when the amount of energy specified by the amplitude of the low-frequency band components is equal to or less than the predetermined value.

[0104] [Configuration 4] The virtual space communication system of any one of configurations 1 to 3, characterized in that the communication control unit sets the secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak in the predetermined voice for a predetermined time or more, and the second user has responded to the first user by continuing to speak in the predetermined voice for a predetermined time or more.

[0105] [Configuration 5] The virtual space communication system described in configuration 4, wherein the communication control unit sets the secret conversation mode between the first user and the second user when it further detects that the maximum volume of speech that continues for more than the predetermined time is equal to or lower than a predetermined volume.

[0106] [Configuration 6] 6. The virtual space communication system according to any one of configurations 2 to 5, wherein the communication control unit sets the predetermined value in accordance with an attribute of a user.

[0107] [Configuration 7] The virtual space communication system according to any one of configurations 1 to 6, wherein the communication control unit sets the secret conversation mode when the first user speaks the identification information of the second user in the predetermined voice and the second user responds in the predetermined voice.

[0108] [Configuration 8] The virtual space communication system of any one of configurations 1 to 7, wherein the communication control unit cancels the setting of the secret conversation mode when at least one of the first user and the second user speaks in a voice other than the predetermined voice while the secret conversation mode is set.

[0109] [Configuration 9] further comprising an action control unit that controls actions within the virtual space of virtual users corresponding to users participating in the virtual space in response to instructions from the users; The communication control unit when the virtual user enters a conversation space provided within the virtual space, a normal conversation mode is set for the virtual user, in which a plurality of users corresponding to the plurality of virtual users in the conversation space can converse with each other; The secret conversation mode is set for virtual users corresponding to the first user and the second user among the plurality of users corresponding to the plurality of virtual users in the conversation space. 9. The virtual space communication system according to any one of configurations 1 to 8, wherein:

[0110] [Configuration 10] The communication control unit controlling the speech of a user corresponding to one virtual user in the conversation space and for whom the normal conversation mode is set to be output from a voice output device used by a user corresponding to one or more other virtual users in the same conversation space; Control is performed so that the speech of the first user corresponding to the virtual user who is in the conversation space and for whom the secret conversation mode is set is output only from the audio output device used by the second user, while the speech of the second user is output only from the audio output device used by the first user. 10. The virtual space communication system according to configuration 9,

[0111] [Configuration 11] The virtual space communication system described in configuration 9 is characterized in that the communication control unit controls the audio being conversed in the conversation space when the virtual user is outside the conversation space to be output from an audio output device used by a user corresponding to the virtual user outside the conversation space at a volume lower than the volume output when the virtual user is inside the conversation space.

[0112] [Configuration 12] The virtual space communication system described in configuration 11, wherein the communication control unit performs sound image localization of the audio output to the audio output device according to the positional relationship between the virtual user outside the conversation space and the conversation space.

[0113] [Configuration 13] The virtual space communication system according to any one of configurations 1 to 12, wherein the virtual space is a non-display virtual space in which there are no images displayed on the screen of the user terminal and only audio exists.

[0114] [Configuration 14] the virtual space is a non-display virtual space in which there is no image displayed on the screen of the user terminal and only audio exists, The virtual space communication system described in configuration 9 is characterized in that the operation control unit controls the operation of a virtual user corresponding to a user participating in the virtual space in accordance with voice instructions input from a voice input device used by the user.

[0115] [Configuration 15] A communication control device that provides a virtual space to a plurality of user terminals connected via a communication network and controls voice communication between users using the user terminals through the virtual space, a communication control unit that controls voice communication between users participating in the virtual space; The communication control unit sets a secret conversation mode in which only the first user and the second user can have a conversation when a first user speaks to a second user in a predetermined voice having a predetermined frequency characteristic and the second user responds in the predetermined voice. A communication control device comprising:

[0116] [Configuration 16] A communication control method for controlling voice communication between users using a plurality of user terminals connected via a communication network through a virtual space provided to the user terminals, comprising: A communication control unit of the computer sets a secret conversation mode in which only the first user and the second user can converse with each other when a first user among a plurality of users participating in the virtual space speaks to a second user in a predetermined voice having a predetermined frequency characteristic and the second user responds in the predetermined voice. A communication control method comprising:

[0117] Furthermore, the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereby. In other words, the present invention can be carried out in various forms without departing from the gist or main characteristics thereof. [Explanation of symbols]

[0118] 10 Server device 11 Communication Control Section 11a Mode setting section 11b Audio control section 12 Operation control section 13 User Information Registration Section 14 User information storage unit 15 Spatial information storage section 20 User terminal 30 Communication Network

Claims

1. A system that enables users of a plurality of user terminals connected via a communication network to communicate with each other by voice through a virtual space provided to the user terminals, comprising: a communication control unit that controls voice communication between users participating in the virtual space; The communication control unit sets a secret conversation mode in which only the first user and the second user can have a conversation when a first user speaks to a second user using a predetermined voice having frequency characteristics in which low-frequency band components lower than a predetermined frequency are equal to or less than a predetermined value, and the second user responds using the predetermined voice. A virtual space communication system characterized by:

2. The virtual space communication system of claim 1, characterized in that the communication control unit analyzes the frequency amplitude characteristics of the user's speech, separates the speech into the low-frequency band components and mid-high-frequency band components higher than the specified frequency, and recognizes the speech as the specified voice if the amount of energy specified by the amplitude of the low-frequency band components is less than the specified value.

3. The virtual space communication system described in claim 1 or 2, characterized in that the communication control unit sets the secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak in the specified voice for a predetermined period of time or more, and the second user has responded to the first user by continuing to speak in the specified voice for a predetermined period of time or more.

4. The virtual space communication system described in claim 3, characterized in that the communication control unit sets the secret conversation mode between the first user and the second user when it further detects that the maximum volume of speech that continues for more than the predetermined time is below a predetermined volume.

5. 2. The virtual space communication system according to claim 1, wherein the communication control unit sets the predetermined value in accordance with an attribute of the user.

6. The virtual space communication system described in claim 1 or 2, characterized in that the communication control unit sets the secret conversation mode when the first user speaks the identification information of the second user in the specified voice and the second user responds in the specified voice.

7. The virtual space communication system described in claim 1 or 2, characterized in that the communication control unit cancels the setting of the secret conversation mode when at least one of the first user and the second user speaks in a voice other than the specified voice while the secret conversation mode is set.

8. further comprising an action control unit that controls actions within the virtual space of virtual users corresponding to users participating in the virtual space in response to instructions from the users; The communication control unit when the virtual user enters a conversation space provided within the virtual space, a normal conversation mode is set for the virtual user, in which a plurality of users corresponding to the plurality of virtual users in the conversation space can converse with each other; The secret conversation mode is set for virtual users corresponding to the first user and the second user among the plurality of users corresponding to the plurality of virtual users in the conversation space.

3. The virtual space communication system according to claim 1 or 2.

9. The communication control unit controlling the speech of a user corresponding to one virtual user in the conversation space and for whom the normal conversation mode is set to be output from a voice output device used by a user corresponding to one or more other virtual users in the same conversation space; Control is performed so that the speech of the first user corresponding to the virtual user who is in the conversation space and for whom the secret conversation mode is set is output only from the audio output device used by the second user, while the speech of the second user is output only from the audio output device used by the first user.

9. The virtual space communication system according to claim 8.

10. The virtual space communication system described in claim 8, characterized in that the communication control unit controls the audio being conversed in the conversation space when the virtual user is outside the conversation space to be output from an audio output device used by a user corresponding to the virtual user outside the conversation space at a volume lower than the volume output when the virtual user is inside the conversation space.

11. The virtual space communication system described in claim 10, characterized in that the communication control unit performs sound image localization of the audio output to the audio output device depending on the positional relationship between the virtual user outside the conversation space and the conversation space.

12. 3. The virtual space communication system according to claim 1, wherein the virtual space is a non-display virtual space in which there is no image displayed on the screen of the user terminal and only audio exists.

13. the virtual space is a non-display virtual space in which there is no image displayed on the screen of the user terminal and only audio exists, The virtual space communication system described in claim 8, characterized in that the action control unit controls the action of a virtual user corresponding to a user participating in the virtual space in accordance with voice instructions input from a voice input device used by the user.

14. A communication control device that provides a virtual space to a plurality of user terminals connected via a communication network and controls voice communication between users using the user terminals through the virtual space, a communication control unit that controls voice communication between users participating in the virtual space; The communication control unit sets a secret conversation mode in which only the first user and the second user can have a conversation when a first user speaks to a second user using a predetermined voice having frequency characteristics in which low-frequency band components lower than a predetermined frequency are equal to or less than a predetermined value, and the second user responds using the predetermined voice. A communication control device comprising:

15. A communication control method for controlling voice communication between users using a plurality of user terminals connected via a communication network through a virtual space provided to the user terminals, comprising: A communication control unit of the computer sets a secret conversation mode in which only the first user and the second user can converse with each other when a first user among a plurality of users participating in the virtual space speaks to a second user using a predetermined voice having frequency characteristics in which low-frequency band components lower than a predetermined frequency are equal to or less than a predetermined value, and the second user responds using the predetermined voice. A communication control method comprising:

Images