Virtual space communication system, communication control device, and communication control method

The virtual space communication system addresses the inadequacy of existing systems by enabling secret whispers between specific users based on voice frequency analysis, replicating real-world conversation dynamics.

WO2026239616A1PCT designated stage Publication Date: 2026-11-19QON INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2025/017926
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-05-16
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Existing virtual space communication systems fail to replicate real-world voice conversations accurately, as they rely solely on relative avatar positions for volume and interaction conditions, neglecting the nuanced conditions of real-world conversations.

Method used

A virtual space communication system that enables users to engage in voice communication with a secret conversation mode, allowing whispers between specific users by analyzing voice frequency characteristics and setting modes accordingly, while maintaining normal conversations among others.

Benefits of technology

Facilitates voice communication in a virtual space that mimics real-world secret conversations, ensuring privacy and clarity by allowing whispers between specific users while others can engage in normal conversations, enhancing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025017926_19112026_PF_FP_ABST
    Figure JP2025017926_19112026_PF_FP_ABST
Patent Text Reader

Abstract

A system according to the present invention makes it possible for users using a plurality of user terminals that are connected over a communication network to communicate by voice via a virtual space that is provided to the user terminals. The system comprises a mode setting unit 11a that, when a first user of the users participating in the virtual space speaks to a second user in a prescribed voice that has prescribed frequency characteristics and the second user responds in the prescribed voice, sets a secret conversation mode in which conversation between only the first user and the second user is possible. The system allows for secret voice communication in a state that is close to secret conversation between only two specific people in an actual space when specific users of a plurality of users participating in a virtual space desire secret communication with only each other.
Need to check novelty before this filing date? Find Prior Art

Description

Virtual space communication system, communication control device, and communication control method

[0001] The present invention relates to a virtual space communication system, a communication control device, and a communication control method, and is particularly suitable for use in a system that enables users using multiple user terminals connected via a communication network to communicate with each other by voice through a virtual space provided to the user terminals.

[0002] Conventionally, systems that enable users to communicate with each other by voice in a computer's virtual space are known (see, for example, Patent Documents 1 to 4). Patent Documents 1 to 4 disclose that users can give instructions to avatars displayed in a virtual space and engage in voice conversations while moving around in the virtual space. Of these, Patent Documents 1 and 2 disclose giving voice instructions to the virtual space. Patent Document 3 discloses enabling conversation in a virtual space when certain conditions are met. Patent Document 4 discloses simulating the propagation of voice communication spoken by users in a virtual collaboration space.

[0003] In the technology described in Patent Document 1, each user can interact in a virtual space through an avatar corresponding to themselves. Users control the avatar's speech and actions using input devices such as keyboard switches, pointing devices, tablets, and microphones via client software installed on a client terminal. When a host user starts a voice chat, a predetermined range centered on the host user is set as the audible range. The audible range moves in accordance with the movement of the host user's avatar. Users who enter the audible range are connected to the voice chat channel used by the host user and can engage in voice chat. When a user leaves the audible range, the user is disconnected from the voice chat channel.

[0004] In the technique described in Patent Document 2, each user uses a VR HMD system to perform voice-based communication via an avatar in a virtual space. When a user wearing an HMD moves their eyes and speaks, in the virtual space presented by another HMD that is communicable with the HMD, the display mode of the avatar object corresponding to the user changes, and the voice is output from a speaker. Since the timing at which the display mode changes and the timing at which the voice is output are synchronized, in communication via the virtual space, each communication partner can perform communication using the voice and the avatar object without a sense of discomfort. The user can give a voice instruction to the virtual space by speaking into a microphone provided in the HMD.

[0005] The space sharing support system described in Patent Document 3 includes a space display unit that displays a virtual space, an avatar display unit that displays a user's avatar in the virtual space, a movement instruction receiving unit that receives a movement instruction from the user to the avatar, and a conversation control unit that controls voice conversations between users via the avatars. The avatar display unit moves the avatar within the virtual space in accordance with the movement instruction. The conversation control unit determines that an interaction condition is satisfied when the first avatar and the second avatar approach each other in the virtual space, and sets the conversation between the users respectively corresponding to the first avatar and the second avatar to be enabled.

[0006] In addition, the conversation control unit determines that the interaction condition is satisfied also when the first avatar enters the personal space of the second avatar. In consideration of the case where another user's avatar may only accidentally pass through one's own personal space, it is disclosed that the mode may be switched to the interaction mode at the timing when communication such as a conversation occurs according to an instruction between users, or when another user's avatar stays within one's own personal space for a predetermined time or longer.

[0007] Furthermore, the conversation control unit determines that the interaction condition is satisfied when the first avatar and the second avatar are present simultaneously in an area created in the virtual space (for example, a conference room or a reception room), or when the first avatar and the second avatar face each other.

[0008] In the system described in Patent Document 4, the position of the avatar and the voice transmission position in the virtual collaboration space are controlled independently. When no voice transmission position is specified separately from the position of the first user's avatar, voice communication related to the first user's speech is propagated to the second and third users. However, when an instruction is given to place the first user's voice transmission location near the second user's avatar, voice communication from the first user to the second user is performed as a virtual whisper, and the first user's voice communication is not propagated to the third user.

[0009] Japanese Patent Publication No. 2009-199198, Japanese Patent Publication No. 2018-185786, Japanese Patent Publication No. 2022-071314, U.S. Patent Application Publication No. 2023 / 0032545

[0010] The systems described in Patent Documents 1 to 4 enable voice communication in a manner similar to that of the real world by setting the system to a conversation-enabled state and adjusting the volume based on the relative positions of each user's avatar in the virtual space. However, in actual conversations in the real world, the conditions and volume of the conversation are not determined solely by the relative positions of the users.

[0011] Therefore, the present invention aims to enable voice communication in a virtual space that allows users to communicate with each other in a manner closer to that of the real world.

[0012] To solve the above-mentioned problems, the present invention provides a system that enables voice communication between users using user terminals through a virtual space provided to multiple user terminals connected via a communication network. In this system, when a first user among the users participating in the virtual space speaks to a second user using a predetermined voice with predetermined frequency characteristics, and the second user responds using the predetermined voice, a secret conversation mode is set that allows conversation only between the first user and the second user.

[0013] According to the present invention configured as described above, in a virtual space where users can communicate with each other by voice, if a user wishes to have a secret conversation with only specific users, they can have voice communication in a state similar to a secret conversation that takes place only between two specific people in the real world.

[0014] This figure shows an example of the overall configuration of a virtual space communication system according to this embodiment. This block diagram shows an example of the functional configuration of a server device according to this embodiment. This flowchart shows an example of the operation of the mode setting unit according to this embodiment. This flowchart shows an example of the operation of the voice control unit according to this embodiment. This flowchart shows an example of the operation of the operation control unit according to this embodiment. This figure shows an example of a user interface displayed on the user terminal's display.

[0015] Hereinafter, one embodiment of the present invention will be described with reference to the drawings. Figure 1 is a diagram showing an example of the overall configuration of a virtual space communication system according to this embodiment. As shown in Figure 1, the virtual space communication system of this embodiment is configured to include a server device 10 and a plurality of user terminals 20. The server device 10 and the user terminals 20 are connected via a communication network 30 such as the Internet and a mobile phone network.

[0016] The user terminal 20 consists of, for example, a smartphone, tablet, or personal computer. The user terminal 20 has a built-in audio input device such as a microphone, or is configured to be connectable via wired or wireless connection. The user terminal 20 also has a built-in audio output device such as a speaker, or is configured to be connectable via wired or wireless connection. A headset equipped with a microphone and speaker may also be connected to the user terminal 20.

[0017] The server device 10 corresponds to a communication control device and provides a virtual space to multiple user terminals 20 connected via the communication network 30, enabling users using the user terminals 20 to communicate with each other via voice through the virtual space. Specifically, the server device 10 receives speaker voice input from the voice input device of one user terminal 20 via the communication network 30, and transmits the received speaker voice to other user terminals 20 via the communication network 30, causing it to be output from their voice output devices.

[0018] The virtual space is a space in which a virtual user corresponding to a user can move freely. A user using the user terminal 20 moves their virtual user within the virtual space and communicates by voice with other virtual users they encounter at their destination. The user terminal 20 has a dedicated application program (hereinafter referred to as the conversation app) installed for processing the actions of such virtual users within the virtual space and for voice communication. "Virtual user corresponding to a user" means a virtual user set up in the conversation app that the user has installed on the user terminal 20.

[0019] The conversation application transmits virtual user action instructions entered by the user to the server device 10. The server device 10 controls the virtual user's actions within the virtual space according to the action instructions received from the user terminal 20. The conversation application also transmits speaker voice input from the voice input device of the user terminal 20 to the server device 10. The server device 10 transmits the speaker voice received from one user terminal 20 to another user terminal 20, causing it to be output from the voice output device.

[0020] In this embodiment, the virtual space provided by the server device 10 to the user terminal 20 is, for example, a non-visible virtual space where there are no images displayed on the user terminal 20 screen, and only sound exists. Although there are no images of the space or virtual users displayed on the user terminal 20, the virtual space itself exists, and the server device 10 manages the location information of the virtual space and the location information of the virtual users within the virtual space. For example, if the user gives a command to move the virtual user, the server device 10 updates the stored location information of the virtual user in accordance with that command.

[0021] Users rely on the audio output from the audio output device to understand the virtual user's location and surrounding environment within the virtual space. Users also move the virtual user within the virtual space by giving voice commands through the audio input device, and engage in voice conversations with other virtual users they encounter at their destinations using the audio input and audio output devices.

[0022] The user terminal 20 is equipped with an image display device such as a display, or is configured to be connectable via wired or wireless connection. However, when voice communication is being performed through a virtual user in the virtual space, the virtual space screen is not displayed on the display.

[0023] Figure 2 is a block diagram showing an example of the functional configuration of the server device 10 according to this embodiment. As shown in Figure 2, the server device 10 of this embodiment includes a communication control unit 11, an operation control unit 12, and a user information registration unit 13 as its functional configuration. The communication control unit 11 includes a mode setting unit 11a and an audio control unit 11b as its more specific functional configuration. The server device 10 also includes a user information storage unit 14 and a spatial information storage unit 15 as storage media.

[0024] The above-described functional blocks 11 to 13 perform the processes described below through the cooperation of hardware and software. For example, the processes of the above-described functional blocks 11 to 13 are executed by the operation of programs stored in storage media such as RAM, ROM, hard disk, or semiconductor memory, under the control of a microcomputer configured to include a CPU, RAM, ROM, etc. In addition to the microcomputer, a DSP (Digital Signal Processor) may also be included.

[0025] The user information registration unit 13 registers user information about users who use the conversation application. Specifically, the user information registration unit 13 receives user information transmitted from the user terminal 20 and stores it in the user information storage unit 14. For example, when a user installs the conversation application on the user terminal 20, they operate the user terminal 20 to input user information and send it to the server device 10 to request registration. The server device 10 receives this registration request and stores the user information received from the user terminal 20 in the user information storage unit 14.

[0026] The user information registered in the user information storage unit 14 includes, for example, the user's name, a nickname to be used as the virtual user's name, a user ID, and a login password. The name and / or nickname are used as user identification information when users communicate with each other by voice. For this reason, it is preferable to register the nickname as a unique name for each individual user. For this reason, when the user terminal 20 requests the registration of a new nickname, the user information registration unit 13 determines whether or not it is the same as a nickname already registered in the user information storage unit 14, and if it is the same, it responds to the user terminal 20 with a message prompting it to set a different nickname.

[0027] The user information storage unit 14 also stores information about virtual users corresponding to the user. For example, the user information storage unit 14 receives setting mode information from the mode setting unit 11a indicating the mode set for the virtual user by the mode setting unit 11a, and stores it in association with the user ID. In addition, the user information storage unit 14 stores information about the virtual user's location and direction of movement as the virtual user moves within the virtual space under the control of the operation control unit 12, in association with the user ID.

[0028] The communication control unit 11 controls voice communication between users participating in the virtual space. Users participating in the virtual space refer to users who have launched the conversation application and logged into the server device 10. The communication control unit 11 controls the mode set for virtual users using the mode setting unit 11a, and controls the conversational voice communicated between user terminals 20 using the voice control unit 11b according to the set mode. Details of these processes will be described later.

[0029] The operation control unit 12 controls the actions of virtual users within the virtual space, corresponding to users participating in the virtual space, in response to action instructions from the user transmitted from the user terminal 20. As described above, the action instructions for virtual users are given by the user's voice. That is, the operation control unit 12 controls the actions of virtual users within the virtual space in response to voice instructions input from the voice input device used by the user.

[0030] The actions of a virtual user include movement of the virtual user within the virtual space. Action instructions include, for example, instructions to move forward, backward, and turn. Action instructions also include instructions to enter and exit conversation spaces provided within the virtual space. One or more conversation spaces are provided within the virtual space. The spatial information storage unit 15 stores in advance location information indicating the overall location of the virtual space and location information indicating the location where conversation spaces exist within the virtual space.

[0031] For example, if the user instructs the virtual user to move forward, the motion control unit 12 controls the virtual user to move forward by a predetermined distance. The user may also specify the distance to move forward. For example, if the user says "move forward," the spoken voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The motion control unit 12 interprets this spoken voice related to the motion instruction through speech recognition processing and controls the virtual user to move forward by a predetermined distance. That is, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating a position moved forward by a predetermined distance in the direction indicated by the direction of travel information.

[0032] Furthermore, if the user instructs the virtual user to turn to the right, the motion control unit 12 controls the virtual user to turn to the right by a predetermined angle. The user may also specify the angle of the turn. For example, if the user says "turn right," the spoken voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The motion control unit 12 interprets this spoken voice related to the motion instruction through speech recognition processing and controls the virtual user to turn to the right by a predetermined angle. In other words, the virtual user's direction of travel information stored in the user information storage unit 14 is updated to information indicating the direction of movement after being displaced to the right by a predetermined angle.

[0033] Furthermore, if the user instructs the virtual user to enter the conversation space, the operation control unit 12 controls the virtual user to enter the conversation space. For example, when the user says "Enter," the spoken voice is input from the voice input device of the user terminal 20 and transmitted to the server device 10. The operation control unit 12 interprets this spoken voice related to the operation instruction through speech recognition processing and controls the virtual user to enter the conversation space. That is, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating the location within the conversation space. Note that this entry process may be limited to when the virtual user is located within a predetermined distance from the conversation space.

[0034] Furthermore, if the user instructs the virtual user to leave the conversation space, the operation control unit 12 controls the virtual user to leave the conversation space. For example, if the user says "Leave," the voice of that utterance is input from the voice input device of the user terminal 20 and sent to the server device 10. The operation control unit 12 interprets this voice utterance related to the operation instruction through speech recognition processing and controls the virtual user to leave the conversation space. That is, the virtual user's location information stored in the user information storage unit 14 is updated to information indicating a location outside the conversation space (for example, the location where the user was before entering the conversation space). Note that this exit process may be enabled only when the virtual user is inside the conversation space.

[0035] When a user logs into the server device 10 for the first time from the conversation application, their virtual user is set to exist at a predetermined starting position in the virtual space. That is, the virtual user's location information stored in the user information storage unit 14 is initially set to a predetermined starting position. On the other hand, when a user logs in for the second time or later, their virtual user is set to the position where they existed at the time of their previous logout. That is, information indicating the position where the virtual user existed at the time of logout is stored in the user information storage unit 14 and is used as the virtual user's location information when logging in the next time.

[0036] The mode setting unit 11a of the communication control unit 11 sets a mode according to the user's spoken voice or the actions of a virtual user instructed by the user. The voice control unit 11b controls the voice transmitted and received with the user terminal 20 according to the mode set by the mode setting unit 11a. Voice control includes volume control and sound image localization processing.

[0037] The mode setting unit 11a can set three modes: wandering mode, normal conversation mode, and secret conversation mode. Wandering mode is set when the virtual user is outside the conversation space. Normal conversation mode is the normal mode set when the virtual user is inside the conversation space. Secret conversation mode is set when the virtual user is inside the conversation space and the user's speech reaches a predetermined state.

[0038] The mode setting unit 11a sets a normal conversation mode for a virtual user when that virtual user enters a conversation space provided within the virtual space, enabling that virtual user to converse with other users corresponding to multiple virtual users in the conversation space. Whether or not a virtual user has entered a conversation space can be determined by comparing the virtual user's location information stored in the user information storage unit 14 with the location information of the conversation space stored in the spatial information storage unit 15. When the mode setting unit 11a detects that a virtual user has entered a conversation space, it stores setting mode information indicating that the normal conversation mode has been set for that virtual user in the user information storage unit 14, associated with the user ID.

[0039] The voice control unit 11b controls the output of the speech voice of a user corresponding to one virtual user who is in the conversation space and has the normal conversation mode set (speech voice transmitted from the user terminal 20 of that user) from the voice output device used by one or more other virtual users who are in the same conversation space.

[0040] In other words, the voice control unit 11b refers to the virtual user location information stored in the user information storage unit 14 to identify multiple virtual users present in a single conversation space. When it receives a user's utterance from a user terminal 20 corresponding to one virtual user present in that conversation space and set to normal conversation mode, it controls the system to transmit that utterance to one or more other user terminals 20s corresponding to other virtual users in the same conversation space and output it from the voice output device.

[0041] Here, the one or more other virtual users that are the output targets of the speaker's voice may include both virtual users for which a normal conversation mode is set and virtual users for which a secret conversation mode is set. Alternatively, as will be described later in detail, the one or more other virtual users may be only the virtual users for which the normal conversation mode is set, excluding the virtual users for which the secret conversation mode is set. Further, the user terminals 20 that are the output targets of the uttered voice may be user terminals other than the user terminal 20 that transmitted the uttered voice, or may include the user terminal 20 that transmitted the uttered voice.

[0042] The mode setting unit 11a and the voice control unit 11b perform the processing as described above, whereby when a plurality of virtual users are present in the conversation space, a plurality of users corresponding to the plurality of virtual users can carry out voice communication in a state close to conversation in the real space.

[0043] Further, among the plurality of users corresponding to the plurality of virtual users in the conversation space, when a first user speaks to a second user with a predetermined voice having a predetermined frequency characteristic, and the second user responds with the predetermined voice, the mode setting unit 11a sets a secret conversation mode, in which conversation is possible only between the first user and the second user, for the virtual users corresponding to the first user and the second user. The mode setting unit 11a stores setting mode information indicating that the secret conversation mode has been set for the two virtual users, in the user information storage unit 14 in association with the user IDs.

[0044] The predetermined voice can be, for example, a voice having a frequency characteristic that a low frequency band component lower than a predetermined frequency is equal to or less than a predetermined value. Here, the mode setting unit 11a analyzes the frequency amplitude characteristic of the uttered voice from the user, separates the uttered voice into a low frequency band component and a mid-high frequency band component, and may recognize that the uttered voice is the predetermined voice when the energy amount specified by the amplitude of the low frequency band component is equal to or less than a predetermined value.

[0045] The frequency-amplitude characteristic analysis can be performed using, for example, FFT (Fast Fourier Transformation). The energy amount specified by the amplitude of the low-frequency band component can be, for example, the maximum amplitude value in the low-frequency band. Alternatively, it may be the total amount of amplitude values in the low-frequency band.

[0046] The above frequency characteristic is a frequency characteristic specific to whispers used when having a confidential conversation. That is, the frequency characteristic of whispers has a feature that the low-frequency band component is smaller compared to the frequency characteristic of normal utterances. When detecting that the first user and the second user are exchanging utterances with predetermined speech having such a frequency characteristic specific to whispers, the mode setting unit 11a sets a confidential conversation mode between the first user and the second user.

[0047] Here, the predetermined frequency used as the boundary between the low-frequency band and the mid-high frequency band can be, for example, the lower boundary frequency of the two boundary frequencies obtained when dividing the entire frequency band of the user's uttered speech into three equal parts. That is, among the three equally divided frequency bands, the lowest frequency band may be defined as the low-frequency band, and the other frequency bands may be defined as the mid-high frequency band. Note that equal division is not essential, and dividing into three parts in a state close thereto is not precluded.

[0048] As another example, the upper limit frequency of the frequency band called the main formant (for example, the frequency band including the first formant to the third formant) or a frequency different therefrom may be set as the predetermined frequency. That is, the frequency band including the main formants may be defined as the low-frequency band, and the frequency band not including the main formants may be defined as the mid-high frequency band.

[0049] As still another example, frequency analysis is performed on the uttered speech of a plurality of sample users produced by whispering and the uttered speech produced by normal utterance that is not whispering, and the frequency characteristic of whispering and the frequency characteristic of normal utterance are compared, so that a boundary frequency at which a significant difference in energy amount is observed in the low-frequency region may be specified as the predetermined frequency.

[0050] Alternatively, the speech data of multiple sample users may be used as training data, and a frequency characteristic in which low-frequency band components below a predetermined frequency are below a predetermined value may be learned by machine learning. The mode setting unit 11a may then input the user's speech into the trained model to determine whether or not the speech is a predetermined voice.

[0051] Furthermore, the predetermined value used to determine whether or not the low-frequency band component is below a predetermined value may be made variable according to the user's attributes. For example, the user information registration unit 13 may further include attribute information such as the user's gender and age as user information registered in the user information storage unit 14. Then, the mode setting unit 11a may set a variable predetermined value according to the attribute information of the speaking user and then determine whether or not the low-frequency band component is below that predetermined value.

[0052] Furthermore, the mode setting unit 11a may set a secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak with a predetermined voice for a predetermined period of time or longer, and the second user has responded to the first user by continuing to speak with a predetermined voice for a predetermined period of time or longer. In addition, the mode setting unit 11a may set a secret conversation mode between the first user and the second user when it further detects that the maximum volume of speech that continues for a predetermined period of time or longer is below a predetermined volume.

[0053] Furthermore, the mode setting unit 11a may set the secret conversation mode when the first user speaks the second user's identification information (e.g., nickname) in a predetermined voice and the second user responds in the predetermined voice. In this case, the second user's response does not matter as long as it is spoken in the predetermined voice. Alternatively, the secret conversation mode may be set only when the second user also speaks the first user's identification information in a predetermined voice.

[0054] Specifically, the mode setting unit 11a monitors the frequency characteristics of the speech transmitted from the user terminal 20 of the user corresponding to the virtual user present in the conversation space, and if it detects speech in a predetermined voice, it interprets the speech using speech recognition processing. It then determines whether the content of the interpreted speech matches any of the nicknames of virtual users in the conversation space stored in the user information storage unit 14. If it determines that it does not match any of the nicknames, the mode setting unit 11a does not set the secret conversation mode.

[0055] On the other hand, if it determines that a nickname matches any one of the given nicknames, the mode setting unit 11a identifies the user of the user terminal 20 that is the source of the spoken voice as the first user. The mode setting unit 11a also monitors the frequency characteristics of the spoken voice transmitted within a predetermined time from the user terminal 20 of the user corresponding to the virtual user of the matched nickname. If it detects a spoken voice of a predetermined frequency, the mode setting unit 11a identifies the user who responded with the spoken voice as the second user and sets a secret conversation mode for the virtual users corresponding to the first user and the second user.

[0056] Furthermore, if the secret conversation mode is to be set only when the second user also speaks the identification information of the first user, the mode setting unit 11a interprets the spoken voice transmitted within a predetermined time from the user terminal 20 of the user whose nickname matches that spoken by the first user using speech recognition processing. It then determines whether the content of the interpreted spoken voice matches the nickname of the first user stored in the user information storage unit 14, and sets the secret conversation mode if it determines that they match.

[0057] When the secret conversation mode is set, the voice control unit 11b controls the system so that the first user's speech is output only from the voice output device used by the second user, while the second user's speech is output only from the voice output device used by the first user.

[0058] In other words, when the voice control unit 11b receives spoken audio from the first user's terminal 20, which is set to secret conversation mode, it controls the system to transmit that spoken audio only to the second user's terminal 20, which is also set to secret conversation mode, and to output it from the voice output device. Furthermore, when the voice control unit 11b receives spoken audio from the second user's terminal 20, it controls the system to transmit that spoken audio only to the first user's terminal 20 and to output it from the voice output device.

[0059] The mode setting unit 11a monitors whether at least one of the first user and the second user has spoken in a voice other than the predetermined voice while the secret conversation mode is set. If it detects that at least one of the users has spoken in a voice other than the predetermined voice, it cancels the secret conversation mode. In other words, it returns the mode setting for the virtual users corresponding to the first user and the second user to normal conversation mode.

[0060] By performing the above-described processing, the mode setting unit 11a and the voice control unit 11b enable a secret conversation in whispers between only the first and second users when multiple users are conversing in a conversation space. This allows for voice communication in a state similar to a secret conversation that takes place only between two specific people in the real world.

[0061] Even when the first and second users are set to secret conversation mode, other users in the same conversation space can still have normal (non-secret) conversations under normal conversation mode. Here, the voice control unit 11b may choose not to transmit the speech of other users in the same conversation space to the user terminals 20 of the first and second users. In this way, the whispered speech of the other user, which is output to the voice output devices of the first and second users who are having a secret conversation, will not be made difficult to hear by the normal speech of other users output to the voice output devices.

[0062] Similarly, when transmitting the voice utterance of a nickname (voice utterance using a predetermined voice) sent from the first user's user terminal 20 to the user terminal 20 of the corresponding user (i.e., a candidate user who may become the second user), the voice utterances of other users in the same conversation space may not be transmitted to the candidate user's user terminal 20. In this way, the candidate user can avoid missing the whispered voice utterance of the nickname output to the candidate user's voice output device because it is difficult to hear due to the normal voice utterances of other users output to the voice output device.

[0063] Furthermore, when a virtual user is outside the conversation space, the mode setting unit 11a sets a roaming mode for that virtual user and stores setting mode information indicating that the roaming mode has been set in the user information storage unit 14 in association with the user ID. In this case, the user with roaming mode set may say anything, but the voice control unit 11b does not transmit the user's spoken voice to other users' terminals 20. On the other hand, the voice control unit 11b controls the voice being spoken in the conversation space to be output from the voice output device used by the user corresponding to the virtual user with roaming mode set, at a volume lower than the volume output when the virtual user is in that conversation space.

[0064] For example, the voice control unit 11b transmits the spoken audio sent from a user terminal 20 of a user who is in the conversation space and has normal conversation mode set to the user terminals 20 of other users in the same conversation space (only users with normal conversation mode set, or users with both normal conversation mode and secret conversation mode set) without reducing the volume. On the other hand, the voice control unit 11b transmits the spoken audio sent from a user terminal 20 of a user who is in the conversation space and has normal conversation mode set to the user terminal 20 of other users who are outside the conversation space and have wandering mode set to a reduced volume.

[0065] In this case, the audio control unit 11b may perform sound image localization of the audio output to the audio output device according to the positional relationship between the virtual user outside the conversation space and the conversation space. That is, the audio control unit 11b controls the audio output to the audio output device so that the audio is heard coming from a certain direction in the conversation space, according to the direction from the virtual user outside the conversation space to the conversation space.

[0066] Furthermore, the audio control unit 11b controls the volume of the audio output to the audio output device according to the distance between the virtual user outside the conversation space and the conversation space, so that the volume decreases as the distance increases and increases as the distance decreases. However, even when the virtual user is very close to the conversation space and the highest volume is set, it will still be lower than the volume output to the audio output device of a user who is inside the conversation space and has normal conversation mode set. Also, if the virtual user is located more than a certain distance away from the conversation space, the volume output to the audio output device of the user corresponding to that virtual user will be set to zero (no spoken audio will be sent to the user terminal 20 of that user).

[0067] By performing this sound localization processing, the audio control unit 11b enables the user to navigate the virtual space while understanding the direction and distance of conversation spaces, even if the virtual space provided to the user terminal 20 is an invisible virtual space consisting only of audio. This allows the user to enter any conversation space and engage in conversation, relying on the sound localized audio output from the audio output device. In this embodiment, all actions, including instructions for the virtual user and conversations between users, can be performed using voice. For example, even visually impaired individuals can enjoy voice communication in a virtual space using a conversation application.

[0068] Figure 3 is a flowchart illustrating an example of the operation of the mode setting unit 11a according to this embodiment. This Figure 3 shows an example of the process of setting a mode for one virtual user, and the flowchart shown in Figure 3 is executed for all logged-in virtual users. Note that Figure 3 shows an example of the operation executed during the first login.

[0069] The mode setting unit 11a sets the wandering mode as the initial mode (step A1). Subsequently, the mode setting unit 11a determines whether or not the virtual user has entered the conversation space (step A2). For example, when the user says "enter," the operation control unit 12 executes a process to put the virtual user into the conversation space, and the virtual user's location information is updated to indicate that the user is in the conversation space. When the mode setting unit 11a confirms this, it determines that the virtual user has entered the conversation space.

[0070] If the mode setting unit 11a determines that the virtual user has not entered the conversation space, the process returns to step A1. On the other hand, if the mode setting unit 11a determines that the virtual user has entered the conversation space, it sets the normal conversation mode for the virtual user (step A3). Subsequently, the mode setting unit 11a monitors the frequency characteristics of the spoken voice transmitted from the user terminal 20 of the user corresponding to the virtual user for whom the normal conversation mode has been set, and determines whether or not the spoken voice is a predetermined voice (step A4).

[0071] If the mode setting unit 11a detects the transmission of a predetermined voice, it interprets the voice using speech recognition processing and determines whether the content of the voice matches any of the nicknames of virtual users in the conversation space stored in the user information storage unit 14 (step A5). If the mode setting unit 11a determines that the voice does not match any of the nicknames, the process proceeds to step A12.

[0072] On the other hand, if it determines that there is a match with any one of the nicknames, the mode setting unit 11a identifies the user of the user terminal 20 that is the source of the spoken voice as the first user. The mode setting unit 11a also monitors the frequency characteristics of the spoken voice transmitted within a predetermined time from the user terminal 20 of the virtual user with the matched nickname, and determines whether or not there was a response with spoken voice in the predetermined voice (step A6).

[0073] If no speech in the specified voice is received, the process proceeds to step A12. On the other hand, if the reception of speech in the specified voice is detected, the mode setting unit 11a identifies the user of the user terminal 20 that is the source of the speech as the second user, and sets a secret conversation mode for the virtual users corresponding to the first user and the second user (step A7).

[0074] Subsequently, the mode setting unit 11a monitors the frequency characteristics of the speech transmitted from the user terminals 20 of the first and second users who have set the secret conversation mode, and determines whether or not it has received speech other than the predetermined speech from at least one of the user terminals 20 (step A8). If no speech other than the predetermined speech has been received, the process returns to step A7 and continues setting the secret conversation mode. On the other hand, if the mode setting unit 11a determines that it has received speech other than the predetermined speech from at least one of the user terminals 20, the process returns to step A3 and sets the normal conversation mode.

[0075] In step A4 above, if no speech in the predetermined voice is detected, the mode setting unit 11a monitors the frequency characteristics of speech transmitted from another user's user terminal 20, which is set to normal conversation mode, to the user terminal 20 of the virtual user for whom the normal conversation mode was set in step A3, and determines whether or not speech in the predetermined voice has been received (step A9).

[0076] If no speech in the predetermined voice is received, the process proceeds to step A12. On the other hand, if the reception of speech in the predetermined voice is detected, the mode setting unit 11a interprets the speech using speech recognition processing and determines whether the content of the speech matches the nickname of the user (the virtual user for whom the normal conversation mode was set in step A3) stored in the user information storage unit 14 (step A10). If the mode setting unit 11a determines that the nickname does not match, the process proceeds to step A12.

[0077] On the other hand, if it determines that the nickname matches, the mode setting unit 11a monitors the frequency characteristics of the spoken voice transmitted from the user terminal 20 within a predetermined time and determines whether or not the response was made with spoken voice of the predetermined voice (step A11).

[0078] If no speech in the predetermined voice is received, the process proceeds to step A12. On the other hand, if the reception of speech in the predetermined voice is detected, the process proceeds to step A7. In this case, the mode setting unit 11a identifies the responding user as the second user and sets a secret conversation mode for the virtual users corresponding to the first user and the second user.

[0079] In step A12, the mode setting unit 11a determines whether the virtual user has left the conversation space. For example, if the user says "leave" and the operation control unit 12 executes a process to move the virtual user out of the conversation space, the virtual user's location information is updated to indicate that the user is outside the conversation space. If the mode setting unit 11a confirms this, it determines that the virtual user has left the conversation space.

[0080] If the mode setting unit 11a determines that the virtual user has not left the conversation space, the process returns to step A3 and continues setting the normal conversation mode. On the other hand, if the mode setting unit 11a determines that the virtual user has left the conversation space, the process returns to step A1 and sets the wandering mode.

[0081] As shown in Figure 3, the initial login is set to roaming mode, but subsequent logins will begin with setting the mode corresponding to the location where the virtual user was at the time of the last logout (step A3 or step A7).

[0082] Figure 4 is a flowchart illustrating an example of the operation of the voice control unit 11b according to this embodiment. This Figure 4 shows an example of operation when processing the voice of one speaker transmitted from one user terminal 20. Each time the speaker voice transmitted from the logged-in user terminal 20 is received, the processing shown in the flowchart in Figure 4 is executed.

[0083] The voice control unit 11b determines whether or not it has received speaker voice from the user terminal 20 (step B1). The voice control unit 11b continues the determination in step B1 until it receives speaker voice. When the server device 10 receives speaker voice, the voice control unit 11b determines the mode currently set for the virtual user corresponding to the user of the user terminal 20 that sent the speaker voice (step B2).

[0084] If it is determined that the mode set for the virtual user is the wandering mode, the process returns to step B1. That is, the voice control unit 11b does not transmit the speaker's voice to other user terminals 20, but waits to receive the next speaker's voice.

[0085] If the system determines that the mode set for a virtual user is normal conversation mode, the voice control unit 11b refers to the virtual user's location information stored in the user information storage unit 14 to identify one or more other virtual users in the same conversation space as the virtual user who is speaking, and controls the system to send spoken audio to one or more user terminals 20 corresponding to those other virtual users and output it from the voice output device (step B3).

[0086] Furthermore, the voice control unit 11b refers to the virtual user location information stored in the user information storage unit 14 to identify one or more virtual users that are outside the conversation space and within a certain distance from the conversation space where the virtual user who is the speaker is located. Then, it controls one or more user terminals 20 corresponding to the identified one or more virtual users to transmit utterances with sound localization applied according to the positional relationship between each virtual user and the conversation space, and to output them from the voice output device (step B4). After that, the process returns to step B1.

[0087] If the system determines that the mode set for a virtual user is secret conversation mode, the voice control unit 11b refers to the secret conversation mode setting information stored in the user information storage unit 14 to identify the other virtual user who is set to secret conversation mode, and controls the system to send spoken audio only to the user terminal 20 corresponding to the identified other virtual user and output it from the voice output device (step B5). After that, the process returns to step B1.

[0088] Figure 5 is a flowchart showing an example of the operation of the operation control unit 12 according to this embodiment. This Figure 5 shows an example of the process of controlling the operation of one virtual user, and the process shown in the flowchart in Figure 5 is executed for all logged-in virtual users.

[0089] The operation control unit 12 determines whether or not it has received an operation instruction from the user terminal 20 (step C1). The operation control unit 12 continues the determination in step C1 until it receives an operation instruction. When the server device 10 receives an operation instruction, the operation control unit 12 controls the virtual user's actions within the virtual space according to that operation instruction (step C2). After that, the process returns to step C1.

[0090] As explained in detail above, in the virtual space communication system of this embodiment, the server device 10 provides a virtual space to a plurality of user terminals 20 connected via a communication network 30, and enables users using the user terminals 20 to communicate with each other by voice through the virtual space. In particular, in this embodiment, when the first user speaks to the second user with a predetermined voice having predetermined frequency characteristics, and the second user responds with the predetermined voice, a secret conversation mode is set that allows conversation only between the first user and the second user. When the secret conversation mode is set, the first user's spoken voice is output only from the voice output device used by the second user, while the second user's spoken voice is output only from the voice output device used by the first user.

[0091] With the virtual space communication system of this embodiment configured in this way, in a virtual space where users can communicate with each other by voice, if a user wishes to have a secret conversation with only specific users, they can have voice communication in a state similar to a secret conversation that takes place only between two specific people in the real world.

[0092] In the above embodiment, an example was described in which the virtual space provided to the user terminal 20 is a voice-only, invisible virtual space, and instructions for actions to the invisible virtual user are given only by voice. However, the present invention is not limited to this. For example, the user interface for giving action instructions may be displayed on a screen.

[0093] Figure 6 shows an example of a user interface displayed on the user terminal 20's screen. As shown in Figure 6, the virtual space and virtual user are not displayed; only operation buttons for giving instructions to move forward, backward, turn, enter, and exit are shown. In this case, the user can give instructions to the virtual user's actions using voice or the on-screen user interface.

[0094] As another example, if the user terminal 20 is a smartphone or tablet with a built-in accelerometer, the system may issue action commands to the virtual user in response to the movement of the user terminal 20 detected by the accelerometer. For example, if the user terminal 20 is shaken in the forward, backward, left, or right directions, the system may instruct the virtual user to move forward, backward, turn left, or turn right, respectively. If the user terminal 20 rotates to the right, the system may instruct the virtual user to enter the room, and if the user terminal 20 rotates to the left, the system may instruct the virtual user to exit the room.

[0095] Alternatively, instead of a hidden virtual space, a displayable virtual space that shows the virtual space and virtual user on the screen may be used. Even in this case, if the user gives instructions to the virtual user using voice or an accelerometer, the user can communicate by voice without looking at the displayable virtual space. Needless to say, if the user wishes, they can communicate by voice while looking at the displayable virtual space.

[0096] Furthermore, while the above embodiment mentions a smartphone, tablet, and personal computer as examples of the user terminal 20, it is not limited to these. For example, the user terminal 20 may be a wearable device such as a goggle-type terminal, glasses-type terminal, or wristwatch-type terminal. Also, when displaying a virtual space, a head-mounted display capable of displaying VR (virtual reality) images may be used as the user terminal 20.

[0097] Furthermore, in the above embodiment, when a virtual user is set to wandering mode, an example was described in which the audio being spoken in a conversation space within a certain distance from the virtual user's location is localized and supplied to the user terminal 20 of the user corresponding to the virtual user. However, instead of this, or in addition, another audio that is not spoken audio may be supplied and output from the audio output device.

[0098] For example, a specific sound may be localized to indicate the presence of a conversation space and supplied to the user terminal 20 in roaming mode. In this case, a special sound may be supplied to conversation spaces where conversation is actively taking place. The definition of "active conversation" can be set arbitrarily. For example, it is possible to determine that conversation is actively taking place if either or both of the following conditions are met: the number of virtual users present in the conversation space is above a threshold, or the number of utterances per predetermined time is above a threshold.

[0099] Furthermore, although the above embodiment described an example with three modes—a roaming mode, a normal conversation mode, and a secret conversation mode—the present invention is not limited to this. For example, there may be only two modes: a normal conversation mode and a secret conversation mode. For example, the virtual space itself may be treated as a single conversation space, and the logged-in virtual user may always exist within one conversation space (= virtual space), and switch between normal conversation mode and secret conversation mode as appropriate. Alternatively, multiple conversation spaces may exist within the virtual space, and the virtual user may be instructed to jump from one conversation space to another as an action instruction.

[0100] The functions or processes described above can be combined and applied as appropriate. Examples of configurations that can be applied to this embodiment are summarized below.

[0101] [Configuration 1] A virtual space communication system that enables users of multiple user terminals connected via a communication network to communicate with each other by voice through a virtual space provided to the user terminals, comprising a communication control unit that controls voice communication between users participating in the virtual space, wherein the communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when the first user speaks to the second user with a predetermined voice having predetermined frequency characteristics and the second user responds with the predetermined voice.

[0102] [Configuration 2] The virtual space communication system according to Configuration 1, characterized in that the predetermined sound is a sound having a frequency characteristic in which the low-frequency band component at a frequency lower than a predetermined frequency is less than or equal to a predetermined value.

[0103] [Configuration 3] The virtual space communication system according to Configuration 2, characterized in that the communication control unit analyzes the frequency amplitude characteristics of the user's spoken voice, separates the spoken voice into the low-frequency band component and the mid-high frequency band component which is higher than the predetermined frequency, and recognizes the spoken voice as the predetermined voice when the amount of energy specified by the amplitude of the low-frequency band component is less than or equal to the predetermined value.

[0104] [Configuration 4] A virtual space communication system according to any one of Configurations 1 to 3, characterized in that the communication control unit sets the secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak with the predetermined voice for a predetermined period of time or longer, and the second user has responded to the first user by continuing to speak with the predetermined voice for a predetermined period of time or longer.

[0105] [Configuration 5] The virtual space communication system according to Configuration 4, characterized in that when the communication control unit further detects that the maximum volume of speech that continues for a predetermined time or longer is less than or equal to a predetermined volume, it sets the secret conversation mode between the first user and the second user.

[0106] [Configuration 6] The virtual space communication system according to any one of Configurations 2 to 5, characterized in that the communication control unit sets the predetermined value according to the user's attributes.

[0107] [Configuration 7] The virtual space communication system according to any one of Configurations 1 to 6, characterized in that the communication control unit sets the secret conversation mode when the first user speaks the identification information of the second user in the predetermined voice and the second user responds in the predetermined voice.

[0108] [Configuration 8] The virtual space communication system according to any one of Configurations 1 to 7, characterized in that the communication control unit cancels the setting of the secret conversation mode when at least one of the first user and the second user speaks in a voice other than the predetermined voice while the secret conversation mode is set.

[0109] [Configuration 9] A virtual space communication system according to any one of Configurations 1 to 8, further comprising an operation control unit that controls the actions of a virtual user in the virtual space corresponding to a user participating in the virtual space in response to instructions from the above-mentioned user, wherein the communication control unit sets a normal conversation mode for the virtual user when the virtual user enters a conversation space provided in the virtual space, enabling the virtual user to converse with multiple users corresponding to multiple virtual users in the conversation space, and sets a secret conversation mode for the virtual users corresponding to the first user and the second user among the multiple users corresponding to the multiple virtual users in the conversation space.

[0110] [Configuration 10] The virtual space communication system according to Configuration 9, characterized in that the communication control unit controls the output of the spoken voice of a user corresponding to one virtual user who is in the conversation space and has the normal conversation mode set, from an audio output device used by users corresponding to one or more other virtual users in the same conversation space, and outputs the spoken voice of the first user corresponding to a virtual user who is in the conversation space and has the secret conversation mode set, from only the audio output device used by the second user, while controlling the output of the spoken voice of the second user from only the audio output device used by the first user.

[0111] [Configuration 11] The virtual space communication system according to Configuration 9, characterized in that when the virtual user is outside the conversation space, the communication control unit controls the output of the audio being spoken in the conversation space at a volume lower than the volume output when the virtual user is inside the conversation space, from an audio output device used by the user corresponding to the virtual user who is outside the conversation space.

[0112] [Configuration 12] The virtual space communication system according to Configuration 11, characterized in that the communication control unit performs sound image localization of the sound output to the voice output device according to the positional relationship between the virtual user who is outside the conversation space and the conversation space.

[0113] [Configuration 13] The virtual space communication system according to any one of Configurations 1 to 12, characterized in that the virtual space is a hidden virtual space in which there are no images displayed on the user terminal screen and only sound exists.

[0114] [Configuration 14] The virtual space communication system according to Configuration 9, characterized in that the virtual space is a hidden virtual space in which there are no images displayed on the user terminal screen and only sound exists, and the operation control unit controls the operation of a virtual user in the virtual space corresponding to a user participating in the virtual space in response to voice instructions input from a voice input device used by the user.

[0115] [Configuration 15] A communication control device that provides a virtual space to a plurality of user terminals connected via a communication network and controls voice communication between users using the user terminals through the virtual space, comprising a communication control unit that controls voice communication between users participating in the virtual space, wherein the communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when the first user speaks to the second user with a predetermined voice having predetermined frequency characteristics and the second user responds with the predetermined voice.

[0116] [Configuration 16] A communication control method for controlling voice communication between users using a user terminal through a virtual space provided to a plurality of user terminals connected via a communication network, characterized in that a computer's communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when a first user among the plurality of users participating in the virtual space speaks to a second user with a predetermined voice having predetermined frequency characteristics, and the second user responds with the predetermined voice.

[0117] Furthermore, the above embodiments are merely examples of how the present invention may be implemented, and the technical scope of the invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various ways without departing from its gist or its main features.

[0118] 10 Server device 11 Communication control unit 11a Mode setting unit 11b Voice control unit 12 Operation control unit 13 User information registration unit 14 User information storage unit 15 Spatial information storage unit 20 User terminal 30 Communication network

Claims

1. A virtual space communication system that enables users of multiple user terminals connected via a communication network to communicate with each other by voice through a virtual space provided to the user terminals, comprising a communication control unit that controls voice communication between users participating in the virtual space, wherein the communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when the first user speaks to the second user with a predetermined voice having predetermined frequency characteristics and the second user responds with the predetermined voice.

2. The virtual space communication system according to claim 1, characterized in that the above-mentioned predetermined sound is a sound having a frequency characteristic in which the low-frequency band component at a frequency lower than the predetermined frequency is less than or equal to a predetermined value.

3. The virtual space communication system according to claim 2, characterized in that the communication control unit analyzes the frequency amplitude characteristics of the user's spoken voice, separates the spoken voice into the low-frequency band component and the mid-high frequency band component which is higher than the predetermined frequency, and recognizes the spoken voice as the predetermined voice when the amount of energy specified by the amplitude of the low-frequency band component is less than or equal to the predetermined value.

4. The virtual space communication system according to any one of claims 1 to 3, characterized in that the communication control unit sets the secret conversation mode between the first user and the second user when it detects that the first user has spoken to the second user by continuing to speak with the predetermined voice for a predetermined period of time or longer, and the second user has responded to the first user by continuing to speak with the predetermined voice for a predetermined period of time or longer.

5. The virtual space communication system according to claim 4, characterized in that the communication control unit further detects that the maximum volume of speech that continues for a predetermined time or longer is below a predetermined volume, and sets the secret conversation mode between the first user and the second user.

6. The virtual space communication system according to claim 2, characterized in that the communication control unit sets the predetermined value according to the user's attributes.

7. The virtual space communication system according to any one of claims 1 to 3, characterized in that the communication control unit sets the secret conversation mode when the first user speaks the identification information of the second user in the predetermined voice and the second user responds in the predetermined voice.

8. The virtual space communication system according to any one of claims 1 to 3, characterized in that the communication control unit cancels the setting of the secret conversation mode if at least one of the first user and the second user speaks in a voice other than the predetermined voice while the secret conversation mode is set.

9. The virtual space communication system according to any one of claims 1 to 3, further comprising an operation control unit that controls the actions of a virtual user within the virtual space corresponding to a user participating in the virtual space in response to instructions from the above user, wherein the communication control unit sets a normal conversation mode for the virtual user when the virtual user enters a conversation space provided within the virtual space, enabling the virtual user to converse with multiple users corresponding to multiple virtual users in the conversation space, and sets a secret conversation mode for the virtual users corresponding to the first user and the second user among the multiple users corresponding to the multiple virtual users in the conversation space.

10. The virtual space communication system according to claim 9, characterized in that the communication control unit controls the output of the utterance of a user corresponding to one virtual user who is in the conversation space and has the normal conversation mode set, from an audio output device used by users corresponding to one or more other virtual users in the same conversation space, and outputs the utterance of the first user corresponding to a virtual user who is in the conversation space and has the secret conversation mode set, from only the audio output device used by the second user, while controlling the output of the utterance of the second user from only the audio output device used by the first user.

11. The virtual space communication system according to claim 9, characterized in that the communication control unit controls the output of the audio being spoken in the conversation space from an audio output device used by a user corresponding to a virtual user outside the conversation space, at a volume lower than the volume output when the virtual user is inside the conversation space.

12. The virtual space communication system according to claim 11, characterized in that the communication control unit performs sound image localization of the sound output to the voice output device according to the positional relationship between the virtual user who is outside the conversation space and the conversation space.

13. The virtual space communication system according to any one of items 1 to 3, characterized in that the virtual space is a hidden virtual space in which there are no images displayed on the user terminal screen and only sound exists.

14. The virtual space communication system according to claim 9, characterized in that the virtual space is a hidden virtual space in which there are no images displayed on the user terminal screen and only sound exists, and the operation control unit controls the operation of a virtual user in the virtual space corresponding to a user participating in the virtual space in response to voice instructions input from a voice input device used by the user.

15. A communication control device that provides a virtual space to a plurality of user terminals connected via a communication network, and controls voice communication between users using the user terminals through the virtual space, comprising a communication control unit that controls voice communication between users participating in the virtual space, wherein the communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when the first user speaks to the second user with a predetermined voice having predetermined frequency characteristics and the second user responds with the predetermined voice.

16. A communication control method for controlling voice communication between users using a user terminal through a virtual space provided to a plurality of user terminals connected via a communication network, characterized in that a computer's communication control unit sets a secret conversation mode that allows conversation only between the first user and the second user when a first user among the plurality of users participating in the virtual space speaks to a second user with a predetermined voice having predetermined frequency characteristics, and the second user responds with the predetermined voice.