Virtual space control system and virtual space control method

Abstract

To appropriately communicate with selected people in a virtual space.SOLUTION: An information processing device 50 provided in a virtual space control system 1 acquires position information in a real space of a first user who is using the virtual space with a first information terminal device and a second user who is using the virtual space with a second information terminal device, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or when the positional relationship in real space between the first user and the second user satisfies a predetermined condition while the first user and the second user are communicating, the information processing device 50 notifies either or both of the first user and the second user of this.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a virtual space control system and a virtual space control method. [Background technology]

[0002] There is known technology relating to a virtual office (virtual office) configured in a virtual space, where each user uses an avatar to carry out work within the virtual office (see, for example, Patent Document 1). When the avatars are close to each other in the virtual space, or when they are located in the same space in the virtual office, they can hear each other's voices and other sounds. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-071314 Summary of the Invention [Problem to be solved by the invention]

[0004] In such virtual spaces as virtual offices, each avatar user can communicate with other users, even those in distant locations or at different business locations, within the virtual office, as if they were virtually in the same office. When using such services, communication via avatars in the virtual office becomes commonplace, and users may not realize that the person they are communicating with is actually near them in the actual (real-space) office.

[0005] The present disclosure aims to enable appropriate communication with a selected person in a virtual space. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the virtual space control system of the present disclosure is a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user of the information terminal device in the virtual space, and an information processing device provided in the virtual space control system acquires position information in real space of a first user who is using the virtual space on a first information terminal device and a second user who is using the virtual space on a second information terminal device, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or while communicating, if the positional relationship in the real space between the first user and the second user satisfies a predetermined condition, the information processing device notifies either or both of the first user and the second user of this.

[0007] The virtual space control method of the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user of the information terminal device in the virtual space, and acquires positional information in real space of a first user who is using the virtual space with a first information terminal device and a second user who is using the virtual space with a second information terminal device, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or when the first user and the second user are communicating, if the positional relationship in the real space between the first user and the second user satisfies a predetermined condition, the virtual space control system notifies either or both of the first user and the second user of this. [Effects of the Invention]

[0008] According to the present disclosure, communication with a selected person in a virtual space can be performed appropriately. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of a virtual space control method according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A virtual space control system and a virtual space control method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0011] [First embodiment] (Virtual space control system) 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. The virtual space control system 1 controls a virtual office configured in a virtual space. In the following embodiment, a virtual office is used as an example for explanation, but the present invention is not limited to virtual offices and can also be applied to various services that use avatars for communication in a virtual space.

[0012] In the following description, a "user" may be referred to as a "first user" and an "other user" may be referred to as a "second user." Furthermore, an information terminal device used by a first user to log in to a virtual office may be referred to as a first information terminal device, and an information terminal device used by another user, a second user, to log in to a virtual office may be referred to as a second information terminal device. A first information terminal device is any information terminal device that is logged in to a virtual office, and a second information terminal device is any information terminal device that is different from the first information terminal device and that is logged in to the same virtual office as the first information terminal device.

[0013] An overview of the virtual office controlled by the virtual space control system 1 will be described. A user uses an information terminal device to come into (log in to) the virtual office using their own account and perform work. In the virtual office, an avatar associated with the user is set. When a user logs in to the virtual office using their own information terminal device 10 (described later), the avatar moves to any seat in the virtual office or to a predetermined seat and the user operates and displays the avatar to sit down. The user can operate the avatar to move around the virtual office. In the virtual office, for example, when avatars are close to each other in the virtual office or when avatars are located in the same space, such as a conference room in the virtual office, they can share information in a way that allows them to hear each other's voices.

[0014] The virtual space control system 1 includes an information terminal device 10 that each user uses for business purposes and logs into the virtual office, and a server device 30.

[0015] The control unit provided in the virtual space control system 1 is a conceptual control unit realized by the cooperation of either or both of the terminal control devices 20 of the multiple information terminal devices 10 used in the virtual office and the server control device 40 of the server device 30. Either the terminal control device 20 of the information terminal device 10 or the server control device 40 of the server device 30 may be the control unit provided in the virtual space control system 1, or the terminal control device 20 of the information terminal device 10 and the server control device 40 of the server device 30 may be the control unit provided in the virtual space control system 1.

[0016] (Information terminal device) 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by a user who performs work in a virtual office. The information terminal device 10 is a terminal device on which the user executes a virtual office application. The information terminal device 10 is a terminal device through which the user logs in to the virtual office using their own account when logging in to the virtual office.

[0017] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal, etc. The information terminal device 10 is connected to the server device 30 via a network so as to be able to communicate data with it.

[0018] The information terminal device 10 logs in to the virtual office based on the account information of the user who is logged in to the information terminal device 10.

[0019] The information terminal device 10 includes a camera 11 , a microphone 12 , an operation unit 13 , a display unit 17 , an audio output unit 18 , a communication unit 19 , and a terminal control device 20 .

[0020] Camera 11 captures an image in the direction facing information terminal device 10. Camera 11 is disposed at a position where it captures an image in the direction facing display unit 17 of information terminal device 10. In other words, camera 11 captures an image in the direction where a user using information terminal device 10 is located. Camera 11 is disposed, for example, near display unit 17. Camera 11 outputs the captured image to image acquisition unit 21 of terminal control device 20.

[0021] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds from the direction facing the display unit 17 of the information terminal device 10, and may be provided in a headset connected to the information terminal device 10. In other words, the microphone 12 picks up sounds spoken by the user using the information terminal device 10 and sounds from the surrounding area. The microphone 12 outputs audio information related to the picked-up sounds to the audio acquisition unit 22 of the terminal control device 20.

[0022] The operation unit 13 is an input device capable of inputting various operations to the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel arranged over the display unit 17, buttons, switches, etc. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.

[0023] The operation unit 13 can accept operations such as moving an avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 accepts operations such as overlapping or placing the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0024] By performing an operation such as superimposing one's avatar on another or placing it adjacent to another avatar, communication such as a video call or a voice call can be initiated between users in the virtual office application. Whether a video call or a voice call will be conducted may be set in advance or may be set by the user's operation.

[0025] The operation unit 13 accepts operations to request communication with other users via avatars in the virtual office. For example, the operation unit 13 accepts, on the display screen of the display unit 17, an operation to search for other users with whom the user wishes to communicate in the virtual office, an operation to select a user from the search results and request communication, etc.

[0026] The display unit 17 displays various types of video including text and images. The display unit 17 is, for example, a display including a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 17 displays a video of a virtual office, etc. In this embodiment, when a video call becomes possible, the display unit 17 outputs a video of the user of another avatar with whom the video call is being made, in other words, a video captured by the camera 11 of the information terminal device 10 used by the user of the other avatar. The display of the display unit 17 is controlled by the display control unit 27.

[0027] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when the user is using the virtual office, the audio output unit 18 outputs the audio around the user's avatar in the virtual office. When a voice call or video call becomes possible, the audio output unit 18 outputs the audio of the user of another avatar with whom the user is making the voice call or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the user of the avatar. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0028] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method such as Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates data such as video and audio or application operation information with the server device 30. The communication unit 19 communicates data such as account information of a user logged in to the information terminal device 10 and application operation status information with the server device 30.

[0029] (Terminal Control Device) The terminal control device 20 controls each part of the information terminal device 10. The terminal control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to the present disclosure. The terminal control device 20 may be realized by an integrated circuit such as an ASIC or an FPGA. The terminal control device 20 loads a stored program into memory and executes instructions included in the program. The terminal control device 20 includes an internal memory such as the RAM described above, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be realized by a combination of hardware and software.

[0030] The terminal control device 20 has functional blocks realized by circuits and executed programs, including a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a memory unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0031] The video acquisition unit 21 acquires video captured by the camera 11. More specifically, the video acquisition unit 21 acquires video captured by the camera 11 of a user facing the information terminal device 10, etc. The video data acquired by the camera 11 is a moving image.

[0032] The voice acquisition unit 22 acquires the voice detected by the microphone 12. The voice acquisition unit 22 acquires voice such as the voice spoken by a user present in the vicinity of the information terminal device .

[0033] The operation reception unit 23 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0034] The operation accepting unit 23 accepts operations on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to move the user's own avatar in the virtual office on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to overlap or place the user's own avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0035] The operation reception unit 23 receives an operation to request communication with another user via an avatar in the virtual office. For example, the operation reception unit 23 receives, on the display screen of the display unit 17, an operation to search for another user with whom the user wishes to communicate in the virtual office, an operation to select a user from the search results and request communication, and the like.

[0036] The application control unit 24 controls the operation of various applications executed on the information terminal device 10. The applications executed by the application control unit 24 may cooperate with an application control unit 42 of the server device 30, which will be described later, to control the various applications.

[0037] The application control unit 24 causes a display control unit 27, which will be described later, to display on the display unit 17 a display related to an application running on the information terminal device 10. The display related to the application is a display screen such as a window or an icon that shows the display related to the application to the user of the information terminal device 10.

[0038] When the user of the information terminal device 10 is logged in to the virtual office, the application control unit 24 makes the virtual office executed by the application control unit 42 of the server device 30 available to the information terminal device 10 .

[0039] When a virtual office application is being executed on the information terminal device 10, the application control unit 24 shares information using the display control unit 27 and the audio output control unit 28 based on an information sharing range set around an avatar corresponding to the user of the information terminal device 10. Furthermore, when a video call with an avatar corresponding to another user is started while the virtual office application is being executed on the information terminal device 10, the application control unit 24 performs the video call using the display control unit 27 and the audio output control unit 28.

[0040] The position information detection unit 25 detects position information in the real space of the user using the information terminal device 10. The position information in the real space of the user using the information terminal device 10 may be position information in the real space of the information terminal device 10. Since the position information detection unit 25 detects position information in the real space of the user using the information terminal device 10 to use the virtual office, the position information in the real space of the information terminal device 10 is position information in the real space of the user using the information terminal device 10.

[0041] The location information detection unit 25 acquires location information of each information terminal device in the office in real space using various systems capable of measuring indoor locations with high accuracy, such as a Real Time Location System (RTLS). In an RTLS, for example, each information terminal device is provided with a tag, which communicates using Ultra Wide Band (UWB) and measures the location information of the tag using a Time Difference Of Arrival (TDoA) method. The tag may be provided on each user's employee ID card, for example.

[0042] The storage unit 26 stores information such as the calculation contents and programs of the terminal control device 20. The storage unit 26 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or an HDD (Hard Disk Drive).

[0043] The storage unit 26 stores programs and setting information relating to applications used in the information terminal device 10, such as a virtual office application.

[0044] The following describes the information sharing range and information sharing set for avatars in a virtual office. In the virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and is the range in which information can be shared between multiple users who are included in the information sharing range. One example of information sharing in the information sharing range is mutual sharing of audio. In other words, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Furthermore, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Information that can be shared in the information sharing range is not limited to audio, but also includes other information such as video and text. In this embodiment, the information sharing range is described as an example in which audio is shared.

[0045] For example, when a second avatar enters the information sharing range of a first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Furthermore, when a second avatar enters the information sharing range of a first avatar and a first avatar enters the information sharing range of the second avatar, two-way voice sharing occurs, allowing each user to sense the other's presence and to converse without any special operations. Therefore, the information sharing range can also be referred to as the voice sharing range. Specifically, when a first avatar and a second avatar are within each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar can be heard in the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar can be heard in the information terminal device 10 used by the first user.

[0046] It is also possible to set up a space that allows information sharing among all avatars within a specific range, such as a conference room set up in a virtual office. Outside of such a set space, the information sharing range is set for each avatar.

[0047] The information sharing range of each avatar is set to an initial size (area) and shape when the virtual office is first used. The size and shape of the information sharing range of each avatar may be changeable by user operation.

[0048] The display control unit 27 controls the display of various images on the display unit 17. The display control unit 27 controls the display of an image of a virtual office on the display unit 17. In this embodiment, when the information to be shared includes an image or text, the display control unit 27 outputs the image or text to the display unit 17. Furthermore, when a video call becomes possible, the display control unit 27 outputs an image of the user's avatar in the virtual office to the display unit 17.

[0049] The audio output control unit 28 controls the output of audio in the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user of another avatar who is present within the information sharing range in the virtual office. Furthermore, when a video call becomes possible, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user who is the other party in the video call.

[0050] The communication control unit 29 controls the communication unit 19 to transmit and receive data such as video and audio to and from the server device 30, and to transmit and receive operation status information of the application. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls, for example, the communication unit 19 to transmit to the server device 30, video and audio of the user facing the display unit 17 of the information terminal device 10, acquired by the video acquisition unit 21 and the audio acquisition unit 22. The operation status information of the application includes, for example, in the case of a virtual office application, the operation of the avatar by the operation unit 13, and the operation of starting and ending a video call. The communication control unit 29 also transmits information indicating the location information detected by the location information detection unit 25 to the server device 30.

[0051] (Server device) FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which the users of the information terminal devices 10 belong, or a server device of a business entity that provides a virtual office service, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 includes a communication unit 31 and a server control device 40.

[0052] The communication unit 31 is a communication unit for performing wired communication or wireless communication. The communication unit 31 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 31 is controlled by a communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operation status information with multiple information terminal devices 10.

[0053] (Server control device) The server control device 40 controls each unit of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The server control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The server control device 40 may be realized by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to the present disclosure.

[0054] The server control device 40 includes a communication control unit 41, an application control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs to be executed.

[0055] The communication control unit 41 controls the communication unit 31 to transmit and receive data including video and audio to and from the information terminal device 10, and to transmit and receive operation status information of applications, etc. The communication control unit 41, for example, controls the communication unit 31 to receive from the information terminal device 10 video captured by the camera 11 of the information terminal device 10 and audio collected by the microphone 12 of the information terminal device 10. The communication control unit 41, for example, controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. The operation status information of the application is, for example, configuration information of the virtual office application.

[0056] The application control unit 42 controls the operation of various applications running on the server device 30. For example, the application control unit 42 controls the operation of a virtual office application. For example, the application control unit 42 controls the operation of an application used for online communication.

[0057] The application control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 that is executing the application via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged in to the virtual office.

[0058] The storage unit 49 stores information such as the contents of calculations and programs of the server control device 40. The storage unit 49 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD.

[0059] The storage unit 49 stores information indicating a virtual office configured in a virtual space. For each user who logs in to the virtual office, the storage unit 49 stores information indicating an avatar, an information terminal device 10 associated with the avatar, and an account user of the information terminal device 10. The storage unit 49 stores information indicating the layout of objects that configure the virtual office, such as the sections that configure the virtual office and virtual desks.

[0060] (Information processing device) An example of the configuration of an information processing device according to the first embodiment will be described with reference to FIG. 4. FIG. 4 is a block diagram showing an example of the configuration of an information processing device according to the first embodiment. The information processing device 50 is a conceptual device realized by the cooperation of either or both of the server device 30 and a plurality of information terminal devices 10 used in the virtual office. Either the information terminal devices 10 or the server device 30 may be the information processing device 50, or the virtual space control system 1 including the information terminal devices 10 and the server device 30 may be the information processing device 50. Each unit of the information processing device 50 is realized by the cooperation of either or both of the terminal control device 20 and the server control device 40.

[0061] The information processing device 50 acquires location information in real space of a first user who is using the virtual space with a first information terminal device 10 and a second user who is using the virtual space with a second information terminal device 10, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or while communicating, if the location relationship in real space between the first user and the second user satisfies a predetermined condition, the information processing device 50 notifies either or both of the first user and the second user of this.

[0062] 4, information processing device 50 includes avatar position detection unit 51, position information acquisition unit 52, communication detection unit 53, application control unit 55, display control unit 58, and audio output control unit 59. For example, avatar position detection unit 51 and communication detection unit 53 may be realized by server control device 40, position information acquisition unit 52 and application control unit 55 may be realized by cooperation between terminal control device 20 and server control device 40, and display control unit 58 may be realized by terminal control device 20, but this is not limitative.

[0063] The avatar position detection unit 51 detects the positions of the avatars in the virtual office, thereby detecting the positions of a first avatar corresponding to a first user and a second avatar corresponding to a second user.

[0064] The avatar position detection unit 51 detects a first avatar that has entered an information sharing range of a second avatar in the virtual space.

[0065] The avatar position detection unit 51 detects a first avatar that has gone out of an information sharing range of a second avatar in the virtual office.

[0066] When the information processing device 50 is implemented in the information terminal device 10, the avatar position detection unit 51 only needs to detect a second user corresponding to a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the avatar position detection unit 51 only needs to detect a second user for each of all users.

[0067] The position information acquisition unit 52 acquires position information indicating the positions in real space of a first user using the first information terminal device 10 and a second user using the second information terminal device 10. The positions in real space of the first user and the second user may be the positions in real space of the first information terminal device 10 and the second information terminal device 10. The position information acquisition unit 52 acquires position information that enables determination of whether the positional relationship in real space between the first user and the second user satisfies a predetermined condition.

[0068] The specified conditions are conditions that make it easy for the first user and the second user to communicate in real space, such as the positional relationship between the first user and the second user in real space being less than a specified distance, being located on the same floor in real space, or being located within the same business premises (building).

[0069] The predetermined distance is a distance at which the first user and the second user can speak directly to each other in real space and be heard by the other user. The predetermined distance is, for example, about 20 m.

[0070] The position information acquisition unit 52 acquires the position information of the first user and the second user in the office in real space from the first information terminal device 10 and the second information terminal device 10.

[0071] The communication detection unit 53 detects whether a first user and a second user are attempting to communicate or are currently communicating via a first avatar and a second avatar in the virtual office. For example, the communication detection unit 53 detects an operation in which the first user moves the first avatar into the information sharing range of the second avatar to enable a voice conversation with the second user. For example, the communication detection unit 53 detects an operation in which the first user overlays the first avatar on the second avatar to enable a video call with the second user.

[0072] When a first user and a second user communicate with each other via a first avatar and a second avatar in a virtual office, or while communicating, if the positional relationship between the first user and the second user in real space satisfies a predetermined condition, the application control unit 55 notifies either or both of the first user and the second user of this.

[0073] The application control unit 55 causes the information terminal device 10 of the user to whom the notification is to be sent to display on the display unit 17 of either the first user or the second user, or both, that the positional relationship of the users with whom communication is being made satisfies specified conditions.

[0074] For example, when the first user moves the first avatar into the information sharing range of the second avatar in order to have a voice conversation with the second user, or when the first user performs an operation to overlay the first avatar on the second avatar in order to have a video call with the second user, and the positional relationship in real space between the first user and the second user satisfies a predetermined condition, the application control unit 55 displays the following message before information sharing such as voice starts: For example, the application control unit 55 displays a message image such as "The second user is nearby. Would you like to communicate using an avatar?", "The second user is on the same floor. Would you like to communicate using an avatar?", or "The second user is in the same business (building). Would you like to communicate using an avatar?" on the first information terminal device 10 of the first user to be notified.

[0075] For example, when a first user and a second user are having a voice conversation or a video call and one or both users move, causing the relative positions of the users who are communication targets to satisfy a predetermined condition, the application control unit 55 displays the following message during the communication: For example, the application control unit 55 displays a message image on the information terminal device 10 of the user to whom the notification is to be sent, such as "The Xth user (other user) is now close. Do you want to continue communication via avatar?" or "The Xth user (other user) is now on the same floor. Do you want to continue communication via avatar?"

[0076] If the positional relationship in real space between the first user and the second user satisfies a predetermined condition, the application control unit 55 may notify either the first user or the second user, whichever has requested communication, of this fact.

[0077] The display control unit 58 causes the display units 17 of the multiple information terminal devices 10 to display images showing various types of information, such as a virtual office screen.

[0078] When a video call becomes possible, the display control unit 58 causes images of faces and the like to be displayed on the first information terminal device 10 and the second information terminal device 10. More specifically, the display control unit 58 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10, and causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0079] When the video call is stopped, the display control unit 58 stops the video sharing between the first user and the second user.

[0080] When a second avatar enters the information sharing range of a first avatar, the audio output control unit 59 enables the second user to share the audio of the first user. Furthermore, when the second avatar is within the information sharing range of the first avatar and the first avatar is within the information sharing range of the second avatar, the second user can share the audio of the first user, and the first user can share the audio of the second user. In other words, the first and second users can share audio, enabling them to have audio conversations. More specifically, when audio sharing is enabled, the audio output control unit 59 enables the information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 where the second user corresponding to the second avatar is logged in to the virtual office to hear each other's voices. More specifically, the audio output control unit 59 outputs the voice of the second user picked up by the microphone 12 of the second information terminal device 10 from the audio output unit 18 of the first information terminal device 10, and outputs the voice of the first user picked up by the microphone 12 of the first information terminal device 10 from the audio output unit 18 of the second information terminal device 10.

[0081] When the first avatar and the second avatar are no longer included in the information sharing range due to, for example, the movement of the avatar, the audio output control unit 59 stops audio sharing between the first user and the second user.

[0082] (Virtual space control method) A virtual space control method will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of a virtual space control method according to the first embodiment. The processing shown in Fig. 5 is executed while a virtual office is provided by the virtual space control system 1. When the information processing device 50 is implemented in the information terminal device 10, the processing of the flowchart shown in Fig. 5 may be executed for a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the processing of the flowchart shown in Fig. 5 may be executed for all users.

[0083] The information processing device 50 starts displaying the virtual office (step S101). More specifically, the information processing device 50 causes the display control unit 58 to display an image showing the virtual office screen on the display unit 17 of the information terminal device 10. The information processing device 50 proceeds to step S102.

[0084] The information processing device 50 determines whether a communication start operation has been performed (step S102). More specifically, the information processing device 50 determines whether the communication detection unit 53 has detected that the first user and the second user are attempting to communicate or are currently communicating via the first avatar and the second avatar in the virtual office. The information processing device 50 determines that a communication start operation has been performed when the communication detection unit 53 detects, for example, an operation in which the first user moves the first avatar into the information sharing range of the second avatar to enable a voice conversation, or an operation in which the first user moves the first avatar so as to overlap the second avatar to enable a video call. If the information processing device 50 determines that a communication start operation has been performed (Yes in step S102), the process proceeds to step S103. If the information processing device 50 does not determine that a communication start operation has been performed (No in step S102), the process proceeds to step S108.

[0085] The information processing device 50 determines whether the positional relationship between the first user and the second user in real space satisfies a predetermined condition, specifically, whether the distance between the first user and the second user in real space is less than a predetermined distance (step S103). If the information processing device 50 determines using the position information acquisition unit 52 that the distance between the first user and the second user in real space is less than the predetermined distance (Yes in step S103), the information processing device 50 proceeds to step S104. If the information processing device 50 does not determine using the position information acquisition unit 52 that the distance between the first user and the second user in real space is less than the predetermined distance (No in step S103), the information processing device 50 proceeds to step S106.

[0086] When it is determined that the distance between the first user and the second user in real space is less than the predetermined distance (Yes in step S103), the information processing device 50 performs a notification (step S104). More specifically, the information processing device 50 notifies either the first user or the second user, or both, that the positional relationship between the first user and the second user in real space is less than the predetermined distance, via the application control unit 55. The information processing device 50 proceeds to step S105.

[0087] In S102, when the first user moves the first avatar into the information sharing range of the second avatar and an operation enabling voice conversation is detected, the first user who performed the operation is notified.In S102, when the first avatar is moved so as to overlap the second avatar and an operation enabling video calling is detected, the first user and the second user are notified.

[0088] The information processing device 50 determines whether communication in a virtual office has been selected (step S105). If communication in a virtual office has started after the notification in step S104, the information processing device 50 determines that communication in a virtual office has been selected. If the information processing device 50 determines that communication in a virtual office has been selected (Yes in step S105), it proceeds to step S106. If the information processing device 50 does not determine that communication in a virtual office has been selected (No in step S105), it proceeds to step S108.

[0089] In step S105, if the user who received the notification in S104 selects communication in the virtual space, communication in the virtual space becomes possible. If both the first user and the second user are notified and either user does not select communication in the virtual space, the result in S105 is No.

[0090] If it is determined that communication in a virtual office has been selected (Yes in step S105), the information processing device 50 enables communication in the virtual office, in other words, enables information sharing in the virtual office, or activates a video call function (step S106). More specifically, the information processing device 50 controls the display control unit 58 to display images of faces and the like on the first information terminal device 10 and the second information terminal device 10. The information processing device 50 controls the audio output control unit 59 to enable audio such as voices to be heard on the information terminal device 10 and the second information terminal device 10. The information processing device 50 proceeds to step S107.

[0091] In step S106, if the first user moves the first avatar into the information sharing range of the second avatar in S102 and performs an operation to enable voice conversation, voice conversation becomes possible. If the first user moves the first avatar so that it overlaps the second avatar in S102 and performs an operation to enable video conversation, the video call function is enabled.

[0092] The information processing device 50 determines whether the communication in the virtual office has ended (step S107). More specifically, the information processing device 50 determines that the communication in the virtual office has ended when either the first avatar or the second avatar in the virtual office goes out of the other's information sharing range, or when an operation to end the communication in the virtual office is detected. If the information processing device 50 determines that the communication in the virtual office has ended (Yes in step S107), it proceeds to step S108. If the information processing device 50 does not determine that the communication in the virtual office has ended (No in step S107), it executes the process of step S107 again.

[0093] The information processing device 50 determines whether to end use of the virtual office (step S108). For example, when the information processing device 50 detects an operation to end use of the virtual office, the information processing device 50 determines to end use of the virtual office. When the information processing device 50 determines to end use of the virtual office (Yes in step S108), the information processing device 50 ends the processing of this flowchart. When the information processing device 50 does not determine to end use of the virtual office (No in step S108), the information processing device 50 executes the processing of step S102 again.

[0094] (effect) As described above, in this embodiment, when a first user and a second user communicate with each other through a first avatar and a second avatar in a virtual office, or while communicating, if the positional relationship between the first user and the second user satisfies a predetermined condition, the first user, the second user, or both can be notified of this. According to this embodiment, the positional relationship of the person with whom the first user is about to communicate in the virtual office in the real space can be known. According to this embodiment, receiving the notification allows the user to consider communicating in the real space, thereby assisting in the selection of appropriate communication. According to this embodiment, the user can appropriately communicate with the person selected in the virtual space.

[0095] In this embodiment, if the first user and the second user are less than a predetermined distance apart, the first user can be notified that the second user is actually nearby in the real-world office.

[0096] In this embodiment, when the positional relationship between the first user and the second user satisfies a predetermined condition, the first user or the second user, who has requested communication, can be notified of this fact. According to this embodiment, the party who has requested communication can receive the notification and consider communicating in real space, thereby supporting the selection of appropriate communication.

[0097] [Second embodiment] A virtual space control system 1 according to the second embodiment will be described with reference to FIG. 6. FIG. 6 is a flowchart showing an example of a virtual space control method according to the second embodiment. In the following description, components similar to those in the virtual space control system 1 of the first embodiment are denoted by the same or corresponding reference numerals, and detailed description thereof will be omitted. The virtual space control system 1 differs from the first embodiment in the processing in the storage unit 26 of the information terminal device 10 and the application control unit 55 of the information processing device 50.

[0098] The storage unit 26 stores position information indicating the normal position in real space of each user who uses the virtual space.

[0099] The usual position is the position where the user usually is when coming to work, such as the position of the user's own desk in an office with fixed seating.

[0100] When the normal position of the first user and the normal position of the second user are at a predetermined distance or more and the positional relationship between the first user and the second user in real space becomes less than the predetermined distance, the application control unit 55 notifies either the first user or the second user, or both, of this.

[0101] When the normal position of the first user and the normal position of the second user are at a predetermined distance or more and the positional relationship between the first user and the second user in real space is less than the predetermined distance, the application control unit 55 notifies the first user or the second user, whichever is at the normal position, of this fact.

[0102] (Virtual space control method) The virtual space control method will be described with reference to Fig. 6. The processes of steps S201, S202, S203, S205, S206, S207, S208, and S210 in Fig. 6 are the same as those of steps S101, S102, S106, S107, S108, S103, S104, and S107 in Fig. 5.

[0103] The information processing device 50 determines whether the distance between the normal positions of the first user and the second user is less than a predetermined distance (step S204). If the application control unit 55 of the information processing device 50 determines that the distance between the normal positions of the first user and the second user is less than the predetermined distance (Yes in step S204), the information processing device 50 proceeds to step S205. If the position information acquisition unit 52 of the information processing device 50 does not determine that the distance between the normal positions of the first user and the second user is less than the predetermined distance (No in step S204), the information processing device 50 proceeds to step S207.

[0104] The information processing device 50 determines whether or not continuation of communication in the virtual office has been selected (step S209). If communication in the virtual office has started after the notification in step S208, the information processing device 50 determines that continuation of communication in the virtual office has been selected. If the information processing device 50 determines that continuation of communication in the virtual office has been selected (Yes in step S209), it proceeds to step S205. If the information processing device 50 does not determine that continuation of communication in the virtual office has been selected (No in step S209), it proceeds to step S206.

[0105] For example, if the first user and the second user are on the same floor and the distance between their normal positions is 20 m or more, step S204 is determined to be No. If thereafter, due to movement of at least one of the first user and the second user, the distance between the first user and the second user in real space becomes less than 20 m, step S207 is determined to be Yes.

[0106] For example, if the usual locations of the first user and the second user are on different floors, the result of step S204 is No. If at least one of the first user and the second user subsequently moves to be on the same floor, the result of step S207 is Yes.

[0107] For example, if the normal locations of the first user and the second user are in different buildings, the result of step S204 is No. If at least one of the first user and the second user subsequently moves to a state where they are in the same building, the result of step S207 is Yes.

[0108] (effect) As described above, in this embodiment, when the normal location of the first user and the normal location of the second user are at least a predetermined distance apart and the positional relationship between the first user and the second user becomes less than the predetermined distance, the first user, the second user, or both can be notified of this. According to this embodiment, communication with a selected person in a virtual space can be performed appropriately.

[0109] In this embodiment, if the normal position of the first user and the normal position of the second user are at a predetermined distance or more, and the positional relationship between the first user and the second user is less than the predetermined distance, the first user or the second user, whichever is at the normal position, can be notified of this.

[0110] The components of the virtual space control system shown in the figure are conceptual and functional, and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0111] The configuration of the virtual space control system is realized, for example, as software, by a program loaded into memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0112] The components described above include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the configurations described above can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0113] 1 Virtual space control system 10 Information terminal device 11 Camera 12 microphones 13 Control section 17 Display 18 Audio output section 19 Communications Department 20 Terminal control device 21 Video acquisition unit 22 Voice acquisition unit 23 Operation reception section 24 Application control section 25 Location information detection unit 26 Memory section 27 Display control unit 28 Audio output control unit 29 Communication control section 30 Server device 31 Communications Department 40 Server control device 41 Communication control unit 42 Application control section 49 Memory section 50 Information processing equipment 51 Avatar position detection unit 52 Location information acquisition section 53 Communication detection unit 55 Application control section 58 Display control unit 59 Audio output control unit

Claims

1. A virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, The information processing device included in the virtual space control system includes: acquires position information in real space of a first user who is using the virtual space with a first information terminal device and a second user who is using the virtual space with a second information terminal device, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or when the first user and the second user communicate, if the positional relationship in the real space between the first user and the second user satisfies a predetermined condition, notifies either or both of the first user and the second user of this; Virtual space control system.

2. The information processing device includes: If the positional relationship between the first user and the second user in the real space is less than a predetermined distance, notify either or both of the first user and the second user of this fact. The virtual space control system according to claim 1 .

3. The information processing device includes: a normal position of the first user in the real space and a normal position of the second user in the real space are stored, and when the normal position of the first user and the normal position of the second user are at a predetermined distance or more and the positional relationship between the first user and the second user in the real space becomes less than the predetermined distance, the device notifies either or both of the first user and the second user of this; The virtual space control system according to claim 1 .

4. The information processing device includes: When the normal position of the first user and the normal position of the second user are at a predetermined distance or more and the positional relationship between the first user and the second user in the real space becomes less than a predetermined distance, notify the first user or the second user, whichever is at the normal position, of this fact. The virtual space control system according to claim 3 .

5. The information processing device includes: If the positional relationship between the first user and the second user in the real space satisfies a predetermined condition, notify the first user or the second user, whichever has made a communication request, of that fact. The virtual space control system according to claim 3 .

6. 1. A virtual space control method executed by a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, comprising: acquiring position information in real space of a first user who is using the virtual space with a first information terminal device and a second user who is using the virtual space with a second information terminal device, and when the first user and the second user communicate in the virtual space via a first avatar corresponding to the first user and a second avatar corresponding to the second user, or when the first user and the second user are communicating, if the positional relationship in the real space between the first user and the second user satisfies a predetermined condition, notifying either or both of the first user and the second user of this; The virtual space control system executes the virtual space control method.

Images