Virtual space control system and virtual space control method

Abstract

To improve the security of communication in virtual spaces. [Solution] The virtual space control system 1 displays a virtual office on the information terminal device 10 and displays an avatar corresponding to the user of the information terminal device 10 in the virtual office. The information processing device 50 of the virtual space control system 1 acquires real-world location information of the person using the virtual office or the person using the virtual office and the people around them. When the first avatar corresponding to the first user and the second avatar corresponding to the second user are in a state where they can communicate in the virtual office, if there is another person in the vicinity of the first user or the second user in the real world, the system notifies at least one of the first user and the second user of this fact.

Description

Technical Field

[0001] The present invention relates to a virtual space control system and a virtual space control method.

Background Art

[0002] In a virtual space such as a virtual office, a user can communicate using an avatar. Also, there is a known technology for reflecting the user position information in the real space in the virtual space to facilitate communication between people working in the virtual office and the real office (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, in a virtual space, since voices can be heard mutually between other avatars existing in the vicinity of one's own avatar, communication with other avatars is possible. Also, it is possible to communicate between avatars using video and voice, like in a video call. When in such a state where communication between avatars is possible or when communication is being carried out, if there are other people in the vicinity of the communication partner, the content of the communication may be overheard or seen.

[0005] The present disclosure aims to improve the security of communication in a virtual space.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objectives, the virtual space control system according to this disclosure is a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to the user of the information terminal device in the virtual space, wherein the control unit of the virtual space control system acquires real-world location information of a person using the virtual space or a person in the real space surrounding the person using the virtual space, and when a first avatar corresponding to a first user and a second avatar for a second user are in a state where they can communicate in the virtual space, if there is another person in the real space near the first user or the second user, the control unit notifies at least one of the first user and the second user of that fact.

[0007] The virtual space control method relating to this disclosure is a virtual space control method performed by a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to the user of the information terminal device in the virtual space, wherein the virtual space control system acquires real-world location information of a person using the virtual space or a person in the real space surrounding the person using the virtual space, and when a first avatar corresponding to a first user and a second avatar for a second user are in a state where they can communicate in the virtual space, if there is another person in the vicinity of the first user or the second user in the real space, the virtual space control system performs the action of notifying at least one of the first user and the second user of that fact. [Effects of the Invention]

[0008] According to this disclosure, it is possible to improve the security of communications in a virtual space. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram showing an example configuration of a virtual space control system according to the first embodiment. [Figure 2]Figure 2 is a block diagram showing an example configuration of an information terminal device according to the first embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of a server device according to the first embodiment. [Figure 4] Figure 4 is a block diagram showing an example configuration of an information processing device according to the first embodiment. [Figure 5] Figure 5 is a schematic diagram showing an example of the configuration of a location information acquisition control device according to the first embodiment. [Figure 6] Figure 6 shows an example of a virtual office window displayed on the display screen of the information terminal device according to the first embodiment. [Figure 7] Figure 7 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the virtual space control system and virtual space control method according to the present invention will be described in detail below with reference to the attached drawings. However, the present invention is not limited to the following embodiments.

[0011] [First Embodiment] (Virtual Space Control System) Figure 1 is a schematic diagram showing an example configuration of a virtual space control system according to the first embodiment. The virtual space control system 1 controls a virtual office configured in the virtual space. In the following embodiments, a virtual office is used as an example for explanation, but it is not limited to a virtual office and can be applied to various services that use avatars for communication in a virtual space.

[0012] This section describes the overview of the virtual office controlled by the virtual space control system 1. Users log in to the virtual office using their own account via an information terminal device and perform their duties. In the virtual office, an avatar is set up that corresponds to each user. When a user logs into the virtual office using the information terminal device 10 described later, the system prompts the user to move their avatar to any seat in the virtual office, or to a predetermined seat, and sit down. Users can move around the virtual office by manipulating their avatar. In the virtual office, for example, if avatars are close to each other in the virtual office, or if avatars are located in the same space, such as a conference room within the virtual office, they can share information by hearing each other's voices and other sounds.

[0013] The virtual space control system 1 comprises an information terminal device 10 used by each user for their work, a server device 30, and a location information acquisition control device 70.

[0014] (Information terminal device) Figure 2 is a block diagram showing an example configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by users who perform work in the virtual office. The information terminal device 10 is a terminal device on which users run applications in the virtual office. The information terminal device 10 is a terminal device on which users log in to the virtual office with their own account when logging into the virtual office.

[0015] The information terminal device 10 is, for example, a general-purpose personal computer, a smartphone, or a tablet device. The information terminal device 10 is connected to the server device 30 via a network in a data communication manner.

[0016] The information terminal device 10 obtains account user information for the information terminal device 10 based on the account information of the person logged into the information terminal device 10.

[0017] The information terminal device 10 includes a camera 11, a microphone 12, an operation unit 13, a display unit 17, an audio output unit 18, a communication unit 19, and a terminal control device 20.

[0018] The camera 11 captures an image in the direction facing the information terminal device 10. The camera 11 is arranged at a position where it captures an image in the direction facing the display unit 17 of the information terminal device 10. That is, the camera 11 captures an image in the direction where a person using the information terminal device 10 is present. The camera 11 is arranged, for example, around the display unit 17. The camera 11 outputs the captured video to the video acquisition unit 21 of the terminal control device 20.

[0019] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds in the direction facing the display unit 17 of the information terminal device 10, or may be provided in a headset or the like connected to the information terminal device 10. That is, the microphone 12 picks up the voice of a person speaking while using the information terminal device 10 and the surrounding sounds. The microphone 12 outputs voice information regarding the picked-up voice to the voice acquisition unit 22 of the terminal control device 20.

[0020] The operation unit 13 is an input device capable of inputting various operations on the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel arranged on top of the display unit 17, buttons, switches, and the like. The operation unit 13 can receive, for example, key input operations, click operations, or touch operations.

[0021] On the display screen of the display unit 17, the operation unit 13 can receive an operation of moving an avatar corresponding to the user himself / herself in the virtual office in an arbitrary direction. For example, on the display screen of the display unit 17, the operation unit 13 receives operations such as overlapping or adjoining its own avatar in the virtual office with other avatars.

[0022] By overlapping or placing one's own avatar next to another's, users can initiate video or audio calls within the virtual office application. Whether to use video or audio calls may be pre-configured or determined by the user.

[0023] The display unit 17 displays various types of images, including text and images. The display unit 17 is a display including, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 17 displays images of the virtual office. In this embodiment, when a video call becomes possible, the display unit 17 outputs the image of the other avatar user making the video call, in other words, the image captured by the camera 11 of the information terminal device 10 used by the other avatar user. The display of the display unit 17 is controlled by the display control unit 27.

[0024] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when using the virtual office, the audio output unit 18 outputs the audio surrounding the user's avatar. Furthermore, when voice or video calls become available, the audio output unit 18 outputs the audio of the other avatar user making the voice or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the other avatar user. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0025] The communication unit 19 is a communication unit for wired or wireless communication. The communication unit 19 communicates using communication methods such as Wi-Fi (registered trademark) or mobile phone lines, and connects to an intranet or the internet. The communication unit 19 is controlled by the communication control unit 29. The communication unit 19 communicates data such as video and audio with the server device 30. The communication unit 19 also communicates data such as account user information and application operating status information of the information terminal device 10 with the server device 30.

[0026] (Terminal control device) The terminal control device 20 controls various parts of the information terminal device 10. The terminal control device 20 includes, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as RAM (Random Access Memory) or ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to this disclosure. The terminal control device 20 may be implemented by an integrated circuit such as an ASIC or FPGA. The terminal control device 20 loads the stored program into memory and executes the instructions contained in the program. The terminal control device 20 includes internal memory such as the aforementioned RAM, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be implemented by a combination of hardware and software.

[0027] The terminal control device 20 includes, as functional blocks realized by circuits and executed programs, a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a storage unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0028] The video acquisition unit 21 acquires the video captured by the camera 11. More specifically, the video acquisition unit 21 acquires the video captured by the camera 11, which includes images of a person facing the information terminal device 10. The video data acquired by the camera 11 is a moving image.

[0029] The voice acquisition unit 22 acquires the sound detected by the microphone 12. The voice acquisition unit 22 acquires sounds such as the voices of people speaking in the vicinity of the information terminal device 10.

[0030] The operation reception unit 23 acquires an operation signal from the operation unit 13 corresponding to the operation performed on the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0031] The operation reception unit 23 receives operations on the display screen of the display unit 17. For example, the operation reception unit 23 receives operations to move the user's avatar in the virtual office on the display screen of the display unit 17. For example, the operation reception unit 23 receives operations to overlap or place the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0032] The application control unit 24 controls the operation of various applications running on the information terminal device 10. The applications running on the application control unit 24 may be controlled in cooperation with the application control unit 42 of the server device 30, which will be described later.

[0033] The application control unit 24 causes the display unit 17 to display information related to the application running on the information terminal device 10, via the display control unit 27, which will be described later. Application-related displays refer to windows, icons, etc., that show information related to the application to the user of the information terminal device 10.

[0034] When a user of the information terminal device 10 is logged into the virtual office, the application control unit 24 makes the virtual office running on the application control unit 42 of the server device 30 available to the information terminal device 10.

[0035] When a virtual office application is running on the information terminal device 10, the application control unit 24 performs information sharing using the display control unit 27 and the audio output control unit 28 based on the information sharing range set around the avatar corresponding to the user of the information terminal device 10. In addition, when a virtual office application is running on the information terminal device 10, the application control unit 24 performs a video call using the display control unit 27 and the audio output control unit 28 if a video call is started with an avatar corresponding to another user.

[0036] The application control unit 24 understands the location and information sharing range of each avatar in the virtual office and detects whether another avatar has entered the information sharing range of any of the avatars, or whether there is a high probability that another avatar will enter it.

[0037] The memory unit 26 stores information such as the calculation contents and programs of the terminal control device 20. The memory unit 26 is composed of, for example, RAM, a main memory such as ROM, an SSD, an HDD (Hard Disk Drive), and other storage devices.

[0038] The memory unit 26 stores programs and configuration information related to applications used in the information terminal device 10, such as virtual office applications.

[0039] This section describes the information sharing range and information sharing that are set for avatars in a virtual office. In a virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and it is the range in which information can be shared among multiple users that are mutually included in the information sharing range. One example of information sharing within the information sharing range is the sharing of voices. In other words, the information sharing range is the range in which the voices of users of other avatars can be heard by users of other avatars. Also, the information sharing range is the range in which users of other avatars can hear the voices of users of other avatars. The information that can be shared within the information sharing range is not limited to voice, but also includes other information such as video and text. In this embodiment, the information sharing range will be described as an example of sharing voices.

[0040] For example, if the second avatar enters the information sharing range of the first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Also, if the second avatar enters the information sharing range of the first avatar, and the first avatar enters the information sharing range of the second avatar, two-way voice sharing takes place, allowing them to sense each other's presence and enabling conversation without any special operation. Therefore, the information sharing range can also be called the voice sharing range. Specifically, when the first and second avatars are mutually included in each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar becomes audible on the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar becomes audible on the information terminal device 10 used by the first user.

[0041] Furthermore, it is possible to create spaces that enable information sharing among all avatars within a specific range, such as a meeting room set up in a virtual office. Outside of such spaces, the information sharing range is set individually for each avatar.

[0042] The information sharing area for each avatar is initially set to a certain size and shape when the virtual office is first used. The size and shape of the information sharing area for each avatar may be changed by user interaction.

[0043] The display control unit 27 controls the display of various types of video on the display unit 17. The display control unit 27 controls the display of video of the virtual office on the display unit 17. In this embodiment, if the information being shared includes video or text, the display control unit 27 outputs the video or text to the display unit 17. Also, when a video call becomes possible, the display control unit 27 outputs the video of the virtual office avatar user, etc., to the display unit 17.

[0044] The audio output control unit 28 controls the audio output of the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech of other avatar users within the information sharing range of the virtual office. Also, when video calls become possible, the audio output control unit 28 causes the audio output unit 18 to output the speech of the user who will be making the video call.

[0045] The communication control unit 29 controls the communication unit 19 to control the transmission and reception of data such as video and audio, and the transmission and reception of application operation status information between the communication control unit 29 and the server device 30. More specifically, the communication control unit 29 controls the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls the communication unit 19 to transmit to the server device 30 the video and audio of the person facing the display unit 17 of the information terminal device 10, which have been acquired by the video acquisition unit 21 and the audio acquisition unit 22. Application operation status information includes, for example, in the case of a virtual office application, the operation of the avatar by the operation unit 13, and the operation of starting and ending video calls.

[0046] (Server device) Figure 3 is a block diagram showing an example configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which each information terminal device 10 user belongs, or a server device of a business entity that provides virtual office services, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 comprises a communication unit 31 and a server control device 40.

[0047] The communication unit 31 is a communication unit for wired or wireless communication. The communication unit 31 communicates using methods such as Wi-Fi or mobile phone lines and connects to an intranet or the internet. The communication unit 31 is controlled by the communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operating status information with multiple information terminal devices 10. The communication unit 31 also communicates data such as user location information acquired by the location information acquisition control device 70 with the location information acquisition control device 70.

[0048] (Server control unit) The server control device 40 controls various parts of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as RAM or ROM. The server control device 40 may be implemented by an integrated circuit such as an ASIC or FPGA. The server control device 40 may be implemented by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to this disclosure.

[0049] The server control device 40 comprises a communication control unit 41, an application control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs.

[0050] The communication control unit 41 controls the communication unit 31 to control the transmission and reception of data, including video and audio, and application operation status information between the information terminal device 10 and the communication control unit 41. For example, the communication control unit 41 controls the communication unit 31 to receive video captured by the camera 11 and audio picked up by the microphone 12 of the information terminal device 10. For example, the communication control unit 41 controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. Application operation status information includes, for example, configuration information of the virtual office application. The communication control unit 41 also controls the communication unit 31 to receive user location information transmitted from the location information acquisition control device 70.

[0051] The application control unit 42 controls the operation of various applications running on the server device 30. For example, the application control unit 42 controls the operation of a virtual office application. For example, the application control unit 42 controls the operation of an application used for online communication.

[0052] The application control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 running the application, via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged into the virtual office.

[0053] The memory unit 49 stores information such as the calculations performed by the server control device 40 and programs. The memory unit 49 is composed of, for example, RAM, a main memory such as ROM, and a storage device such as an SSD or HDD.

[0054] The memory unit 49 stores information indicating the virtual office configured in the virtual space. For each user who logs into the virtual office, the memory unit 49 stores information indicating the avatar, the information terminal device 10 associated with the avatar, and the account user of the information terminal device 10. The memory unit 49 may also store organizational information indicating the department to which the user belongs, or job title information indicating the job title. The memory unit 49 stores information indicating the arrangement of objects that constitute the virtual office, such as the sections and virtual desks that make up the virtual office.

[0055] (Information processing device) An example of the configuration of the information processing device according to the first embodiment will be described using Figure 4. Figure 4 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment. The information processing device 50 is a conceptual device (control unit of the virtual space control system 1) realized through the cooperation of either or both of the server device 30 and the multiple information terminal devices 10 used in the virtual office. Either the information terminal device 10 or the server device 30 may be designated as the information processing device 50, or an information processing system comprising the information terminal device 10 and the server device 30 may be designated as the information processing device 50. Each part of the information processing device 50 is realized through the cooperation of either or both of the terminal control device 20 and the server control device 40.

[0056] The information processing device 50 acquires real-world location information of users using the virtual office or users in the real world around them. When the first avatar and the second avatar are in a state where they can communicate in the virtual office, if there are other users in the vicinity of the first or second user in the real world, the device notifies at least one of the first or second user of this fact.

[0057] As shown in Figure 4, the information processing device 50 includes an avatar position detection unit 51, a communication detection unit 52, a user position information acquisition unit 55, a display control unit 58, and an audio output control unit 59.

[0058] The avatar position detection unit 51 detects the positions of the first avatar corresponding to the first user and the second avatar corresponding to the second user by detecting the positions of the avatars in the virtual office.

[0059] The avatar position detection unit 51 detects the first avatar entering the information sharing range of the second avatar in the virtual office.

[0060] The avatar position detection unit 51 detects the first avatar that has moved outside the information sharing range of the second avatar in the virtual office.

[0061] When the information processing device 50 is implemented in the information terminal device 10, the avatar position detection unit 51 only needs to detect the second user for the first user logged into the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the avatar position detection unit 51 only needs to detect the second user for each user. The same applies to each part of the information processing device 50.

[0062] The communication detection unit 52 determines whether the first user and the second user are in a state where they can communicate with each other in the virtual office via the first and second avatars. More specifically, the communication detection unit 52 detects, for example, that the first avatar is within the information sharing range of the second avatar. The communication detection unit 52 also detects, for example, that the first user is overlapping the first avatar with the second avatar in order to make a video call with the second user. If these conditions are detected, the communication detection unit 52 determines that communication is possible.

[0063] The user location information acquisition unit 55 acquires location information indicating the user's location in the real world from the location information acquisition control device 70. More specifically, the user location information acquisition unit 55 acquires the real-world location information of the user using the virtual office and other users in their vicinity. The location information acquisition control device 70, which acquires the user's location information in the real world, will be described later.

[0064] The display control unit 58 causes the display units 17 of the multiple information terminal devices 10 to display video showing various types of information, such as virtual office screens.

[0065] When a video call becomes possible, the display control unit 58 ensures that images of faces and other visuals are displayed to each other on the information terminal device 10 used by the first user corresponding to the first avatar and the information terminal device 10 (hereinafter referred to as "second information terminal device 10") used by the second user who is logged into the virtual office and corresponding to the second avatar. More specifically, the display control unit 58 causes the display unit 17 of the first information terminal device 10 to output the image of the second user captured by the camera 11 of the second information terminal device 10, and the display unit 17 of the second information terminal device 10 to output the image of the first user captured by the camera 11 of the first information terminal device 10.

[0066] The display control unit 58 stops sharing video between the first user and the second user if the video call is stopped.

[0067] When the first avatar and the second avatar are able to communicate in the virtual office, the display control unit 58, if another user is present in the vicinity of the first or second user in the real world, displays this information on the display unit 17 of the information terminal device 10 used by the user to be notified, in order to notify at least one of the first or second user.

[0068] Based on the location information of each user acquired by the user location information acquisition unit 55, it is possible to determine whether or not another user exists in the vicinity of the first or second user in real space.

[0069] In real space, proximity refers to a distance at which you can hear the voices of users conversing in a virtual office, or a distance at which you can see the display screen showing shared documents in the virtual office. For example, proximity in real space is about 2 to 3 meters.

[0070] If another user is located near the first user and the second user, who are separated by a predetermined distance or more in real space, the display control unit 58 will display this information on the display unit 17 of the information terminal device 10 used by at least one of the first user and the second user in order to notify them of this fact.

[0071] A predetermined distance is a distance in real space at which direct visual confirmation between two parties is not possible. Being separated by a predetermined distance means, for example, that the first user and the second user are located in different sections of a real-world office, or that the first user and the second user are located on different floors of a real-world office. Being separated by a predetermined distance also means, for example, that one of the first user and the second user is both present at the real-world office and the virtual office, while the other is working from home and working at the virtual office, or that both the first user and the second user are working from home and working at the virtual office.

[0072] The display control unit 58 may, for example, cause the following display to occur: The display control unit 58 may, for example, cause the information terminal device 10 of the notified user to display a message image to the effect of, "There is another user near your communication partner," "△△ is near your communication partner, ○○," or "△△ is near you." The display control unit 58 may also illustrate the positional relationship between users who can communicate in the virtual office and other users who are in the vicinity of those users in the real world, along with the names of the other users.

[0073] The display control unit 58 may, for example, when the first avatar and the second avatar are in a state where they can communicate in the virtual office, and another user moves near either or both users, resulting in another user being present in the vicinity of the first or second user in the real world, display a notification to that effect on the display unit 17 of the information terminal device 10 used by the notified user.

[0074] The display control unit 58 causes the following to be displayed, for example: The display control unit 58 causes the information terminal device 10 of the notified user to display a message image to the effect of, for example, "Another user has come near your communication partner," "△△ has come near your communication partner, ○○," or "△△ has come near you."

[0075] The audio output control unit 59 enables the second user to share the first user's voice when the second avatar enters the first avatar's information sharing range. Furthermore, if the second avatar is within the first avatar's information sharing range, and the first avatar is within the second avatar's information sharing range, the audio output control unit 59 enables the second user to share the first user's voice, and the audio output control unit 59 enables voice communication between the first and second users when voice sharing becomes possible. More specifically, when voice sharing becomes possible, the audio output control unit 59 enables voices and other sounds to be heard by both the information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 where the second user, corresponding to the second avatar, is logged into the virtual office. More specifically, the audio output control unit 59 causes the audio output unit 18 of the first information terminal device 10 to output the audio of the second user picked up by the microphone 12 of the second information terminal device 10, and the audio output unit 18 of the second information terminal device 10 to output the audio of the first user picked up by the microphone 12 of the first information terminal device 10.

[0076] The audio output control unit 59 stops audio sharing between the first user and the second user if the first avatar and the second avatar are no longer included in the information sharing range due to avatar movement or other reasons.

[0077] (Location information acquisition control device) Using Figure 5, an example of the configuration of the location information acquisition control device according to the first embodiment will be explained. Figure 5 is a schematic diagram showing an example of the configuration of the location information acquisition control device according to the first embodiment. The location information acquisition control device 70 is a device that acquires the location of users (employees) in a real-world office (real office), and is a server device used by a company that has a real-world office, or a server device used by a service provider that acquires the location information of users in a real-world office and provides it to a company that has a real-world office. In Figure 5, u1 to u4 are users present in a real-world office. Each user u is logged into the virtual office using their respective information terminal device 10. Each user u possesses a location tag 80. Figure 5 is an example showing a room in a real-world office owned by a company that uses a virtual office.

[0078] The location information acquisition control device 70 acquires the real-world location information of users using the virtual office, or of users using the virtual office and their surroundings. The location information acquisition control device 70 acquires the real-world location information of each user via a receiver 71 located in the real office. The location information acquisition control device 70 transmits the acquired real-world location information of each user to the server device 30 and the information processing device 50.

[0079] The location information acquisition and control device 70 acquires location information of the location tag 80 in real space using a so-called RTLS (Real Time Location System) method, such as the TDOA (Time Difference of Arrival) method. However, the method is not limited to other methods, as long as it is possible to acquire location information in real space.

[0080] The receivers 71 are placed, for example, on the ceiling of a real office, specifically at the four corners of a room in the real office. The receivers 71 are anchor devices that receive radio waves from the location tags 80 carried by the users. From the received radio waves, the location information of each user can be obtained. The receivers 71A to 71D shown in Figure 5 are receivers that are each placed at the four corners of a room in the real office shown in Figure 5, and they communicate with the location information of the location tags 80 carried by each user shown in Figure 5.

[0081] Figure 5 illustrates an example where, in a real office room equipped with receivers 71A to 71D, there are users u1 using information terminal device 101 and possessing location tag 801, user u2 using information terminal device 102 and possessing location tag 802, user u3 using information terminal device 103 and possessing location tag 803, and user u4 possessing location tag 804.

[0082] Using Figure 6, we will explain the display screen on the display unit 17 of the first information terminal device 10 used by the first user who is logged into the virtual office. Figure 6 is a diagram showing an example of a virtual office window displayed on the display screen of the information terminal device according to the first embodiment. As shown in Figure 6, the display unit 17 of the first information terminal device 10 displays a window W that displays the virtual office screen by, for example, the virtual office application. In this case, the first user is a user u5 who is using the virtual office and does not exist in the real office shown in Figure 5. User u5 is using an information terminal device 105 (not shown), which is the first information terminal device 10, and is using avatar A5 in the virtual office. Figure 5 shows avatar A1 corresponding to user u1, avatar A2 corresponding to user u2, avatar A5 corresponding to user u5, and other avatars A corresponding to other users. Users u2 and u5 are able to communicate by voice because their respective avatars are located within a range where they can share voices with each other in the virtual office. At this point, there are no other users' avatars in the virtual office that can communicate by voice with users u2 and u5.

[0083] (Virtual space control method) The virtual space control method will be explained using Figure 7. Figure 7 is a flowchart of an example of the virtual space control method according to the first embodiment. The process shown in Figure 7 is executed for each avatar while the virtual office is provided by the virtual space control system 1. While the virtual office is provided by the virtual space control system 1, the location information acquisition control device 70 acquires the real-world location information of each user via the receiver 71 located in the real office and transmits it to the server device 30 and the information processing device 50. If the information processing device 50 is implemented in the information terminal device 10, the process of the flowchart shown in Figure 7 only needs to be executed for users logged into that information terminal device 10. If the information processing device 50 is implemented in the server device 30, the process of the flowchart shown in Figure 7 only needs to be executed for all users.

[0084] The information processing device 50 determines whether or not communication between the first user and the second user via avatars has become possible (step S101). More specifically, the information processing device 50 uses a communication detection unit 52 to determine whether or not the first user and the second user have become able to communicate in the virtual office via the first avatar and the second avatar. The information processing device 50 uses the communication detection unit 52 to detect, for example, that the first avatar is within the information sharing range of the second avatar. The information processing device 50 uses the communication detection unit 52 to detect, for example, that the first user has superimposed the first avatar onto the second avatar in order to make a video call with the second user. If the information processing device 50 detects these states for the first and second avatars using the communication detection unit 52, it determines that the first user and the second user are able to communicate in the virtual office via the first and second avatars. In Figure 6, the state in which the first avatar exists within the information sharing range of the second avatar, or in other words, the state in which the second avatar and the first avatar are mutually included in the information sharing range, corresponds to the state of avatar A5 and avatar A2, where avatar A5 is the first avatar and avatar A2 is the second avatar.

[0085] If the information processing device 50 determines that communication with the second user via the avatar is possible (step S101; Yes), it proceeds to step S102. If the information processing device 50 does not determine that communication with the second user via the avatar is possible (step S101; No), it terminates the processing of this flowchart.

[0086] The information processing device 50 determines whether or not another person exists in the vicinity of the second user (step S102). Based on the real-world location information of each user acquired by the user location information acquisition unit 55, the information processing device 50 determines whether or not there is another user in real space whose distance from the second user is less than a predetermined distance. If the information processing device 50 determines that another person exists in the vicinity of the second user (step S102; Yes), it proceeds to step S103. If the information processing device 50 does not determine that another person exists in the vicinity of the second user (step S102; No), it proceeds to step S104.

[0087] If it is determined that another person is present in the vicinity of the second user (step S102; Yes), the information processing device 50 notifies the first user of the presence of another person in the vicinity of the second user (step S103). More specifically, the information processing device 50, via the display control unit 58, causes the display unit 17 of the first user's information terminal device 10 to display a message image indicating the presence of another person in the vicinity of the second user. The information processing device 50 then proceeds to step S104. In the example shown in Figure 5, the other people present in the vicinity of the second user are users u1, u3, and u4, who are present in the vicinity of user u2, who is the second user.

[0088] The information processing device 50 determines whether another person has come near the second user (step S104). Based on the real-world location information of each user acquired by the user location information acquisition unit 55, the information processing device 50 determines whether another person has come near the second user. If the information processing device 50 determines that another person has come near the second user (step S104; Yes), it proceeds to step S105. If the information processing device 50 does not determine that another person has come near the second user (step S104; No), it proceeds to step S106. In the example shown in Figure 5, the other person who has come near the second user is user u4 who has approached user u2, who is the second user.

[0089] The information processing device 50 notifies the first user of information about other people who have come near the second user (step S105). More specifically, the information processing device 50, via the display control unit 58, causes the display unit 17 of the first user's information terminal device 10 to display a message image indicating the other person who has come near the second user. The information processing device 50 then proceeds to step S106.

[0090] In Figure 7, the processing shown in steps S102 and S103 when another person is present in the vicinity of the second user, and the processing shown in steps S104 and S105 when another person approaches the vicinity of the second user, may be performed as either both processes, or only the processing shown in steps S104 and S105 may be performed. For example, when the second user communicates with the first user in the virtual office, the second user can communicate with the first user in the virtual office after confirming that there are no problems with the content of the communication with other people present in the vicinity of the second user.

[0091] The information processing device 50 determines whether the state in which communication between the second user and the avatar is possible has been terminated (step S106). More specifically, the information processing device 50 uses the communication detection unit 52 to determine whether the state in which communication is possible between the first avatar and the second avatar in the virtual office has been terminated. The information processing device 50 uses the communication detection unit 52 to detect, for example, that the first avatar has moved out of the information sharing range of the second avatar. The information processing device 50 uses the communication detection unit 52 to detect, for example, that the state in which the first avatar is overlapping the second avatar has been resolved. If the information processing device 50 detects these, it determines that the state in which communication is possible has been terminated. If the information processing device 50 determines that the state in which communication between the second user and the avatar is possible has been terminated (step S106; Yes), it terminates the processing in this flowchart. If the information processing device 50 does not determine that the state in which communication between the second user and the avatar is possible has been terminated (step S106; No), it executes the processing in step S104 again.

[0092] (effect) As described above, in this embodiment, when the first avatar and the second avatar are in a state where they can communicate in the virtual office, if another person is present near either the first user or the second user, that fact can be notified to either or both of them. According to this embodiment, it is possible to confirm the presence of another user nearby and decide whether to continue or interrupt the communication. According to this embodiment, the security of communication in the virtual office can be improved.

[0093] In this embodiment, if another person is present near the first and second users, whose physical locations are separated by a predetermined distance or more, either the first user, the second user, or both can be notified of this fact. According to this embodiment, when users who are separated by a distance in the physical world and cannot directly see each other communicate in a virtual office, the presence of another user can be appropriately notified.

[0094] [Second Embodiment] The second embodiment differs from the first embodiment in the processing performed by the information processing device 50. In the following embodiment, the differences from the first embodiment will be described, and the points common to the first embodiment will be omitted.

[0095] If the information processing device 50 detects that there are other users in the vicinity of the first or second user who are not in a state where they can communicate with the first and second users in the virtual office, it notifies at least one of the first and second users of this fact.

[0096] Other users who are not in a state where communication is possible include the following: for example, users who are not participating in the virtual office, users who are not users of the virtual office, or users who are not logged into the virtual office. For example, a third user who is a user of the virtual office but whose avatar is not within a distance where they can hear each other's voice.

[0097] Other users who are not in a state where communication is possible include users who are not participating in the virtual office, users who are not users of the virtual office, or users who are not logged into the virtual office. In the example shown in Figure 5, these users are user u4, who is located near user u2, who corresponds to the second user, and is not using the information terminal device 10. Other users who are not in a state where communication is possible include users other than the first and second users, who are users of the virtual office but whose avatars are not within a distance where they can hear each other. In the example shown in Figure 5, these users are user u1, who is the user of avatar A1, who is located near user u2, who corresponds to the second user, and is logged into the virtual office, and user u3, whose avatar is located outside the range shown in Figure 6 in the virtual office.

[0098] (effect) As described above, in this embodiment, if there is another user near the first or second user who is not in a state where they can communicate with the first and second users in the virtual office, at least one of the first and second users can be notified of this fact. According to this embodiment, it is possible to prevent other users who are not in a state where they can communicate in the virtual office from hearing the conversation between the first and second users in the virtual office, or from seeing the display screen of documents shared in the virtual office.

[0099] [Third Embodiment] The third embodiment differs from the first embodiment in the processing performed by the information processing device 50. In the following embodiments, the differences from the first embodiment will be described, and the points common to the first embodiment will be omitted.

[0100] If the information processing device 50 detects that there is another user in the vicinity of the first or second user who is not in a state to communicate with the first and second users in the virtual office and belongs to a different organization than the first or second user, it notifies at least one of the first or second user of this fact.

[0101] Each user's department is stored as organizational information in the memory unit 49. In this case, "department" preferably refers to a unit of work that operates within a defined area in a real office, such as a "department," "section," "team," or "project," as shown in the example in Figure 5, or a department that handles information that is highly confidential from other departments. Alternatively, each user's department can be rephrased as the company to which each user belongs. In Figure 5, if users u1, u2, and u3 belong to the same department, and user u4 belongs to a different department, then in the virtual office, communication with the first and second users is not possible. The other user who belongs to a different department from the first or second user is user u4, who is located near user u2 (corresponding to the second user) and belongs to a different department from user u2.

[0102] (effect) As described above, in this embodiment, if there is another user in the vicinity of the first or second user who is not able to communicate with the first and second users in the virtual office and belongs to a different affiliation, at least one of the first and second users can be notified of this fact. According to this embodiment, it is possible to prevent other users belonging to different affiliations who are not able to communicate with the first and second users in the virtual office from hearing conversations between them or seeing screens displaying documents shared in the virtual office.

[0103] The components of the illustrated virtual space control system are functionally conceptual and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage of each device.

[0104] The configuration of the virtual space control system is implemented, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks implemented through the cooperation of hardware or software. That is, these functional blocks can be implemented in various forms using hardware alone, software alone, or a combination thereof.

[0105] The above-described components include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the above-described components can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention. [Explanation of Symbols]

[0106] 1. Virtual Space Control System 10 Information terminal device 11 Cameras 12 microphones 13 Control section 17 Display section 18 Audio output section 19 Communications Department 20 Terminal control device 21 Video Acquisition Unit 22 Voice acquisition unit 23 Operation Reception Section 24 Application Control Unit 26 Memory section 27 Display Control Unit 28 Audio Output Control Unit 29 Communication Control Unit 30 Server Devices 31 Communications Department 40 Server Control Units 41 Communication Control Unit 42 Application Control Unit 49 Memory section 50 Information Processing Devices 51 Avatar position detection unit 52 Communication detection unit 55 User Location Information Acquisition Unit 58 Display Control Unit 59 Audio Output Control Unit 70 Location Information Acquisition Control Device 71 Receiver 80 Location Tags

Claims

1. A virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to the user of the information terminal device in the virtual space, The control unit of the virtual space control system is: The location information of a person using the virtual space, or of a person using the virtual space and people in their vicinity, is acquired in the real space. When the first avatar corresponding to the first user and the second avatar corresponding to the second user are in a state where they can communicate in the virtual space, if another person is present in the vicinity of the first user or the second user in the real space, at least one of the first user and the second user will be notified of this fact. Virtual space control system.

2. The control unit, If another person is present in the vicinity of the first user and the second user, whose positions in the real space are separated by a predetermined distance or more, at least one of the first user and the second user shall be notified of this fact. The virtual space control system according to claim 1.

3. The control unit, If there is another person in the vicinity of the first user or the second user who is not in a state where they can communicate with the first user and the second user in the virtual space, that fact shall be notified to at least one of the first user and the second user. A virtual space control system according to claim 1 or 2.

4. The control unit, If there is another person in the vicinity of the first user or the second user who is not in a state where they can communicate with the first user and the second user in the virtual space, and who belongs to a different organization than the first user or the second user, then at least one of the first user and the second user shall be notified of this fact. A virtual space control system according to claim 1 or 2.

5. A virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to the user of the information terminal device in the virtual space, The location information of a person using the virtual space, or of a person using the virtual space and people in their vicinity, is acquired in the real space. When the first avatar corresponding to the first user and the second avatar corresponding to the second user are in a state where they can communicate in the virtual space, if another person is present in the vicinity of the first user or the second user in the real space, at least one of the first user and the second user will be notified of this fact. A virtual space control method performed by a virtual space control system.

Images